Home > Research > Publications & Outputs > Textual Variations Affect Human Judgements of S...

Research

Associated organisational units

Electronic data

  • ECRA2022 Author Accepted Manuscript

    Rights statement: This is the author’s version of a work that was accepted for publication in Electronic Commerce Research and Applications. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Electronic Commerce Research and Applications, 53, 2022 DOI: 10.1016/j.elerap.2022.101149

    Accepted author manuscript, 756 KB, PDF document

    Available under license: CC BY-NC-ND: Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License

Links

Text available via DOI:

Keywords

View graph of relations

Textual Variations Affect Human Judgements of Sentiment Values

Research output: Contribution to Journal/Magazine › Journal article › peer-review

Published

Standard

Textual Variations Affect Human Judgements of Sentiment Values. / Lee Teh, Phoey; Rayson, Paul; Pak, Irina et al.
In: Electronic Commerce Research and Applications, Vol. 53, 101149, 31.05.2022.

Research output: Contribution to Journal/Magazine › Journal article › peer-review

Harvard

Lee Teh, P, Rayson, P, Pak, I, Piao, S, Sze Yin Ho, J, Moore, A & Cheah, Y-N 2022, 'Textual Variations Affect Human Judgements of Sentiment Values', Electronic Commerce Research and Applications, vol. 53, 101149. https://doi.org/10.1016/j.elerap.2022.101149

APA

Lee Teh, P., Rayson, P., Pak, I., Piao, S., Sze Yin Ho, J., Moore, A., & Cheah, Y-N. (2022). Textual Variations Affect Human Judgements of Sentiment Values. Electronic Commerce Research and Applications, 53, Article 101149. https://doi.org/10.1016/j.elerap.2022.101149

Vancouver

Lee Teh P, Rayson P, Pak I, Piao S, Sze Yin Ho J, Moore A et al. Textual Variations Affect Human Judgements of Sentiment Values. Electronic Commerce Research and Applications. 2022 May 31;53:101149. Epub 2022 Apr 19. doi: 10.1016/j.elerap.2022.101149

Author

Lee Teh, Phoey ; Rayson, Paul ; Pak, Irina et al. / Textual Variations Affect Human Judgements of Sentiment Values. In: Electronic Commerce Research and Applications. 2022 ; Vol. 53.

Bibtex

@article{b24c440a21fc4c58ac3f7b574f064f88,
title = "Textual Variations Affect Human Judgements of Sentiment Values",
abstract = "Electronic word-of-mouth communication in the form of online reviews influences people{\textquoteright}s product or service choices. People use text features to add or emphasise feelings and emotions in their text. The text emphasis can come in as capital letters, letter repetition, exclamation marks and emoticons. The existing literature has not paid sufficient attention to the effects of such textual variations on human text interpretation. This paper presents an analysis of text variations that can affect the interpretation of a text. A total of 1,041 online comments were collected, in which seven types of the most used textual variations were identified and simulated for hypothesis testing. Sentiment scores from 500 participants were collected to rate the value expressed for each of the textual variations. Statistical analysis showed that collected ratings are significant for the accurate calculation of sentiment values for short comments. Furthermore, the performance of ten existing sentiment tools was analysed based on seven textual variations. Results indicate that those tools should consider these textual variations to fully reflect a human interpretation on the text variations.",
keywords = "Sentiment analysis, Text analysis, Classification algorithms, Text mining, NLP tools, computer mediated cues (CMC), Punctuation",
author = "{Lee Teh}, Phoey and Paul Rayson and Irina Pak and Scott Piao and {Sze Yin Ho}, Jessica and Andrew Moore and Yu-N Cheah",
note = "This is the author{\textquoteright}s version of a work that was accepted for publication in Electronic Commerce Research and Applications. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Electronic Commerce Research and Applications, 53, 2022 DOI: 10.1016/j.elerap.2022.101149",
year = "2022",
month = may,
day = "31",
doi = "10.1016/j.elerap.2022.101149",
language = "English",
volume = "53",
journal = "Electronic Commerce Research and Applications",
issn = "1567-4223",
publisher = "Elsevier",

}

RIS

TY - JOUR

T1 - Textual Variations Affect Human Judgements of Sentiment Values

AU - Lee Teh, Phoey

AU - Rayson, Paul

AU - Pak, Irina

AU - Piao, Scott

AU - Sze Yin Ho, Jessica

AU - Moore, Andrew

AU - Cheah, Yu-N

N1 - This is the author’s version of a work that was accepted for publication in Electronic Commerce Research and Applications. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Electronic Commerce Research and Applications, 53, 2022 DOI: 10.1016/j.elerap.2022.101149

PY - 2022/5/31

Y1 - 2022/5/31

N2 - Electronic word-of-mouth communication in the form of online reviews influences people’s product or service choices. People use text features to add or emphasise feelings and emotions in their text. The text emphasis can come in as capital letters, letter repetition, exclamation marks and emoticons. The existing literature has not paid sufficient attention to the effects of such textual variations on human text interpretation. This paper presents an analysis of text variations that can affect the interpretation of a text. A total of 1,041 online comments were collected, in which seven types of the most used textual variations were identified and simulated for hypothesis testing. Sentiment scores from 500 participants were collected to rate the value expressed for each of the textual variations. Statistical analysis showed that collected ratings are significant for the accurate calculation of sentiment values for short comments. Furthermore, the performance of ten existing sentiment tools was analysed based on seven textual variations. Results indicate that those tools should consider these textual variations to fully reflect a human interpretation on the text variations.

AB - Electronic word-of-mouth communication in the form of online reviews influences people’s product or service choices. People use text features to add or emphasise feelings and emotions in their text. The text emphasis can come in as capital letters, letter repetition, exclamation marks and emoticons. The existing literature has not paid sufficient attention to the effects of such textual variations on human text interpretation. This paper presents an analysis of text variations that can affect the interpretation of a text. A total of 1,041 online comments were collected, in which seven types of the most used textual variations were identified and simulated for hypothesis testing. Sentiment scores from 500 participants were collected to rate the value expressed for each of the textual variations. Statistical analysis showed that collected ratings are significant for the accurate calculation of sentiment values for short comments. Furthermore, the performance of ten existing sentiment tools was analysed based on seven textual variations. Results indicate that those tools should consider these textual variations to fully reflect a human interpretation on the text variations.

KW - Sentiment analysis

KW - Text analysis

KW - Classification algorithms

KW - Text mining

KW - NLP tools

KW - computer mediated cues (CMC)

KW - Punctuation

U2 - 10.1016/j.elerap.2022.101149

DO - 10.1016/j.elerap.2022.101149

M3 - Journal article

VL - 53

JO - Electronic Commerce Research and Applications

JF - Electronic Commerce Research and Applications

SN - 1567-4223

M1 - 101149

ER -