Skip to main content

Linguistic Markers of Affect and the Gender Dimension in Online Hate Speech

  • Chapter
  • First Online:
Hate Speech in Social Media

Abstract

Language is not only a tool for information transfer but also a vehicle of the producer’s subjectivity which adds to the persuasive power of the message. Given the proliferation of discriminatory and hateful content online, it is important to understand the mechanisms of such messages to curb its propagation as efficiently as possible. Looking into a number of factors, such as the characteristics of hate speech producers, contributes to properly addressing the destructive phenomenon of hate speech. This study aims to explore the role of gender in the production of online hate speech by focusing on the use of linguistic markers conveying affect. We analyse selected typographical, grammatical and lexical features in English and Slovene Facebook comments which were identified as conveying socially unacceptable propositions. The results show statistically significant differences in the use of linguistic markers of affect between English-speaking or Slovene-speaking male and female commenters with regard to their hate speech production. This study shows that men are more likely to post shorter and violent comments as opposed to offensive ones, while women tend to include more linguistic markers of affect in their comments on all studied levels.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Each comment was annotated by several annotators, and comments were tagged according to the modal value. For certain comments, however, the mode could not be defined. This study uses only the comments for which the modal value was available both at the level of type and target, meaning that these comments were judged as socially unacceptable by the majority of annotators.

  2. 2.

    The FRENK corpus contains several categories of SUD (Violent, Threatening, Offensive, Inappropriate). In general terms, the Inappropriate tag was used when no target of SUD could be specified and the Violent, Threatening tag was chosen over Offensive if the comment included a threat or a call or an allusion to physical violence. For a detailed description of the annotation schema, see Ljubešić et al. (2019). In this study, we are not interested in the fine-grained distinctions between the inappropriate and offensive comments on the one hand and the violent and threatening ones on the other, so we merged them into two major categories Offensive and Violent.

  3. 3.

    The information about the number of deleted comments is not available for our dataset. For current data regarding Facebook content moderation, see https://transparency.fb.com/data/community-standards-enforcement/hate-speech/facebook/

  4. 4.

    Calculator provided by Stangroom (2022).

  5. 5.

    Code by Bedre (2021).

  6. 6.

    In the case of expressive punctuation, the unit can include more than one punctuation mark.

  7. 7.

    It is important to bear in mind that typographical characteristics could also be influenced by the commenter’s device and its settings (e.g. autocorrect function), leading to differences which are more a reflection of technical affordances than of sociocultural or linguistic aspects.

References

  • Ahn, W., Park, J., & Han, K. (2011). Emoticons convey emotion in CMC. In Proceedings of HCI 2011 The 25th BCS Conference on Human Computer Interaction (HCI), pp. 429–430.

    Google Scholar 

  • Al-Saaqa, S., Abdel-Nabi, H. & Awajan, A. (2018, July). A survey of textual emotion detection. In 2018 8th International Conference on Computer Science and Information Technology (CSIT), pp. 136–142.

    Google Scholar 

  • Ameka, F. (1992). Interjections: The universal yet neglected part of speech. Journal of Pragmatics, 18(2–3), 101–118.

    Article  Google Scholar 

  • Androutsopoulos, J. (2011). Language change and digital media: a review of conceptions and evidence. In Standard languages and language standards in a changing Europe (Vol. 1, pp. 145–159).

    Google Scholar 

  • Apresyan, M. (2018). On the concept of “expressiveness” in modern linguistics. Annals of Language and Literature, 2(4), 8–12.

    Article  Google Scholar 

  • Argaman, O. (2010). Linguistic markers and emotional intensity. Journal of Psycholinguistic Research, 39(2), 89–99.

    Article  Google Scholar 

  • Bednarek, M. (2008). Emotion talk across corpora. Palgrave Macmillan.

    Book  Google Scholar 

  • Bedre, R. (2021). Mann-Whitney U test (Wilcoxon rank sum test) in Python [pandas and SciPy]. Accessed November 21, 2022, from https://www.reneshbedre.com/blog/mann-whitney-u-test.html

  • Biber, D., & Finegan, E. (1989). Styles of stance in English: Lexical and grammatical marking of evidentiality and affect. Text - Interdisciplinary Journal for the Study of Discourse, 9(1), 93–124.

    Article  Google Scholar 

  • Briscoe, E. J., Appling, D. S., & Hayes, H. (2014). Cues to deception in social media communications. In 2014 47th Hawaii international conference on system sciences, pp. 1435–1443.

    Google Scholar 

  • Burger, L., & Miller, P. J. (1999). Early talk about the past revisited: Affect in working-class and middle-class children’s co-narrations. Journal of Child Language, 26, 133–162.

    Article  Google Scholar 

  • Charteris-Black, J., & Seale, C. (2013). Men and emotion talk: Evidence from the experience of illness. Gender and Language, 3(1), 81–113.

    Article  Google Scholar 

  • Chiril, P., Pamungkas, E. W., Benamara, F., Moriceau, V., & Patti, V. (2022). Emotionally informed hate speech detection: A multi-target perspective. Cognitive Computation, 2022, 1–31.

    Google Scholar 

  • Costello, M., & Hawdon, J. (2018). Who are the online extremists among us? Sociodemographic characteristics, social networking, and online experiences of those who produce online hate materials. Violence and Gender, 5(1), 55–60.

    Article  Google Scholar 

  • Dirven, R. (1997). Emotions as cause and the cause of emotions. In S. Niemeier & R. Dirven (Eds.), The language of emotions: Conceptualization, expression, and theoretical foundation (pp. 55–86). John Benjamins.

    Chapter  Google Scholar 

  • Donath, J. (1999). Identity and deception in the virtual community. In M. Smith & P. Kollock (Eds.), Communities in cyberspace (pp. 29–59). Routledge.

    Google Scholar 

  • Dueñas, P. M. (2010). Attitude markers in business management research articles: A cross-cultural corpus-driven approach. International Journal of Applied Linguistics, 20(1), 50–72.

    Article  Google Scholar 

  • Fox, A. B., Bukatko, D., Hallahan, M., & Crawford, M. (2007). The medium makes a difference: Gender similarities and differences in instant messaging. Journal of Language and Social Psychology, 26(4), 389–397.

    Article  Google Scholar 

  • Franza, J. (2022). Emotion recognition and analysis in socially unacceptable discourse on social media. Manuscript in preparation. University of Ljubljana.

    Google Scholar 

  • Franza, J., Evkoski, B., & Fišer, D. (2022). Emotion analysis in socially unacceptable discourse. Slovenščina 2.0, 10(1), 1–22.

    Google Scholar 

  • Fuentes, A. M. M., Kahn, J. H., & Lannin, D. G. (2021). Emotional disclosure and emotion change during an expressive-writing task: Do pronouns matter? Current Psychology, 40(4), 1672–1679.

    Article  Google Scholar 

  • Hancock, J. T. (2007). Digital deception: When, where and how people lie online. In A. Joinson, K. McKenna, T. Postmes, & U. D. Reips (Eds.), Oxford handbook of internet psychology (pp. 287–301). Oxford University Press.

    Google Scholar 

  • Hogg, M. A., Abrams, D., & Martin, G. N. (2010). Social cognition and attitudes. In G. N. Martin, N. R. Carlson, & W. Buskist (Eds.), Psychology (pp. 646–677). Pearson Education Limited.

    Google Scholar 

  • LaFrance, M., & Banaji, M. (1992). Toward a reconsideration of the gender-emotion relationship. Emotion and Social Behavior, 14, 178–201.

    Google Scholar 

  • Ljubešić, N., & Dobrovoljc, K. (2019). What does neural bring? Analysing improvements in morphosyntactic annotation and lemmatisation of Slovenian, Croatian and Serbian. In Proceedings of the 7th workshop on balto-slavic natural language processing, pp. 29–34.

    Google Scholar 

  • Ljubešić, N., Fišer, D., & Erjavec, T. (2019). The FRENK datasets of socially unacceptable discourse in Slovene and English. In Text, speech, and dialogue: 22nd International Conference, TSD 2019, Ljubljana, Slovenia, September 11–13, 2019, Proceedings. Springer-Verlag, pp. 103–114.

    Google Scholar 

  • Marques, T. (2022). The expression of hate in hate speech. Journal of Applied Philosophy, 10, 1–29.

    Google Scholar 

  • Martin, J. R., & White, P. R. R. (2005). The language of evaluation: Appraisal in English. Palgrave Macmillan.

    Book  Google Scholar 

  • Martinez, L., Falvello, V. B., Aviezer, H., & Todorov, A. (2016). Contributions of facial expressions and body language to the rapid perception of dynamic emotions. Cognition and Emotion, 30(5), 939–952.

    Article  Google Scholar 

  • McAndrew, F., & DeJonge, C. (2011). Electronic person perception: What do we infer about people from the style of their e-mail messages? Social Psychological and Personality Science, 2, 403–407. https://doi.org/10.1177/1948550610393988

    Article  Google Scholar 

  • Merriam-Webster Dictionary. (2022). Accessed November 24, 2022, from https://www.merriam-webster.com/

  • Mills, S. (2005). Gender and impoliteness. Journal of Politeness Research, 1(2), 263–280.

    Article  Google Scholar 

  • Mohammad S. & Turney, P. (2010, June). Emotions evoked by common words and phrases: Using mechanical turk to create an emotion lexicon. In Proceedings of the NAACL-HLT 2010 workshop on computational approaches to analysis and generation of emotion in text.

    Google Scholar 

  • Ochs, E., & Schieffelin, B. (1989). Language has a heart. Text - Interdisciplinary Journal for the Study of Discourse, 9(1), 7–26.

    Article  Google Scholar 

  • Ortega-Sánchez, D., Blanch, J. P., Quintana, J. I., Cal, E. S. D. L., & de la Fuente-Anuncibay, R. (2021). Hate speech, emotions, and gender identities: A study of social narratives on Twitter with trainee teachers. International Journal of Environmental Research and Public Health, 18(8), 4055.

    Article  Google Scholar 

  • Pahor de Maiti, K., Franza, J., & Fišer, D. (2022). Haters in the spotlight: gender and socially unacceptable Facebook comments. Manuscript submitted.

    Google Scholar 

  • Palmer, G. B., & Occhi, D. J. (1999). Introduction: Linguistic anthropology and emotional experience. In G. B. Palmer & D. J. Occhi (Eds.), Languages of sentiment: Cultural constructions of emotional substrates (pp. 1–22). Benjamins.

    Chapter  Google Scholar 

  • Parkins, R. (2012). Gender and emotional expressiveness: An analysis of prosodic features in emotional expression. Griffith Working Papers in Pragmatics and Intercultural Communication, 5(1), 46–54.

    Google Scholar 

  • Provine, R. R., Spencer, R. J., & Mandell, D. L. (2007). Emotional expression online: Emoticons punctuate website text messages. Journal of Language and Social Psychology, 26(3), 299–307.

    Article  Google Scholar 

  • Račečič, A. (2012). Multimodalna analiza in sredstva prepričevanja dveh predsednikov vlad, Janeza Janše in Boruta Pahorja. BA thesis, Univerza v Mariboru.

    Google Scholar 

  • Rett, J. (2021). The semantics of emotive markers and other illocutionary content. Journal of Semantics, 38(2), 305–340.

    Article  Google Scholar 

  • Schäfer, S., Sülflow, M., & Reiners, L. (2021). Hate speech as an indicator for the state of the society. Journal of Media Psychology, 34(1), 3–15.

    Article  Google Scholar 

  • Schuller, B., & Batliner, A. (2013). Computational paralinguistics: Emotion, affect and personality in speech and language processing. Wiley.

    Book  Google Scholar 

  • Schwartz, H. A., Eichstaedt, J. C., Kern, M. L., Dziurzynski, L., Ramones, S. M., Agrawal, M., Shah, A., Stillwell, D., Seligman, M. E. P., & Ungar, L. H. (2013). Personality, gender, and age in the language of social media: The open-vocabulary approach. PLoS One, 8(9), e73791.

    Article  Google Scholar 

  • Silveira, N., Dozat, T., De Marneffe, M. C., Bowman, S., Connor, M., Bauer, J., & Manning, C. D. (2014). A gold standard dependency corpus for English. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC’14), pp. 2897–2904.

    Google Scholar 

  • SSKJ. Slovar slovenskega knjižnega jezika. (2022). Accessed November 24, 2022, from https://www.fran.si

  • Stange, U. (2016). Emotive interjections in British English: A corpus-based study on variation in acquisition, function, and usage. John Benjamins Publishing Company.

    Book  Google Scholar 

  • Stangroom, J. (2022). Chi-Square test calculator. Social Science Statistics. Accessed November 29, 2022, from https://www.socscistatistics.com/tests/chisquare2/default2.aspx

  • Tarasova, A. N. (2016). Expressive means of punctuation in net texts on the material of the Tatar, Russian and English Languages. Global Media Journal, 2016, 14–27.

    Google Scholar 

  • Truesdale, D. M., & Pell, M. D. (2018). The sound of passion and indifference. Speech Communication, 99, 124–134.

    Article  Google Scholar 

  • Ubando, M. (2016). Gender differences in intimacy, emotional expressivity, and relationship satisfaction. Pepperdine Journal of Communication Research, 4(1), 13.

    Google Scholar 

  • Unicode. (2022). Full Emoji List, v15.0. Accessed November 10, 2022, from https://unicode.org/emoji/charts/full-emoji-list.html

  • Utych, S. M. (2018). Negative affective language in politics. American Politics Research, 46(1), 77–102.

    Article  Google Scholar 

  • Van den Stock, J., Righart, R., & de Gelder, B. (2007). Body expressions influence recognition of emotions in the face and voice. Emotion, 7(3), 487–494.

    Article  Google Scholar 

  • Van Swol, L. M., Braun, M. T., & Kolb, M. R. (2015). Deception, detection, demeanor, and truth bias in face-to-face and computer-mediated communication. Communication Research, 42(8), 1116–1142.

    Article  Google Scholar 

  • Vandergriff, I. (2013). Emotive communication online: A contextual analysis of computer-mediated communication (CMC) cues. Journal of Pragmatics, 51, 1–12.

    Article  Google Scholar 

  • Veglis, A., & Pomportsis, A. (2012). The e-citizen in the cyberspace – A journalism aspect. In 25th international conference on information law and ethics.

    Google Scholar 

  • Wolf, A. (2000). Emotional expression online: Gender differences in emoticon use. CyberPsychology & Behavior, 3(5), 683–908.

    Article  Google Scholar 

  • Wolny, W. (2016). Emotion analysis of Twitter data that use emoticons and emoji ideograms. ISD.

    Google Scholar 

Download references

Acknowledgements

The work described in this chapter was funded by the Slovenian Research Agency research programme P6-0436: Digital Humanities: resources, tools and methods (2022-2027), the DARIAH-SI research infrastructure, and the national research project N6-0099: LiLaH: Linguistic Landscape of Hate Speech.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Kristina Pahor de Maiti .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Pahor de Maiti, K., Franza, J., Fišer, D. (2023). Linguistic Markers of Affect and the Gender Dimension in Online Hate Speech. In: Ermida, I. (eds) Hate Speech in Social Media. Palgrave Macmillan, Cham. https://doi.org/10.1007/978-3-031-38248-2_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-38248-2_13

  • Published:

  • Publisher Name: Palgrave Macmillan, Cham

  • Print ISBN: 978-3-031-38247-5

  • Online ISBN: 978-3-031-38248-2

  • eBook Packages: Social SciencesSocial Sciences (R0)

Publish with us

Policies and ethics