The Language of Affect Heuristic in Online Discourse: A Corpus Study with Human and Llm Coders
Okładka czasopisma Człowiek i Społeczeństwo, tom 61, rok 2026, tytuł Emotion in Argumentation
PDF (English)

Słowa kluczowe

affect heuristic
emotions in argumentation
online discourse
argumentation in social media
cognitive biases
large language models (LLMs)

Jak cytować

Żelewska, P., & Konat , B. (2026). The Language of Affect Heuristic in Online Discourse: A Corpus Study with Human and Llm Coders. Człowiek I Społeczeństwo, 61, 103–118. https://doi.org/10.14746/cis.2026.61.8

Liczba wyświetleń: 22


Liczba pobrań: 18

Abstrakt

This paper investigates the affect heuristic in online argumentative discourse through a corpus-based study combining manual and automatic annotation. Drawing on research in argumentation theory, psychology, and decision science, the study approaches affect not as an external addition to reasoning but as a recurring component of evaluative judgment. The analysis focuses on discussions of climate change and artificial intelligence collected from Reddit and X (formerly Twitter), domains characterised by uncertainty, risk perception, and public controversy. The study employs a bottom-up annotation methodology in which four human annotators identify instances of affect heuristic and related cognitive biases in a corpus of more than 30,000 posts and comments. Inter-annotator agreement is assessed using Fleiss’ κ, Cohen’s κ, Gwet’s AC1, and weighted F1 measures. In a second stage, the same annotation scheme is applied to GPT-4o, treated as a constrained fifth annotator operating within predefined categories and probabilistic classification rules. The results show that the affect heuristic is the most frequent heuristic pattern in the corpus, occurring more often than confirmation bias, availability heuristic, or representativeness heuristic. Although traditional κ coefficients remain low because of category imbalance, agreement measures robust to prevalence effects indicate substantial consistency among annotators. The automatic anno-tation stage reveals partial alignment between human and model judgments, while also exposing systematic discrepancies in the model’s distribution of categories. A lexical and discursive analysis further demonstrates that affect heuristics do not necessarily manifest through explicit emotion vocabulary. Instead, they frequently appear through evaluative framing, practical reasoning under uncertainty, and subtle stance-taking related to collective action and future-oriented judgment. The findings contribute to empirical research on emotional processes in argumentation and demonstrate how affective reasoning can be operationalised and studied through combined qualitative and computational methods.

https://doi.org/10.14746/cis.2026.61.8
PDF (English)

Bibliografia

Damasio, A. (1994). Descartes’ Error: Emotion, Reason and the Human Brain. New York: Avon Books.

Finucane, M.L., Alhakami, A., Slovic, P., Johnson, S.M. (2000). The affect heuristic in judgments of risks and benefits. Journal of Behavioral Decision Making, 13(1), 1–17. DOI: https://doi.org/10.1002/(SICI)1099-0771(200001/03)13:1<1::AID-BDM333>3.0.CO;2-S

Kahneman, D. (2011). Thinking, Fast and Slow. New York: Macmillan.

Koszowy, M., Budzynska, K., Pereira-Fariña, M., Duthie, R. (2022). From theory of rhetoric to the practice of language use: The case of appeals to ethos elements. Argumentation, 36(1), 123–149. DOI: https://doi.org/10.1007/s10503-021-09564-0

Slovic, P., Finucane, M.L., Peters, E., MacGregor, D.G. (2007). The affect heuristic. European Journal of Operational Research, 177(3), 1333–1352. DOI: https://doi.org/10.1016/j.ejor.2005.04.006

Walton, D. (1992). The Place of Emotion in Argument. University Park, PA: The Pennsylvania State University Press.

Zajonc, R.B. (1980). Feeling and thinking: Preferences need no inferences. American Psychologist, 35(2), 151–175. DOI: https://doi.org/10.1037/0003-066X.35.2.151