Research across contexts and timescales with the experience sampling method: Applications in the study of language anxiety
Journal cover Studies in Second Language Learning and Teaching, volume 15, no. 4, year 2025, title Special issue: Foreign language anxiety: Theoretical and methodological developments
PDF

Keywords

language anxiety
experience sampling method
intensive longitudinal methods
informal learning

How to Cite

Arndt, H. L., & Krstic, O. M. (2025). Research across contexts and timescales with the experience sampling method: Applications in the study of language anxiety. Studies in Second Language Learning and Teaching, 15(4), 885–907. https://doi.org/10.14746/ssllt.47115

Number of views: 242


Number of downloads: 54

Abstract

Language anxiety (LA) is among the most researched emotions in language learning research. Mirroring the recent dynamic turn in the broader field, LA researchers are increasingly interested in the situation-specific and dynamic nature of anxiety (Elahi Shirvan & Taherian, 2021; MacIntyre, 2017). In practice, this must be accompanied by a movement towards methodologies sensitive to potential dynamic changes in LA within and across various contexts. The idiodynamic methodconstitutes one such approach, which allows researchers to investigate moment-to-moment changes in situated LA (e.g., MacIntyre & Gregersen, 2022; Macintyre & Legatto, 2011), whereas general self-report questionnaires implemented longitudinally typically capture changes at the level of weeks and months. However, quantitative studies on the intermediate timescales, at the level of hours and days, as well as those comparing LA across different contexts, remain comparatively rare. In this paper, we explore the potential of the experience sampling method (ESM; Csikszentmihalyi & Larson, 1987) as an approach to conducting longitudinal studies of LA in a variety of contexts at this timescale, within and beyond the language classroom. Drawing connections to recent theoretical and methodological developments, we reflect on how the ESM complements existing measures and provide practical guidance for researchers interested in integrating the method into their own studies.

https://doi.org/10.14746/ssllt.47115
PDF

References

Alpers, G. W. (2009). Ambulatory assessment in panic disorder and specific phobia. Psychological Assessment, 21(4), 476-485. DOI: https://doi.org/10.1037/a0017489

An, H., & Li, S. (2024). Task-specific writing anxiety and self-efficacy are separate from general L2 writing anxiety and self-efficacy and they have differential associations with the effects of written corrective feedback in pre-task and within-task planning. System, 126, 103480. DOI: https://doi.org/10.1016/j.system.2024.103480

Arndt, H. L., Granfeldt, J., & Gullberg, M. (2023). Reviewing the potential of the experience sampling method (ESM) for capturing second language exposure and use. Second Language Research, 39(1), 39-58. DOI: https://doi.org/10.1177/02676583211020055

Arndt, H. L., Granfeldt, J., & Gullberg, M. (2024). Language exposure and use in study abroad versus migration contexts: Modelling activity and learner profiles with ESM data. Bilingualism: Language and Cognition. DOI: https://doi.org/10.1017/S136672892400097X

Arndt, H. L., & Rose, H. (2023). Capturing life as it is truly lived? Improving diary data in educational research. International Journal of Research & Method in Education, 46(2), 175-186. DOI: https://doi.org/10.1080/1743727X.2022.2094360

Bielak, J., & Mystkowska‐Wiertelak, A. (2024). Emotions and emotion regulation in L2 classroom speaking tasks: A mixed‐methods study combining the idiodynamic and quantitative perspectives. Modern Language Journal, 108, 688-718. DOI: https://doi.org/10.1111/modl.12950

Biesemans, T., Hiekkaranta, A. P., Myin-Germeys, I., Kunc, B., Pihlajamäki, M., Kemme, N. D. F., Kirtley, O., Eisele, G., Vermaelen, N., Kunkels, Y. K., Schoefs, S., & Van Heck, L. (2018). The experience sampling method (ESM) item repository.

Bolger, N., Davis, A., & Rafaeli, E. (2003). Diary methods: Capturing life as it is lived. Annual Review of Psychology, 54(1), 579-616. DOI: https://doi.org/10.1146/annurev.psych.54.101601.145030

Botes, E., Dewaele, J.-M., & Greiff, S. (2020). The foreign language classroom anxiety scale and academic achievement: An overview of the prevailing literature and a meta-analysis. Journal for the Psychology of Language Learning, 2(1), 26-56. DOI: https://doi.org/10.52598/jpll/2/1/3

Botes, E., Van Der Westhuizen, L., Dewaele, J.-M., MacIntyre, P., & Greiff, S. (2022). Validating the short-form foreign language classroom anxiety scale. Applied Linguistics, 43(5), 1006-1033. DOI: https://doi.org/10.1093/applin/amac018

Boudreau, C., MacIntyre, P. D., & Dewaele, J.-M. (2018). Enjoyment and anxiety in second language communication: An idiodynamic approach. Studies in Second Language Learning and Teaching, 8(1), 149-170. DOI: https://doi.org/10.14746/ssllt.2018.8.1.7

Bronfenbrenner, U. (1993). The ecology of cognitive development: Research models and fugitive findings. In R. H. Wozniak & K. W. Fischer (Eds.), Development in context: Acting and thinking in specific environments (pp. 3-44). Lawrence Erlbaum.

Carter, L.-A., & Emsley, R. (2019). The analysis of experience sampling data. In J. Palmier-Claus, G. Haddock, & F. Varese (Eds.), Experience sampling in mental health research (1st ed., pp. 18-37). Routledge. DOI: https://doi.org/10.4324/9781315398341-3

Chen, Y., Mark, G., Ali, S., & Ma, X. (2017). Unpacking happiness: Lessons from smartphone photography among college students. 2017 IEEE International Conference on Healthcare Informatics (ICHI), 429-438. DOI: https://doi.org/10.1109/ICHI.2017.25

Cheng, Y.-S. (2004). A measure of second language writing anxiety: Scale development and preliminary validation. Journal of Second Language Writing, 13(4), 313-335. DOI: https://doi.org/10.1016/j.jslw.2004.07.001

Craig, A., Moore, D., & Knox, D. (2017). Experience sampling: Assessing urban soundscapes using in-situ participatory methods. Applied Acoustics, 117, 227-235. DOI: https://doi.org/10.1016/j.apacoust.2016.05.026

Csikszentmihalyi, M. (1990). Flow: The psychology of optimal experience. Harper & Row.

Csikszentmihalyi, M., & Larson, R. (1987). Validity and reliability of the experience-sampling method: The Journal of Nervous and Mental Disease, 175(9), 526-536. DOI: https://doi.org/10.1097/00005053-198709000-00004

Dewaele, J.-M. (2007). The effect of multilingualism, sociobiographical, and situational factors on communicative anxiety and foreign language anxiety of mature language learners. International Journal of Bilingualism, 11(4), 391-409. DOI: https://doi.org/10.1177/13670069070110040301

Dewaele, J.-M., Botes, E., & Greiff, S. (2023). Sources and effects of foreign language enjoyment, anxiety, and boredom: A structural equation modeling approach. Studies in Second Language Acquisition, 45(2), 461-479. DOI: https://doi.org/10.1017/S0272263122000328

Dewaele, J.-M., & Dewaele, L. (2017). The dynamic interactions in foreign language classroom anxiety and foreign language enjoyment of pupils aged 12 to 18: A pseudo-longitudinal investigation. Journal of the European Second Language Association, 1(1), 12-22. DOI: https://doi.org/10.22599/jesla.6

Dewaele, J.-M., & MacIntyre, P. D. (2014). The two faces of Janus? Anxiety and enjoyment in the foreign language classroom. Studies in Second Language Learning and Teaching, 4(2), 237-274. DOI: https://doi.org/10.14746/ssllt.2014.4.2.5

Eisele, G., Vachon, H., Lafit, G., Kuppens, P., Houben, M., Myin-Germeys, I., & Viechtbauer, W. (2022). The effects of sampling frequency and questionnaire length on perceived burden, compliance, and careless responding in experience sampling data in a student population. Assessment, 29(2), 136-151. DOI: https://doi.org/10.1177/1073191120957102

Elahi Shirvan, M., & Taherian, T. (2021). Longitudinal examination of university students’ foreign language enjoyment and foreign language classroom anxiety in the course of general English: Latent growth curve modeling. International Journal of Bilingual Education and Bilingualism, 24(1), 31-49. DOI: https://doi.org/10.1080/13670050.2018.1441804

Elahi Shirvan, M., Taherian, T., & Yazdanmehr, E. (2020). The dynamics of foreign language enjoyment: An ecological momentary assessment. Frontiers in Psychology, 11, 1391. DOI: https://doi.org/10.3389/fpsyg.2020.01391

Elahi Shirvan, M., & Talebzadeh, N. (2018). Exploring the fluctuations of foreign language enjoyment in conversation: An idiodynamic perspective. Journal of Intercultural Communication Research, 47(1), 21-37. DOI: https://doi.org/10.1080/17475759.2017.1400458

Ellison, W. D., Trahan, A. C., Pinzon, J. C., Gillespie, M. E., Simmons, L. M., & King, K. Y. (2020). For whom, and for what, is experience sampling more accurate than retrospective report? Personality and Individual Differences, 163, 110071. DOI: https://doi.org/10.1016/j.paid.2020.110071

Endler, N. S., & Kocovski, N. L. (2001). State and trait anxiety revisited. Anxiety Disorders, 15(3), 231-245. DOI: https://doi.org/10.1016/S0887-6185(01)00060-3

Fritz, J., Piccirillo, M. L., Cohen, Z. D., Frumkin, M., Kirtley, O., Moeller, J., Neubauer, A. B., Norris, L. A., Schuurman, N. K., Snippe, E., & Bring-mann, L. F. (2024). So you want to do ESM? 10 essential topics for implementing the experience-sampling method. Advances in Methods and Practices in Psychological Science, 7(3). DOI: https://doi.org/10.1177/25152459241267912

Gargalianou, V., Muehlfeld, K., Urbig, D., & Van Witteloostuijn, A. (2016). Foreign language anxiety in professional contexts: A short scale and evidence of personality and gender differences. Schmalenbach Business Review, 17(2), 195-223. DOI: https://doi.org/10.1007/s41464-016-0007-6

Gkonou, C. (2017). Towards an ecological understanding of language anxiety. In C. Gkonou, M. Daubney, & J.-M. Dewaele (Eds.), New insights into language anxiety: Theory, research and educational implications (pp. 135-155). Multilingual Matters. DOI: https://doi.org/10.2307/jj.22730706.11

Gregersen, T., Macintyre, P. D., & Meza, M. D. (2014). The motion of emotion: Idiodynamic case studies of learners’ foreign language anxiety. Modern Language Journal, 98(2), 574-588. DOI: https://doi.org/10.1111/j.1540-4781.2014.12084.x

Gregersen, T., MacIntyre, P. D., & Olson, T. (2017). Do you see what I feel? An idiodynamic assessment of expert and peer’s reading of nonverbal language anxiety cues. In C. Gkonou, M. Daubney, & J.-M. Dewaele (Eds.), New insights into language anxiety: Theory, research and educational implications (pp. 110-134). Multilingual Matters. DOI: https://doi.org/10.2307/jj.22730706.10

Guntzviller, L. M., Jensen, J. D., King, A. J., & Davis, L. A. (2011). The foreign language anxiety in a medical office scale: Developing and validating a measurement tool for Spanish-speaking individuals. Journal of Health Communication, 16(8), 849-869. DOI: https://doi.org/10.1080/10810730.2011.561917

Guntzviller, L. M., Yale, R. N., & Jensen, J. D. (2016). Foreign language communication anxiety outside of a classroom: Scale validation and curvilinear relationship with foreign language use. Journal of Cross-Cultural Psychology, 47(4), 605-625. DOI: https://doi.org/10.1177/0022022116635743

Hektner, J., Schmidt, J., & Csíkszentimihályi, M. (2007). Experience sampling method: Measuring the quality of everyday life. Sage Publications. DOI: https://doi.org/10.4135/9781412984201

Henry, A., Thorsen, C., & MacIntyre, P. D. (2024). Willingness to communicate in a multilingual context: Part two, person-context dynamics. Journal of Multilingual and Multicultural Development, 45(4), 1033-1048. DOI: https://doi.org/10.1080/01434632.2021.1935975

Horwitz, E. K. (2008). Becoming a language teacher: A practical guide to second language learning and teaching (2nd ed.). Pearson.

Horwitz, E. K., Horwitz, M. B., & Cope, J. (1986). Foreign language classroom anxiety. Modern Language Journal, 70(2), 125-132. DOI: https://doi.org/10.1111/j.1540-4781.1986.tb05256.x

Hsieh, G., Li, I., Dey, A., Forlizzi, J., & Hudson, S. E. (2008). Using visualizations to increase compliance in experience sampling. In Proceedings of the 10th International Conference on Ubiquitous Computing (UbiComp ‘08) (pp. 164-167). Association for Computing Machinery. DOI: https://doi.org/10.1145/1409635.1409657

Kasbi, S., & Elahi Shirvan, M. (2017). Ecological understanding of foreign language speaking anxiety: Emerging patterns and dynamic systems. Asian-Pacific Journal of Second and Foreign Language Education, 2(1), 1-20. DOI: https://doi.org/10.1186/s40862-017-0026-y

Khajavy, G. H., MacIntyre, P. D., Taherian, T., & Ross, J. (2021). Examining the dynamic relationships between willingness to communicate, anxiety and enjoyment using the experience sampling method. In N. Zarrinabadi & M. Pawlak (Eds.), New perspectives on willingness to communicate in a second language (pp. 169-197). Springer International Publishing. DOI: https://doi.org/10.1007/978-3-030-67634-6_9

Larsen-Freeman, D. (2007). On the complementarity of chaos/complexity theory and dynamic systems theory in understanding the second language acquisition process. Bilingualism: Language and Cognition, 10(01), 35-37. DOI: https://doi.org/10.1017/S136672890600277X

Leaković, M. (2024). Surviving English: Language anxiety and language aptitude of university students [Master’s thesis, University of Zagreb]. https://repozitorij.ffzg.unizg.hr/islandora/object/ffzg:11318/

Lee, J. S., & Lee, K. (2020). Affective factors, virtual intercultural experiences, and L2 willingness to communicate in in-class, out-of-class, and digital settings. Language Teaching Research, 24(6), 813-833. DOI: https://doi.org/10.1177/1362168819831408

Liao, Y., Skelton, K., Dunton, G., & Bruening, M. (2016). A systematic review of methods and procedures used in ecological momentary assessments of diet and physical activity research in youth: An adapted STROBE checklist for reporting EMA studies (CREMAS). Journal of Medical Internet Research, 18(6), e151. DOI: https://doi.org/10.2196/jmir.4954

Liu, M., & Huang, W. (2011). An exploration of foreign language anxiety and English learning motivation. Education Research International, 2011, 493167. DOI: https://doi.org/10.1155/2011/493167

Liu, M., & Wu, B. (2021). Teaching anxiety and foreign language anxiety among Chinese college English teachers. Sage Open, 11(2). DOI: https://doi.org/10.1177/21582440211016556

Machida, T. (2016). Japanese elementary school teachers and English language anxiety. TESOL Journal, 7(1), 40-66. DOI: https://doi.org/10.1002/tesj.189

MacIntyre, P. D. (2012). The idiodynamic method: A closer look at the dynamics of communication traits. Communication Research Reports, 29(4), 361-367. DOI: https://doi.org/10.1080/08824096.2012.723274

MacIntyre, P. D. (2017). An overview of language anxiety research and trends in its development. In C. Gkonou, M. Daubney, & J.-M. Dewaele (Eds.), New insights into language anxiety: Theory, research and educational implications (pp. 11-30). Multilingual Matters. DOI: https://doi.org/10.2307/jj.22730706.5

MacIntyre, P. D., & Gardner, R. C. (1989). Anxiety and second‐language learning: Toward a theoretical clarification. Language Learning, 39(2), 251-275. DOI: https://doi.org/10.1111/j.1467-1770.1989.tb00423.x

MacIntyre, P. D., & Gardner, R. C. (1994). The subtle effects of language anxiety on cognitive processing in the second language. Language Learning, 44(2), 283-305. DOI: https://doi.org/10.1111/j.1467-1770.1994.tb01103.x

MacIntyre, P. D., & Gregersen, T. (2022). The idiodynamic method: Willingness to communicate and anxiety processes interacting in real time. International Review of Applied Linguistics in Language Teaching, 60(1), 67-84. DOI: https://doi.org/10.1515/iral-2021-0024

Macintyre, P. D., & Legatto, J. J. (2011). A dynamic system approach to willingness to communicate: Developing an idiodynamic method to capture rapidly changing affect. Applied Linguistics, 32(2), 149-171. DOI: https://doi.org/10.1093/applin/amq037

MacIntyre, P. D., & Wang, L. (2022). Anxiety. In S. Li, P. Hiver, & M. Papi, The Routledge handbook of second language acquisition and individual differences (1st ed., pp. 175-189). Routledge. DOI: https://doi.org/10.4324/9781003270546-15

MacKerron, G., & Mourato, S. (2013). Happiness is greater in natural environments. Global Environmental Change, 23(5), 992-1000. DOI: https://doi.org/10.1016/j.gloenvcha.2013.03.010

Myin-Germeys, I., & Kuppens, P. (Eds.). (2021). The open handbook of experience sampling methodology: A step-by-step guide to designing, conducting, and analyzing ESM studies (2nd ed.). The Center for Research on Experience Sampling and Ambulatory Methods Leuven (REAL). https://www.kuleuven.be/samenwerking/real/real-book/index.htm

Onwuegbuzie, A. J., Bailey, P., & Daley, C. E. (2000). The validation of three scales measuring anxiety at different stages of the foreign language learning process: The input anxiety scale, the processing anxiety scale, and the output anxiety scale. Language Learning, 50(1), 87-117. DOI: https://doi.org/10.1111/0023-8333.00112

Pan, C., & Zhang, X. (2023). A longitudinal study of foreign language anxiety and enjoyment. Language Teaching Research, 27(6), 1552-1575. DOI: https://doi.org/10.1177/1362168821993341

Pawlak, M. (2012). The dynamic nature of motivation in language learning: A classroom perspective. Studies in Second Language Learning and Teaching, 2(2), 249-278. DOI: https://doi.org/10.14746/ssllt.2012.2.2.7

Pawlak, M., Kruk, M., & Zawodniak, J. (2022). Investigating individual trajectories in experiencing boredom in the language classroom: The case of 11 Polish students of English. Language Teaching Research, 26(4), 598-616. DOI: https://doi.org/10.1177/1362168820914004

Pawlak, M., Mystkowska-Wiertelak, A., & Bielak, J. (2016). Investigating the nature of classroom willingness to communicate (WTC): A micro-perspective. Language Teaching Research, 20(5), 654-671. DOI: https://doi.org/10.1177/1362168815609615

Rauthmann, J. F., Horstmann, K. T., & Sherman, R. A. (2019). Do self-reported traits and aggregated states capture the same thing? A nomological perspective on trait-state homomorphy. Social Psychological and Personality Science, 10(5), 596-611. DOI: https://doi.org/10.1177/1948550618774772

Rintala, A., Wampers, M., Myin-Germeys, I., & Viechtbauer, W. (2019). Response compliance and predictors thereof in studies using the experience sampling method. Psychological Assessment, 31(2), 226-235. DOI: https://doi.org/10.1037/pas0000662

Šafranj, J., & Zivlak, J. (2019). Effects of big five personality traits and fear of negative evaluation on foreign language anxiety. Croatian Journal of Education, 21(1), 275-306. DOI: https://doi.org/10.15516/cje.v21i1.2942

Saghafi, K., & Elahi Shirvan, M. (2020). Rapid changes in foreign language learning anxiety caused by a multiplicity of topics: An idiodynamic approach. Journal of Language and Education, 6(1), 83-102. DOI: https://doi.org/10.17323/jle.2020.9684

Schimpff, A., & Botes, E. (2024, May 17). Preliminary development and validation of language anxiety scales beyond the foreign language classroom context [Conference presentation]. Psychology of Language Learning PLL5, Madrid, Spain.

Schuurman, N. K. (2023). A “within/between problem” primer: About (not) separating within-person variance and between-person variance in psychology [Preprint]. PsyArXiv. DOI: https://doi.org/10.31234/osf.io/7zgkx

Sevinç, Y. (2018). Language anxiety in the immigrant context: Sweaty palms? International Journal of Bilingualism, 22(6), 717-739. DOI: https://doi.org/10.1177/1367006917690914

Shiffman, S., Stone, A. A., & Hufford, M. R. (2008). Ecological momentary assessment. Annual Review of Clinical Psychology, 4(1), 1-32. DOI: https://doi.org/10.1146/annurev.clinpsy.3.022806.091415

Spielberger, C. D., Gorsuch, R. L., Lushene, R., Vagg, P. R., & Jacobs, G. A. (1983). Manual for the state-trait anxiety inventory. Consulting Psychologists Press.

Spitzberg, B. H. (2000). A model of intercultural communication competence. In L. A. Samovar & R. E. Porter (Eds.), Intercultural communica-tion: A reader (9 ed., pp. 375-387). Wadsworth Publishing.

The ManyMoments Consortium. (2021). ManyMoments – Using multi-lab collaboration to improve replicability of intensive longitudinal studies [Conference presentation]. Society for Ambulatory Assessment Conference 2021, Zürich, Switzerland.

Toyama, M., & Yamazaki, Y. (2021). Classroom interventions and foreign language anxiety: A systematic review with narrative approach. Frontiers in Psychology, 12, 614184. DOI: https://doi.org/10.3389/fpsyg.2021.614184

van Lier, L. (2004). The ecology and semiotics of language learning: A soci-ocultural perspective. Springer. DOI: https://doi.org/10.1007/1-4020-7912-5

Walls, T. A., Jung, H., & Schwartz, J. E. (2006). Multilevel models for intensive longitudinal data. In T. A. Walls & J. L. Schafer (Eds.), Models for intensive longitudinal data (pp. 3-37). Oxford University Press. DOI: https://doi.org/10.1093/acprof:oso/9780195173444.003.0001

Walz, L. C., Nauta, M. H., & Aan Het Rot, M. (2014). Experience sampling and ecological momentary assessment for studying the daily lives of patients with anxiety disorders: A systematic review. Journal of Anxiety Disorders, 28(8), 925-937. DOI: https://doi.org/10.1016/j.janxdis.2014.09.022

Wrzus, C., & Neubauer, A. B. (2023). Ecological momentary assessment: A meta-analysis on designs, samples, and compliance across research fields. Assessment, 30(3), 825-846. DOI: https://doi.org/10.1177/10731911211067538

Zoghi, M., & Alivandivafa, M. (2014). EFL reading anxiety inventory (EFLRAI): Factorial validity and reliability. Journal of Psychoeducational Assessment, 32(4), 318-329. DOI: https://doi.org/10.1177/0734282913513686