Digital multimodal composing: A synthesis of theory-research connections and justifications for task selection
Journal cover Studies in Second Language Learning and Teaching, title Online First
PDF

Keywords

digital genres
multimodal composition
research methods
TBLT
technology

How to Cite

Kessler, M. (2026). Digital multimodal composing: A synthesis of theory-research connections and justifications for task selection. Studies in Second Language Learning and Teaching. https://doi.org/10.14746/ssllt.52980

Number of views: 0


Number of downloads: 0

Abstract

As human communications have grown increasingly digital and multimodal, so too, has scholarly interest in the topic of digital multimodal composing (DMC). Much research to date has explored various aspects of DMC tasks, including their capacity to affect second language (L2) learning processes and outcomes in the classroom. Despite this, two recurring limitations have surfaced across studies, which involve: (1) unclear connections between theory and research designs, and (2) missing justifications as to why a DMC task or activity was used in the study context. The current article opens with a brief overview of DMC literature, followed by a discussion of these limitations. To further explore their pervasiveness, a research synthesis was conducted of DMC studies published since 2023 (K = 42). The findings of this synthesis show that although researchers often mention theory in their introduction and literature review sections, theory is rarely tied to an aspect of the research methods (e.g., instrument design, data analyses). Additionally, less than one-third of the studies reviewed contain explanations as to why a specific DMC task was adopted. Based on these findings, future recommendations are provided with the aim of fostering stronger connections between theory, research, and practice.

https://doi.org/10.14746/ssllt.52980
PDF

References

Akoto, M., & Li, M. (2025). Exploring collaborative digital multimodal composition: Interaction patterns and texts in the French as a foreign language context. System, 129, 103583.

Belcher, D. D. (2023). Digital genres: What they are, what they do, and why we need to better understand them. English for Specific Purposes, 70, 33-43.

Bezemer, J., & Jewitt, C. (2010). Multimodal analysis: Key issues. In L. Li-tosseliti (Ed.), Research methods in linguistics (pp. 180-197). Continuum.

Braun, V., & Clarke, V. (2021). Thematic analysis: A practical guide. Sage Publications.

Cao, Z., & Mao, Z. (2025). Teachers’ conceptualizations of digital multi-modal composing in L2 writing. Journal of Second Language Writing, 68, 101210.

Cho, H., & Kim, Y. (2021). Comparing the characteristics of EFL students’ multimodal composing and traditional monomodal writing: The case of a reading-to-write task. Language Teaching Research.

Chong, S. W. (2026). Research synthesis. In M. Kessler (Ed.), Digital and internet-based research methods in applied linguistics (pp. 10-34). John Benjamins.

Ellis, R., Skehan, P., Li, S., Shintani, N., & Lambert, C. (2019). Task-based language teaching: Theory and practice. Cambridge University Press.

Farrell, T. S. C. (2018). Reflective language teaching: Practical applications for TESOL teachers (2nd ed.). Bloomsbury.

Férez Mora, P. A., & Coyle, Y. (2023). Videoed storytelling in primary education EFL: Exploring trainees’ digital shift. International Review of Applied Linguistics in Language Teaching, 62(4), pp. 1747-1772.

Fu, X., & Zhang, L. J. (2025). Translanguaging space construction in five Chinese EFL learners’ collaborative English-language culture-introduction videos: Patterns and influential factors. Written Communication, 42(2), 333-370.

García-Pastor, M. D., & Calatayud, J. P. (2023). Crafting L2 multimodal composing identities. CALICO Journal, 40(3), 313-334.

Hafner, C. A. (2025). Multimodality and ESP research. In S. Starfield & C. A. Hafner (Eds.), The handbook of English for specific purposes (2nd ed.). Wiley.

Halliday, M. A. K. (1978). Language as social semiotic: The social interpretation of language and meaning. Edward Arnold.

Henry, A. (2019). Online media creation and L2 motivation: A socially situated perspective. TESOL Quarterly, 53(2), 372-404.

Ho, W. Y. J. (2024). Digital multimodal composing pedagogy in a university writing course. ELT Journal, 78(3), 326-335.

Huang, Q., & Xia, S. (2024). Preparing learners for digitally mediated academic communication: Digital multimodal practice in students’ knowledge dissemination videos. Journal of English for Academic Purposes, 71, 101429.

Hyon, S. (2018). Introducing genre and English for specific purposes. Routledge.

Jewitt, C., & Kress, G. (2003). Multimodal literacy. Lang.

Jiang, L., & Hafner, C. A. (2024). Digital multimodal composing in L2 classrooms: A research agenda. Language Teaching, 58(4), 528-546.

Jiang, L., & Lai, C. (2025). How did the generative artificial intelligence-assisted digital multimodal composing process facilitate the production of quality digital multimodal compositions: Toward a process-genre model. TESOL Quarterly, 59, 552-585.

Jiang, L., Yang, M., & Yu, S. (2020). Chinese ethnic minority students’ investment in English learning empowered by digital multimodal composing. TESOL Quarterly, 54(4), 954-979.

Kang, S., & Kim, Y. (2023). EFL adolescent learners’ perceptions of digital multimodal composing tasks and task outcomes: A longitudinal study. International Journal of Applied Linguistics, 33(2), 340-361.

Kessler, M. (2024). Digital multimodal composing: Connecting theory, research and practice in second language acquisition. Multilingual Matters.

Kessler, M., & Casal, J. E. (2024). English writing instructors’ use of theories, genres, and activities: A survey of teachers’ beliefs and practices. Journal of English for Academic Purposes, 69, 101384.

Kim, Y. (2025, May 23). L2 writing, monomodal and multimodal perspectives, task variables and effects on L2 processes and products [Conference session]. L2 Writing Research Seminar, Murcia, Spain.

Kim, Y., Belcher, D., & Peyton, C. (2023). Comparing monomodal traditional writing and digital multimodal composing in EAP classrooms: Linguistic performance and writing development. Journal of English for Academic Purposes, 64, 101247.

Kohnke, L., Jarvis, A., & Ting, A. (2021). Digital multimodal composing as authentic assessment in discipline-specific English courses: Insights from ESP learners. TESOL Journal, 12(3), e600.

Kress, G. (2010). Multimodality: A social semiotic approach to contemporary communication. Routledge.

Li, D., Xia, S., & Guo, K. (2025). Investigating L2 learners’ text-to-video resemiotisation in AI-enhanced digital multimodal composing. Computer Assisted Language Learning.

Li, M., & Pham, Q. N. (2025). Three heads are better than one? Digital multimodal composition completed collaboratively versus individually. Language Teaching Research, 29(5), 1866-1888.

Lim, J. (2020). Language in multimodal writing processes and performance: Developing multimodal writing tasks for L2 learners (27993285) [Doctoral dissertation, Michigan State University]. ProQuest.

Lim, J., & Kessler, M. (2022). Directions for future research on SLA, L2 writing, and multimodality. In R. Manchón & C. Polio (Eds.), The Routledge handbook of second language acquisition and writing (pp. 300-314). Routledge.

Lim, J., & Kessler, M. (2024). Multimodal composing and second language acquisition. Language Teaching, 57(2), 183-202.

Lim, J., & Polio, C. (2020). Multimodal assignments in higher education: Implications for multimodal writing tasks for L2 writers. Journal of Second Language Writing, 47, 100713.

Lin, C.-H., Zhou, K., Li, L., & Sun, L. (2025). Integrating generative AI into digital multimodal composition: A study of multicultural second-language classrooms. Computers and Composition, 75, 102895.

Long, M. H. (1996). The role of the linguistic environment in second language acquisition. In W. Ritchie & T. K. Bhatia (Eds.), Handbook of language acquisition: Second language acquisition (pp. 413-468). Academic Press.

Manchón, R. M. (2026). Multimodal composing and L2 learning through writing: Rationales, controversies, and empirical evidence. Studies in Second Language Learning and Teaching.

Marino, F. (2025). Digital multimodal composing in an L2 Italian classroom: The effects of digital video projects on students’ development and investment (Publication No. 31843978) [Doctoral dissertation, University of South Florida]. ProQuest.

Negretti, R., & McGrath, L. (2018). Scaffolding genre knowledge and meta-cognition: Insights from an L2 doctoral research writing course. Journal of Second Language Writing, 40, 12-31.

New London Group. (1996). A pedagogy of multiliteracies: Designing social futures. Harvard Educational Review, 66(1), 60-92.

Paltridge, B., & Phakiti, A. (Eds.). (2015). Research methods in applied linguistics: A practical resource. Bloomsbury.

Phakiti, A., De Costa, P., Plonsky, L., & Starfield, S. (Eds.). (2018). The Palgrave handbook of applied linguistics research methodology. Palgrave MacMillan.

Pham, Q. N., & Li, M. (2023). Digital multimodal composing using Visme: EFL students’ perspectives. The Asia-Pacific Education Researcher, 32, 695-706.

Plonsky, L. (2024). Study quality as an intellectual and ethical imperative: A proposed framework. Annual Review of Applied Linguistics, 44, 4-18.

Sato, M., & Loewen, S. (Eds.). (2019). Evidence-based second language pedagogy: A collection of instructed second language acquisition studies. Routledge.

Sato, M., & Loewen, S. (2022). The research-practice dialogue in second language learning and teaching: Past, present, and future. Modern Language Journal, 106(3), 509-527.

Schmidt, R. (1990). The role of consciousness in second language learning. Applied Linguistics, 11(2), 129-158.

Shin, D., & Cimasko, T. (2008). Multimodal composition in a college ESL class: New tools, traditional norms. Computers and Composition, 25(4), 376-395.

Shin, D., Cimasko, T., & Yi, Y. (2020). Development of metalanguage for multimodal composing: A case study of an L2 writer’s design of multimedia texts. Journal of Second Language Writing, 47, 100714.

Swain, M. (1993). The output hypothesis: Just speaking and writing aren’t enough. Canadian Modern Language Review, 50(1), 158-164.

Swain, M., & Lapkin, S. (1998). Interaction and second language learning: Two adolescent French immersion students working together. Modern Language Journal, 82(3), 320-337.

Swales, J. M. (1990). Genre analysis: English in academic and research set-tings. Cambridge University Press.

Swales, J. M. (2004). Research genres: Exploration and applications. Cambridge University Press.

Tan, X. (2023). Stories behind the scenes: L2 students’ cognitive processes of multimodal composing and traditional writing. Journal of Second Language Writing, 59, 100958.

Tardy, C. M., (2005). Expressions of disciplinarity and individuality in a multimodal genre. Computers and Composition, 22(3), 319-336.

Tardy, C. M. (2023). Genre-based writing: What every ESL teacher needs to know. University of Michigan Press.

VanPatten, B., Keating, G. D., & Wulff, S. (2020). Theories in second language acquisition: An introduction (3rd ed.). Routledge.

Vygotsky, L. S. (1978). Mind in society: The development of higher psychological processes. Harvard University Press.

Xu, Y. (2023). Investigating the effects of digital multimodal composing on Chinese EFL learners’ writing performance: A quasi-experimental study. Computer Assisted Language Learning, 36(4), 785-805.

Zhang, M., Akoto, M., & Li, M. (2023). Digital multimodal composing in post-secondary L2 settings: A review of the empirical landscape. Computer Assisted Language Learning, 36(4), 694-721.

Zhang, Y., Peng, J., & Zheng, Y. (2024). Teachers’ perceptions of implementing digital multimodal composing in tertiary classrooms: Voices from Chinese EFL teachers. International Journal of Applied Linguistics, 34(4), 1265-1282.