Abstract
In this single-case study with a quasi-experimental design, we set out to examine the role of two input-based features of the language learning app Duolingo on learners’ development of implicit and explicit second language (L2) knowledge. We investigated the effect of Duolingo’s Stories feature and Podcast feature on two Spanish-L2 learners’ performance on a battery of implicit and explicit L2 knowledge tests. Once a week, over a four-week period using these input-based features, both participants repeatedly performed oral narrative tasks, timed and untimed grammaticality judgment tasks, and metalinguistic knowledge tests. The participant assigned to the Podcast condition showed meager gains in productive implicit knowledge (measured by oral narrative tasks) but decreased in receptive explicit knowledge (measured by untimed grammaticality judgment tasks). The participant assigned to the Stories condition showed a large increase in receptive implicit knowledge of Spanish (measured by timed grammaticality judgment tasks). Neither participant showed meaningful gains in the measure of productive explicit knowledge (measured by metalinguistic knowledge tasks). Although there was a slight increase in receptive explicit knowledge for the participant using Stories, the data from both participants discount the idea that app-based mobile-assisted language learning (MALL) prioritizes receptive explicit L2 knowledge, at least when considering these novel input-based features of Duolingo. These findings add nuance to previous research showing that the primary outcome of MALL app use is receptive explicit L2 knowledge.
References
Ajisoko, P. (2020). The use of Duolingo apps to improve English vocabulary learning. International Journal of Emerging Technologies in Learning, 15(7), 149-155. DOI: https://doi.org/10.3991/ijet.v15i07.13229
Al-Sabbagh, K. W., Bradley, L., & Bartram, L. (2018). Mobile language learning applications for Arabic speaking migrants: A usability per-spective. Language Learning in Higher Education, 9(1), 71-95. DOI: https://doi.org/10.1515/cercles-2019-0004
Andringa, S., & Rebuschat, P. (2015). New directions in the study of implicit and explicit learning: An introduction. Studies in Second Language Acquisition, 37(2), 185-196. DOI: https://doi.org/10.1017/S027226311500008X
Antonia, T. G., & Pierpaolo, L. (2020). E-learning, MALL and LMOOC or a new didactic tendency in foreign language learning: A meta-analysis from 2014 to 2018. Psychology, 11(4), 581-593. DOI: https://doi.org/10.4236/psych.2020.114039
Burston, J. (2015). Twenty years of MALL project implementation: A meta-analysis of learning outcomes. ReCALL, 27(1), 4-20. DOI: https://doi.org/10.1017/S0958344014000159
Chen, X., Meurers, D., & Rebuschat, P. (2022). ICALL offering individually adaptive input: Effects of complex input on L2 development. Language Learning & Technology, 26(1), 1-21.
Chwo, G. S. M., Marek, M. W., & Wu, W. C. V. (2018). Meta-analysis of MALL research and design. System, 74, 62-72. DOI: https://doi.org/10.1016/j.system.2018.02.009
Cross, J. (2014). Promoting autonomous listening to podcasts: A case study. Language Teaching Research, 18(1), 8-32. DOI: https://doi.org/10.1177/1362168813505394
Crowther, D., Kim, K. M., & Loewen, S. (2017). The implementation of ISLA in MALL technology: An investigation into the potential effectiveness of Duolingo. MSU Working Papers in SLS, 8, 20-39.
de Vos, J. F., Schriefers, H., Nivard, M. G., & Lemhöfer, K. (2018). A meta-analysis and meta-regression of incidental second language word learning from spoken input. Language Learning, 68(4), 906-941. DOI: https://doi.org/10.1111/lang.12296
DeKeyser, R. (2017). Knowledge and skill in ISLA. In S. Loewen & M. Sato (Eds.), The Routledge handbook of instructed second language acquisition (pp. 15-32). Routledge. DOI: https://doi.org/10.4324/9781315676968-2
Ellis, R. (2005). Measuring implicit and explicit knowledge of a second language. Studies in Second Language Acquisition, 27(2), 141-172. DOI: https://doi.org/10.1017/S0272263105050096
Ellis, R., & Roever, C. (2021). The measurement of implicit and explicit knowledge. Language Learning Journal, 49(2), 160-175. DOI: https://doi.org/10.1080/09571736.2018.1504229
Fouz-González, J. (2019). Podcast-based pronunciation training: Enhancing FL learners’ perception and production of fossilized segmental features. ReCALL, 31(2), 150-159. DOI: https://doi.org/10.1017/S0958344018000174
García Botero, G., Questier, F., & Zhu, C. (2019). Self-directed language learning in a mobile-assisted, out-of-class context: Do students walk the talk? Computer Assisted Language Learning, 32(1-2), 71-97. DOI: https://doi.org/10.1080/09588221.2018.1485707
Godfroid, A. (2022). Hypotheses about the interface between explicit and implicit knowledge in second language acquisition. In A. Godfroid & H. Hopp (Eds.), The Routledge handbook of second language acquisition and psycholinguistics (pp. 294-307). Routledge. DOI: https://doi.org/10.4324/9781003018872-28
Hasan, M. M., & Hoon, T. B. (2013). Podcast applications in language learning: A review of recent studies. English Language Teaching, 6(2), 128-135. DOI: https://doi.org/10.5539/elt.v6n2p128
Isbell, D. R., Rawal, H., Oh, R., & Loewen, S. (2017). Narrative perspectives on self-directed foreign language learning in a computer- and mobile-assisted language learning context. Languages, 2(2), 4. DOI: https://doi.org/10.3390/languages2020004
Jiang, X., Rollinson, J., Plonsky, L., & Pajak, B. (2020). Duolingo efficacy study: Beginning-level courses equivalent to four university semes-ters. Duolingo Research Report DRR-20-04.
Kang, E. Y., Sok, S., & Han, Z. (2019). Thirty-five years of ISLA on form-focused instruction: A meta-analysis. Language Teaching Research, 23(4), 428-453. DOI: https://doi.org/10.1177/1362168818776671
Krashen, S. (2014). Does Duolingo “trump” university-level language learning? International Journal of Foreign Language Teaching, 9(1), 13-15.
Kukulska-Hulme, A., Lee, H., & Norris, L. (2017). Mobile learning revolution: Implications for language pedagogy. In C. Chapelle & S. Sauro (Eds.), The handbook of technology and second language teaching and learning (pp. 217-233). Wiley-Blackwell. DOI: https://doi.org/10.1002/9781118914069.ch15
Kukulska-Hulme, A., & Viberg, O. (2018). Mobile collaborative language learning: State of the art. British Journal of Educational Technology, 49(2), 207-218. DOI: https://doi.org/10.1111/bjet.12580
Leow, R. (2019). ISLA: How implicit or how explicit should it be? Theoretical, empirical, and pedagogical/curricular issues. Language Teaching Research, 23(4), 476-493. DOI: https://doi.org/10.1177/1362168818776674
Lin, J. J., & Lin, H. (2019). Mobile-assisted ESL/EFL vocabulary learning: A systematic review and meta-analysis. Computer Assisted Language Learning, 32(8), 878-919. DOI: https://doi.org/10.1080/09588221.2018.1541359
Loewen, S., Crowther, D., Isbell, D. R., Kim, K. M., Maloney, J., Miller, Z. F., & Rawal, H. (2019). Mobile-assisted language learning: A Duolingo case study. ReCALL, 31(3), 293-311. DOI: https://doi.org/10.1017/S0958344019000065
Loewen, S., Isbell, D. R., & Sporn, Z. (2020). The effectiveness of app-based language instruction for developing receptive linguistic knowledge and oral communicative ability. Foreign Language Annals, 53(2), 209-233. DOI: https://doi.org/10.1111/flan.12454
Lomicka, L., & Lord, G. (2010). Podcasting – past, present and future: Applications of academic podcasting in and out of the language class-room. In B. R. Facer & M. Abdous (Eds.), Academic podcasting and mobile assisted language learning: Applications and outcomes (pp. 1-20). IGI Global. DOI: https://doi.org/10.4018/978-1-60960-141-6.ch001
Long, M. H. (2020). Optimal input for language learning: Genuine, simplified, elaborated, or modified elaborated? Language Teaching, 53(2), 169-182. DOI: https://doi.org/10.1017/S0261444819000466
Lord, G. (2008). Podcasting communities and second language pronunciation. Foreign Language Annals, 41(2), 364-379. DOI: https://doi.org/10.1111/j.1944-9720.2008.tb03297.x
Meurers, D. (2021). Natural language processing and language learning. In C. A. Chapelle (Ed.), The encyclopedia of applied linguistics. Wiley. DOI: https://doi.org/10.1002/9781405198431.wbeal0858.pub2
Mostafa, T., & Kim, Y. J. (2021). The effects of input and output based instruction on the development of L2 explicit and automatized explicit knowledge: A classroom based study. Language Awareness, 30(1), 17-41. DOI: https://doi.org/10.1080/09658416.2020.1760292
Munday, P. (2016). The case for using Duolingo as part of the language classroom experience Duolingo como parte del curriculum de las clases de lengua extranjera. RIED V, 19(1), 83-101. DOI: https://doi.org/10.5944/ried.19.1.14581
Nation, P. (2007). The four strands. Innovation in Language Learning and Teaching, 1(1), 2-13. DOI: https://doi.org/10.2167/illt039.0
O’Bryan, A., & Hegelheimer, V. (2007). Integrating CALL into the classroom: The role of podcasting in an ESL listening strategies course. ReCALL, 19(2), 162-180. DOI: https://doi.org/10.1017/S0958344007000523
Philp, J. (2009). Pathways to proficiency: Learning experiences and attainment in implicit and explicit knowledge of English as a second language. In R. Ellis, S. Loewen, C. Elder, R. Erlam, J. Philp, & H. Reinders (Eds.), Implicit and explicit knowledge in second language learning, testing and teaching (pp. 194-215). Multilingual Matters. DOI: https://doi.org/10.21832/9781847691767-010
Piske, T., & Young-Scholten, M. (Eds.). (2008). Input matters in SLA. Multilingual Matters. DOI: https://doi.org/10.21832/9781847691118
Plonsky, L., Marsden, E., Crowther, D., Gass, S. M., & Spinner, P. (2020). A methodological synthesis and meta-analysis of judgment tasks in second language research. Second Language Research, 36(4), 583-621. DOI: https://doi.org/10.1177/0267658319828413
Rachels, J. R., & Rockinson-Szapkiw, A. J. (2018). The effects of a mobile gamification app on elementary students’ Spanish achievement and self-efficacy. Computer Assisted Language Learning, 31(1-2), 72-89. DOI: https://doi.org/10.1080/09588221.2017.1382536
Rawson, K. A., & Dunlosky, J. (2011). Optimizing schedules of retrieval practice for durable and efficient learning: How much is enough? Journal of Experimental Psychology: General, 140(3), 283-302. DOI: https://doi.org/10.1037/a0023956
Rebuschat, P. (2013). Measuring implicit and explicit knowledge in second language research. Language Learning, 63(3), 595-626. DOI: https://doi.org/10.1111/lang.12010
Reinders, H., & Ellis, R. (2009). Effects of two types of positive enhanced input on intake and L2 acquisition. In R. Ellis, S. Loewen, C. Elder, R. Erlam, J. Philp, & H. Reinders (Eds.), Implicit and explicit knowledge in second language learning (pp. 281-302). Multilingual Matters. DOI: https://doi.org/10.21832/9781847691767-014
Roehr, K., & Gánem-Gutiérrez, G. A. (2009). The status of metalinguistic knowledge in instructed adult L2 learning. Language Awareness, 18(2), 165-181. DOI: https://doi.org/10.1080/09658410902855854
Rosell-Aguilar, F. (2007). Top of the pods – in search of a podcasting “po-dagogy” for language learning. Computer Assisted Language Learning, 20(5), 471-492. DOI: https://doi.org/10.1080/09588220701746047
Rosell-Aguilar, F. (2013). Podcasting for language learning through iTunes U: The learner’s view. Language Learning and Technology, 17(3), 74-93.
Rostami, M. A., Azarnoosh, M., & Abdolmanafi-Rokni, S. J. (2017). The effect of podcasting on Iranian EFL learners’ motivation and attitude. Theory and Practice in Language Studies, 7(1), 70. DOI: https://doi.org/10.17507/tpls.0701.09
Ruiz, S., Rebuschat, P., & Meurers, D. (2021). The effects of working memory and declarative memory on instructed second language vocabulary learning: Insights from intelligent CALL. Language Teaching Research, 25, 510-539. DOI: https://doi.org/10.1177/1362168819872859
Ruiz, S., Rebuschat, P., & Meurers, D. (2024). Supporting individualized practice through intelligent CALL. In Y. Suzuki (Ed.), Practice and automatization in second language research: Perspectives from skill acquisition theory and cognitive psychology (pp. 119-143). Routledge. DOI: https://doi.org/10.4324/9781003414643-7
Savvani, S. (2019). State-of-the-art Duolingo features and applications. Advances in Intelligent Systems and Computing, 917, 139-148. DOI: https://doi.org/10.1007/978-3-030-11935-5_14
Schmidt, J. (2008). Podcasting as a learning tool: German language and culture every day. Die Unterrichtspraxis/Teaching German, 41, 186-194. DOI: https://doi.org/10.1111/j.1756-1221.2008.00023.x
Sharwood Smith, M. (1993). Input enhancement in instructed SLA: Theoretical bases. Studies in Second Language Acquisition, 15(2), 165-179. DOI: https://doi.org/10.1017/S0272263100011943
Spinner, P., & Gass, S. (2019). Using judgments in second language acquisi-tion research. Routledge. DOI: https://doi.org/10.4324/9781315463377
Sudina, E., & Plonsky, L. (2023). The effects of frequency, duration, and intensity on L2 learning through Duolingo: A natural experiment. Journal of Second Language Studies. DOI: https://doi.org/10.1075/jsls.00021.plo
Suzuki, Y. (2017). Validity of new measures of implicit knowledge: Distinguishing implicit knowledge from automatized explicit knowledge. Applied Psycholinguistics, 38(5), 1229-1261. DOI: https://doi.org/10.1017/S014271641700011X
Suzuki, Y. (Ed.). (2024). Practice and automatization in second language research: Perspectives from skill acquisition theory and cognitive psy-chology. Routledge. DOI: https://doi.org/10.4324/9781003414643
Suzuki, Y., & DeKeyser, R. (2017). The interface of explicit and implicit knowledge in a second language: Insights from individual differences in cognitive aptitudes. Language Learning, 67(4), 747-790. DOI: https://doi.org/10.1111/lang.12241
Teske, K. (2017). Duolingo. Computer Assisted Language Instruction Consortium, 34(3), 393-402. DOI: https://doi.org/10.1558/cj.32509
Torres, J., Estremera, R., & Mohamed, S. (2019). The contribution of psychosocial and biographical variables to heritage language learners’ linguistic knowledge of Spanish. Studies in Second Language Acquisition, 41(4), 695-719. DOI: https://doi.org/10.1017/S0272263119000184
Toto, G. A., & Limone, P. (2019). Contemporary trends in studies on mobile learning of foreign languages: A meta-analysis. International Journal of Engineering Education, 1(2), 85-90. DOI: https://doi.org/10.14710/ijee.1.2.85-90
VanPatten, B. (2018). El Secreto. In Cuentos Cortos Volume 1: Flash fiction in Spanish for novice and intermediate levels (pp. 1-6). Input and More.
Verspoor, M. H., de Bot, K., & Lowie, W. (Eds.). (2011). A dynamic approach to second language development. John Benjamins. DOI: https://doi.org/10.1075/lllt.29
Vesselinov, R., & Grego, J. (2012). Duolingo effectiveness study. Duolingo. 1-25. http://static.duolingo.com/s3/DuolingoReport_Final.pdf
Yin, R. K. (2018). Case study research and applications: Design and methods (6th ed.). SAGE.
Ziegler, N., Meurers, D., Rebuschat, P., Ruiz, S., Moreno Vega, J. L., Chinkina, M., Li, W., & Grey, S. (2017). Interdisciplinary research at the inter-section of CALL, NLP, and SLA: Methodological implications from an input enhancement project. Language Learning, 67, 209-231. DOI: https://doi.org/10.1111/lang.12227
License
Copyright (c) 2024 Anthony Brandy, Phil Hiver
This work is licensed under a Creative Commons Attribution 4.0 International License.
1.1 The Author hereby warrants that he/she is the owner of all the copyright and other intellectual property rights in the Work and that, within the scope of the present Agreement, the paper does not infringe the legal rights of another person. The owner of the copyright work also warrants that he/she is the sole and original creator thereof and that is not bound by any legal constraints in regard to the use or sale of the work.
1.2. The Publisher warrants that is the owner of the PRESSto platform for open access journals, hereinafter referred to as the PRESSto Platform.
2. The Author grants the Publisher non-exclusive and free of charge license to unlimited use worldwide over an unspecified period of time in the following areas of exploitation:
2.1. production of multiple copies of the Work produced according to the specific application of a given technology, including printing, reproduction of graphics through mechanical or electrical means (reprography) and digital technology;
2.2. marketing authorisation, loan or lease of the original or copies thereof;
2.3. public performance, public performance in the broadcast, video screening, media enhancements as well as broadcasting and rebroadcasting, made available to the public in such a way that members of the public may access the Work from a place and at a time individually chosen by them;
2.4. inclusion of the Work into a collective work (i.e. with a number of contributions);
2.5. inclusion of the Work in the electronic version to be offered on an electronic platform, or any other conceivable introduction of the Work in its electronic version to the Internet;
2.6. dissemination of electronic versions of the Work in its electronic version online, in a collective work or independently;
2.7. making the Work in the electronic version available to the public in such a way that members of the public may access the Work from a place and at a time individually chosen by them, in particular by making it accessible via the Internet, Intranet, Extranet;
2.8. making the Work available according to appropriate license pattern Attribution 4.0 International (CC BY 4.0) as well as another language version of this license or any later version published by Creative Commons.
3. The Author grants the Publisher permission to reproduce a single copy (print or download) and royalty-free use and disposal of rights to compilations of the Work and these compilations.
4. The Author grants the Publisher permission to send metadata files related to the Work, including to commercial and non-commercial journal-indexing databases.
5. The Author represents that, on the basis of the license granted in the present Agreement, the Publisher is entitled and obliged to:
5.1. allow third parties to obtain further licenses (sublicenses) to the Work and to other materials, including derivatives thereof or compilations made, based on or including the Work, whereas the provisions of such sub-licenses will be the same as with the Attribution 4.0 International (CC BY 4.0) Creative Commons sub-license or another language version of this license, or any later version of this license published by Creative Commons;
5.2. make the Work available to the public in such a way that members of the public may access the Work from a place and at a time individually chosen by them, without any technological constraints;
5.3. appropriately inform members of the public to whom the Work is to be made available about sublicenses in such a way as to ensure that all parties are properly informed (appropriate informing messages).
6. Because of the royalty-free provision of services of the Author (resulting from the scope of obligations stipulated in the present Agreement), the Author shall not be entitled to any author’s fee due and payable on the part of the Publisher (no fee or royalty is payable by the Publisher to the Author).
7.1. In the case of third party claims or actions for indemnity against the Publisher owing to any infractions related to any form of infringement of intellectual property rights protection, including copyright infringements, the Author is obliged to take all possible measures necessary to protect against these claims and, when as a result of legal action, the Publisher, or any third party licensed by the Publisher to use the Work, will have to abandon using the Work in its entirety or in part or, following a court ruling in a legal challenge, to pay damages to a third party, whatever the legal basis
7.2. The Author will immediately inform the Publisher about any damage claims related to intellectual property infringements, including the author’s proprietary rights pertaining to a copyrighted work, filed against the Author. of liability, the Author is obliged to redress the damage resulting from claims made by third party, including costs and expenditures incurred in the process.
7.3. To all matters not settled herein provisions of the Polish Civil Code and the Polish Copyright and Related Rights Act shall apply.