Keywords
MARSI
MARSI-R
construct validity
confirmatory composite analysis (CCA)
confirmatory factor analysis (CFA)
partial least squared structural equation modeling (PLS-SEM)
How to Cite
Number of views: 552
Number of downloads: 707
Abstract
Language students apply different strategies to learn a second language (L2), especially when they want to attain proficiency in reading. The aim of the present study was to revisit the validity of the Metacognitive Awareness of Reading Strategies Inventory (MARSI-R) among Saudi students using a new statistical method of confirmatory composite analysis (CCA). Past studies modeled MARSI-R as a common factor and applied confirmatory factor analysis (CFA) to test its validity. However, studies struggled to provide support for the validity of the MASRI-R with each suggesting different model. Instead, we treat the inventory as a composite, meaning that the items in MARSI-R form and define the inventory and not the other way around. We use partial least squared structural equation modeling (PLS-SEM) to allow the composite model to be estimated. The results indicated that the constructs of MARSI-R are better operationalized as composites not common factors as supported through CCA exclusively. After confirming the nature of the inventory, we evaluated the extent to which MARSI-R is related to reading proficiency through the mediational mechanism of motivational intensity (i.e., learning effort). Descriptive statistics illustrated that problem-solving strategies are the most used strategy and that females used the strategies more frequently than their male counterparts. Most importantly, the structural model showed that metacognitive reading strategies only exert an indirect effect on reading proficiency, suggesting that the effect of strategies is mediated by motivational intensity (i.e., learning effort). Thus, motivational intensity seems to be mediator in the relationship between metacognitive reading strategies and reading proficiency. Finally, methodological and educational implications are provided.
Funding
This work was supported by the Deanship of Scientific Research, Vice Presi-dency for Graduate Studies and Scientific Research, King Faisal University, Saudi Arabia [Grant No. 2670].
References
Alamer, A. (2022a). Basic psychological needs, motivational orientations, effort, and vocabulary knowledge: A comprehensive model. Studies in Second Language Acquisition, 44, 164-184. DOI: https://doi.org/10.1017/S027226312100005X
Alamer, A. (2022b). Having a single language interest autonomously predicts L2 achievement: Addressing the predictive validity of L2 grit. System, 108, 102850. DOI: https://doi.org/10.1016/j.system.2022.102850
Alamer, A. (2022c). Exploratory structural equation modeling (ESEM) and bifactor ESEM for construct validation purposes: Guidelines and applied example. Research Methods in Applied Linguistics, 1, 100005. DOI: https://doi.org/10.1016/j.rmal.2022.100005
Alamer, A., Al Khateeb, A., & Jeno, L. (2022). Using WhatsApp increases L2 students’ self-motivation and achievement, and decreases learning anxiety: A self-determination theory approach. Journal of Computer Assisted Learning. DOI: https://doi.org/10.1111/jcal.12753
Alamer, A., & Marsh, H. (2022). Exploratory structural equation modeling in second language research: An applied example using the dualistic model of passion. Studies in Second Language Acquisition. DOI: https://doi.org/10.1017/S0272263121000863
Alamer, A., Schuberth, F., & Henseler, J. (in press). Confirmatory composite analysis: A tool for assessing inventories and questionnaires in language learning research. Language Learning.
Alrabai, F., & Alamer, A. (2022). The role of learner character strengths and classroom emotions in L2 resilience. Frontiers in Psychology. 13, 956216. DOI: https://doi.org/10.3389/fpsyg.2022.956216
Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford University Press.
Bachman, L. F., & Palmer, A. (1996). Language testing in practice: Designing and developing useful language tests. Oxford University Press.
Bachman, L. F., & Palmer, A. S. (2010). Language testing in practice (2nd ed.). Oxford University Press.
Cai, Y., & Kunnan, A. J. (2020). Mapping the fluctuating effect of strategy use ability on English reading performance for nursing students: A multi-layered moderation analysis approach. Language Testing, 37, 280-304. DOI: https://doi.org/10.1177/0265532219893384
Carrell, P. L. (1998). Can reading strategies be successfully taught. Australian Review of Applied Linguistics, 21, 1-20. DOI: https://doi.org/10.1075/aral.21.1.01car
Chambers Cantrell, S. & Carter, J. (2009). Relationships among learner characteristics and adolescents’ perceptions about reading strategy use. Reading Psychology, 30, 195-224. DOI: https://doi.org/10.1080/02702710802275397
Cohen, A. D. (2006). The coming of age of research on test-taking strategies. Language Assessment Quarterly, 3, 307-331. DOI: https://doi.org/10.1080/15434300701333129
Cohen, A. D. (2011). L2 learner strategies. In E. Hinkel (Ed.), Handbook of research in second language learning and teaching (Part V). Methods and instruction in second language teaching: Vol. II (pp. 681-698). Routledge.
Cohen, A. D. (2013). Using test-wiseness strategy research in task development. In A. J. Kunnan (Ed.), The companion to language assessment – Vol. 2: Approaches and development, Part 7: Assessment development. Wiley and Sons. DOI: https://doi.org/10.1002/9781118411360.wbcla006
Cohen, A. D., & Upton, T. A. (2007) “I want to go back to the text:” Response strategies on the reading subtest of the New TOEFL. Language Testing, 24(2), 209-250. DOI: https://doi.org/10.1177/0265532207076364
Dirsehan, T., & Henseler, J. (2022). Modeling indices using partial least squares: How to determine the optimum weights? Quality & Quantity, 1-15. DOI: https://doi.org/10.1007/s11135-022-01515-5
Gardner, R. (2010). Motivation and second language acquisition: The socio-educational model. Peter Lang.
Gebril, A. (2018). Test preparation in the accountability era: Toward a learning-oriented approach. TESOL Journal, 9, 4-16. DOI: https://doi.org/10.1002/tesj.302
Griffiths, C. (2018). The strategy factor in successful language learning: The tornado effect. Multilingual Matters. DOI: https://doi.org/10.21832/9781783099757
Griffiths, C., & Soruç, A. (2020). Individual differences in language learning. Palgrave. DOI: https://doi.org/10.1007/978-3-030-52900-0
Guthrie, J. T., Wigfield, A., Barbosa, P., Perencevich, K. C., Taboada, A., Davis, M. H., Scafiddi, N. T., & Tonks, S. (2004). Increasing reading comprehension and engagement through concept-oriented reading instruction. Journal of Educational Psychology, 96(3), 403-423. DOI: https://doi.org/10.1037/0022-0663.96.3.403
Hair, J., & Alamer, A. (2022). Partial least squares structural equation modeling (PLS-SEM) in second language and education research: Guidelines using an applied example. Research Methods in Applied Linguistics, 1(3), 100027. DOI: https://doi.org/10.1016/j.rmal.2022.100027
Henseler, J., & Schuberth, F. (2021). Confirmatory composite analysis. In J. Henseler (Ed.), Composite-based structural equation modeling: Analyzing latent and emergent variables (pp. 179-201). The Guilford Press.
Kunnan, A. J. (1995). Test taker characteristics and test performance: A structural modeling approach. Cambridge University Press.
Lin, L., Lam, J. W.-I., & Tse, S. K. (2019). Test takers’ strategy use and L2 Chinese reading test performance in mainland China: A structural equation approach. Studies in Educational Evaluation, 60, 189-198. DOI: https://doi.org/10.1016/j.stueduc.2019.01.002
Mokhtari, K., Dimitrov, D. M., & Reichard, C. A. (2018). Revising the Metacognitive Awareness of Reading Strategies Inventory (MARSI) and testing for factorial invariance. Studies in Second Language Learning and Teaching, 8(2), 219-246. DOI: https://doi.org/10.14746/ssllt.2018.8.2.3
Mokhtari, K., & Reichard, C. A. (2002). Assessing students’ metacognitive awareness of reading strategies. Journal of Educational Psychology, 94(2), 249-259. DOI: https://doi.org/10.1037/0022-0663.94.2.249
Nassaji, H. (2003). Higher-level and lower-level text processing skills in advanced ESL reading comprehension. Modern Langage Journal, 87, 261-276. DOI: https://doi.org/10.1111/1540-4781.00189
Ondé, D., Jiménez, V., Alvarado, JM., & Gràcia, M. (2022). Analysis of the structural validity of the reduced version of metacognitive awareness of reading strategies inventory. Frontiers in Psychology, 13, 894327. DOI: https://doi.org/10.3389/fpsyg.2022.894327
Oxford, R. (2017). Teaching and researching language learning strategies: Self-regulation in context (2nd ed.). Routledge. DOI: https://doi.org/10.4324/9781315719146
Phakiti, A. (2003). A closer look at the relationship of cognitive and metacognitive strategy use to EFL reading achievement test performance. Language Testing, 20, 26-56. DOI: https://doi.org/10.1191/0265532203lt243oa
Phakiti, A. (2006). Modeling cognitive and metacognitive strategies and their relationships to EFL reading test performance. Melbourne Papers in Language Testing, 11, 53-95.
Phakiti, A. (2008). Construct validation of Bachman and Palmer’s (1996) strategic competence model over time in EFL reading tests. Language Testing, 25(2), 237-272. DOI: https://doi.org/10.1177/0265532207086783
Prichard, C. (2014). Reading strategy use of low- and high-proficiency learners and the effect of reading instruction. Bulletin of Higher Education Okayama University, 10, 115-122.
Purpura, J. E. (1997). An analysis of the relationships between test takers’ cognitive and metacognitive strategy use and second language test performance. Language Learning, 47, 289-325. DOI: https://doi.org/10.1111/0023-8333.91997009
Purpura, J. E. (1998). Investigating the effects of strategy use and second language test performance with high- and low-ability test takers: A structural equation modeling approach. Language Testing, 15(3), 333-379. DOI: https://doi.org/10.1191/026553298669984422
Rivera-Mills, S. V., & Plonsky, L. (2007). Empowering students with language learning strategies: A critical review of current issues. Foreign Language Annals, 40, 535-548. DOI: https://doi.org/10.1111/j.1944-9720.2007.tb02874.x
Schallert, D. L., & Martin, D. B. (2003). A psychological analysis of what teachers and students do in the language arts classroom. In J. Flood, D. Lapp, J. R. Squire, & J. M. Jensen (Eds.), Handbook of research on teaching the English language arts (pp. 31-45). Erlbaum.
Schuberth, F. (2021). Confirmatory composite analysis using partial least squares: Setting the record straight. Review of Managerial Science, 15, 1311-1345. DOI: https://doi.org/10.1007/s11846-020-00405-0
Schuberth, F., Henseler, J., & Dijkstra, T. K. (2018). Confirmatory composite analysis. Frontiers in Psychology, 9(2541). DOI: https://doi.org/10.3389/fpsyg.2018.02541
Schuberth, F., Rademaker, M. E., & Henseler, J. (2022). Assessing the overall fit of composite models estimated by partial least squares path modeling. European Journal of Marketing. DOI: https://doi.org/10.1108/EJM-08-2020-0586
Shao, K., Elahi Shirvan, M., & Alamer, A. (2022). How accurate is your correlation? Different methods derive different results and different interpretations. Frontiers in Psychology, 13, 901412. DOI: https://doi.org/10.3389/fpsyg.2022.901412
Shmueli, G., Sarstedt, M., Hair, J., Cheah, J., Ting, H., Vaithilingam, S., & Ringle, C. (2019). Predictive model assessment in PLS-SEM: Guidelines for using PLSpredict. European Journal of Marketing, 53(11), 2322-2347. DOI: https://doi.org/10.1108/EJM-02-2019-0189
Sparks, R., & Alamer, A. (2022). Long-term impacts of L1 language skills on L2 anxiety: The mediating role of language aptitude and L2 achievement. Language Teaching Research. DOI: https://doi.org/10.1177/13621688221104392
Sparks, R., & Alamer, A. (2023). How does first language achievement impact second language reading anxiety? Exploration of mediator variables. Reading and Writing. DOI: https://doi.org/10.1007/s11145-022-10410-2
Wallace, M., Li, V., Huang, T., & He, N. (2021). Metacognitive strategy use for EFL readers: Differences in gender and reading ability. TESL-EJ, 25(2), 1-22.
Zhang, L. M., Goh, C. M. C., & Kunnan, A. J. (2014). Analysis of test takers’ metacognitive and cognitive strategy use and EFL reading test performance: A multi-sample SEM approach. Language Assessment Quarterly, 11, 76-120. DOI: https://doi.org/10.1080/15434303.2013.853770
License
Copyright (c) 2023 Abdullah Alamer, Ahmad Alsagoafi
This work is licensed under a Creative Commons Attribution 4.0 International License.
1.1 The Author hereby warrants that he/she is the owner of all the copyright and other intellectual property rights in the Work and that, within the scope of the present Agreement, the paper does not infringe the legal rights of another person. The owner of the copyright work also warrants that he/she is the sole and original creator thereof and that is not bound by any legal constraints in regard to the use or sale of the work.
1.2. The Publisher warrants that is the owner of the PRESSto platform for open access journals, hereinafter referred to as the PRESSto Platform.
2. The Author grants the Publisher non-exclusive and free of charge license to unlimited use worldwide over an unspecified period of time in the following areas of exploitation:
2.1. production of multiple copies of the Work produced according to the specific application of a given technology, including printing, reproduction of graphics through mechanical or electrical means (reprography) and digital technology;
2.2. marketing authorisation, loan or lease of the original or copies thereof;
2.3. public performance, public performance in the broadcast, video screening, media enhancements as well as broadcasting and rebroadcasting, made available to the public in such a way that members of the public may access the Work from a place and at a time individually chosen by them;
2.4. inclusion of the Work into a collective work (i.e. with a number of contributions);
2.5. inclusion of the Work in the electronic version to be offered on an electronic platform, or any other conceivable introduction of the Work in its electronic version to the Internet;
2.6. dissemination of electronic versions of the Work in its electronic version online, in a collective work or independently;
2.7. making the Work in the electronic version available to the public in such a way that members of the public may access the Work from a place and at a time individually chosen by them, in particular by making it accessible via the Internet, Intranet, Extranet;
2.8. making the Work available according to appropriate license pattern Attribution 4.0 International (CC BY 4.0) as well as another language version of this license or any later version published by Creative Commons.
3. The Author grants the Publisher permission to reproduce a single copy (print or download) and royalty-free use and disposal of rights to compilations of the Work and these compilations.
4. The Author grants the Publisher permission to send metadata files related to the Work, including to commercial and non-commercial journal-indexing databases.
5. The Author represents that, on the basis of the license granted in the present Agreement, the Publisher is entitled and obliged to:
5.1. allow third parties to obtain further licenses (sublicenses) to the Work and to other materials, including derivatives thereof or compilations made, based on or including the Work, whereas the provisions of such sub-licenses will be the same as with the Attribution 4.0 International (CC BY 4.0) Creative Commons sub-license or another language version of this license, or any later version of this license published by Creative Commons;
5.2. make the Work available to the public in such a way that members of the public may access the Work from a place and at a time individually chosen by them, without any technological constraints;
5.3. appropriately inform members of the public to whom the Work is to be made available about sublicenses in such a way as to ensure that all parties are properly informed (appropriate informing messages).
6. Because of the royalty-free provision of services of the Author (resulting from the scope of obligations stipulated in the present Agreement), the Author shall not be entitled to any author’s fee due and payable on the part of the Publisher (no fee or royalty is payable by the Publisher to the Author).
7.1. In the case of third party claims or actions for indemnity against the Publisher owing to any infractions related to any form of infringement of intellectual property rights protection, including copyright infringements, the Author is obliged to take all possible measures necessary to protect against these claims and, when as a result of legal action, the Publisher, or any third party licensed by the Publisher to use the Work, will have to abandon using the Work in its entirety or in part or, following a court ruling in a legal challenge, to pay damages to a third party, whatever the legal basis
7.2. The Author will immediately inform the Publisher about any damage claims related to intellectual property infringements, including the author’s proprietary rights pertaining to a copyrighted work, filed against the Author. of liability, the Author is obliged to redress the damage resulting from claims made by third party, including costs and expenditures incurred in the process.
7.3. To all matters not settled herein provisions of the Polish Civil Code and the Polish Copyright and Related Rights Act shall apply.