Construct validation of the revised Metacognitive Awareness of Reading Strategies Inventory (MARSI-R) and its relation to learning effort and reading achievement
PDF

Keywords

metacognitive reading strategies
MARSI
MARSI-R
construct validity
confirmatory composite analysis (CCA)
confirmatory factor analysis (CFA)
partial least squared structural equation modeling (PLS-SEM)

How to Cite

Alamer, A., & Alsagoafi, A. (2023). Construct validation of the revised Metacognitive Awareness of Reading Strategies Inventory (MARSI-R) and its relation to learning effort and reading achievement. Studies in Second Language Learning and Teaching, 13(1), 125–149. https://doi.org/10.14746/ssllt.31990

Number of views: 705


Number of downloads: 891

Abstract

Language students apply different strategies to learn a second language (L2), especially when they want to attain proficiency in reading. The aim of the present study was to revisit the validity of the Metacognitive Awareness of Reading Strategies Inventory (MARSI-R) among Saudi students using a new statistical method of confirmatory composite analysis (CCA). Past studies modeled MARSI-R as a common factor and applied confirmatory factor analysis (CFA) to test its validity. However, studies struggled to provide support for the validity of the MASRI-R with each suggesting different model. Instead, we treat the inventory as a composite, meaning that the items in MARSI-R form and define the inventory and not the other way around. We use partial least squared structural equation modeling (PLS-SEM) to allow the composite model to be estimated. The results indicated that the constructs of MARSI-R are better operationalized as composites not common factors as supported through CCA exclusively. After confirming the nature of the inventory, we evaluated the extent to which MARSI-R is related to reading proficiency through the mediational mechanism of motivational intensity (i.e., learning effort). Descriptive statistics illustrated that problem-solving strategies are the most used strategy and that females used the strategies more frequently than their male counterparts. Most importantly, the structural model showed that metacognitive reading strategies only exert an indirect effect on reading proficiency, suggesting that the effect of strategies is mediated by motivational intensity (i.e., learning effort). Thus, motivational intensity seems to be mediator in the relationship between metacognitive reading strategies and reading proficiency. Finally, methodological and educational implications are provided.

https://doi.org/10.14746/ssllt.31990
PDF

Funding

This work was supported by the Deanship of Scientific Research, Vice Presi-dency for Graduate Studies and Scientific Research, King Faisal University, Saudi Arabia [Grant No. 2670].

References

Alamer, A. (2022a). Basic psychological needs, motivational orientations, effort, and vocabulary knowledge: A comprehensive model. Studies in Second Language Acquisition, 44, 164-184. DOI: https://doi.org/10.1017/S027226312100005X

Alamer, A. (2022b). Having a single language interest autonomously predicts L2 achievement: Addressing the predictive validity of L2 grit. System, 108, 102850. DOI: https://doi.org/10.1016/j.system.2022.102850

Alamer, A. (2022c). Exploratory structural equation modeling (ESEM) and bifactor ESEM for construct validation purposes: Guidelines and applied example. Research Methods in Applied Linguistics, 1, 100005. DOI: https://doi.org/10.1016/j.rmal.2022.100005

Alamer, A., Al Khateeb, A., & Jeno, L. (2022). Using WhatsApp increases L2 students’ self-motivation and achievement, and decreases learning anxiety: A self-determination theory approach. Journal of Computer Assisted Learning. DOI: https://doi.org/10.1111/jcal.12753

Alamer, A., & Marsh, H. (2022). Exploratory structural equation modeling in second language research: An applied example using the dualistic model of passion. Studies in Second Language Acquisition. DOI: https://doi.org/10.1017/S0272263121000863

Alamer, A., Schuberth, F., & Henseler, J. (in press). Confirmatory composite analysis: A tool for assessing inventories and questionnaires in language learning research. Language Learning.

Alrabai, F., & Alamer, A. (2022). The role of learner character strengths and classroom emotions in L2 resilience. Frontiers in Psychology. 13, 956216. DOI: https://doi.org/10.3389/fpsyg.2022.956216

Bachman, L. F. (1990). Fundamental considerations in language testing. Oxford University Press.

Bachman, L. F., & Palmer, A. (1996). Language testing in practice: Designing and developing useful language tests. Oxford University Press.

Bachman, L. F., & Palmer, A. S. (2010). Language testing in practice (2nd ed.). Oxford University Press.

Cai, Y., & Kunnan, A. J. (2020). Mapping the fluctuating effect of strategy use ability on English reading performance for nursing students: A multi-layered moderation analysis approach. Language Testing, 37, 280-304. DOI: https://doi.org/10.1177/0265532219893384

Carrell, P. L. (1998). Can reading strategies be successfully taught. Australian Review of Applied Linguistics, 21, 1-20. DOI: https://doi.org/10.1075/aral.21.1.01car

Chambers Cantrell, S. & Carter, J. (2009). Relationships among learner characteristics and adolescents’ perceptions about reading strategy use. Reading Psychology, 30, 195-224. DOI: https://doi.org/10.1080/02702710802275397

Cohen, A. D. (2006). The coming of age of research on test-taking strategies. Language Assessment Quarterly, 3, 307-331. DOI: https://doi.org/10.1080/15434300701333129

Cohen, A. D. (2011). L2 learner strategies. In E. Hinkel (Ed.), Handbook of research in second language learning and teaching (Part V). Methods and instruction in second language teaching: Vol. II (pp. 681-698). Routledge.

Cohen, A. D. (2013). Using test-wiseness strategy research in task development. In A. J. Kunnan (Ed.), The companion to language assessment – Vol. 2: Approaches and development, Part 7: Assessment development. Wiley and Sons. DOI: https://doi.org/10.1002/9781118411360.wbcla006

Cohen, A. D., & Upton, T. A. (2007) “I want to go back to the text:” Response strategies on the reading subtest of the New TOEFL. Language Testing, 24(2), 209-250. DOI: https://doi.org/10.1177/0265532207076364

Dirsehan, T., & Henseler, J. (2022). Modeling indices using partial least squares: How to determine the optimum weights? Quality & Quantity, 1-15. DOI: https://doi.org/10.1007/s11135-022-01515-5

Gardner, R. (2010). Motivation and second language acquisition: The socio-educational model. Peter Lang.

Gebril, A. (2018). Test preparation in the accountability era: Toward a learning-oriented approach. TESOL Journal, 9, 4-16. DOI: https://doi.org/10.1002/tesj.302

Griffiths, C. (2018). The strategy factor in successful language learning: The tornado effect. Multilingual Matters.‏ DOI: https://doi.org/10.21832/9781783099757

Griffiths, C., & Soruç, A. (2020). Individual differences in language learning. Palgrave. DOI: https://doi.org/10.1007/978-3-030-52900-0

Guthrie, J. T., Wigfield, A., Barbosa, P., Perencevich, K. C., Taboada, A., Davis, M. H., Scafiddi, N. T., & Tonks, S. (2004). Increasing reading comprehension and engagement through concept-oriented reading instruction. Journal of Educational Psychology, 96(3), 403-423. DOI: https://doi.org/10.1037/0022-0663.96.3.403

Hair, J., & Alamer, A. (2022). Partial least squares structural equation modeling (PLS-SEM) in second language and education research: Guidelines using an applied example. Research Methods in Applied Linguistics, 1(3), 100027. DOI: https://doi.org/10.1016/j.rmal.2022.100027

Henseler, J., & Schuberth, F. (2021). Confirmatory composite analysis. In J. Henseler (Ed.), Composite-based structural equation modeling: Analyzing latent and emergent variables (pp. 179-201). The Guilford Press.

Kunnan, A. J. (1995). Test taker characteristics and test performance: A structural modeling approach. Cambridge University Press.

Lin, L., Lam, J. W.-I., & Tse, S. K. (2019). Test takers’ strategy use and L2 Chinese reading test performance in mainland China: A structural equation approach. Studies in Educational Evaluation, 60, 189-198. DOI: https://doi.org/10.1016/j.stueduc.2019.01.002

Mokhtari, K., Dimitrov, D. M., & Reichard, C. A. (2018). Revising the Metacognitive Awareness of Reading Strategies Inventory (MARSI) and testing for factorial invariance. Studies in Second Language Learning and Teaching, 8(2), 219-246.‏ DOI: https://doi.org/10.14746/ssllt.2018.8.2.3

Mokhtari, K., & Reichard, C. A. (2002). Assessing students’ metacognitive awareness of reading strategies. Journal of Educational Psychology, 94(2), 249-259. DOI: https://doi.org/10.1037/0022-0663.94.2.249

Nassaji, H. (2003). Higher-level and lower-level text processing skills in advanced ESL reading comprehension. Modern Langage Journal, 87, 261-276. DOI: https://doi.org/10.1111/1540-4781.00189

Ondé, D., Jiménez, V., Alvarado, JM., & Gràcia, M. (2022). Analysis of the structural validity of the reduced version of metacognitive awareness of reading strategies inventory. Frontiers in Psychology, 13, 894327. DOI: https://doi.org/10.3389/fpsyg.2022.894327

Oxford, R. (2017). Teaching and researching language learning strategies: Self-regulation in context (2nd ed.). Routledge. DOI: https://doi.org/10.4324/9781315719146

Phakiti, A. (2003). A closer look at the relationship of cognitive and metacognitive strategy use to EFL reading achievement test performance. Language Testing, 20, 26-56. DOI: https://doi.org/10.1191/0265532203lt243oa

Phakiti, A. (2006). Modeling cognitive and metacognitive strategies and their relationships to EFL reading test performance. Melbourne Papers in Language Testing, 11, 53-95.

Phakiti, A. (2008). Construct validation of Bachman and Palmer’s (1996) strategic competence model over time in EFL reading tests. Language Testing, 25(2), 237-272. DOI: https://doi.org/10.1177/0265532207086783

Prichard, C. (2014). Reading strategy use of low- and high-proficiency learners and the effect of reading instruction. Bulletin of Higher Education Okayama University, 10, 115-122.

Purpura, J. E. (1997). An analysis of the relationships between test takers’ cognitive and metacognitive strategy use and second language test performance. Language Learning, 47, 289-325. DOI: https://doi.org/10.1111/0023-8333.91997009

Purpura, J. E. (1998). Investigating the effects of strategy use and second language test performance with high- and low-ability test takers: A structural equation modeling approach. Language Testing, 15(3), 333-379. DOI: https://doi.org/10.1191/026553298669984422

Rivera-Mills, S. V., & Plonsky, L. (2007). Empowering students with language learning strategies: A critical review of current issues. Foreign Language Annals, 40, 535-548. DOI: https://doi.org/10.1111/j.1944-9720.2007.tb02874.x

Schallert, D. L., & Martin, D. B. (2003). A psychological analysis of what teachers and students do in the language arts classroom. In J. Flood, D. Lapp, J. R. Squire, & J. M. Jensen (Eds.), Handbook of research on teaching the English language arts (pp. 31-45). Erlbaum.

Schuberth, F. (2021). Confirmatory composite analysis using partial least squares: Setting the record straight. Review of Managerial Science, 15, 1311-1345. DOI: https://doi.org/10.1007/s11846-020-00405-0

Schuberth, F., Henseler, J., & Dijkstra, T. K. (2018). Confirmatory composite analysis. Frontiers in Psychology, 9(2541). DOI: https://doi.org/10.3389/fpsyg.2018.02541

Schuberth, F., Rademaker, M. E., & Henseler, J. (2022). Assessing the overall fit of composite models estimated by partial least squares path modeling. European Journal of Marketing. DOI: https://doi.org/10.1108/EJM-08-2020-0586

Shao, K., Elahi Shirvan, M., & Alamer, A. (2022). How accurate is your correlation? Different methods derive different results and different interpretations. Frontiers in Psychology, 13, 901412. DOI: https://doi.org/10.3389/fpsyg.2022.901412

Shmueli, G., Sarstedt, M., Hair, J., Cheah, J., Ting, H., Vaithilingam, S., & Ringle, C. (2019). Predictive model assessment in PLS-SEM: Guidelines for using PLSpredict. European Journal of Marketing, 53(11), 2322-2347. DOI: https://doi.org/10.1108/EJM-02-2019-0189

Sparks, R., & Alamer, A. (2022). Long-term impacts of L1 language skills on L2 anxiety: The mediating role of language aptitude and L2 achievement. Language Teaching Research. DOI: https://doi.org/10.1177/13621688221104392

Sparks, R., & Alamer, A. (2023). How does first language achievement impact second language reading anxiety? Exploration of mediator variables. Reading and Writing. DOI: https://doi.org/10.1007/s11145-022-10410-2

Wallace, M., Li, V., Huang, T., & He, N. (2021). Metacognitive strategy use for EFL readers: Differences in gender and reading ability. TESL-EJ, 25(2), 1-22.

Zhang, L. M., Goh, C. M. C., & Kunnan, A. J. (2014). Analysis of test takers’ metacognitive and cognitive strategy use and EFL reading test performance: A multi-sample SEM approach. Language Assessment Quarterly, 11, 76-120. DOI: https://doi.org/10.1080/15434303.2013.853770