Modeling quality and prestige in applied linguistics journals: A bibliometric and synthetic analysis
PDF

Keywords

Applied Linguistics journals
quality
prestige
perception
publication practices
journal culture

How to Cite

Xu, Y., Zhuang, J., Blair, R., Kim, A. I., Li, F., Hernández, R. T., & Plonsky, L. (2023). Modeling quality and prestige in applied linguistics journals: A bibliometric and synthetic analysis. Studies in Second Language Learning and Teaching, 13(4), 755–779. https://doi.org/10.14746/ssllt.40215

Number of views: 501


Number of downloads: 762

Abstract

The importance of academic journals in second language (L2) research is evident on at least two levels. Journals are, first of all, central to the process of disseminating scientific findings. Journals are also critical on a professional level as most L2 researchers must publish articles to advance their careers. However, not all journals are perceived as equal; some may be considered more prestigious or of higher quality and may, therefore, achieve a greater impact on the field. It is therefore necessary that we understand the identity and quality of L2 research journals, yet very little research (e.g., Egbert, 2007; VanPatten & Williams, 2002) has considered these issues to date. The current study sought to explore L2 journal identity and quality, and the relationship between these constructs. In order to do so, a database was compiled based on three different types of sources: (1) a questionnaire eliciting L2 researchers’ perceptions of the quality and prestige of 27 journals that publish L2 research (N = 327); (2) manual coding of different types of articles (e.g., empirical studies, review papers), data (quantitative, qualitative, mixed), research settings, and authorship patterns (K = 2,024) using the same 27 journals; and (3) bibliometric and submission data such as impact factors, citation counts, and acceptance rates. Descriptive statistics were applied to explore overall quality and prestige ratings as well as publication trends found in each journal. The relationships between those patterns and subjective ratings were also examined. In addition, regression models were built to determine the extent to which perceptions of journal quality and prestige could be explained as a function of journal and article features. We discuss the findings of the study in terms of on-going debates concerning publication practices, study quality, impact factors, journal selection, and the “journal culture” in applied linguistics.

https://doi.org/10.14746/ssllt.40215
PDF

References

Al-Hoorie, A. H., & Vitta, J. P. (2019). The seven sins of L2 research: A review of 30 journals’ statistical quality and their CiteScore, SJR, SNIP, JCR Impact Factors. Language Teaching Research, 23, 727-744. DOI: https://doi.org/10.1177/1362168818767191

American Association for Applied Linguistics. (2019). Promotion & tenure guidelines. https://www.aaal.org/promotion-and-tenure-guidelines

Amini Farsani, M. A., Jamali, H. R., Beikmohammadi, M., Daneshvar Ghorbani, B. D., & Soleimani, L. (2021). Methodological orientations, academic citations, and scientific collaboration in applied linguistics: What do research synthesis and bibliometrics indicate? System, 100, 102547. DOI: https://doi.org/10.1016/j.system.2021.102547

Bhattacharya, U., Jiang, L., & Canagarajah, S. (2020). Race, representation, and diversity in the American Association for Applied Linguistics. Applied Linguistics, 41(6), 999-1004. DOI: https://doi.org/10.1093/applin/amz003

Bhuyan, R., Park, Y., & Lee, E. (2020). Should journal rankings matter? Assigning “prestige and quality” in the neoliberal academy. Journal of Women and Social Work, 35(2), 157-159. DOI: https://doi.org/10.1177/0886109920917247

Chong, S. W., & Plonsky, L. (2023). A typology of secondary research in applied linguistics. Applied Linguistics Review. DOI: https://doi.org/10.1515/applirev-2022-0189

Egbert, J. (2007). Quality analysis of journals in TESOL and applied linguistics. TESOL Quarterly, 41(1), 157-171. DOI: https://doi.org/10.1002/j.1545-7249.2007.tb00044.x

Gass, S., Loewen, S., & Plonsky, L. (2021). Coming of age: The past, present, and future of quantitative SLA research. Language Teaching, 54, 245-258. DOI: https://doi.org/10.1017/S0261444819000430

George, D., & Mallery, P. (2020). IBM SPSS statistics 26 step by step: A simple guide and reference (16th ed.). Routledge. DOI: https://doi.org/10.4324/9780429056765

Haensly, P. J., Hodges, P. E., & Davenport, S. A. (2008). Acceptance rates and journal quality: An analysis of journals in economics and finance. Journal of Business & Finance Librarianship, 14(1), 2-31. DOI: https://doi.org/10.1080/08963560802176330

Hicks, D., Wouters, P., Waltman, L., De Rijcke, S., & Rafols, I. (2015). The Leiden Manifesto for research metrics. Nature, 520, 429-431. DOI: https://doi.org/10.1038/520429a

Jeon, E. H. (2015). Multiple regression. In L. Plonsky (Ed.), Advancing quantitative methods in second language research (pp. 131-159). Routledge. DOI: https://doi.org/10.4324/9781315870908-7

Johnstone, B. (2009). In the profession: Choosing the right journal for your manuscript. Journal of English Linguistics, 37, 375-379. DOI: https://doi.org/10.1177/0075424209348154

Larson-Hall, J. (2015). A guide to doing statistics in second language research using SPSS and R. Routledge. DOI: https://doi.org/10.4324/9781315775661

Larsson, T., Plonsky, L., & Hancock, G. R. (2022). Latent variables in learner cor-pus research: Conceptual and methodological considerations. International Journal of Learner Corpus Research, 8, 237-260. DOI: https://doi.org/10.1075/ijlcr.21007.lar

Lee, K. P., Schotland, M., Bacchetti, P., & Bero, L. A. (2002). Association of journal quality indicators with methodological quality of clinical research articles. JAMA, 287(21), 2805-2808. DOI: https://doi.org/10.1001/jama.287.21.2805

Marsden, E., Mackey A., & Plonsky, L. (2016). The IRIS repository: Advancing research practice and methodology. In A. Mackey & E. Marsden (Eds.), Advancing methodology and practice: The IRIS repository of instruments for research into second languages (pp. 1-21). Routledge. DOI: https://doi.org/10.4324/9780203489666

McIvor, O. (2020). Indigenous language revitalization and applied linguistics: Parallel histories, shared futures? Annual Review of Applied Linguistics, 40, 78-96. DOI: https://doi.org/10.1017/S0267190520000094

Plonsky, L., & Gönülal, T. (2015). Methodological synthesis in quantitative L2 research: A review of reviews and a case study of exploratory factor analysis. Language Learning, 65, Supp. 1, 9-36. DOI: https://doi.org/10.1111/lang.12111

Plonsky, L., & Oswald, F. L. (2014). How big is “big”? Interpreting effect sizes in L2 research. Language Learning, 64, 878-912. DOI: https://doi.org/10.1111/lang.12079

Plonsky, L., & Oswald, F. L. (2015). Meta-analyzing second language research. In L. Plonsky (Ed.), Advancing quantitative methods in second language re-search (pp. 106-128). Routledge. DOI: https://doi.org/10.4324/9781315870908-6

Smith, B., & Lafford, B. A. (2009). The evaluation of scholarly activity in computer-assisted language learning. Modern Language Journal, 93, 868-883. DOI: https://doi.org/10.1111/j.1540-4781.2009.00978.x

Suber, P. (2010). Thoughts on prestige, quality, and open access. Logos, 21(1-2), 115-128. DOI: https://doi.org/10.1163/095796510X546959

VanPatten, B., & Williams, J. (2002). Research criteria for tenure in second language acquisition: Results from a survey of the field. (Unpublished manuscript). The University of Illinois of Chicago, IL.

Varki, A. (2017). Rename the impact factor. Nature, 548(7668), 393-393. DOI: https://doi.org/10.1038/548393c

Weiner, G. (2001). The academic journal: Has it a future? Education Policy Analysis Archives, 9(9), 1-19. DOI: https://doi.org/10.14507/epaa.v9n9.2001

West, R. E., & Rich, P. J. (2012). Rigor, impact and prestige: A proposed frame-work for evaluating scholarly publications. Innovative Higher Education, 37(5), 359-371. DOI: https://doi.org/10.1007/s10755-012-9214-3

Yu, D., Wang, W., Zhang, S., Zhang, W., & Liu, R. (2017). A multiple-link, mutually reinforced journal-ranking model to measure the prestige of journals. Scientometrics, 111, 521-542. DOI: https://doi.org/10.1007/s11192-017-2262-9

Zhao, J., Beckett, G. H., & Wang, L. L. (2017). Evaluating the research quality in education journals in China: Implications for increasing global impact in peripheral countries. Review of Educational Research, 87(3), 583-618. DOI: https://doi.org/10.3102/0034654317690813