Abstract
This article presents an evaluation of the LSP-TEOC.Pro project. It sets out the evaluation methodology applied, how it was implemented and the key evaluation findings. Given the exploratory nature of the project, the range and complexity of the intervening variables involved and logistical constraints, it was not possible to use an experimental evaluation approach. Instead, the evaluation used an approach based on a ‘realist’ and ‘theory-driven’ framework to test whether the ‘mechanisms’ implicit in the project theory of change were supported by the evidence. The evaluation showed that LSP-TEOC.PRO has progressed significantly along its ‘change journey’, although further effort is required going forward to support scaling up and out, so that the project has an impact at the macro level.
Funding
the Erasmus+ programme of the European Union (Reference Number: 2020-1-DE01-005687). Project title: LSPTEOC. Pro (Language for Specific Purposes Teacher Education Online Course for Professional Development)
References
Astbury, B. / Leeuw, F.L. (2010). Unpacking black boxes: Mechanisms and theory building in evaluation. American Journal of Evaluation, 31(3), 363–381. DOI: https://doi.org/10.1177/1098214010371972
Befani, B. (2012). Models of causality and causal inference. In: E. Stern / N. Stame / J. Mayne / K. Forss / R. Davies / B. Befani (eds.), Broadening the range of designs and methods for impact evaluations (DFID Working Paper 38) (pp. Annex to the report). London: Department for International Development. https://assets.publishing.service.gov.uk/media/5a79d0d240f0b66d161ae57c/design-method-impact-eval.pdf
Campbell, D.T. / Stanley, J.C. (1973). Experimental and quasi-experimental designs for research. Chicago: Rand McNally.
Chen, H.-T. / Rossi, P.H. (1989). Issues in the theory-driven perspective. Evaluation and Program Planning, 12(4), 299–306. DOI: https://doi.org/10.1016/0149-7189(89)90046-3
Ferraro, P. (2009). Counterfactual thinking and impact evaluation in environmental policy. New Directions for Evaluation, 122, 75–84. DOI: https://doi.org/10.1002/ev.297
Guba, E.G. / Lincoln, Y.S. (1989). Fourth generation evaluation. London: Sage.
Loi, M. / Rodriguez, M. (2012). A note on the impact evaluation of public policies: The counterfactual analysis. Seville: JRC Scientific and Policy Reports.
LSP-TEOC. Pro website: https://lsp-teoc-pro.de/
Pawson, R. / Tilley, N. (1997). Realistic evaluation. London: Sage.
Weiss, C (1995). Nothing as practical as good theory: Exploring theory-based evaluation for comprehensive community initiatives for children and families. In: J. Connell / A.C. Kubisch / L.B. Schorr / C.H. Weiss (eds.), New approaches to evaluating community initiatives: Concepts, methods, and contexts (pp. 65–92). Washington: Aspen Institute.
License
Copyright (c) 2025 Joseph Cullen, Gregory Holloway
This work is licensed under a Creative Commons Attribution-NoDerivatives 4.0 International License.
Authors
Authors of texts accepted for publication in Glottodidactica are required to complete, sign and return to the Editorial team’s office the Agreement for granting a royalty-free license to works with a commitment to grant a CC sub-license.
Under the agreement, the authors of the texts published in Glottodidactica grant Adam Mickiewicz University in Poznań a non-exclusive, royalty-free license and authorize the use of Attribution-NoDerivatives 4.0 International (CC BY-ND 4.0) Creative Commons sub-license.
The authors retain the right to the free disposal of the work.
Users
Interested Internet users are entitled to use works that have been published in Glottodidactica since 2016, under the following conditions:
▪ attribution – obligation to provide, together with the distributed work, information about the authorship, title, source (link to the original work, DOI) and the license itself.
▪ no derivatives – the work must be preserved in its original form. Without the author's consent, it is not possible to distribute the modified work in the form of translations, publications, etc.
Copyrights are reserved for all texts published before 2016.
Miscellaneous
Adam Mickiewicz University in Poznań retains the property right as a whole (layout, graphic form, title, cover design, logo etc.).
Privacy statement
The names and email addresses published on this journal site will be used exclusively for the purposes declared by this journal and cannot be used for any other purpose or by any other party.