Keywords
standardized tests
theory
objectivity
validity
How to Cite
Number of views: 342
Number of downloads: 247
Abstract
Researchers who need valid and objective data for evaluating their theories or the efficacy of educational methods and programs have to choose between two equally undesirable alternatives: either they can use “objective” methods which have a questionable validity, or they can turn to “subjective” assessment methods with better validity. In other words, while subjective approaches to the study of human traits may be, or really are, valid, they lack objectivity, that is, they may be biased toward the researcher’s theory. On the other hand, objective approaches to the study of psychological traits often lack psychological underpinning but are solely designed to fit a certain statistical model. Thus, we cannot know what these instruments really measure. Here I present a new approach to the study of human traits, which claims to be objective as well as psychologically valid, namely the concept Experimental Questionnaire (EQ). An EQ lets us make traits visible without relying on dubious statistical assumptions. Thus, it makes it possible for the researcher to test the psychological theory underlying its designs. The EQ methodology is not only an idea, but it has been applied for constructing the Moral Competence Test (MCT) and for testing the assumptions about the nature of moral competence which were used to design it. So far, all the studies have clearly confirmed their validity. This makes the MCT suitable for testing hypotheses regarding the relevance and teachability of moral competence, and, therefore, also for evaluating the efficacy and efficiency of educational methods of fostering this competence. Experimentally designed questionnaires can also be used in other fields of educational and psychological research in which testable theories about the nature of its objects have been developed.
References
Allerup P. 2007. “Identification of Group Differences Using PISA Scales – Considering Effects of Inhomogeneous Items,” in S. T. Hopmann, G. Brinek, & M. Retzl (Eds.), PISA zufolge PISA (pp. 175–202). Berlin: LIT-Verlag.
Amrein A. L. & Berliner D. 2002. “High-stakes Testing, Uncertainty, and Student Learning,” Education Policy Analysis Archives 10 (18):1–74.
Ausch R. 2016. Methodological Problems with the Academic Sources of Popular Psychology. Lanham: Lexington Books.
Bailey K. 1994. Method of Social Research. New York: The Free Press.
Block J. 1967. “Advancing the Psychology of Personality,” in D. Magnusson & N. Endler (Eds.), Personality at the Crossroads (pp. 37–63). Hillsdale, NJ: Lawrence Erlbaum.
Bühler K. 1927. Die Krise der Psychologie [The crisis of psychology]. Jena: Gustav Fischer.
Cohen R. J. & Swerdlik M. E. 2018. Psychological Testing and Assessment. An Introduction to Tests and Measurement. 9th edition. New York: McGraw Hill.
Colby A., Kohlberg L., Colby A., Speicher B., Hewer A., Candee O., Gibbs J., & Power C. 1987. The Measurement of Moral Judgment: Standard Issue Scoring Manual, Vol. I & II. New York: Cambridge University Press
Donders F. C. 1969 (Orig. 1868). “On the Speed of Mental Processes,” Acta Psychologica. Attention and Performance II, 30:412–431. Retrieved from http://www2.psychology.uiowa.edu/faculty/mordkoff/InfoProc/pdfs/Donders 01868.pdf (on February 25, 2021). DOI: 10.1016/0001-6918(69)90065-1
Emler N., Renwick S., & Malone B. 1983. “The Relationship between Moral Reasoning and Political Orientation,” Journal of Personality and Social Psychology 45:1073–80.
Graumann C. F. 1960. “Eigenschaften als Problem der Persönlichkeitsforschung,” in P. Lersch & H. Thomae (Eds.), Handbuch der Psychologie, Bd. IV, Persönlichkeitsforschung und Persönlichkeitstheorie (pp. 87–154). Göttingen: Hogrefe.
Gregory R. J. 2018. Psychological Testing: History, Principles, and Applications. London, England: Pearson Publisher.
Gulliksen H. 1950. Theory of Mental Tests. New York: Wiley.
Habermas J. 1990. Moral Consciousness and Communicative Action. Cambridge: MIT Press.
Haidt J. 2007. “The New Synthesis in Moral Psychology,” Science 316:998–1002.
Hartshorne H. & May M. A. 1928. Studies in the Nature of Character. Vol. I: Studies in Deceit, Book I & II. New York: Macmillan.
Hemmerling K. 2014. Morality behind Bars – An Intervention Study on Fostering Moral Competence of Prisoners As a New Approach to Social Rehabilitation. Frankfurt/Main: Peter Lang.
Jablonka E. 2007. “Mathematical Literacy: Die Verflüchtigung eines ambitionierten Testkonstrukts in bedeutungslosen PISA-Punkten,“ in T. Jahnke & W. Meyerhöfer (Eds.), Pisa & Co. Kritik eines Programms (pp. 247–280). Hildesheim: Franzbecker.
Keasey Ch. B. 1974. “The Influence of Opinion-agreement and Qualitative Supportive Reasoning in the Evaluation of Moral Judgments,” Journal of Personality and Social Psychology 30:477–482.
Keller M. 1990. “Zur Entwicklung moralischer Reflexion: Eine Kritik und Rekonzeptualisierung der Stufen des präkonventionellen moralischen Urteils in der Theorie von Kohlberg,“ in M. Knopf & W. Schneider (Eds.), Entwicklung. Allgemeine Verläufe – Individuelle Unterschiede (pp. 19–44). Göttingen: Verlag für Psychologie.
Kempf W. 1981. Testtheorie. University of Konstanz, Dept. of Economy and Statistics, a mimeographed paper.
Kohlberg L. 1958. The Development of Modes of Moral Thinking and Choice in the Years 10 to 16. University of Chicago. Unpublished doctoral dissertation.
Kohlberg L. 1964. “Development of Moral Character and Moral Ideology,” in M. L. Hoffman & L. W. Hoffman (Eds.), Review of Child Development Research, Vol. I (pp. 381–431). New York: Russel Sage Foundation.
Kohlberg L. 1976. “Moral Stages and Moralization: The Cognitive-developmental Approach,” in T. Lickona (Ed.), Moral Development and Behavior: Theory, Research and Social Issues (pp. 31–53). New York: Holt, Rinehart & Winston.
Kohlberg L. 1979. The Meaning and Measurement of Moral Development. The Heinz Werner Lecture Series, Vol. 13. Worcester, MA: Clark University Press.
Kohlberg L. 1984. The Psychology of Moral Development. Vol. II: Essays on Moral Development. San Francisco: Harper & Row.
Koretz D. 2017. The Testing Charade. Pretending to Make Schools Better. Chicago: University of Chicago Press.
Kurtines W. M. & Greif E. B. 1974. „The Development of Moral Thought: Review and Evaluation of Kohlberg’s Approach,” Psychological Bulletin 81:453–470.
Levy-Suhl M. 1912. „Die Prüfung der sittlichen Reife jugendlicher Angeklagter und die Reformvorschläge zum § 56 des deutschen Strafgesetzbuches,“ Zeitschrift für Psychotherapie und Medizinische Psychologie 4:232–254.
Lind G. 1978. “Wie misst man moralisches Urteil? Probleme und alternative Möglichkeiten der Messung eines komplexen Konstrukts,” in G. Portele (Ed.), Sozialisation und Moral (pp. 171–201). Weinheim: Beltz.
Lind G. 1982. “Experimental Questionnaires: A New Approach to Personality Research,” in A. Kossakowski & K. Obuchowski (Eds.), Progress in Psychology of Personality (pp. 132–144). Amsterdam, NL: North-Holland.
Lind G. 1985a. “Attitude Change or Cognitive-moral Development? How to Conceive of Socialization at the University,” in G. Lind, H. A. Hartmann, & R. Wakenhut (Eds.), Moral Development and the Social Environment. Studies in the Psychology and Philosophy of Moral Judgment and Education (pp. 173–192). Chicago: Precedent Publishing.
Lind G. 1985b. “The Theory of Moral-cognitive Development: A Socio-psychological Assessment,” in G. Lind, H. A. Hartmann, & R. Wakenhut (Eds.), Moral Development and the Social Environment (pp. 21–53). Chicago: Precedent Publishing Inc.
Lind G. 1986. “Cultural Differences in Moral Judgment Competence? A Study of West and East European University Students,” Behavior Science Research 20:208–225.
Lind G. 1989. “Essay Review: ‘The Measurement of Moral Judgment’ by Anne Colby, Lawrence Kohlberg et al.,” Human Development 32:388–397.
Lind G. 2000. “Moral Regression in Medical Students and Their Learning Environment,” Revista Brasileira de Educacao Médica 24(3):24–33.
Lind G. 2002. Ist Moral lehrbar? Ergebnisse der modernen moralpsychologischen Forschung. 2nd Edition. Berlin: Logos-Verlag.
Lind G. 2005. The Cross-cultural Validity of the Moral Judgment Test:* Findings from 28 Cross-cultural Studies. Presentation at the conference of the American Psychological Association, August 18–21, 2005, Washington, D.C.
Lind G. 2013. “Thirty Years of the Moral Judgment Test:* Support for the Dual-aspect Theory of Moral Development,” in C. S. Hutz & L. K. de Souza (Eds.), Estudos e pesquisas em psicologia do desenvolvimento e da personalidade: uma homenagem a Angela Biaggio (pp. 143–170). São Paulo: Casa do Psicólogo.
Lind G. 2017a. “From Donder’s Dilemma to Objective Internal Assessment: How Experimental Developmental Psychology Can Contribute to Moral Education,” Psychologia Rozwojowa 22(3):15–24.
Lind G. 2017b. Wie kann man moralische Orientierung im Verhalten erkennen? Von Brunswiks diakritischer Methode zum Moralische Kompetenz-Test (MKT). Beitrag zur Moralforschertagung, January 26–28, 2017, Universität Leipzig.
Lind G. 2019. How to Teach Morality. Berlin: Logos.
Lind G. & Nowak E. 2015. “Kohlberg’s Unnoticed Dilemma – The External Assessment of Internal Moral Competence?,” in B. Zizek, D. Garz, & E. Nowak (Eds.), Kohlberg Revisited (pp. 139–154). Rotterdam – Taipei – Boston: Sense Publishers.
Lind G. & Wakenhut R. 2010. “Testing for Moral Judgment Competence,” in G. Lind, H. A. Hartmann, & R. Wakenhut (Eds.), Moral Judgment and Social Education (pp. 79–105). Rutgers, NJ: Transaction Books, 2nd edition.
Linn R. L. 2000. “Assessments and Accountability,” Educational Researcher 29(2):4–16.
Loevinger J. 1957. “Objective Tests as Instruments of Psychological Theory,” Psychological Reports 3:635–694.
Lupu I. 2009. „Moral, Lernumwelt und Religiosität. Die Entwicklung moralischer Urteilsfähigkeit bei Studierenden in Rumänien in Abhängigkeit von Verantwortungsübernahme und Religiosität.“ Doctoral dissertation, University of Konstanz, Germany.
Meehl P. E. 1958. “When to Use Your Head Instead of the Formula?,” in H. Feigl, M. Scriven, & G. Maxwell (Eds.), Minnesota Studies in the Philosophy of Science (pp. 498–506). Minneapolis, MI: University of Minnesota Press.
Micceri T. 198. “The Unicorn, the Normal Curve, and Other Improbable Creatures,” Psychological Bulletin 105(1):156–166.
Piaget J. 1965 (Orig. 1932). The Moral Judgment of the Child. New York: The Free Press.
Piaget J. 1976. “The Affective Unconscious and the Cognitive Unconscious,” in B. Inhelder & H. H. Chipman (Eds.), Piaget and His School (pp. 63–71). New York: Springer.
Popper K. R. 1968. Conjectures and Refutations. New York: Harper & Row.
Prehn K. 2013. “Moral Judgment Competence: A Re-evaluation of the Dual-Aspect Theory
Based on Recent Neuroscientific Research,” in E. Nowak, D. Schrader, & B. Zizek (Eds.), Educating Competencies for Democracy (pp. 9–22). Frankfurt am Main – Bern – Brussells – New York: Peter Lang Editions.
Ravitch D. 2013. The Death and Life of the Great American School System: How Testing and Choice Are Undermining Education. New York: Basic Book.
Rest J. R. 1969. “Level of Moral Development As a Determinant of Preference and Comprehension of Moral Judgments Made by Others,” Journal of Personality 37(1):220–228.
Rest J. R. 1979. Development in Judging Moral Issues. Minneapolis, MI: University of Minnesota Press.
Rosnow R. L. & Rosenthal R. 1997. People Studying People. Artifacts and Effects on Behavioral Research. New York: Freeman & Co.
Ryle G. 1949. The Concept of Mind, Chicago: University of Chicago Press.
Scott W. A. 1968. “Attitude Measurement,” in G. Lindsey & E. Aronson (Eds.), Handbook of Social Psychology. Vol. II (pp. 204–273). Reading, MA: Addison-Wesley.
Saeidi-Parvaneh S. 2011. Moral, Bildung und Religion im Iran – Zur Bedeutung universitärer Bildung für die Entwicklung moralischer Urteils- und Diskursfähigkeit in einem religiös geprägten Land. Doctoral Dissertation, University of Konstanz.
Schillinger M. 2006. Learning Environments and Moral Development: How University Education Fosters Moral Judgment Competence in Brazil and two German-speaking Countries. Aachen: Shaker Verlag.
Schoenfeld A. H. 1999. “Looking Toward the 21th Century: Challenges of Educational Theory and Practice,” Educational Researcher 28:4–14.
Sjoberg S. 2007. “PISA and ‘Real Life Challenge’: Mission Impossible?,” in S. T. Hopfmann et al. (Eds.), PISA zufolge PISA (pp. 201–224). Berlin: LIT-Verlag.
Sjoberg S. 2017. “PISA Testing – A Global Educational Race?,” Europhysics News.
https://www.europhysicsnews.org/articles/epn/pdf/2017/04/epn2017484p17.pdf
Travers R. M. 1951. “Rational Hypotheses in the Construction of Tests,” Educational and Psychological Measurement 11:128–137.
Walberg H. J., Strykowski B. F., Rovai E., & Hung S. 1984. „Exceptional Performance,” Review of Educational Research 54(1):87–112.
Walberg H. J. & Haertel G. D. 1994. „The Implications of Cognitive Psychology for Measuring Student Achievement,” in OECD (Ed.), Making Education Count (pp. 219–236). Paris: OECD.
Watson J. B. 1970 (Orig. 1924). Behaviorism. New York: Norton.
Wilson M. 2005. Constructing Measures. An Item Response Modeling Approach. Mahwah, NJ: Erlbaum Associates Publishers.
Wittgenstein L. 1953. Philosophical Investigations. Trans. by G.E.M. Anscombe. New York: The Macmillan Company.
Wuttke J. 2005. “Fehler, Verzerrungen, Unsicherheiten in der PISA-Auswertung” [Errors, biases, uncertainties in PISA interpretation], in T. Jahnke & W. Meyerhöfer (Eds.), Pisa & Co. Kritik eines Programms (pp. 101–154). Hildesheim: Franzbecker.
Wuttke J. 2007. “Uncertainties and Bias in PISA,” in S. T. Hopmann, G. Brinek, & M. Retzl (Eds.), PISA zufolge PISA (pp. 241–264). Berlin: LIT Verlag.