Bias in the Assessment of Regulation Activities in Studying at the Level of Higher Education
Abstract
This article presents the results of a comparison between two questionnaires about regulation activities related to studying in higher education. The questionnaire developed within a different educational setting appears to be less discriminative and predictive than an equally developed local version. Due to cultural bias, the external regulation activities cause the main difference. Nevertheless, the factorial structure of the regulation activity scales seems to be invariant over different domains of study within the same educational setting. The bias in the assessment of regulation activities is significantly stronger in the group of students with the lower and medium level of general thinking skills. Furthermore, we found that a higher level of regulation skills can compensate for a lower level of general thinking skills. Evidence is discussed that the specificity of metacognitive skills about studying is domain-independent, but situation-bounded.
References
Ajisuksmo, C. Vermunt, J.D.H.M. (1995, August). Self-regulated learning in Indonesian higher education: The effects of reciprocal teaching and co-operative learning on students' learning strategies and students' academic performance . Paper presented at the 6th European Conference for Research on Learning and Instruction, Nijmegen, The NetherlandsBaker, L. (1982). An evaluation of the role of metacognitive deficits in learning disabilities. Topics in Learning and Learning Disabilities, 2, 27– 35Birkmire, D.P. (1987). Text processing: The role of reader expectations and background knowledge . Aberdeen: U. S. Army Human Engineering LaboratoryBrown, A.L. (1987). Metacognition, executive control, self-regulation and other more mysterious mechanisms. In F.E. Weinert & R.H. Kluwe (Eds.), Metacognition, motivation and understanding (pp. 65-116). Hillsdale, NJ: ErlbaumBrown, A.L. Collins, A. Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18 (1), 32– 42Byrne, B.M. (1989). A primer of LISREL. Basis applications and programming for confirmatory analytic models . New York: Springer-VerlagCampione, J.C. Brown, A.L. (1978). Toward a theory of intelligence: Contributions from research with retarded children. Intelligence, 2, 279– 304Collins, A. Brown, J.S. Newman, S.E. (1989). Cognitive apprenticeship: Teaching the craft of reading, writing and mathematics. In L.B. Resnick (Ed.), Knowing, learning and instruction. Essays in honor of Robert Glaser (pp. 453-494). Hillsdale, NJ: ErlbaumEntwistle, N.J. (1992). The impact of teaching on learning outcomes in higher education: A literature review . Sheffield/UK: USDUGarner, R. (1987). Metacognition and reading comprehension . Norwood, NJ: AblexHeim, A.W. Watts, K.P. Simmonds, V. (1982). Manual for the AH 6 group tests of high-level intelligence . Windsor/UK: NFER-NelsonJanssen, P.J. (1995, May). Teaching: Facilitating effective studying in each of its 3 × 3 components . Paper presented at the Second International Symposium on Understanding Understanding, Edinburgh, UKJanssen, P.J. (1996). Studaxology: The expertise students need to be effective in higher education. Higher Education, 31 (1), 117– 141Jöreskog, K.G. Sörbom, D. (1989). LISREL 7: User's reference guide . Chicago: Scientific SoftwareJöreskog, K.G. Sörbom, D. (1993). LISREL 8: Structural equation modeling with the SIMPLIS command language . Chicago: Scientific SoftwareKaroly, P. (1993). Mechanisms of self-regulation: A systems view. Annual Review of Psychology, 44, 23– 52Kluwe, R.H. (1987). Executive decisions and regulation of problem solving behavior. In F.E. Weinert & R.H. Kluwe (Eds.), Metacognition, motivation and understanding (pp. 31-64). Hillsdale, NJ: ErlbaumLompscher, J. (1994). Learning strategies: Issues on metacognitive and real action level . Paper presented at the 23th International Congress of Applied Psychology, Madrid, SpainMinnaert, A. Red. (1992). Experimentele versie AH56-L . Leuven: University of Leuven, Department of Psychology, Centre for School PsychologyMinnaert, A. (1996). Academic performance, cognition, metacognition and motivation. Assessing freshmen characteristics on task: A validation and replication study in higher education (Doctoral dissertation). Leuven: University of LeuvenMinnaert, A. Janssen, P.J. (1992). Success and progress in higher education: A structural model of studying. British Journal of Educational Psychology, 62, 184– 192Minnaert, A. Janssen, P.J. (1994). A structural model to explain individual differences in learning: The role of cognitive, metacognitive and motivational components in the process of studying in higher education . Paper presented at the 23th International Congress of Applied Psychology, Madrid, SpainPalincsar, A.S. Brown, A.L. (1984). Reciprocal teaching of comprehension-fostering and comprehension-monitoring activities. Cognition and Instruction, 1, 117– 175Paris, S.G. Myers, M. (1981). Comprehension monitoring, memory, and study strategies of good and poor readers. Journal of Reading Behavior, 13 (1), 5– 22Pintrich, P.R. Garcia, T. (1994). Self-regulated learning in college students: Knowledge, strategies and motivation. In P.R. Pintrich, D.R. Brown, & C.E. Weinstein (Eds.), Student motivation, cognition and learning. Essays in honor of Wilbert J. McKeachie (pp. 113-133). Hillsdale, NJ: ErlbaumRasch, G. (1980). Probabilistic models for some intelligence and attainment tests . Chicago: University of Chicago PressResnick, L.B. (1987). Instruction and the cultivation of thinking. In E. De Corte, H. Lodewijks, R. Parmentier, & P. Span (Eds.), Learning and Instruction. European Research in an International Context: Vol. 1 (pp. 415- 442). Oxford/Leuven: Pergamon Press/Leuven University PressSalomon, G. (1994). Not just the individual: A new conception for a new educational psychology . Paper presented at the 23rd International Congress of Applied Psychology, Madrid, SpainSchoenfeld, A.H. (1985). Mathematical problem solving . Orlando, FL: Academic PressSchouwenburg, H.C. (1995). Uitstellen en faalangst: twee aan de persoonlijkheid gebonden studeerproblemen. (procrastination and fear-of-failure: two study problems related to personality). In H.C. Schouwenburg & J.T. Groenewoud (Eds), Studievaardigheid en leerstijlen: Proceedings van de 14de Landelijke Dag Studievaardigheden te Groningen (pp. 215-228). Groningen: Wolters-NoordhoffSimons, P.R.J. Beukhof, G. (1987). The regulation of learning. In P.R.J. Simons & G. Beukhof (Eds.), Regulation of learning (pp. 3-11). Den Haag: SVO-SelectaSimons, P.R.J. Vermunt, J.D.H.M. (1986). Self-regulation in knowledge acquisition: A selection of Dutch research. In G. Beukhof & P.R.J. Simons (Eds.), German and Dutch research on learning and instruction (pp. 101-135). Den Haag: SVO-SelectaSnow, R.E. Jackson, D.N. (1994). Individual differences in conation: Selected constructs and measures. In H.F. O'Neil Jr. & M. Drillings (Eds.), Motivation: Theory and research (pp. 71-99). Hillsdale, NJ: ErlbaumSolomon, L.J. Rothblum, E.D. (1984). Academic procrastination: Frequency and cognitive-behavioral correlates. Journal of Counseling Psychology, 31 (4), 503– 509Stoutjesdijk, E. Beishuizen, J.J. (1992). Cognitie en metacognitie bij het bestuderen van informatieve tekst. Tijdschrift voor Onderwijsresearch, 17 (5), 313– 326Swanson, H.L. (1990). Influence of metacognitive knowledge and aptitude on problem solving. Journal of Educational Psychology, 82 (2), 306– 314Veenman, M.V.J. (1993). Intellectual ability and metacognitive skill. Determinants of discovery learning in computerized learning environments (Doctoral dissertation). Amsterdam: University of AmsterdamVerhelst, N.D. (1992). Het eenparameter logistische model (OPLM): Een theoretische inleiding en een handleiding bij het computerprogramma . [The one-parameter logistic model: A theoretical introduction and a manual to the computer programme) (OPD Memorandum 92-3]. Arnhem: CitoVermetten, Y. Vermunt, J. Lodewijks, J. (1995). Changes in learning styles as a result of student oriented education . Paper presented at the 6th European Conference for Research on Learning and Instruction, Nijmegen, The NetherlandsVermunt, J.D.H.M. (1992). Leerstijlen en sturen van leerprocessen in het hoger onderwijs. Naar procesgerichte instructie in zelfstandig denken . [Learning styles and regulation of learning processes in higher education. Toward process-oriented instruction in independent thinking]. Amsterdam/Lisse: Swets & ZeitlingerVermunt, J.D.H.M. Van Rijswijk, F.A.W.M. (1987). Inventaris leerstijlen voor het Hoger Onderwijs . [Inventory of learning styles for higher education]. Tilburg: Catholic University of BrabantVolet, S.E. (1991). Modelling and coaching of relevant metacognitive strategies for enhancing university students' learning. Learning and Instruction, 1, 319– 336Vygotsky, L.S. (1978). Mind in society: The development of higher psychological processes . Cambridge, MA: Harvard University PressWeinert, F.E. (1987). Introduction and overview: Metacognition and motivation as determinants of effective learning and understanding. In F.E. Weinert & R.H. Kluwe (Eds.), Metacognition, motivation and understanding (pp. 1-16). Hillsdale, NJ: Erlbaum
