RT info:eu-repo/semantics/article T1 Observation of Metacognitive Skills in Natural Environments: A Longitudinal Study With Mixed Methods A1 Sáiz Manzanares, María Consuelo A1 Queiruga Dios, Miguel Ángel A1 García Osorio, César A1 Montero García, Eduardo A1 Rodríguez Medina, Jairo K1 Metacognitive skills K1 Quality K1 On-line evaluation methods K1 Mixed methods K1 Indirect observation K1 Systematic observation K1 Natural environments K1 Personalized learning K1 Enseñanza secundaria K1 Education, Secondary K1 Psicología K1 Psychology AB Recent studies pointing to evaluation methods in natural environments suggest that their use in the analysis of metacognitive skills provides more precise information than the use of off-line evaluation methods. In this research, mixed methods are used over one academic year for the evaluation of the metacognitive skills that students of Secondary Education apply to solve physics problems. The objectives of this study are to analyze the use of metacognitive skills in natural environments and to study behavioral patterns of student learning through a longitudinal study. A total of 509 recordings of think-aloud protocols are analyzed through the categorization of the responses (liquefying) and the protocol of Van der Stel and Veenman for the analysis of the quality of metacognitive skills. Fewer conceptual errors and less uncertainty over vocabulary were noted during the academic year. Nevertheless, a degree of ambiguity persisted in the understanding of physics concepts. The metacognitive skills of Orientation and Planning were used more than any others. The technique of graph analysis is also applied, to establish the patterns of behavior of each student throughout the academic year. Different patterns were found, the analysis of which helped to identify academically challenged and at-risk students. The use of mixed observation techniques and graph analysis facilitated information on the pace of learning of each student. Future studies will be directed at proposals for the automation of these evaluation techniques in natural learning environments. PB Frontiers Media SN 1664-1078 YR 2019 FD 2019-11 LK http://hdl.handle.net/10259/6265 UL http://hdl.handle.net/10259/6265 LA eng DS Repositorio Institucional de la Universidad de Burgos RD 23-abr-2024