Shulan Xia, Peida Zhan, Kennedy Kam Ho Chan, Lijun Wang
{"title":"Assessing concept mapping competence using item expansion-based diagnostic classification analysis","authors":"Shulan Xia, Peida Zhan, Kennedy Kam Ho Chan, Lijun Wang","doi":"10.1002/tea.21897","DOIUrl":null,"url":null,"abstract":"<p>Concept mapping is widely used as a tool for assessing students' understanding of science. To fully realize the diagnostic potential of concept mapping, a scoring method that not only provides an objective and accurate assessment of students' drawn concept maps but also provides a detailed understanding of students' proficiency and deficiencies in knowledge is necessary. However, few of the existing scoring methods focus on the latent constructs (e.g., knowledge, skills, and cognitive processes) that guide the creation of concept maps. Instead, they focus on the completeness of the concept map by assigning a composite score, which makes it difficult to generate targeted diagnostic feedback information for advancing students' learning. To apply the diagnostic classification model to the quantitative analysis of concept maps, this study introduced the novel application of the item expansion-based diagnostic classification analysis (IE-DCA) for this purpose. The IE-DCA can not only assess students' concept mapping abilities along a continuum but also classify students according to their concept mapping attributes when constructing the concept maps. The application and benefits of this approach were illustrated using a physics concept-mapping item related to particle and rigid body. Results showed that the estimated attribute profiles via the IE-DCA provided more detailed information about students' latent constructs than the composite score. Overall, this study illustrates the feasibility and potential of applying IE-DCA to analyze concept maps. Future applications of IE-DCS in other assessments in science education are discussed.</p>","PeriodicalId":48369,"journal":{"name":"Journal of Research in Science Teaching","volume":null,"pages":null},"PeriodicalIF":3.6000,"publicationDate":"2023-08-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Research in Science Teaching","FirstCategoryId":"95","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/tea.21897","RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
Concept mapping is widely used as a tool for assessing students' understanding of science. To fully realize the diagnostic potential of concept mapping, a scoring method that not only provides an objective and accurate assessment of students' drawn concept maps but also provides a detailed understanding of students' proficiency and deficiencies in knowledge is necessary. However, few of the existing scoring methods focus on the latent constructs (e.g., knowledge, skills, and cognitive processes) that guide the creation of concept maps. Instead, they focus on the completeness of the concept map by assigning a composite score, which makes it difficult to generate targeted diagnostic feedback information for advancing students' learning. To apply the diagnostic classification model to the quantitative analysis of concept maps, this study introduced the novel application of the item expansion-based diagnostic classification analysis (IE-DCA) for this purpose. The IE-DCA can not only assess students' concept mapping abilities along a continuum but also classify students according to their concept mapping attributes when constructing the concept maps. The application and benefits of this approach were illustrated using a physics concept-mapping item related to particle and rigid body. Results showed that the estimated attribute profiles via the IE-DCA provided more detailed information about students' latent constructs than the composite score. Overall, this study illustrates the feasibility and potential of applying IE-DCA to analyze concept maps. Future applications of IE-DCS in other assessments in science education are discussed.
期刊介绍:
Journal of Research in Science Teaching, the official journal of NARST: A Worldwide Organization for Improving Science Teaching and Learning Through Research, publishes reports for science education researchers and practitioners on issues of science teaching and learning and science education policy. Scholarly manuscripts within the domain of the Journal of Research in Science Teaching include, but are not limited to, investigations employing qualitative, ethnographic, historical, survey, philosophical, case study research, quantitative, experimental, quasi-experimental, data mining, and data analytics approaches; position papers; policy perspectives; critical reviews of the literature; and comments and criticism.