W. Silva, Elias de Oliveira, M. Curi, Jean-Rémi Bourguet
{"title":"写作水平评估:基于机器学习技术的项目反应理论回归分析","authors":"W. Silva, Elias de Oliveira, M. Curi, Jean-Rémi Bourguet","doi":"10.1109/CLEI53233.2021.9639903","DOIUrl":null,"url":null,"abstract":"A subject's ability to express himself demonstrates his ability to understand reality. Text production is a way to verify the proficiency of such a skill. This correlation can help in the teaching-learning process since the learning diagnosis depends on the identification of possible instructional gaps, which subsidize the composition of better teaching strategies. In this article, we present an approach to characterizing learning profiles and estimating grades in the assessment of writing tests. For that, we used item response theory and machine learning techniques in the dataset of test scores of the Exame Nacional do Ensino Médio carried out in 2019. The results show that using a portion of only 2k training instances of the 3; 7M instances and only one of the five competencies evaluated, it is possible to have a correct prediction of the skill with a p-value 0:06 and pearson correlation of 0:94. Our approach shows the benefits of employing such techniques in a real-world scenario.","PeriodicalId":6803,"journal":{"name":"2021 XLVII Latin American Computing Conference (CLEI)","volume":"38 1","pages":"1-10"},"PeriodicalIF":0.0000,"publicationDate":"2021-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Writing Proficiency Assessment: Regression Analysis of Item Response Theory supported by Machine Learning Techniques\",\"authors\":\"W. Silva, Elias de Oliveira, M. Curi, Jean-Rémi Bourguet\",\"doi\":\"10.1109/CLEI53233.2021.9639903\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"A subject's ability to express himself demonstrates his ability to understand reality. Text production is a way to verify the proficiency of such a skill. This correlation can help in the teaching-learning process since the learning diagnosis depends on the identification of possible instructional gaps, which subsidize the composition of better teaching strategies. In this article, we present an approach to characterizing learning profiles and estimating grades in the assessment of writing tests. For that, we used item response theory and machine learning techniques in the dataset of test scores of the Exame Nacional do Ensino Médio carried out in 2019. The results show that using a portion of only 2k training instances of the 3; 7M instances and only one of the five competencies evaluated, it is possible to have a correct prediction of the skill with a p-value 0:06 and pearson correlation of 0:94. Our approach shows the benefits of employing such techniques in a real-world scenario.\",\"PeriodicalId\":6803,\"journal\":{\"name\":\"2021 XLVII Latin American Computing Conference (CLEI)\",\"volume\":\"38 1\",\"pages\":\"1-10\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-10-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 XLVII Latin American Computing Conference (CLEI)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CLEI53233.2021.9639903\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 XLVII Latin American Computing Conference (CLEI)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CLEI53233.2021.9639903","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Writing Proficiency Assessment: Regression Analysis of Item Response Theory supported by Machine Learning Techniques
A subject's ability to express himself demonstrates his ability to understand reality. Text production is a way to verify the proficiency of such a skill. This correlation can help in the teaching-learning process since the learning diagnosis depends on the identification of possible instructional gaps, which subsidize the composition of better teaching strategies. In this article, we present an approach to characterizing learning profiles and estimating grades in the assessment of writing tests. For that, we used item response theory and machine learning techniques in the dataset of test scores of the Exame Nacional do Ensino Médio carried out in 2019. The results show that using a portion of only 2k training instances of the 3; 7M instances and only one of the five competencies evaluated, it is possible to have a correct prediction of the skill with a p-value 0:06 and pearson correlation of 0:94. Our approach shows the benefits of employing such techniques in a real-world scenario.