Catherine Cleophas, Christoph Hönnige, Frank Meisel, Philipp Meyer
{"title":"作弊是谁?从在线考试文本和事件中挖掘共谋模式","authors":"Catherine Cleophas, Christoph Hönnige, Frank Meisel, Philipp Meyer","doi":"10.1287/ited.2021.0260","DOIUrl":null,"url":null,"abstract":"As the COVID-19 pandemic motivated a shift to virtual teaching, exams have increasingly moved online too. Detecting cheating through collusion is not easy when tech-savvy students take online exams at home and on their own devices. Such online at-home exams may tempt students to collude and share materials and answers. However, online exams’ digital output also enables computer-aided detection of collusion patterns. This paper presents two simple data-driven techniques to analyze exam event logs and essay-form answers. Based on examples from exams in social sciences, we show that such analyses can reveal patterns of student collusion. We suggest using these patterns to quantify the degree of collusion. Finally, we summarize a set of lessons learned about designing and analyzing online exams.","PeriodicalId":37137,"journal":{"name":"INFORMS Transactions on Education","volume":"5 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"Who’s Cheating? Mining Patterns of Collusion from Text and Events in Online Exams\",\"authors\":\"Catherine Cleophas, Christoph Hönnige, Frank Meisel, Philipp Meyer\",\"doi\":\"10.1287/ited.2021.0260\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"As the COVID-19 pandemic motivated a shift to virtual teaching, exams have increasingly moved online too. Detecting cheating through collusion is not easy when tech-savvy students take online exams at home and on their own devices. Such online at-home exams may tempt students to collude and share materials and answers. However, online exams’ digital output also enables computer-aided detection of collusion patterns. This paper presents two simple data-driven techniques to analyze exam event logs and essay-form answers. Based on examples from exams in social sciences, we show that such analyses can reveal patterns of student collusion. We suggest using these patterns to quantify the degree of collusion. Finally, we summarize a set of lessons learned about designing and analyzing online exams.\",\"PeriodicalId\":37137,\"journal\":{\"name\":\"INFORMS Transactions on Education\",\"volume\":\"5 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"INFORMS Transactions on Education\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1287/ited.2021.0260\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"Social Sciences\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"INFORMS Transactions on Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1287/ited.2021.0260","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Social Sciences","Score":null,"Total":0}
Who’s Cheating? Mining Patterns of Collusion from Text and Events in Online Exams
As the COVID-19 pandemic motivated a shift to virtual teaching, exams have increasingly moved online too. Detecting cheating through collusion is not easy when tech-savvy students take online exams at home and on their own devices. Such online at-home exams may tempt students to collude and share materials and answers. However, online exams’ digital output also enables computer-aided detection of collusion patterns. This paper presents two simple data-driven techniques to analyze exam event logs and essay-form answers. Based on examples from exams in social sciences, we show that such analyses can reveal patterns of student collusion. We suggest using these patterns to quantify the degree of collusion. Finally, we summarize a set of lessons learned about designing and analyzing online exams.