Dorottya Demszky, Jing Liu, H. Hill, Dan Jurafsky, C. Piech
{"title":"自动反馈能提高教师对学生想法的吸收吗?大规模在线课程中随机对照试验的证据","authors":"Dorottya Demszky, Jing Liu, H. Hill, Dan Jurafsky, C. Piech","doi":"10.3102/01623737231169270","DOIUrl":null,"url":null,"abstract":"Providing consistent, individualized feedback to teachers is essential for improving instruction but can be prohibitively resource-intensive in most educational contexts. We develop M-Powering Teachers, an automated tool based on natural language processing to give teachers feedback on their uptake of student contributions, a high-leverage dialogic teaching practice that makes students feel heard. We conduct a randomized controlled trial in an online computer science course (N = 1,136 instructors), to evaluate the effectiveness of our tool. We find that M-Powering Teachers improves instructors’ uptake of student contributions by 13% and present suggestive evidence that it also improves students’ satisfaction with the course and assignment completion. These results demonstrate the promise of M-Powering Teachers to complement existing efforts in teachers’ professional development.","PeriodicalId":48079,"journal":{"name":"Educational Evaluation and Policy Analysis","volume":" ","pages":""},"PeriodicalIF":2.4000,"publicationDate":"2023-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"15","resultStr":"{\"title\":\"Can Automated Feedback Improve Teachers’ Uptake of Student Ideas? Evidence From a Randomized Controlled Trial in a Large-Scale Online Course\",\"authors\":\"Dorottya Demszky, Jing Liu, H. Hill, Dan Jurafsky, C. Piech\",\"doi\":\"10.3102/01623737231169270\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Providing consistent, individualized feedback to teachers is essential for improving instruction but can be prohibitively resource-intensive in most educational contexts. We develop M-Powering Teachers, an automated tool based on natural language processing to give teachers feedback on their uptake of student contributions, a high-leverage dialogic teaching practice that makes students feel heard. We conduct a randomized controlled trial in an online computer science course (N = 1,136 instructors), to evaluate the effectiveness of our tool. We find that M-Powering Teachers improves instructors’ uptake of student contributions by 13% and present suggestive evidence that it also improves students’ satisfaction with the course and assignment completion. These results demonstrate the promise of M-Powering Teachers to complement existing efforts in teachers’ professional development.\",\"PeriodicalId\":48079,\"journal\":{\"name\":\"Educational Evaluation and Policy Analysis\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":2.4000,\"publicationDate\":\"2023-05-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"15\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Educational Evaluation and Policy Analysis\",\"FirstCategoryId\":\"95\",\"ListUrlMain\":\"https://doi.org/10.3102/01623737231169270\",\"RegionNum\":1,\"RegionCategory\":\"教育学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Educational Evaluation and Policy Analysis","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.3102/01623737231169270","RegionNum":1,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
Can Automated Feedback Improve Teachers’ Uptake of Student Ideas? Evidence From a Randomized Controlled Trial in a Large-Scale Online Course
Providing consistent, individualized feedback to teachers is essential for improving instruction but can be prohibitively resource-intensive in most educational contexts. We develop M-Powering Teachers, an automated tool based on natural language processing to give teachers feedback on their uptake of student contributions, a high-leverage dialogic teaching practice that makes students feel heard. We conduct a randomized controlled trial in an online computer science course (N = 1,136 instructors), to evaluate the effectiveness of our tool. We find that M-Powering Teachers improves instructors’ uptake of student contributions by 13% and present suggestive evidence that it also improves students’ satisfaction with the course and assignment completion. These results demonstrate the promise of M-Powering Teachers to complement existing efforts in teachers’ professional development.
期刊介绍:
Educational Evaluation and Policy Analysis (EEPA) publishes manuscripts of theoretical or practical interest to those engaged in educational evaluation or policy analysis, including economic, demographic, financial, and political analyses of education policies, and significant meta-analyses or syntheses that address issues of current concern. The journal seeks high-quality research on how reforms and interventions affect educational outcomes; research on how multiple educational policy and reform initiatives support or conflict with each other; and research that informs pending changes in educational policy at the federal, state, and local levels, demonstrating an effect on early childhood through early adulthood.