Khalid Alalawi, Rukshan Athauda, Raymond Chiong, Ian Renner
{"title":"Evaluating the student performance prediction and action framework through a learning analytics intervention study","authors":"Khalid Alalawi, Rukshan Athauda, Raymond Chiong, Ian Renner","doi":"10.1007/s10639-024-12923-5","DOIUrl":null,"url":null,"abstract":"<p>Learning analytics intervention (LAI) studies aim to identify at-risk students early during an academic term using predictive models and facilitate educators to provide effective interventions to improve educational outcomes. A major impediment to the uptake of LAI is the lack of access to LAI infrastructure by educators to pilot LAI, which typically requires substantial institution-wide efforts and investment to collect related data sets and develop accurate predictive models that identify at-risk students and also provide tools to facilitate interventions. This paper presents a novel LAI framework, termed Student Performance Prediction and Action (SPPA), that facilitates educators to seamlessly provide LAIs in their courses avoiding the need for large-scale institution-wide efforts and investments. Educators develop course-specific predictive models using historical course assessment data. In learning analytics, providing effective interventions is a challenge. SPPA utilises pedagogy principles in course design and interventions to facilitate effective interventions by providing insights into students’ risk levels, gaps in students’ knowledge, and personalised study/revision plans addressing knowledge gaps. SPPA was evaluated in a large undergraduate course on its ability to predict at-risk students and facilitate effective interventions as well as its ease of use by academics. The results are encouraging with high performance of predictive models, facilitating effective interventions leading to significant improved educational outcomes with positive feedback and uptake by academics. With its advantages, SPPA has the potential to catalyse and influence wide-scale adoption in LAIs.</p>","PeriodicalId":51494,"journal":{"name":"Education and Information Technologies","volume":null,"pages":null},"PeriodicalIF":4.8000,"publicationDate":"2024-08-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Education and Information Technologies","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1007/s10639-024-12923-5","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
Learning analytics intervention (LAI) studies aim to identify at-risk students early during an academic term using predictive models and facilitate educators to provide effective interventions to improve educational outcomes. A major impediment to the uptake of LAI is the lack of access to LAI infrastructure by educators to pilot LAI, which typically requires substantial institution-wide efforts and investment to collect related data sets and develop accurate predictive models that identify at-risk students and also provide tools to facilitate interventions. This paper presents a novel LAI framework, termed Student Performance Prediction and Action (SPPA), that facilitates educators to seamlessly provide LAIs in their courses avoiding the need for large-scale institution-wide efforts and investments. Educators develop course-specific predictive models using historical course assessment data. In learning analytics, providing effective interventions is a challenge. SPPA utilises pedagogy principles in course design and interventions to facilitate effective interventions by providing insights into students’ risk levels, gaps in students’ knowledge, and personalised study/revision plans addressing knowledge gaps. SPPA was evaluated in a large undergraduate course on its ability to predict at-risk students and facilitate effective interventions as well as its ease of use by academics. The results are encouraging with high performance of predictive models, facilitating effective interventions leading to significant improved educational outcomes with positive feedback and uptake by academics. With its advantages, SPPA has the potential to catalyse and influence wide-scale adoption in LAIs.
期刊介绍:
The Journal of Education and Information Technologies (EAIT) is a platform for the range of debates and issues in the field of Computing Education as well as the many uses of information and communication technology (ICT) across many educational subjects and sectors. It probes the use of computing to improve education and learning in a variety of settings, platforms and environments.
The journal aims to provide perspectives at all levels, from the micro level of specific pedagogical approaches in Computing Education and applications or instances of use in classrooms, to macro concerns of national policies and major projects; from pre-school classes to adults in tertiary institutions; from teachers and administrators to researchers and designers; from institutions to online and lifelong learning. The journal is embedded in the research and practice of professionals within the contemporary global context and its breadth and scope encourage debate on fundamental issues at all levels and from different research paradigms and learning theories. The journal does not proselytize on behalf of the technologies (whether they be mobile, desktop, interactive, virtual, games-based or learning management systems) but rather provokes debate on all the complex relationships within and between computing and education, whether they are in informal or formal settings. It probes state of the art technologies in Computing Education and it also considers the design and evaluation of digital educational artefacts. The journal aims to maintain and expand its international standing by careful selection on merit of the papers submitted, thus providing a credible ongoing forum for debate and scholarly discourse. Special Issues are occasionally published to cover particular issues in depth. EAIT invites readers to submit papers that draw inferences, probe theory and create new knowledge that informs practice, policy and scholarship. Readers are also invited to comment and reflect upon the argument and opinions published. EAIT is the official journal of the Technical Committee on Education of the International Federation for Information Processing (IFIP) in partnership with UNESCO.