{"title":"Measurement of higher education students’ and teachers’ experiences in learning management systems: a scoping review","authors":"Patricia Simon, Juming Jiang, Luke K. Fryer","doi":"10.1080/02602938.2023.2266154","DOIUrl":null,"url":null,"abstract":"AbstractLearning management systems (LMSs) have facilitated access to courses beyond conventional classroom environments via distance and asynchronous education. Although numerous studies have examined LMS usage in higher education institutions, review of scales measuring the LMS experience of both students and teachers remains scarce. This scoping review aimed to identify scales assessing student and teacher experiences with LMS, along with the attributes of studies employing these scales. The systematic search encompassed five databases, ultimately incorporating 79 of 5536 peer-reviewed articles in the final review. Findings revealed that included studies predominantly focused on student samples, with fewer examining teacher samples and even fewer involving both stakeholders. The majority of included studies created their own measurement, and over half of the newly created measurements were combined with constructs that were extracted from multiple theories. The System Usability Scale is the only measurement that has been used in multiple studies. The Technology Acceptance Model (TAM) and DeLone and McLean’s Information Success (IS) model emerged as the most frequently employed frameworks for investigating factors influencing LMS utilization. Moodle ranked as the most commonly assessed LMS within the reviewed studies. Based on this data, recommendations for future LMS research are discussed.Keywords: Distance educationonline learningpost-secondary educationevaluation methodologies AcknowledgementThe authors would like to thank the help and support from Miss. Yijin Li and Miss. Ying Su. This work could not be accomplished without their tireless hard work.Disclosure statementThere is no conflict of interest to declare.Notes on contributorsPatricia D. Simon is a postdoctoral fellow at the University of Hong Kong. Her research interests include the promotion of students’ mental health, well-being and engagement in both physical and virtual classrooms. She is also interested in applying psychological principles for the improvement of educational technologies and for the promotion of environmental sustainability, health, and well-being.Juming Jiang is a post-doctoral fellow at the University of Hong Kong, Hong Kong. His research programme focuses on how to support students’ learning motivation and interest in offline and online learning environments, with extended reality (i.e., virtual/augmented/mixed reality) and artificial intelligence technologies.Luke K. Fryer is an Associate Professor at the University of Hong Kong, Hong Kong. His research programme addresses motivations to learn, learning strategies and teaching-learning on/off-line.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":null,"pages":null},"PeriodicalIF":4.1000,"publicationDate":"2023-10-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Assessment & Evaluation in Higher Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/02602938.2023.2266154","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
AbstractLearning management systems (LMSs) have facilitated access to courses beyond conventional classroom environments via distance and asynchronous education. Although numerous studies have examined LMS usage in higher education institutions, review of scales measuring the LMS experience of both students and teachers remains scarce. This scoping review aimed to identify scales assessing student and teacher experiences with LMS, along with the attributes of studies employing these scales. The systematic search encompassed five databases, ultimately incorporating 79 of 5536 peer-reviewed articles in the final review. Findings revealed that included studies predominantly focused on student samples, with fewer examining teacher samples and even fewer involving both stakeholders. The majority of included studies created their own measurement, and over half of the newly created measurements were combined with constructs that were extracted from multiple theories. The System Usability Scale is the only measurement that has been used in multiple studies. The Technology Acceptance Model (TAM) and DeLone and McLean’s Information Success (IS) model emerged as the most frequently employed frameworks for investigating factors influencing LMS utilization. Moodle ranked as the most commonly assessed LMS within the reviewed studies. Based on this data, recommendations for future LMS research are discussed.Keywords: Distance educationonline learningpost-secondary educationevaluation methodologies AcknowledgementThe authors would like to thank the help and support from Miss. Yijin Li and Miss. Ying Su. This work could not be accomplished without their tireless hard work.Disclosure statementThere is no conflict of interest to declare.Notes on contributorsPatricia D. Simon is a postdoctoral fellow at the University of Hong Kong. Her research interests include the promotion of students’ mental health, well-being and engagement in both physical and virtual classrooms. She is also interested in applying psychological principles for the improvement of educational technologies and for the promotion of environmental sustainability, health, and well-being.Juming Jiang is a post-doctoral fellow at the University of Hong Kong, Hong Kong. His research programme focuses on how to support students’ learning motivation and interest in offline and online learning environments, with extended reality (i.e., virtual/augmented/mixed reality) and artificial intelligence technologies.Luke K. Fryer is an Associate Professor at the University of Hong Kong, Hong Kong. His research programme addresses motivations to learn, learning strategies and teaching-learning on/off-line.
摘要学习管理系统(lms)通过远程和异步教育促进了传统课堂环境之外的课程访问。尽管有许多研究调查了高等教育机构中LMS的使用情况,但对衡量学生和教师LMS体验的量表的审查仍然很少。本综述旨在确定评估学生和教师使用LMS经验的量表,以及使用这些量表的研究的属性。系统搜索包括5个数据库,最终将5536篇同行评议文章中的79篇纳入最终评审。调查结果显示,纳入的研究主要集中在学生样本上,较少检查教师样本,甚至更少涉及两个利益相关者。大多数纳入的研究创建了自己的测量方法,超过一半的新创建的测量方法与从多种理论中提取的结构相结合。系统可用性量表是唯一在多个研究中使用的测量方法。技术接受模型(TAM)和DeLone和McLean的信息成功模型(IS)是研究影响LMS利用的因素时最常用的框架。在回顾的研究中,Moodle被评为最常被评估的LMS。在此基础上,对未来LMS研究提出了建议。关键词:远程教育在线学习专上教育评价方法感谢李翊锦小姐和苏颖小姐的帮助和支持,这项工作的完成离不开她们的不懈努力。披露声明没有利益冲突需要申报。作者简介:patricia D. Simon是香港大学的博士后。她的研究兴趣包括促进学生的心理健康,福祉和参与物理和虚拟教室。她还对应用心理学原理改善教育技术和促进环境可持续性、健康和福祉感兴趣。蒋巨明,香港大学博士后研究员。他的研究项目侧重于如何通过扩展现实(即虚拟/增强/混合现实)和人工智能技术,在线下和在线学习环境中支持学生的学习动机和兴趣。Luke K. Fryer,香港大学副教授。他的研究项目涉及学习动机、学习策略和线上/线下教学。