Brian Moon, Farima Fatahi Bayat, Sneha C. Nair, Andrew Slaughter
The U.S. Army sought to develop capabilities that allow for the automated or semi-automated, with greatly reduced human involvement, creation of tests and assessments. In recognizing the potential for an assessment approach that goes beyond multiple-choice, the Army chose our team to introduce and evaluate automated capabilities to author concept mapping-based assessments. This paper describes our initial approaches toward introducing efficiencies into the authoring process for concept map-based assessments. We are developing and evaluating methods to automatically generate concept maps from a knowledge domain and convert the maps into assessments for formative and summative purposes. Our initial work has sought to overcome challenges as we introduced artificial intelligence into the authoring process. In this paper, we describe our emergent approach and the challenges we have faced in seeking efficiencies in the conversion of text to concept maps.
{"title":"Challenges for introducing artificial intelligence to improve the efficiency of a next generation assessment approach","authors":"Brian Moon, Farima Fatahi Bayat, Sneha C. Nair, Andrew Slaughter","doi":"10.1145/3470745","DOIUrl":"https://doi.org/10.1145/3470745","url":null,"abstract":"The U.S. Army sought to develop capabilities that allow for the automated or semi-automated, with greatly reduced human involvement, creation of tests and assessments. In recognizing the potential for an assessment approach that goes beyond multiple-choice, the Army chose our team to introduce and evaluate automated capabilities to author concept mapping-based assessments. This paper describes our initial approaches toward introducing efficiencies into the authoring process for concept map-based assessments. We are developing and evaluating methods to automatically generate concept maps from a knowledge domain and convert the maps into assessments for formative and summative purposes. Our initial work has sought to overcome challenges as we introduced artificial intelligence into the authoring process. In this paper, we describe our emergent approach and the challenges we have faced in seeking efficiencies in the conversion of text to concept maps.","PeriodicalId":72732,"journal":{"name":"Current issues in emerging elearning","volume":"32 1","pages":"1 - 15"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81037977","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Concept maps (CM) are a learning tool that has emerged into an efficient e-learning and e-assessment knowledge tool. The aim of this research is to propose and share the most important aspects, practices, and achievements of using, with science teachers and a master student, a combination of a metacognitive tool-advanced concept mapping (ACM) to assess mental models with immediate real-time feedback assessment tool. The use of the logic branching feature of multiple-choice Google Forms (MCGF) may enable teachers to customize surveys and to assess within many students' high order thinking skills, with the convenience and efficiency of an automatic grading system. Additionally, the ACM-MCGF enables the test taker to have an adaptive learning practice while undergoing assessment.
{"title":"Adaptive knowledge assessment using advanced concept maps with logic branching multiple-choice Google Forms","authors":"A. Fonseca, Hugo Faria","doi":"10.1145/3466623","DOIUrl":"https://doi.org/10.1145/3466623","url":null,"abstract":"Concept maps (CM) are a learning tool that has emerged into an efficient e-learning and e-assessment knowledge tool. The aim of this research is to propose and share the most important aspects, practices, and achievements of using, with science teachers and a master student, a combination of a metacognitive tool-advanced concept mapping (ACM) to assess mental models with immediate real-time feedback assessment tool. The use of the logic branching feature of multiple-choice Google Forms (MCGF) may enable teachers to customize surveys and to assess within many students' high order thinking skills, with the convenience and efficiency of an automatic grading system. Additionally, the ACM-MCGF enables the test taker to have an adaptive learning practice while undergoing assessment.","PeriodicalId":72732,"journal":{"name":"Current issues in emerging elearning","volume":"68 1","pages":"1 - 12"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87836823","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This review analyzes ideas and themes that emerged from Beyond Multiple Choice 2020 (BMC2020), the third iteration of an annual conference exploring the future of assessment. Taking place online due to restrictions surrounding COVID-19, BMC2020 attracted speakers and delegates from across the globe, representing various facets of the assessment industry. Altogether, the presentations compiled a bird's-eye snapshot of challenges and opportunities for advancing assessment to better meet 21st-century training and education needs.
{"title":"Beyond Multiple Choice Conference in review","authors":"Kristine Hadeed","doi":"10.1145/3469378","DOIUrl":"https://doi.org/10.1145/3469378","url":null,"abstract":"This review analyzes ideas and themes that emerged from Beyond Multiple Choice 2020 (BMC2020), the third iteration of an annual conference exploring the future of assessment. Taking place online due to restrictions surrounding COVID-19, BMC2020 attracted speakers and delegates from across the globe, representing various facets of the assessment industry. Altogether, the presentations compiled a bird's-eye snapshot of challenges and opportunities for advancing assessment to better meet 21st-century training and education needs.","PeriodicalId":72732,"journal":{"name":"Current issues in emerging elearning","volume":"183 1","pages":"1 - 9"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74639622","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Authors for this special issue presented their work, perspectives, and recommendations that look to move learning assessment at all levels "beyond multiple-choice."
本期特刊的作者介绍了他们的工作、观点和建议,以期推动各级学习评估“超越多项选择”。
{"title":"eLearn Magazine Special Issue: Beyond Multiple Choice","authors":"Brian Moon","doi":"10.1145/3471910","DOIUrl":"https://doi.org/10.1145/3471910","url":null,"abstract":"Authors for this special issue presented their work, perspectives, and recommendations that look to move learning assessment at all levels \"beyond multiple-choice.\"","PeriodicalId":72732,"journal":{"name":"Current issues in emerging elearning","volume":"34 1","pages":"1 - 4"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75028209","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This article summarizes the main themes and chapters for The Learner-Centered Instructional Designer (Stylus Publishing, 2021) and provides a critical evaluation and recommendations for prospective readers. The book consists of 19 short essay-like chapters where 20 experienced instructional designers cover a range of topics related to instructional design consulting in higher education. The various authors share practical strategies and best practices about working with instructors to create online courses.
{"title":"How Instructional Designers Work and Think in Online Higher Education","authors":"L. Howles","doi":"10.1145/3486958.3490433","DOIUrl":"https://doi.org/10.1145/3486958.3490433","url":null,"abstract":"This article summarizes the main themes and chapters for The Learner-Centered Instructional Designer (Stylus Publishing, 2021) and provides a critical evaluation and recommendations for prospective readers. The book consists of 19 short essay-like chapters where 20 experienced instructional designers cover a range of topics related to instructional design consulting in higher education. The various authors share practical strategies and best practices about working with instructors to create online courses.","PeriodicalId":72732,"journal":{"name":"Current issues in emerging elearning","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83101073","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In this opinion piece, Susan Lyons explores the imperative to amplify diverse voices and perspectives in the field of educational measurement. She identifies two negative effects of the lack of cultural diversity in leadership positions within the field and ends by calling for a higher level of critical consciousness within the profession of educational measurement.
{"title":"The future of assessment depends on elevating culturally diverse perspectives","authors":"Susan Lyons","doi":"10.1145/3473855","DOIUrl":"https://doi.org/10.1145/3473855","url":null,"abstract":"In this opinion piece, Susan Lyons explores the imperative to amplify diverse voices and perspectives in the field of educational measurement. She identifies two negative effects of the lack of cultural diversity in leadership positions within the field and ends by calling for a higher level of critical consciousness within the profession of educational measurement.","PeriodicalId":72732,"journal":{"name":"Current issues in emerging elearning","volume":"24 1","pages":"1 - 5"},"PeriodicalIF":0.0,"publicationDate":"2021-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83573577","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
J. Ernstberger, Justin Fetner, Kyle Gutowski, Patrick J. Riley, Nick Stavrow
In an online, general education course, for a course grade, students were to submit video posts to an introductory course activity. Student responses (by text) were also required for that activity. Initial posts and responses were cataloged by race and gender across multiple sections of the course through multiple semesters and years. Statistical tests were performed to analyze mean numbers of responses and determined that evidence supported that different numbers of responses occurred depending on the race or gender of the original poster, but not both the race and the gender.
{"title":"Student Interactions in an Introductory Activity of an Online Course by Ethnicity and Gender","authors":"J. Ernstberger, Justin Fetner, Kyle Gutowski, Patrick J. Riley, Nick Stavrow","doi":"10.1145/3486955.3460493","DOIUrl":"https://doi.org/10.1145/3486955.3460493","url":null,"abstract":"In an online, general education course, for a course grade, students were to submit video posts to an introductory course activity. Student responses (by text) were also required for that activity. Initial posts and responses were cataloged by race and gender across multiple sections of the course through multiple semesters and years. Statistical tests were performed to analyze mean numbers of responses and determined that evidence supported that different numbers of responses occurred depending on the race or gender of the original poster, but not both the race and the gender.","PeriodicalId":72732,"journal":{"name":"Current issues in emerging elearning","volume":"73 7 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78677100","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Blended learning offers adult learners unique opportunities for instructional continuity given work and personal commitments. However, learners participating in blended learning may experience a sense of isolation and/or problems with technology. To address the challenges of a blended program, an expanded orientation, called "onboarding," was designed to ensure learners feel connected to their program and clearly understand the programmatic requirements. Onboarding spans six months and includes a series of activities to provide learners with technological, interaction, and self-directed learning skills needed to succeed in a blended program. Results from the evaluation survey reveal that learners feel most engaged with the program through one-to-one interactions with their academic advisors and interactions with peers in an online discussion board. In addition, learners primarily found the onboarding process straightforward and mostly expressed a desire for more explicit instructions. The onboarding, catering to adult learner needs, provides a combination of personal interactions and self-paced activities, offers hands-on experience of the technologies that learners will be using in the program, and contextualizes all the technical activities within programmatic requirements. Providing a comprehensive onboarding process can help returning learners in their transition to blended learning
{"title":"Preparing Adult Learners for Success in Blended Learning through Onboarding: A pilot study","authors":"A. Samuel, S. Durning, Holly S. Meyer","doi":"10.1145/3486955.3480946","DOIUrl":"https://doi.org/10.1145/3486955.3480946","url":null,"abstract":"Blended learning offers adult learners unique opportunities for instructional continuity given work and personal commitments. However, learners participating in blended learning may experience a sense of isolation and/or problems with technology. To address the challenges of a blended program, an expanded orientation, called \"onboarding,\" was designed to ensure learners feel connected to their program and clearly understand the programmatic requirements. Onboarding spans six months and includes a series of activities to provide learners with technological, interaction, and self-directed learning skills needed to succeed in a blended program. Results from the evaluation survey reveal that learners feel most engaged with the program through one-to-one interactions with their academic advisors and interactions with peers in an online discussion board. In addition, learners primarily found the onboarding process straightforward and mostly expressed a desire for more explicit instructions. The onboarding, catering to adult learner needs, provides a combination of personal interactions and self-paced activities, offers hands-on experience of the technologies that learners will be using in the program, and contextualizes all the technical activities within programmatic requirements. Providing a comprehensive onboarding process can help returning learners in their transition to blended learning","PeriodicalId":72732,"journal":{"name":"Current issues in emerging elearning","volume":"36 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-09-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87172051","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
In 2020-2021, elearning became essential at all levels of education due to the COVID-19 pandemic. This editorial provides a year in review for eLearn Magazine. A common theme was the challenges of the COVID-19 pandemic in online education and opportunities for overcoming these challenges.
{"title":"Challenges and Opportunities for eLearning During the COVID-19 Pandemic: The year in review","authors":"Simone C. O. Conceição","doi":"10.1145/3481580.3481715","DOIUrl":"https://doi.org/10.1145/3481580.3481715","url":null,"abstract":"In 2020-2021, elearning became essential at all levels of education due to the COVID-19 pandemic. This editorial provides a year in review for eLearn Magazine. A common theme was the challenges of the COVID-19 pandemic in online education and opportunities for overcoming these challenges.","PeriodicalId":72732,"journal":{"name":"Current issues in emerging elearning","volume":"85 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90674088","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
A. Correia, Sean Hickey, T. Lepicki, Alicia Willis
While adult and workplace training were quick to adopt the use of online learning, many of these efforts have not advanced far beyond taking presentation slides or video recordings from formerly in-person training and making them available on learning-management systems. Compared to formal education, adult and workplace training has been much slower to iterate and improve upon early digital and virtual educational methods, leaving online learning that is viewed as neither engaging for the end-user nor effective at achieving intended outcomes. The COVID-19 pandemic and resulting lockdown added urgency to this problem, with many organizations being forced to either improve upon existing virtual training methods or finally completely replace in-person training with online options. The Ohio State University?s Center on Education and Training for Employment used evidence-based practices to develop a training collection specifically aimed at trainers, learning designers, and learning and development professionals. Translating the latest e-learning research into practical solutions, making use of proven instructional strategies, center learning designers created online training materials that are well-positioned to be effective at engaging adult learners, simultaneously instructing learners and demonstrating the learning content being delivered.
{"title":"Meeting Online Learners Where They Are: e-Learning during a time of pandemic","authors":"A. Correia, Sean Hickey, T. Lepicki, Alicia Willis","doi":"10.1145/3481580.3470746","DOIUrl":"https://doi.org/10.1145/3481580.3470746","url":null,"abstract":"While adult and workplace training were quick to adopt the use of online learning, many of these efforts have not advanced far beyond taking presentation slides or video recordings from formerly in-person training and making them available on learning-management systems. Compared to formal education, adult and workplace training has been much slower to iterate and improve upon early digital and virtual educational methods, leaving online learning that is viewed as neither engaging for the end-user nor effective at achieving intended outcomes. The COVID-19 pandemic and resulting lockdown added urgency to this problem, with many organizations being forced to either improve upon existing virtual training methods or finally completely replace in-person training with online options. The Ohio State University?s Center on Education and Training for Employment used evidence-based practices to develop a training collection specifically aimed at trainers, learning designers, and learning and development professionals. Translating the latest e-learning research into practical solutions, making use of proven instructional strategies, center learning designers created online training materials that are well-positioned to be effective at engaging adult learners, simultaneously instructing learners and demonstrating the learning content being delivered.","PeriodicalId":72732,"journal":{"name":"Current issues in emerging elearning","volume":"29 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-08-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86552045","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}