Catherine McBride, Jana Chi-San Ho, Maria McQuade, Vince Siu Hin Ngan, Melody Chi Ying Ng, Zebedee Rui En Cheah, Urs Maurer
{"title":"Online assessment in young children: Challenges and considerations.","authors":"Catherine McBride, Jana Chi-San Ho, Maria McQuade, Vince Siu Hin Ngan, Melody Chi Ying Ng, Zebedee Rui En Cheah, Urs Maurer","doi":"10.1002/pchj.805","DOIUrl":null,"url":null,"abstract":"<p><p>In the years following the COVID-19 pandemic, online assessment has emerged as an increasingly popular method for testing children. This review aims to review key advantages and disadvantages of online assessment in young children, specifically in the area of literacy and mathematics assessment. We first consider the recent history of online assessment and give evidence from our own experiences with online assessments in both Cebu, Philippines and Hong Kong. We then discuss the benefits of conducting assessments online. One of the key strengths of online assessments is the efficient use of resources, such as ease of staff training, increased participation and decreased costs for both participants and researchers. Difficulties related to testing environment, parental interference and exclusion of certain populations are also highlighted as focal challenges that must be considered when designing and implementing online assessment. The reliability and validity of online assessments are then specifically discussed in relation to the question of how to best ensure that online measures function as intended, stressing the importance of establishing separate norms for the various administration modes. Notably, online assessments delivered via phone screen must have separate norms than those delivered on a computer screen, as device differences may account for differences in performance. Finally, we present broader considerations for designing online assessments with young children. This includes practical tips for pilot testing, user interface design, data confidentiality and automatic scoring, both to enhance the efficiency of future online assessments and increase participation. Specifically, online assessments for children must account for their developing attentional abilities, meaning assessments should be brief, engaging and contain clear task instructions. The implementation of these considerations will support the development of more reliable, valid and inclusive assessments which will allow researchers and practitioners to support equitable and feasible online testing moving forward.</p>","PeriodicalId":20804,"journal":{"name":"PsyCh journal","volume":" ","pages":""},"PeriodicalIF":1.3000,"publicationDate":"2024-12-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"PsyCh journal","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1002/pchj.805","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
In the years following the COVID-19 pandemic, online assessment has emerged as an increasingly popular method for testing children. This review aims to review key advantages and disadvantages of online assessment in young children, specifically in the area of literacy and mathematics assessment. We first consider the recent history of online assessment and give evidence from our own experiences with online assessments in both Cebu, Philippines and Hong Kong. We then discuss the benefits of conducting assessments online. One of the key strengths of online assessments is the efficient use of resources, such as ease of staff training, increased participation and decreased costs for both participants and researchers. Difficulties related to testing environment, parental interference and exclusion of certain populations are also highlighted as focal challenges that must be considered when designing and implementing online assessment. The reliability and validity of online assessments are then specifically discussed in relation to the question of how to best ensure that online measures function as intended, stressing the importance of establishing separate norms for the various administration modes. Notably, online assessments delivered via phone screen must have separate norms than those delivered on a computer screen, as device differences may account for differences in performance. Finally, we present broader considerations for designing online assessments with young children. This includes practical tips for pilot testing, user interface design, data confidentiality and automatic scoring, both to enhance the efficiency of future online assessments and increase participation. Specifically, online assessments for children must account for their developing attentional abilities, meaning assessments should be brief, engaging and contain clear task instructions. The implementation of these considerations will support the development of more reliable, valid and inclusive assessments which will allow researchers and practitioners to support equitable and feasible online testing moving forward.
期刊介绍:
PsyCh Journal, China''s first international psychology journal, publishes peer‑reviewed research articles, research reports and integrated research reviews spanning the entire spectrum of scientific psychology and its applications. PsyCh Journal is the flagship journal of the Institute of Psychology, Chinese Academy of Sciences – the only national psychology research institute in China – and reflects the high research standards of the nation. Launched in 2012, PsyCh Journal is devoted to the publication of advanced research exploring basic mechanisms of the human mind and behavior, and delivering scientific knowledge to enhance understanding of culture and society. Towards that broader goal, the Journal will provide a forum for academic exchange and a “knowledge bridge” between China and the World by showcasing high-quality, cutting-edge research related to the science and practice of psychology both within and outside of China. PsyCh Journal features original articles of both empirical and theoretical research in scientific psychology and interdisciplinary sciences, across all levels, from molecular, cellular and system, to individual, group and society. The Journal also publishes evaluative and integrative review papers on any significant research contribution in any area of scientific psychology