Evaluating the effectiveness of sonification in science education using Edukoi

Q1 Social Sciences Personal and Ubiquitous Computing Pub Date : 2024-05-29 DOI:10.1007/s00779-024-01809-5
Lucrezia Guiotto Nai Fovino, Anita Zanella, Luca Di Mascolo, Michele Ginolfi, Nicolò Carpita, Francesco Trovato Manuncola, Massimo Grassi
{"title":"Evaluating the effectiveness of sonification in science education using Edukoi","authors":"Lucrezia Guiotto Nai Fovino, Anita Zanella, Luca Di Mascolo, Michele Ginolfi, Nicolò Carpita, Francesco Trovato Manuncola, Massimo Grassi","doi":"10.1007/s00779-024-01809-5","DOIUrl":null,"url":null,"abstract":"<p>Science, Technology, Engineering, and Mathematics classes are mainly taught using visual supports. However, the advancement of technology and the increasing efforts to equip schools with digital instrumentation have opened up the possibility of exploring new teaching avenues, such as sonification. We explored the efficacy of sonification in education using a novel interactive tool, Edukoi, in the context of astronomy, which is predominantly disseminated through spectacular images, animations, and visuals. Edukoi is a motion-sensing sonification tool that converts images to sound in real-time for educational applications. Our study, conducted with nearly 150 middle-school students, included a preliminary questionnaire investigating the perception, engagement, and motivation of students towards science; two sessions dedicated to testing Edukoi and assessing the potentiality of the software for the recognition of the colour and the shape of real and sketchy images; and a final second administration of the questionnaire to capture a possible beneficial effect of the use of the tool in the engagement towards science. Results showed the effectiveness of Edukoi in colour recognition and reasonable efficacy in shape identification. Although the questionnaire did not reveal an increment in science engagement over the time of the study, oral feedback from the students was positive. Edukoi presents a possible alternative teaching aid, potentially benefiting diverse learners, including the visually impaired. Further developments of the software are needed to enhance its effectiveness in conveying more complex features such as composite colours or shapes.</p>","PeriodicalId":54628,"journal":{"name":"Personal and Ubiquitous Computing","volume":"9 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Personal and Ubiquitous Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1007/s00779-024-01809-5","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Social Sciences","Score":null,"Total":0}
引用次数: 0

Abstract

Science, Technology, Engineering, and Mathematics classes are mainly taught using visual supports. However, the advancement of technology and the increasing efforts to equip schools with digital instrumentation have opened up the possibility of exploring new teaching avenues, such as sonification. We explored the efficacy of sonification in education using a novel interactive tool, Edukoi, in the context of astronomy, which is predominantly disseminated through spectacular images, animations, and visuals. Edukoi is a motion-sensing sonification tool that converts images to sound in real-time for educational applications. Our study, conducted with nearly 150 middle-school students, included a preliminary questionnaire investigating the perception, engagement, and motivation of students towards science; two sessions dedicated to testing Edukoi and assessing the potentiality of the software for the recognition of the colour and the shape of real and sketchy images; and a final second administration of the questionnaire to capture a possible beneficial effect of the use of the tool in the engagement towards science. Results showed the effectiveness of Edukoi in colour recognition and reasonable efficacy in shape identification. Although the questionnaire did not reveal an increment in science engagement over the time of the study, oral feedback from the students was positive. Edukoi presents a possible alternative teaching aid, potentially benefiting diverse learners, including the visually impaired. Further developments of the software are needed to enhance its effectiveness in conveying more complex features such as composite colours or shapes.

Abstract Image

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
利用 Edukoi 评估科学教育中的声化效果
科学、技术、工程和数学课程主要采用视觉辅助教学。然而,技术的进步和学校越来越多地配备数字仪器,为探索新的教学途径提供了可能,比如声化教学。天文学主要通过壮观的图像、动画和视觉效果进行传播,我们利用新颖的互动工具 Edukoi 探索了声化在天文学教育中的功效。Edukoi 是一种动作感应声化工具,可将图像实时转换成声音,用于教育应用。我们的研究对象是近 150 名中学生,包括一份初步调查问卷,调查学生对科学的感知、参与和动机;两节课专门测试 Edukoi,评估该软件在识别真实和素描图像的颜色和形状方面的潜力;以及最后的第二次问卷调查,以了解使用该工具对参与科学可能产生的有益影响。结果显示,Edukoi 在颜色识别方面很有效,在形状识别方面也有一定的效果。虽然问卷调查并未显示在研究期间科学参与度有所提高,但学生的口头反馈是积极的。Edukoi 提供了一种可能的替代教学辅助工具,有可能使包括视障者在内的不同学习者受益。该软件需要进一步开发,以提高其在传达更复杂特征(如复合颜色或形状)方面的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Personal and Ubiquitous Computing
Personal and Ubiquitous Computing 工程技术-电信学
CiteScore
6.60
自引率
0.00%
发文量
35
审稿时长
6-12 weeks
期刊介绍: Personal and Ubiquitous Computing publishes peer-reviewed multidisciplinary research on personal and ubiquitous technologies and services. The journal provides a global perspective on new developments in research in areas including user experience for advanced digital technologies, the Internet of Things, big data, social technologies and mobile and wearable devices.
期刊最新文献
Sonifying gait kinematics: generating water wading sounds through a digital Foley approach Cross-device free-text keystroke dynamics authentication using federated learning Self-disclosure to conversational AI: a literature review, emergent framework, and directions for future research Rethinking feminized service bots: user responses to abstract and gender-ambiguous chatbot avatars in a large-scale interaction study Informing the design of question-asking conversational agents for reflection
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1