Robert O. Davis, Yong-Jik Lee, Joseph Vincent, Lili Wan
{"title":"利用教学代理探索多媒体环境中的手势频率和图像","authors":"Robert O. Davis, Yong-Jik Lee, Joseph Vincent, Lili Wan","doi":"10.1111/jcal.13053","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background</h3>\n \n <p>Gestures are an integral component in human-to-human communication when the speaker is visually present to the listener. In the past several years, research has examined how computer-generated pedagogical agents can be designed to perform the four main gesture types and what this means for agent persona and learning outcomes. The research into agent gesturing has only explored gestures without other presentation strategies such as visual aids or verbal redundancy to properly explore the impact of gestures, and to avoid overly “rich” displays of information.</p>\n </section>\n \n <section>\n \n <h3> Objective</h3>\n \n <p>The objective of this study is to explore the use of static images and varying frequencies of gestures to assess whether two visual inputs increases the risk of the split-attention effect, and to investigate the potential for visual redundancy when two visual inputs coincide with narration. Data on cognitive load, agent persona, and learning outcomes (recall and transfer) will be collected to measure participants' learning experience while acquiring procedural knowledge, specifically regarding the principles of lightning, in comparison to previous research.</p>\n </section>\n \n <section>\n \n <h3> Method</h3>\n \n <p>A mixed methods approach consisted of three gesture frequency conditions (enhanced, average, no) with 118 participants. Quantitative data were analysed using a random-effect linear regression model; whereas qualitative data was collected through individual interviews that lasted 15–20 min.</p>\n </section>\n \n <section>\n \n <h3> Results and Conclusions</h3>\n \n <p>The use of enhanced gesture frequency and images may significantly increase intrinsic cognitive load, but gestures and images do not cause extraneous cognitive load. The enhanced gesture condition significantly outperformed the no-gesture condition. Interviews indicated that depending upon the gesture condition, students selectively attended to information that they perceived as offering them the greatest learning opportunity. Using two visual inputs does not cause split-attention, nor does it provide evidence of a visual redundancy effect.</p>\n </section>\n </div>","PeriodicalId":48071,"journal":{"name":"Journal of Computer Assisted Learning","volume":"40 6","pages":"3055-3071"},"PeriodicalIF":5.1000,"publicationDate":"2024-08-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Exploring gesture frequencies and images in multimedia environments with pedagogical agents\",\"authors\":\"Robert O. Davis, Yong-Jik Lee, Joseph Vincent, Lili Wan\",\"doi\":\"10.1111/jcal.13053\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n \\n <section>\\n \\n <h3> Background</h3>\\n \\n <p>Gestures are an integral component in human-to-human communication when the speaker is visually present to the listener. In the past several years, research has examined how computer-generated pedagogical agents can be designed to perform the four main gesture types and what this means for agent persona and learning outcomes. The research into agent gesturing has only explored gestures without other presentation strategies such as visual aids or verbal redundancy to properly explore the impact of gestures, and to avoid overly “rich” displays of information.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Objective</h3>\\n \\n <p>The objective of this study is to explore the use of static images and varying frequencies of gestures to assess whether two visual inputs increases the risk of the split-attention effect, and to investigate the potential for visual redundancy when two visual inputs coincide with narration. Data on cognitive load, agent persona, and learning outcomes (recall and transfer) will be collected to measure participants' learning experience while acquiring procedural knowledge, specifically regarding the principles of lightning, in comparison to previous research.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Method</h3>\\n \\n <p>A mixed methods approach consisted of three gesture frequency conditions (enhanced, average, no) with 118 participants. Quantitative data were analysed using a random-effect linear regression model; whereas qualitative data was collected through individual interviews that lasted 15–20 min.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Results and Conclusions</h3>\\n \\n <p>The use of enhanced gesture frequency and images may significantly increase intrinsic cognitive load, but gestures and images do not cause extraneous cognitive load. The enhanced gesture condition significantly outperformed the no-gesture condition. Interviews indicated that depending upon the gesture condition, students selectively attended to information that they perceived as offering them the greatest learning opportunity. Using two visual inputs does not cause split-attention, nor does it provide evidence of a visual redundancy effect.</p>\\n </section>\\n </div>\",\"PeriodicalId\":48071,\"journal\":{\"name\":\"Journal of Computer Assisted Learning\",\"volume\":\"40 6\",\"pages\":\"3055-3071\"},\"PeriodicalIF\":5.1000,\"publicationDate\":\"2024-08-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Computer Assisted Learning\",\"FirstCategoryId\":\"95\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/jcal.13053\",\"RegionNum\":2,\"RegionCategory\":\"教育学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Computer Assisted Learning","FirstCategoryId":"95","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/jcal.13053","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
Exploring gesture frequencies and images in multimedia environments with pedagogical agents
Background
Gestures are an integral component in human-to-human communication when the speaker is visually present to the listener. In the past several years, research has examined how computer-generated pedagogical agents can be designed to perform the four main gesture types and what this means for agent persona and learning outcomes. The research into agent gesturing has only explored gestures without other presentation strategies such as visual aids or verbal redundancy to properly explore the impact of gestures, and to avoid overly “rich” displays of information.
Objective
The objective of this study is to explore the use of static images and varying frequencies of gestures to assess whether two visual inputs increases the risk of the split-attention effect, and to investigate the potential for visual redundancy when two visual inputs coincide with narration. Data on cognitive load, agent persona, and learning outcomes (recall and transfer) will be collected to measure participants' learning experience while acquiring procedural knowledge, specifically regarding the principles of lightning, in comparison to previous research.
Method
A mixed methods approach consisted of three gesture frequency conditions (enhanced, average, no) with 118 participants. Quantitative data were analysed using a random-effect linear regression model; whereas qualitative data was collected through individual interviews that lasted 15–20 min.
Results and Conclusions
The use of enhanced gesture frequency and images may significantly increase intrinsic cognitive load, but gestures and images do not cause extraneous cognitive load. The enhanced gesture condition significantly outperformed the no-gesture condition. Interviews indicated that depending upon the gesture condition, students selectively attended to information that they perceived as offering them the greatest learning opportunity. Using two visual inputs does not cause split-attention, nor does it provide evidence of a visual redundancy effect.
期刊介绍:
The Journal of Computer Assisted Learning is an international peer-reviewed journal which covers the whole range of uses of information and communication technology to support learning and knowledge exchange. It aims to provide a medium for communication among researchers as well as a channel linking researchers, practitioners, and policy makers. JCAL is also a rich source of material for master and PhD students in areas such as educational psychology, the learning sciences, instructional technology, instructional design, collaborative learning, intelligent learning systems, learning analytics, open, distance and networked learning, and educational evaluation and assessment. This is the case for formal (e.g., schools), non-formal (e.g., workplace learning) and informal learning (e.g., museums and libraries) situations and environments. Volumes often include one Special Issue which these provides readers with a broad and in-depth perspective on a specific topic. First published in 1985, JCAL continues to have the aim of making the outcomes of contemporary research and experience accessible. During this period there have been major technological advances offering new opportunities and approaches in the use of a wide range of technologies to support learning and knowledge transfer more generally. There is currently much emphasis on the use of network functionality and the challenges its appropriate uses pose to teachers/tutors working with students locally and at a distance. JCAL welcomes: -Empirical reports, single studies or programmatic series of studies on the use of computers and information technologies in learning and assessment -Critical and original meta-reviews of literature on the use of computers for learning -Empirical studies on the design and development of innovative technology-based systems for learning -Conceptual articles on issues relating to the Aims and Scope