基于虚拟世界探索和视听感官替代的阅读障碍读者数学内容浏览

IF 2.5 Q3 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS ACM Transactions on Accessible Computing Pub Date : 2022-02-03 DOI:10.1145/3584365
Rynhardt Kruger, Febe de Wet, T. Niesler
{"title":"基于虚拟世界探索和视听感官替代的阅读障碍读者数学内容浏览","authors":"Rynhardt Kruger, Febe de Wet, T. Niesler","doi":"10.1145/3584365","DOIUrl":null,"url":null,"abstract":"Documents containing mathematical content remain largely inaccessible to blind and visually impaired readers because they are predominantly published as untagged PDFs, which do not include the semantic data necessary for effective accessibility. Equations in such documents consist of text interlaced with lines and other graphical elements and cannot be interpreted using a screen reader. We present a browsing approach for print-disabled readers specifically aimed at such mathematical content. This approach draws on the navigational mechanisms often used to explore the virtual worlds of text adventure games with audio-visual sensory substitution for graphical content. The relative spatial placement of the elements of an equation are represented as a virtual world so the reader can navigate between elements. Text elements are announced conventionally using synthesised speech, while graphical elements, such as roots and fraction lines, are rendered using a modification of the vOICe algorithm. The virtual world allows the reader to interactively discover the spatial structure of the equation, while the rendition of graphical elements as sound allows the shape and identity of elements that cannot be synthesised as speech to be discovered and recognised. The browsing approach was evaluated by 11 blind and 14 sighted participants in a user trial that included identifying twelve equations extracted from PDF documents. Overall, equations were identified completely correctly in 78% of cases (74% and 83%, respectively, for blind and sighted subjects). If partial correctness is considered, then the performance is substantially higher. Feedback from the blind subjects indicated that the technique allows spatial information and graphical detail to be discovered. We conclude that the integration of a spatial model represented as a virtual world in conjunction with audio-visual sensory substitution for non-textual elements can be an effective way for blind and visually impaired readers to read currently inaccessible mathematical content in PDF documents.","PeriodicalId":54128,"journal":{"name":"ACM Transactions on Accessible Computing","volume":"58 1","pages":"1 - 27"},"PeriodicalIF":2.5000,"publicationDate":"2022-02-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Mathematical Content Browsing for Print-disabled Readers Based on Virtual-world Exploration and Audio-visual Sensory Substitution\",\"authors\":\"Rynhardt Kruger, Febe de Wet, T. Niesler\",\"doi\":\"10.1145/3584365\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Documents containing mathematical content remain largely inaccessible to blind and visually impaired readers because they are predominantly published as untagged PDFs, which do not include the semantic data necessary for effective accessibility. Equations in such documents consist of text interlaced with lines and other graphical elements and cannot be interpreted using a screen reader. We present a browsing approach for print-disabled readers specifically aimed at such mathematical content. This approach draws on the navigational mechanisms often used to explore the virtual worlds of text adventure games with audio-visual sensory substitution for graphical content. The relative spatial placement of the elements of an equation are represented as a virtual world so the reader can navigate between elements. Text elements are announced conventionally using synthesised speech, while graphical elements, such as roots and fraction lines, are rendered using a modification of the vOICe algorithm. The virtual world allows the reader to interactively discover the spatial structure of the equation, while the rendition of graphical elements as sound allows the shape and identity of elements that cannot be synthesised as speech to be discovered and recognised. The browsing approach was evaluated by 11 blind and 14 sighted participants in a user trial that included identifying twelve equations extracted from PDF documents. Overall, equations were identified completely correctly in 78% of cases (74% and 83%, respectively, for blind and sighted subjects). If partial correctness is considered, then the performance is substantially higher. Feedback from the blind subjects indicated that the technique allows spatial information and graphical detail to be discovered. We conclude that the integration of a spatial model represented as a virtual world in conjunction with audio-visual sensory substitution for non-textual elements can be an effective way for blind and visually impaired readers to read currently inaccessible mathematical content in PDF documents.\",\"PeriodicalId\":54128,\"journal\":{\"name\":\"ACM Transactions on Accessible Computing\",\"volume\":\"58 1\",\"pages\":\"1 - 27\"},\"PeriodicalIF\":2.5000,\"publicationDate\":\"2022-02-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ACM Transactions on Accessible Computing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3584365\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACM Transactions on Accessible Computing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3584365","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 1

摘要

包含数学内容的文档在很大程度上仍然无法被盲人和视力受损的读者访问,因为它们主要以未标记的pdf形式发布,不包括有效可访问性所需的语义数据。这类文档中的方程式由文本与线条和其他图形元素交错组成,无法使用屏幕阅读器进行解释。我们提出了一种浏览方法为印刷残疾读者专门针对这样的数学内容。这种方法借鉴了通常用于探索文本冒险游戏的虚拟世界的导航机制,使用视听感官代替图像内容。方程元素的相对空间位置表现为一个虚拟世界,因此读者可以在元素之间导航。文本元素通常使用合成语音宣布,而图形元素,如根和分数线,则使用vOICe算法的修改来呈现。虚拟世界允许读者以互动的方式发现方程的空间结构,而图形元素作为声音的再现允许发现和识别不能合成为语音的元素的形状和身份。在一项用户试验中,11名盲人和14名视力正常的参与者对浏览方法进行了评估,其中包括识别从PDF文档中提取的12个方程。总的来说,方程在78%的情况下被完全正确地识别出来(盲人和视力正常的受试者分别为74%和83%)。如果考虑了部分正确性,那么性能会大大提高。来自盲人受试者的反馈表明,该技术可以发现空间信息和图形细节。我们得出的结论是,将空间模型表示为虚拟世界,并结合视听感官替代非文本元素,可以为盲人和视障读者提供阅读PDF文档中当前无法访问的数学内容的有效方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Mathematical Content Browsing for Print-disabled Readers Based on Virtual-world Exploration and Audio-visual Sensory Substitution
Documents containing mathematical content remain largely inaccessible to blind and visually impaired readers because they are predominantly published as untagged PDFs, which do not include the semantic data necessary for effective accessibility. Equations in such documents consist of text interlaced with lines and other graphical elements and cannot be interpreted using a screen reader. We present a browsing approach for print-disabled readers specifically aimed at such mathematical content. This approach draws on the navigational mechanisms often used to explore the virtual worlds of text adventure games with audio-visual sensory substitution for graphical content. The relative spatial placement of the elements of an equation are represented as a virtual world so the reader can navigate between elements. Text elements are announced conventionally using synthesised speech, while graphical elements, such as roots and fraction lines, are rendered using a modification of the vOICe algorithm. The virtual world allows the reader to interactively discover the spatial structure of the equation, while the rendition of graphical elements as sound allows the shape and identity of elements that cannot be synthesised as speech to be discovered and recognised. The browsing approach was evaluated by 11 blind and 14 sighted participants in a user trial that included identifying twelve equations extracted from PDF documents. Overall, equations were identified completely correctly in 78% of cases (74% and 83%, respectively, for blind and sighted subjects). If partial correctness is considered, then the performance is substantially higher. Feedback from the blind subjects indicated that the technique allows spatial information and graphical detail to be discovered. We conclude that the integration of a spatial model represented as a virtual world in conjunction with audio-visual sensory substitution for non-textual elements can be an effective way for blind and visually impaired readers to read currently inaccessible mathematical content in PDF documents.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
ACM Transactions on Accessible Computing
ACM Transactions on Accessible Computing COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS-
CiteScore
6.20
自引率
8.30%
发文量
43
期刊介绍: Computer and information technologies have re-designed the way modern society operates. Their widespread use poses both opportunities and challenges for people who experience various disabilities including age-related disabilities. That is, while there are new avenues to assist individuals with disabilities and provide tools and resources to alleviate the traditional barriers encountered by these individuals, in many cases the technology itself presents barriers to use. ACM Transactions on Accessible Computing (TACCESS) is a quarterly peer-reviewed journal that publishes refereed articles addressing issues of computing that seek to address barriers to access, either creating new solutions or providing for the more inclusive design of technology to provide access for individuals with diverse abilities. The journal provides a technical forum for disseminating innovative research that covers either applications of computing and information technologies to provide assistive systems or inclusive technologies for individuals with disabilities. Some examples are web accessibility for those with visual impairments and blindness as well as web search explorations for those with limited cognitive abilities, technologies to address stroke rehabilitation or dementia care, language support systems deaf signers or those with limited language abilities, and input systems for individuals with limited ability to control traditional mouse and keyboard systems. The journal is of particular interest to SIGACCESS members and delegates to its affiliated conference (i.e., ASSETS) as well as other international accessibility conferences. It serves as a forum for discussions and information exchange between researchers, clinicians, and educators; including rehabilitation personnel who administer assistive technologies; and policy makers concerned with equitable access to information technologies.
期刊最新文献
Stress Detection of Autistic Adults during Simulated Job Interviews using a Novel Physiological Dataset and Machine Learning Measuring the Accuracy of Automatic Speech Recognition Solutions Helping or hindering: Inclusive Design of Automated Task Prompting for Workers with Cognitive Disabilities Supporting Social Inclusion with DIY-ATs: Perspectives of Kenyan Caregivers of Children with Cognitive Disabilities Digital Musical Instruments in Special Educational Needs Schools: Requirements from the Music Teachers’ Perspective and the Status Quo in Germany
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1