基于LSTM网络的自发注视交互对象选择

Muhammad Ainul Fikri, Iqbal Kurniawan Asmar Putra, S. Wibirama
{"title":"基于LSTM网络的自发注视交互对象选择","authors":"Muhammad Ainul Fikri, Iqbal Kurniawan Asmar Putra, S. Wibirama","doi":"10.1109/ICITEE56407.2022.9954104","DOIUrl":null,"url":null,"abstract":"Two years on with Covid-19, touchless technology has evolved from a device that symbolizes luxury to something that is necessary. Eye tracker is one type of touchless technologies that uses user's gaze to interact with computer without touching the screen. Development of spontaneous gazebased interaction is progressing very rapidly. Researchers have developed various object selection methods without prior gazeto-screen calibration. Recently, the conventional approach of setting threshold was developed as a gaze-based object selection method. However, the use of threshold values is considered non-adaptive and requires additional data pre-processing to handle noises. To overcome this problem, deep learning is used as an object selection method for spontaneous gaze-based interaction. Deep learning does not require any data preprocessing method to achieve accurate object selection results. Out of five deep learning algorithms that were evaluated, LSTM (Long Short-Term Memory) and BiLSTM (Bidirectional Long Short-Term Memory) networks achieved comparable accuracy of $95.17 \\pm 0.95$% and $95.15 \\pm 1.17$%, respectively. In future, our research is promising for development of real-time object selection technique for touchless public display.","PeriodicalId":246279,"journal":{"name":"2022 14th International Conference on Information Technology and Electrical Engineering (ICITEE)","volume":"43 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Object Selection Using LSTM Networks for Spontaneous Gaze-Based Interaction\",\"authors\":\"Muhammad Ainul Fikri, Iqbal Kurniawan Asmar Putra, S. Wibirama\",\"doi\":\"10.1109/ICITEE56407.2022.9954104\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Two years on with Covid-19, touchless technology has evolved from a device that symbolizes luxury to something that is necessary. Eye tracker is one type of touchless technologies that uses user's gaze to interact with computer without touching the screen. Development of spontaneous gazebased interaction is progressing very rapidly. Researchers have developed various object selection methods without prior gazeto-screen calibration. Recently, the conventional approach of setting threshold was developed as a gaze-based object selection method. However, the use of threshold values is considered non-adaptive and requires additional data pre-processing to handle noises. To overcome this problem, deep learning is used as an object selection method for spontaneous gaze-based interaction. Deep learning does not require any data preprocessing method to achieve accurate object selection results. Out of five deep learning algorithms that were evaluated, LSTM (Long Short-Term Memory) and BiLSTM (Bidirectional Long Short-Term Memory) networks achieved comparable accuracy of $95.17 \\\\pm 0.95$% and $95.15 \\\\pm 1.17$%, respectively. In future, our research is promising for development of real-time object selection technique for touchless public display.\",\"PeriodicalId\":246279,\"journal\":{\"name\":\"2022 14th International Conference on Information Technology and Electrical Engineering (ICITEE)\",\"volume\":\"43 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 14th International Conference on Information Technology and Electrical Engineering (ICITEE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICITEE56407.2022.9954104\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 14th International Conference on Information Technology and Electrical Engineering (ICITEE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICITEE56407.2022.9954104","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

新冠肺炎爆发两年后,非接触式技术已经从一种象征奢侈品的设备发展成为一种必需品。眼动仪是一种非接触式技术,它利用用户的目光与计算机进行交互,而不接触屏幕。自发的基于注视的相互作用的发展非常迅速。研究人员已经开发了各种各样的对象选择方法,而不需要事先对报刊屏幕进行校准。近年来,传统的阈值设置方法被发展成为一种基于注视的目标选择方法。然而,阈值的使用被认为是非自适应的,并且需要额外的数据预处理来处理噪声。为了克服这个问题,深度学习被用作自发的基于注视的交互的对象选择方法。深度学习不需要任何数据预处理方法来获得准确的对象选择结果。在评估的五种深度学习算法中,LSTM(长短期记忆)和BiLSTM(双向长短期记忆)网络的准确率分别为95.17 \pm 0.95$%和95.15 \pm 1.17$%。我们的研究为非接触式公共显示的实时目标选择技术的发展提供了广阔的前景。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Object Selection Using LSTM Networks for Spontaneous Gaze-Based Interaction
Two years on with Covid-19, touchless technology has evolved from a device that symbolizes luxury to something that is necessary. Eye tracker is one type of touchless technologies that uses user's gaze to interact with computer without touching the screen. Development of spontaneous gazebased interaction is progressing very rapidly. Researchers have developed various object selection methods without prior gazeto-screen calibration. Recently, the conventional approach of setting threshold was developed as a gaze-based object selection method. However, the use of threshold values is considered non-adaptive and requires additional data pre-processing to handle noises. To overcome this problem, deep learning is used as an object selection method for spontaneous gaze-based interaction. Deep learning does not require any data preprocessing method to achieve accurate object selection results. Out of five deep learning algorithms that were evaluated, LSTM (Long Short-Term Memory) and BiLSTM (Bidirectional Long Short-Term Memory) networks achieved comparable accuracy of $95.17 \pm 0.95$% and $95.15 \pm 1.17$%, respectively. In future, our research is promising for development of real-time object selection technique for touchless public display.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Measuring Trust Perception during Information Evaluation Comparative Study of Multi-channel and Omni-channel on Supply Chain Management Classifying Stress Mental State by using Power Spectral Density of Electroencephalography (EEG) Development of CNN Pruning Method for Earthquake Signal Imagery Classification Object Selection Using LSTM Networks for Spontaneous Gaze-Based Interaction
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1