Muhammad Ainul Fikri, Iqbal Kurniawan Asmar Putra, S. Wibirama
{"title":"基于LSTM网络的自发注视交互对象选择","authors":"Muhammad Ainul Fikri, Iqbal Kurniawan Asmar Putra, S. Wibirama","doi":"10.1109/ICITEE56407.2022.9954104","DOIUrl":null,"url":null,"abstract":"Two years on with Covid-19, touchless technology has evolved from a device that symbolizes luxury to something that is necessary. Eye tracker is one type of touchless technologies that uses user's gaze to interact with computer without touching the screen. Development of spontaneous gazebased interaction is progressing very rapidly. Researchers have developed various object selection methods without prior gazeto-screen calibration. Recently, the conventional approach of setting threshold was developed as a gaze-based object selection method. However, the use of threshold values is considered non-adaptive and requires additional data pre-processing to handle noises. To overcome this problem, deep learning is used as an object selection method for spontaneous gaze-based interaction. Deep learning does not require any data preprocessing method to achieve accurate object selection results. Out of five deep learning algorithms that were evaluated, LSTM (Long Short-Term Memory) and BiLSTM (Bidirectional Long Short-Term Memory) networks achieved comparable accuracy of $95.17 \\pm 0.95$% and $95.15 \\pm 1.17$%, respectively. In future, our research is promising for development of real-time object selection technique for touchless public display.","PeriodicalId":246279,"journal":{"name":"2022 14th International Conference on Information Technology and Electrical Engineering (ICITEE)","volume":"43 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Object Selection Using LSTM Networks for Spontaneous Gaze-Based Interaction\",\"authors\":\"Muhammad Ainul Fikri, Iqbal Kurniawan Asmar Putra, S. Wibirama\",\"doi\":\"10.1109/ICITEE56407.2022.9954104\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Two years on with Covid-19, touchless technology has evolved from a device that symbolizes luxury to something that is necessary. Eye tracker is one type of touchless technologies that uses user's gaze to interact with computer without touching the screen. Development of spontaneous gazebased interaction is progressing very rapidly. Researchers have developed various object selection methods without prior gazeto-screen calibration. Recently, the conventional approach of setting threshold was developed as a gaze-based object selection method. However, the use of threshold values is considered non-adaptive and requires additional data pre-processing to handle noises. To overcome this problem, deep learning is used as an object selection method for spontaneous gaze-based interaction. Deep learning does not require any data preprocessing method to achieve accurate object selection results. Out of five deep learning algorithms that were evaluated, LSTM (Long Short-Term Memory) and BiLSTM (Bidirectional Long Short-Term Memory) networks achieved comparable accuracy of $95.17 \\\\pm 0.95$% and $95.15 \\\\pm 1.17$%, respectively. In future, our research is promising for development of real-time object selection technique for touchless public display.\",\"PeriodicalId\":246279,\"journal\":{\"name\":\"2022 14th International Conference on Information Technology and Electrical Engineering (ICITEE)\",\"volume\":\"43 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-10-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 14th International Conference on Information Technology and Electrical Engineering (ICITEE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICITEE56407.2022.9954104\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 14th International Conference on Information Technology and Electrical Engineering (ICITEE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICITEE56407.2022.9954104","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Object Selection Using LSTM Networks for Spontaneous Gaze-Based Interaction
Two years on with Covid-19, touchless technology has evolved from a device that symbolizes luxury to something that is necessary. Eye tracker is one type of touchless technologies that uses user's gaze to interact with computer without touching the screen. Development of spontaneous gazebased interaction is progressing very rapidly. Researchers have developed various object selection methods without prior gazeto-screen calibration. Recently, the conventional approach of setting threshold was developed as a gaze-based object selection method. However, the use of threshold values is considered non-adaptive and requires additional data pre-processing to handle noises. To overcome this problem, deep learning is used as an object selection method for spontaneous gaze-based interaction. Deep learning does not require any data preprocessing method to achieve accurate object selection results. Out of five deep learning algorithms that were evaluated, LSTM (Long Short-Term Memory) and BiLSTM (Bidirectional Long Short-Term Memory) networks achieved comparable accuracy of $95.17 \pm 0.95$% and $95.15 \pm 1.17$%, respectively. In future, our research is promising for development of real-time object selection technique for touchless public display.