{"title":"Towards Intelligent Reading through Multimodal and Contextualized Word LookUp","authors":"Swetha Govindu, Raviteja Vidya Guttula, Swati Kohli, Poonam Patil, Anagha Kulkarni, Ilmi Yoon","doi":"10.1109/ICMLA52953.2021.00203","DOIUrl":null,"url":null,"abstract":"This paper presents Koob, an eBook Reader app that coalesces three key ideas to enhance students’ language learning, specifically for ambiguous words. The first idea is to improve the effectiveness of word lookup functionality through contextualization – by incorporating word sense disambiguation (WSD) techniques to show the contextually relevant definition at the top. The second idea is to augment WSD results with crowd-sourcing solutions. The last idea seeks to reinforce students’ learning by augmenting textual information with a visual aid, pictures related to the word, as part of the word lookup functionality. An empirical evaluation demonstrates that existing WSD techniques can successfully employed to dynamically reorder definitions such that the most relevant definition is at the top of the list for more than 80% of the instances.","PeriodicalId":6750,"journal":{"name":"2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA)","volume":"10 1","pages":"1249-1252"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICMLA52953.2021.00203","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1
Abstract
This paper presents Koob, an eBook Reader app that coalesces three key ideas to enhance students’ language learning, specifically for ambiguous words. The first idea is to improve the effectiveness of word lookup functionality through contextualization – by incorporating word sense disambiguation (WSD) techniques to show the contextually relevant definition at the top. The second idea is to augment WSD results with crowd-sourcing solutions. The last idea seeks to reinforce students’ learning by augmenting textual information with a visual aid, pictures related to the word, as part of the word lookup functionality. An empirical evaluation demonstrates that existing WSD techniques can successfully employed to dynamically reorder definitions such that the most relevant definition is at the top of the list for more than 80% of the instances.