Towards Intelligent Reading through Multimodal and Contextualized Word LookUp

Swetha Govindu, Raviteja Vidya Guttula, Swati Kohli, Poonam Patil, Anagha Kulkarni, Ilmi Yoon
{"title":"Towards Intelligent Reading through Multimodal and Contextualized Word LookUp","authors":"Swetha Govindu, Raviteja Vidya Guttula, Swati Kohli, Poonam Patil, Anagha Kulkarni, Ilmi Yoon","doi":"10.1109/ICMLA52953.2021.00203","DOIUrl":null,"url":null,"abstract":"This paper presents Koob, an eBook Reader app that coalesces three key ideas to enhance students’ language learning, specifically for ambiguous words. The first idea is to improve the effectiveness of word lookup functionality through contextualization – by incorporating word sense disambiguation (WSD) techniques to show the contextually relevant definition at the top. The second idea is to augment WSD results with crowd-sourcing solutions. The last idea seeks to reinforce students’ learning by augmenting textual information with a visual aid, pictures related to the word, as part of the word lookup functionality. An empirical evaluation demonstrates that existing WSD techniques can successfully employed to dynamically reorder definitions such that the most relevant definition is at the top of the list for more than 80% of the instances.","PeriodicalId":6750,"journal":{"name":"2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA)","volume":"10 1","pages":"1249-1252"},"PeriodicalIF":0.0000,"publicationDate":"2021-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 20th IEEE International Conference on Machine Learning and Applications (ICMLA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICMLA52953.2021.00203","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

This paper presents Koob, an eBook Reader app that coalesces three key ideas to enhance students’ language learning, specifically for ambiguous words. The first idea is to improve the effectiveness of word lookup functionality through contextualization – by incorporating word sense disambiguation (WSD) techniques to show the contextually relevant definition at the top. The second idea is to augment WSD results with crowd-sourcing solutions. The last idea seeks to reinforce students’ learning by augmenting textual information with a visual aid, pictures related to the word, as part of the word lookup functionality. An empirical evaluation demonstrates that existing WSD techniques can successfully employed to dynamically reorder definitions such that the most relevant definition is at the top of the list for more than 80% of the instances.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
通过多模态和语境化查词实现智能阅读
本文介绍了Koob,一个电子书阅读器应用程序,它结合了三个关键思想来提高学生的语言学习,特别是对于歧义词。第一个想法是通过上下文化来提高单词查找功能的有效性——通过结合词义消歧(WSD)技术在顶部显示与上下文相关的定义。第二个想法是通过众包解决方案来增强水务署的成果。最后一个想法是通过视觉辅助来增加文本信息,与单词相关的图片,作为单词查找功能的一部分,来加强学生的学习。经验评估表明,现有的WSD技术可以成功地用于动态地重新排序定义,以便在超过80%的实例中,最相关的定义位于列表的顶部。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Detecting Offensive Content on Twitter During Proud Boys Riots Explainable Zero-Shot Modelling of Clinical Depression Symptoms from Text Deep Learning Methods for the Prediction of Information Display Type Using Eye Tracking Sequences Step Detection using SVM on NURVV Trackers Condition Monitoring for Power Converters via Deep One-Class Classification
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1