{"title":"Aligning Visual and Lexical Semantics","authors":"Fausto Giunchiglia, Mayukh Bagchi, Xiaolei Diao","doi":"10.48550/arXiv.2212.06629","DOIUrl":null,"url":null,"abstract":"We discuss two kinds of semantics relevant to Computer Vision (CV) systems - Visual Semantics and Lexical Semantics. While visual semantics focus on how humans build concepts when using vision to perceive a target reality, lexical semantics focus on how humans build concepts of the same target reality through the use of language. The lack of coincidence between visual and lexical semantics, in turn, has a major impact on CV systems in the form of the Semantic Gap Problem (SGP). The paper, while extensively exemplifying the lack of coincidence as above, introduces a general, domain-agnostic methodology to enforce alignment between visual and lexical semantics.","PeriodicalId":93543,"journal":{"name":"Diversity, divergence, dialogue : 16th international conference, iConference 2021, Beijing, China, March 17-31, 2021 : proceedings. iConference (Conference) (16th : 2021 : Online)","volume":"172 1","pages":"294-302"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Diversity, divergence, dialogue : 16th international conference, iConference 2021, Beijing, China, March 17-31, 2021 : proceedings. iConference (Conference) (16th : 2021 : Online)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.48550/arXiv.2212.06629","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3
Abstract
We discuss two kinds of semantics relevant to Computer Vision (CV) systems - Visual Semantics and Lexical Semantics. While visual semantics focus on how humans build concepts when using vision to perceive a target reality, lexical semantics focus on how humans build concepts of the same target reality through the use of language. The lack of coincidence between visual and lexical semantics, in turn, has a major impact on CV systems in the form of the Semantic Gap Problem (SGP). The paper, while extensively exemplifying the lack of coincidence as above, introduces a general, domain-agnostic methodology to enforce alignment between visual and lexical semantics.
京公网安备 11010802042870号
京ICP备2023020795号-1
分享
求助内容：
应助结果提醒方式：
扫码关注我们
