{"title":"对齐视觉和词汇语义","authors":"Fausto Giunchiglia, Mayukh Bagchi, Xiaolei Diao","doi":"10.48550/arXiv.2212.06629","DOIUrl":null,"url":null,"abstract":"We discuss two kinds of semantics relevant to Computer Vision (CV) systems - Visual Semantics and Lexical Semantics. While visual semantics focus on how humans build concepts when using vision to perceive a target reality, lexical semantics focus on how humans build concepts of the same target reality through the use of language. The lack of coincidence between visual and lexical semantics, in turn, has a major impact on CV systems in the form of the Semantic Gap Problem (SGP). The paper, while extensively exemplifying the lack of coincidence as above, introduces a general, domain-agnostic methodology to enforce alignment between visual and lexical semantics.","PeriodicalId":93543,"journal":{"name":"Diversity, divergence, dialogue : 16th international conference, iConference 2021, Beijing, China, March 17-31, 2021 : proceedings. iConference (Conference) (16th : 2021 : Online)","volume":"172 1","pages":"294-302"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"Aligning Visual and Lexical Semantics\",\"authors\":\"Fausto Giunchiglia, Mayukh Bagchi, Xiaolei Diao\",\"doi\":\"10.48550/arXiv.2212.06629\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"We discuss two kinds of semantics relevant to Computer Vision (CV) systems - Visual Semantics and Lexical Semantics. While visual semantics focus on how humans build concepts when using vision to perceive a target reality, lexical semantics focus on how humans build concepts of the same target reality through the use of language. The lack of coincidence between visual and lexical semantics, in turn, has a major impact on CV systems in the form of the Semantic Gap Problem (SGP). The paper, while extensively exemplifying the lack of coincidence as above, introduces a general, domain-agnostic methodology to enforce alignment between visual and lexical semantics.\",\"PeriodicalId\":93543,\"journal\":{\"name\":\"Diversity, divergence, dialogue : 16th international conference, iConference 2021, Beijing, China, March 17-31, 2021 : proceedings. iConference (Conference) (16th : 2021 : Online)\",\"volume\":\"172 1\",\"pages\":\"294-302\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-12-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Diversity, divergence, dialogue : 16th international conference, iConference 2021, Beijing, China, March 17-31, 2021 : proceedings. iConference (Conference) (16th : 2021 : Online)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.48550/arXiv.2212.06629\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Diversity, divergence, dialogue : 16th international conference, iConference 2021, Beijing, China, March 17-31, 2021 : proceedings. iConference (Conference) (16th : 2021 : Online)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.48550/arXiv.2212.06629","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
We discuss two kinds of semantics relevant to Computer Vision (CV) systems - Visual Semantics and Lexical Semantics. While visual semantics focus on how humans build concepts when using vision to perceive a target reality, lexical semantics focus on how humans build concepts of the same target reality through the use of language. The lack of coincidence between visual and lexical semantics, in turn, has a major impact on CV systems in the form of the Semantic Gap Problem (SGP). The paper, while extensively exemplifying the lack of coincidence as above, introduces a general, domain-agnostic methodology to enforce alignment between visual and lexical semantics.