Ingus Janis Pretkalnins, A. Sprogis, Guntis Barzdins
{"title":"CLIP Augmentation for Image Search","authors":"Ingus Janis Pretkalnins, A. Sprogis, Guntis Barzdins","doi":"10.5220/0011046600003197","DOIUrl":null,"url":null,"abstract":": We devised a probabilistic method for adding face recognition to the neural network model CLIP. The method was tested by creating a prototype and matching 1000 images to their descriptions. The method improved the text to image Recall @ 1 metric from 14.0% matches for CLIP alone to 21.8% for CLIP + method, for a sample size of 1000 images and descriptions.","PeriodicalId":414016,"journal":{"name":"International Conference on Complex Information Systems","volume":"7 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Conference on Complex Information Systems","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5220/0011046600003197","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
: We devised a probabilistic method for adding face recognition to the neural network model CLIP. The method was tested by creating a prototype and matching 1000 images to their descriptions. The method improved the text to image Recall @ 1 metric from 14.0% matches for CLIP alone to 21.8% for CLIP + method, for a sample size of 1000 images and descriptions.