Rocco Ballester , Yanis Labeyrie , Mehmet Oguz Mulayim , Jose Luis Fernandez-Marquez , Jesus Cerquides
{"title":"众包地理定位:数学和计算建模方法的详细探索","authors":"Rocco Ballester , Yanis Labeyrie , Mehmet Oguz Mulayim , Jose Luis Fernandez-Marquez , Jesus Cerquides","doi":"10.1016/j.cogsys.2024.101266","DOIUrl":null,"url":null,"abstract":"<div><p>In emergency situations, social media platforms produce a vast amount of real-time data that holds immense value, particularly in the first 72 h following a disaster event. Despite previous efforts, efficiently determining the geographical location of images related to a new disaster remains an unresolved operational challenge. Currently, the state-of-the-art approach for dealing with these first response mapping is first filtering and then submitting the images to be geolocated to a volunteer crowd, assigning the images randomly to the volunteers. In this work, we extend our previous paper (Ballester et al., 2023) to explore the potential of artificial intelligence (AI) in aiding emergency responders and disaster relief organizations in geolocating social media images from a zone recently hit by a disaster. Our contributions include building two different models in which we try to (i) be able to learn volunteers’ error profiles and (ii) intelligently assign tasks to those volunteers who exhibit higher proficiency. Moreover, we present methods that outperform random allocation of tasks, analyze the effect on the models’ performance when varying numerous parameters, and show that for a given set of tasks and volunteers, we are able to process them with a significantly lower annotation budget, that is, we are able to make fewer volunteer solicitations without losing any quality on the final consensus.</p></div>","PeriodicalId":55242,"journal":{"name":"Cognitive Systems Research","volume":"88 ","pages":"Article 101266"},"PeriodicalIF":2.1000,"publicationDate":"2024-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Crowdsourced geolocation: Detailed exploration of mathematical and computational modeling approaches\",\"authors\":\"Rocco Ballester , Yanis Labeyrie , Mehmet Oguz Mulayim , Jose Luis Fernandez-Marquez , Jesus Cerquides\",\"doi\":\"10.1016/j.cogsys.2024.101266\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>In emergency situations, social media platforms produce a vast amount of real-time data that holds immense value, particularly in the first 72 h following a disaster event. Despite previous efforts, efficiently determining the geographical location of images related to a new disaster remains an unresolved operational challenge. Currently, the state-of-the-art approach for dealing with these first response mapping is first filtering and then submitting the images to be geolocated to a volunteer crowd, assigning the images randomly to the volunteers. In this work, we extend our previous paper (Ballester et al., 2023) to explore the potential of artificial intelligence (AI) in aiding emergency responders and disaster relief organizations in geolocating social media images from a zone recently hit by a disaster. Our contributions include building two different models in which we try to (i) be able to learn volunteers’ error profiles and (ii) intelligently assign tasks to those volunteers who exhibit higher proficiency. Moreover, we present methods that outperform random allocation of tasks, analyze the effect on the models’ performance when varying numerous parameters, and show that for a given set of tasks and volunteers, we are able to process them with a significantly lower annotation budget, that is, we are able to make fewer volunteer solicitations without losing any quality on the final consensus.</p></div>\",\"PeriodicalId\":55242,\"journal\":{\"name\":\"Cognitive Systems Research\",\"volume\":\"88 \",\"pages\":\"Article 101266\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2024-07-31\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Cognitive Systems Research\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1389041724000603\",\"RegionNum\":3,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cognitive Systems Research","FirstCategoryId":"102","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1389041724000603","RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Crowdsourced geolocation: Detailed exploration of mathematical and computational modeling approaches
In emergency situations, social media platforms produce a vast amount of real-time data that holds immense value, particularly in the first 72 h following a disaster event. Despite previous efforts, efficiently determining the geographical location of images related to a new disaster remains an unresolved operational challenge. Currently, the state-of-the-art approach for dealing with these first response mapping is first filtering and then submitting the images to be geolocated to a volunteer crowd, assigning the images randomly to the volunteers. In this work, we extend our previous paper (Ballester et al., 2023) to explore the potential of artificial intelligence (AI) in aiding emergency responders and disaster relief organizations in geolocating social media images from a zone recently hit by a disaster. Our contributions include building two different models in which we try to (i) be able to learn volunteers’ error profiles and (ii) intelligently assign tasks to those volunteers who exhibit higher proficiency. Moreover, we present methods that outperform random allocation of tasks, analyze the effect on the models’ performance when varying numerous parameters, and show that for a given set of tasks and volunteers, we are able to process them with a significantly lower annotation budget, that is, we are able to make fewer volunteer solicitations without losing any quality on the final consensus.
期刊介绍:
Cognitive Systems Research is dedicated to the study of human-level cognition. As such, it welcomes papers which advance the understanding, design and applications of cognitive and intelligent systems, both natural and artificial.
The journal brings together a broad community studying cognition in its many facets in vivo and in silico, across the developmental spectrum, focusing on individual capacities or on entire architectures. It aims to foster debate and integrate ideas, concepts, constructs, theories, models and techniques from across different disciplines and different perspectives on human-level cognition. The scope of interest includes the study of cognitive capacities and architectures - both brain-inspired and non-brain-inspired - and the application of cognitive systems to real-world problems as far as it offers insights relevant for the understanding of cognition.
Cognitive Systems Research therefore welcomes mature and cutting-edge research approaching cognition from a systems-oriented perspective, both theoretical and empirically-informed, in the form of original manuscripts, short communications, opinion articles, systematic reviews, and topical survey articles from the fields of Cognitive Science (including Philosophy of Cognitive Science), Artificial Intelligence/Computer Science, Cognitive Robotics, Developmental Science, Psychology, and Neuroscience and Neuromorphic Engineering. Empirical studies will be considered if they are supplemented by theoretical analyses and contributions to theory development and/or computational modelling studies.