{"title":"将人类智能和机器学习结合起来进行事实检查:迈向混合人在循环框架","authors":"David La Barbera, Kevin Roitero, Stefano Mizzaro","doi":"10.3233/ia-230011","DOIUrl":null,"url":null,"abstract":"Online misinformation is posing a serious threat for the modern society. Assessing the veracity of online information is a complex problem which nowadays is addressed by heavily relying on trained fact-checking experts. This solution is not scalable, and due to the importance of the problem the issue gained the attention of the scientific community, which proposed many based on Artificial Intelligence and Machine Learning methods. Despite the efforts made, the effectiveness of such approaches is not yet enough to allow them to be used without supervision. In this position paper, we propose a hybrid human-in-the-loop framework for fact-checking: we address the misinformation issue by relying on a combination of automatic Artificial Intelligence methods, crowdsourcing ones, and experts. We study the single components of the framework as well as their interactions, and we propose an interleaving of the different components which we believe will serve as a useful starting point for the future research towards effective and scalable fact-checking.","PeriodicalId":42055,"journal":{"name":"Intelligenza Artificiale","volume":"10 2","pages":"0"},"PeriodicalIF":1.9000,"publicationDate":"2023-10-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Combining human intelligence and machine learning for fact-checking: Towards a hybrid human-in-the-loop framework\",\"authors\":\"David La Barbera, Kevin Roitero, Stefano Mizzaro\",\"doi\":\"10.3233/ia-230011\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Online misinformation is posing a serious threat for the modern society. Assessing the veracity of online information is a complex problem which nowadays is addressed by heavily relying on trained fact-checking experts. This solution is not scalable, and due to the importance of the problem the issue gained the attention of the scientific community, which proposed many based on Artificial Intelligence and Machine Learning methods. Despite the efforts made, the effectiveness of such approaches is not yet enough to allow them to be used without supervision. In this position paper, we propose a hybrid human-in-the-loop framework for fact-checking: we address the misinformation issue by relying on a combination of automatic Artificial Intelligence methods, crowdsourcing ones, and experts. We study the single components of the framework as well as their interactions, and we propose an interleaving of the different components which we believe will serve as a useful starting point for the future research towards effective and scalable fact-checking.\",\"PeriodicalId\":42055,\"journal\":{\"name\":\"Intelligenza Artificiale\",\"volume\":\"10 2\",\"pages\":\"0\"},\"PeriodicalIF\":1.9000,\"publicationDate\":\"2023-10-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Intelligenza Artificiale\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3233/ia-230011\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Intelligenza Artificiale","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3233/ia-230011","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Combining human intelligence and machine learning for fact-checking: Towards a hybrid human-in-the-loop framework
Online misinformation is posing a serious threat for the modern society. Assessing the veracity of online information is a complex problem which nowadays is addressed by heavily relying on trained fact-checking experts. This solution is not scalable, and due to the importance of the problem the issue gained the attention of the scientific community, which proposed many based on Artificial Intelligence and Machine Learning methods. Despite the efforts made, the effectiveness of such approaches is not yet enough to allow them to be used without supervision. In this position paper, we propose a hybrid human-in-the-loop framework for fact-checking: we address the misinformation issue by relying on a combination of automatic Artificial Intelligence methods, crowdsourcing ones, and experts. We study the single components of the framework as well as their interactions, and we propose an interleaving of the different components which we believe will serve as a useful starting point for the future research towards effective and scalable fact-checking.