NewsCom-TOX: a corpus of comments on news articles annotated for toxicity in Spanish

IF 1.7 3区计算机科学 Q3 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Language Resources and Evaluation Pub Date : 2024-01-17 DOI:10.1007/s10579-023-09711-x

Mariona Taulé, Montserrat Nofre, Víctor Bargiela, Xavier Bonet

{"title":"NewsCom-TOX: a corpus of comments on news articles annotated for toxicity in Spanish","authors":"Mariona Taulé, Montserrat Nofre, Víctor Bargiela, Xavier Bonet","doi":"10.1007/s10579-023-09711-x","DOIUrl":null,"url":null,"abstract":"<p>In this article, we present the NewsCom-TOX corpus, a new corpus manually annotated for toxicity in Spanish. NewsCom-TOX consists of 4359 comments in Spanish posted in response to 21 news articles on social media related to immigration, in order to analyse and identify messages with racial and xenophobic content. This corpus is multi-level annotated with different binary linguistic categories -stance, target, stereotype, sarcasm, mockery, insult, improper language, aggressiveness and intolerance- taking into account not only the information conveyed in each comment, but also the whole discourse thread in which the comment occurs, as well as the information conveyed in the news article, including their images. These categories allow us to identify the presence of toxicity and its intensity, that is, the level of toxicity of each comment. All this information is available for research purposes upon request. Here we describe the NewsCom-TOX corpus, the annotation tagset used, the criteria applied and the annotation process carried out, including the inter-annotator agreement tests conducted. A quantitative analysis of the results obtained is also provided. NewsCom-TOX is a linguistic resource that will be valuable for both linguistic and computational research in Spanish in NLP tasks for the detection of toxic information.</p>","PeriodicalId":49927,"journal":{"name":"Language Resources and Evaluation","volume":"14 1","pages":""},"PeriodicalIF":1.7000,"publicationDate":"2024-01-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Language Resources and Evaluation","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1007/s10579-023-09711-x","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}

引用次数: 0

Abstract

In this article, we present the NewsCom-TOX corpus, a new corpus manually annotated for toxicity in Spanish. NewsCom-TOX consists of 4359 comments in Spanish posted in response to 21 news articles on social media related to immigration, in order to analyse and identify messages with racial and xenophobic content. This corpus is multi-level annotated with different binary linguistic categories -stance, target, stereotype, sarcasm, mockery, insult, improper language, aggressiveness and intolerance- taking into account not only the information conveyed in each comment, but also the whole discourse thread in which the comment occurs, as well as the information conveyed in the news article, including their images. These categories allow us to identify the presence of toxicity and its intensity, that is, the level of toxicity of each comment. All this information is available for research purposes upon request. Here we describe the NewsCom-TOX corpus, the annotation tagset used, the criteria applied and the annotation process carried out, including the inter-annotator agreement tests conducted. A quantitative analysis of the results obtained is also provided. NewsCom-TOX is a linguistic resource that will be valuable for both linguistic and computational research in Spanish in NLP tasks for the detection of toxic information.

查看原文

微信好友朋友圈 QQ好友复制链接

本刊更多论文

NewsCom-TOX：西班牙语新闻文章评论注释语料库

在本文中，我们介绍了 NewsCom-TOX 语料库，这是一个人工标注西班牙语毒性的新语料库。NewsCom-TOX 包含针对社交媒体上 21 篇有关移民的新闻文章发表的 4359 条西班牙语评论，目的是分析和识别带有种族和仇外内容的信息。该语料库使用不同的二元语言类别（立场、目标、刻板印象、讽刺、嘲弄、侮辱、不当语言、攻击性和不容忍）进行多层次注释，不仅考虑到每条评论中传达的信息，还考虑到评论发生时的整个话语线程，以及新闻文章中传达的信息，包括其图片。通过这些分类，我们可以确定是否存在毒性及其强度，即每条评论的毒性程度。所有这些信息都可应要求提供用于研究目的。在此，我们将介绍 NewsCom-TOX 语料库、使用的注释标签集、应用的标准和进行的注释过程，包括进行的注释者间一致性测试。我们还提供了对所获结果的定量分析。NewsCom-TOX 是一种语言资源，对西班牙语在有毒信息检测 NLP 任务中的语言学和计算研究都很有价值。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文去求助

来源期刊

Language Resources and Evaluation 工程技术-计算机：跨学科应用

CiteScore

6.50

自引率

3.70%

发文量

审稿时长

>12 weeks

期刊介绍： Language Resources and Evaluation is the first publication devoted to the acquisition, creation, annotation, and use of language resources, together with methods for evaluation of resources, technologies, and applications. Language resources include language data and descriptions in machine readable form used to assist and augment language processing applications, such as written or spoken corpora and lexica, multimodal resources, grammars, terminology or domain specific databases and dictionaries, ontologies, multimedia databases, etc., as well as basic software tools for their acquisition, preparation, annotation, management, customization, and use. Evaluation of language resources concerns assessing the state-of-the-art for a given technology, comparing different approaches to a given problem, assessing the availability of resources and technologies for a given application, benchmarking, and assessing system usability and user satisfaction.