{"title":"有毒评论分类的集成多语言模型","authors":"Gaofei Xie","doi":"10.1117/12.2636419","DOIUrl":null,"url":null,"abstract":"The online toxic comments cause enormous harm to the society, where toxicity is defined as anything rude, disrespectful or otherwise likely to make someone leave a discussion. To have a safer, more collaborative internet, grateful contributions are made by a main area of focus on machine learning models to identify toxicity in English, whereas part of misinformation disseminates in other languages. Over the past year, pretraining multilingual language models give rise to impressive gains for cross lingual toxicity classification. This paper presents an approach to build toxicity models applying the Jigsaw Multilingual Toxic Comment Classification dataset provided by Kaggle. We set our ensemble model in three parts based on Besides, we implement subsample, Pseudo-labeling with open-subtitles, translating non-English languages to English language, and Post Processing to improve the classification accuracy indispensably. Our final model achieved an AUC of 0.9469 for the training set and 0.9485 for the validation set, demonstrating the effectiveness of performance under cross-lingual toxicity detectors.","PeriodicalId":342847,"journal":{"name":"International Conference on Algorithms, Microchips and Network Applications","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2022-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"An ensemble multilingual model for toxic comment classification\",\"authors\":\"Gaofei Xie\",\"doi\":\"10.1117/12.2636419\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The online toxic comments cause enormous harm to the society, where toxicity is defined as anything rude, disrespectful or otherwise likely to make someone leave a discussion. To have a safer, more collaborative internet, grateful contributions are made by a main area of focus on machine learning models to identify toxicity in English, whereas part of misinformation disseminates in other languages. Over the past year, pretraining multilingual language models give rise to impressive gains for cross lingual toxicity classification. This paper presents an approach to build toxicity models applying the Jigsaw Multilingual Toxic Comment Classification dataset provided by Kaggle. We set our ensemble model in three parts based on Besides, we implement subsample, Pseudo-labeling with open-subtitles, translating non-English languages to English language, and Post Processing to improve the classification accuracy indispensably. Our final model achieved an AUC of 0.9469 for the training set and 0.9485 for the validation set, demonstrating the effectiveness of performance under cross-lingual toxicity detectors.\",\"PeriodicalId\":342847,\"journal\":{\"name\":\"International Conference on Algorithms, Microchips and Network Applications\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-05-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Conference on Algorithms, Microchips and Network Applications\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2636419\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Conference on Algorithms, Microchips and Network Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2636419","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
An ensemble multilingual model for toxic comment classification
The online toxic comments cause enormous harm to the society, where toxicity is defined as anything rude, disrespectful or otherwise likely to make someone leave a discussion. To have a safer, more collaborative internet, grateful contributions are made by a main area of focus on machine learning models to identify toxicity in English, whereas part of misinformation disseminates in other languages. Over the past year, pretraining multilingual language models give rise to impressive gains for cross lingual toxicity classification. This paper presents an approach to build toxicity models applying the Jigsaw Multilingual Toxic Comment Classification dataset provided by Kaggle. We set our ensemble model in three parts based on Besides, we implement subsample, Pseudo-labeling with open-subtitles, translating non-English languages to English language, and Post Processing to improve the classification accuracy indispensably. Our final model achieved an AUC of 0.9469 for the training set and 0.9485 for the validation set, demonstrating the effectiveness of performance under cross-lingual toxicity detectors.