Jordi Cabot, L. Burgueño, R. Clarisó, Gwendal Daniel, Jorge Perianez-Pascual, Roberto Rodríguez-Echeverría
{"title":"Testing challenges for NLP-intensive bots","authors":"Jordi Cabot, L. Burgueño, R. Clarisó, Gwendal Daniel, Jorge Perianez-Pascual, Roberto Rodríguez-Echeverría","doi":"10.1109/BotSE52550.2021.00014","DOIUrl":null,"url":null,"abstract":"The popularity of bots is on the rise, with many bots able to interact with users via a chat or voice interface thanks to the embedding of a Natural Language Processing (NLP) component. Still, companies often express concerns about the quality of such bots, as their malfunctioning could have a severe impact on the company revenue or image. Unfortunately, the field of testing NLP-intensive bots is still in its infancy. This paper aims to characterize the testing properties and techniques (and their adaptation) relevant to this type of bots. We believe this will be helpful as a reference framework to compare and evaluate future bot testing research initiatives.","PeriodicalId":339364,"journal":{"name":"2021 IEEE/ACM Third International Workshop on Bots in Software Engineering (BotSE)","volume":"229 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE/ACM Third International Workshop on Bots in Software Engineering (BotSE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/BotSE52550.2021.00014","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4
Abstract
The popularity of bots is on the rise, with many bots able to interact with users via a chat or voice interface thanks to the embedding of a Natural Language Processing (NLP) component. Still, companies often express concerns about the quality of such bots, as their malfunctioning could have a severe impact on the company revenue or image. Unfortunately, the field of testing NLP-intensive bots is still in its infancy. This paper aims to characterize the testing properties and techniques (and their adaptation) relevant to this type of bots. We believe this will be helpful as a reference framework to compare and evaluate future bot testing research initiatives.