Maurilio De Araujo Possi, Alcione de Paiva Oliveira, Alexandra Moreira, Lucas Mucida Costa
{"title":"CARMEN: A Method for Automatic Evaluation of Poems","authors":"Maurilio De Araujo Possi, Alcione de Paiva Oliveira, Alexandra Moreira, Lucas Mucida Costa","doi":"10.1109/ICNLP58431.2023.00051","DOIUrl":null,"url":null,"abstract":"Automatic poem generation has been a challenging topic in Natural Language Processing research. However, their evaluation is still largely based on methods that involve evaluation by human judges, comparing the results with poems written by humans, or using metrics that were not designed for this purpose. In order to fill this gap, this work proposes a specific metric for automatic evaluation of poems, capable of quantitatively evaluating morphological characteristics of the text, such as rhyme and meter, of different types within this literary genre. The tests carried out demonstrate that the metric developed presents an advance for the evaluation of this type of text.","PeriodicalId":53637,"journal":{"name":"Icon","volume":"1 1","pages":"244-247"},"PeriodicalIF":0.0000,"publicationDate":"2023-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Icon","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICNLP58431.2023.00051","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Arts and Humanities","Score":null,"Total":0}
引用次数: 0
Abstract
Automatic poem generation has been a challenging topic in Natural Language Processing research. However, their evaluation is still largely based on methods that involve evaluation by human judges, comparing the results with poems written by humans, or using metrics that were not designed for this purpose. In order to fill this gap, this work proposes a specific metric for automatic evaluation of poems, capable of quantitatively evaluating morphological characteristics of the text, such as rhyme and meter, of different types within this literary genre. The tests carried out demonstrate that the metric developed presents an advance for the evaluation of this type of text.