{"title":"Teaching Tale Types to a Computer: A First Experiment with the Annotated Folktales Collection","authors":"Johan Eklund, Josh Hagedorn, Sándor Darányi","doi":"10.1515/fabula-2023-0005","DOIUrl":null,"url":null,"abstract":"Abstract Computational motif detection in folk narratives is an unresolved problem, partly because motifs are formally fluid, and because test collections to teach machine learning algorithms are not generally available or big enough to yield robust predictions for expert confirmation. As a result, standard tale typology based on texts as motif strings renders its computational reproduction an automatic classification exercise. In this brief communication, to report work in progress we use the Support Vector Machine algorithm on the ten best populated classes of the Annotated Folktales test collection, to predict text membership in their internationally accepted categories. The classification result was evaluated using recall, precision, and F1 scores. The F1 score was in the range 0.8–1.0 for all the selected tale types except for type 275 (The Race between Two Animals), which, although its recall rate was 1.0, suffered from a low precision.","PeriodicalId":42252,"journal":{"name":"FABULA","volume":"64 1","pages":"92 - 106"},"PeriodicalIF":0.1000,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"FABULA","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1515/fabula-2023-0005","RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"FOLKLORE","Score":null,"Total":0}
引用次数: 0
Abstract
Abstract Computational motif detection in folk narratives is an unresolved problem, partly because motifs are formally fluid, and because test collections to teach machine learning algorithms are not generally available or big enough to yield robust predictions for expert confirmation. As a result, standard tale typology based on texts as motif strings renders its computational reproduction an automatic classification exercise. In this brief communication, to report work in progress we use the Support Vector Machine algorithm on the ten best populated classes of the Annotated Folktales test collection, to predict text membership in their internationally accepted categories. The classification result was evaluated using recall, precision, and F1 scores. The F1 score was in the range 0.8–1.0 for all the selected tale types except for type 275 (The Race between Two Animals), which, although its recall rate was 1.0, suffered from a low precision.
民间叙事中的计算母题检测是一个尚未解决的问题,部分原因是母题在形式上是流动的,而且用于教授机器学习算法的测试集通常不可用,也不够大,无法产生专家确认的可靠预测。因此,基于文本作为主题字符串的标准故事类型学使其计算复制成为自动分类练习。在这篇简短的交流中,为了报告正在进行的工作,我们使用支持向量机算法对注释民间故事测试集的十个最佳填充类进行分析,以预测其国际公认类别中的文本隶属度。分类结果用查全率、查准率和F1分数来评价。除了275类型(The Race between Two Animals)的回忆率为1.0,其他类型的F1得分均在0.8-1.0之间,但准确率较低。
期刊介绍:
Fabula is a medium of discussion for issues of all kinds which are of interest to international folk narrative research. The journal contains eight divisions: Articles, Minor Contributions, Research Reports and Conference Reports, News, Projects and Queries, Reviews, Bibliographical Notes, and Books Received. Principal themes of the article section are the study of popular narrative traditions in their various forms (fairy tales, legends, jokes and anecdotes, exempla, fables, ballads, etc.), the interrelationship between oral and literary traditions as well as the contemporary genres. Interest focuses on Europe and overseas countries which are influenced by European civilization, but still, there is quite a number of contributions from other culture areas.