Edirlei Soares de Lima , Margot M.E. Neggers , Bruno Feijó , Marco A. Casanova , Antonio L. Furtado
{"title":"An AI-powered approach to the semiotic reconstruction of narratives","authors":"Edirlei Soares de Lima , Margot M.E. Neggers , Bruno Feijó , Marco A. Casanova , Antonio L. Furtado","doi":"10.1016/j.entcom.2024.100810","DOIUrl":null,"url":null,"abstract":"<div><p>This article presents a novel and highly interactive process to generate natural language narratives based on our ongoing work on semiotic relations, providing four criteria for composing new narratives from existing stories. The wide applicability of this semiotic reconstruction process is suggested by a reputed literary scholar’s deconstructive claim that new narratives can often be shown to be a tissue of previous narratives. Along, respectively, three semiotic axes – syntagmatic, paradigmatic, and meronymic – existing stories can yield new stories by the combination, imitation, or expansion of an iconic scene; lastly, a new story may emerge through reversal via an antithetic consideration, i.e., through the adoption of opposite values. Targeting casual users, we present a fully operational prototype with a simple and user-friendly interface that incorporates an AI agent, namely ChatGPT. The prototype, in a coauthor capacity, generates context-compatible sequences of events in storyboard format using backward-chaining abductive reasoning (employing Stable Diffusion to draw scene illustrations), conforming as much as possible to the user’s authorial instructions. The extensive repertoire of book and movie summaries available to the AI agent obviates the need to manually supply laborious and error-prone context specifications. A user study was conducted to evaluate user experience and satisfaction with the generated narratives. The preliminary findings suggest that our approach has the potential to enhance story quality while offering a positive user experience.</p></div>","PeriodicalId":55997,"journal":{"name":"Entertainment Computing","volume":"52 ","pages":"Article 100810"},"PeriodicalIF":2.8000,"publicationDate":"2024-07-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1875952124001782/pdfft?md5=5b5f11f699fcd6fce40807ce70508250&pid=1-s2.0-S1875952124001782-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Entertainment Computing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1875952124001782","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, CYBERNETICS","Score":null,"Total":0}
引用次数: 0
Abstract
This article presents a novel and highly interactive process to generate natural language narratives based on our ongoing work on semiotic relations, providing four criteria for composing new narratives from existing stories. The wide applicability of this semiotic reconstruction process is suggested by a reputed literary scholar’s deconstructive claim that new narratives can often be shown to be a tissue of previous narratives. Along, respectively, three semiotic axes – syntagmatic, paradigmatic, and meronymic – existing stories can yield new stories by the combination, imitation, or expansion of an iconic scene; lastly, a new story may emerge through reversal via an antithetic consideration, i.e., through the adoption of opposite values. Targeting casual users, we present a fully operational prototype with a simple and user-friendly interface that incorporates an AI agent, namely ChatGPT. The prototype, in a coauthor capacity, generates context-compatible sequences of events in storyboard format using backward-chaining abductive reasoning (employing Stable Diffusion to draw scene illustrations), conforming as much as possible to the user’s authorial instructions. The extensive repertoire of book and movie summaries available to the AI agent obviates the need to manually supply laborious and error-prone context specifications. A user study was conducted to evaluate user experience and satisfaction with the generated narratives. The preliminary findings suggest that our approach has the potential to enhance story quality while offering a positive user experience.
期刊介绍:
Entertainment Computing publishes original, peer-reviewed research articles and serves as a forum for stimulating and disseminating innovative research ideas, emerging technologies, empirical investigations, state-of-the-art methods and tools in all aspects of digital entertainment, new media, entertainment computing, gaming, robotics, toys and applications among researchers, engineers, social scientists, artists and practitioners. Theoretical, technical, empirical, survey articles and case studies are all appropriate to the journal.