{"title":"艾尔森:一个具有独特南美声音的神经口语诗歌生成器","authors":"Paola Torres Núñez del Prado","doi":"10.1386/jivs_00052_1","DOIUrl":null,"url":null,"abstract":"Human–computer interaction will soon be framed as a dialogue in-between two agents, rather than the imposition of the needs and desires of the human entity over the inert machine. As the latter become seemingly more intelligent, we will witness how they reshape art, knowledge and society in general even more in the not-so-distant future. In this framework, decolonization of their algorithms becomes imperative so as not to reproduce the ethnic and cultural biases that prevail in contemporary human society. By using a pre-trained transformer-based language model (GPT-2) (Radford et al. 2019a), retrained with poetry in Spanish, fine-tuned on examples of South American poetry recited by two different text-to-speech synthesis systems – the Tacotron 2 (Radford et al. 2019b) + Waveglow (Prenger et al. 2018) – coupled posteriorly using the ESPnet-TTS toolkit (Hayashi et al. 2020), trained on an Argentinean voice dataset fine-tuned on voice snippets of Peruvian poet Jorge Eduardo Eielson, I came up with a selection of spoken-word poems in a distinctly Latin American voice that ended up presented as the El Tiempo del Hombre (‘The Time of Man’) album, printed on a set of four 7-inch lathe-cut stereo vinyl discs. This process turns into a self-reflecting gesture when the dataset used for training is based on South American Artistic Traditions of both the present and the past.","PeriodicalId":36145,"journal":{"name":"Journal of Interdisciplinary Voice Studies","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2022-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"AIELSON: A neural spoken-word poetry generator with a distinct South American voice\",\"authors\":\"Paola Torres Núñez del Prado\",\"doi\":\"10.1386/jivs_00052_1\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Human–computer interaction will soon be framed as a dialogue in-between two agents, rather than the imposition of the needs and desires of the human entity over the inert machine. As the latter become seemingly more intelligent, we will witness how they reshape art, knowledge and society in general even more in the not-so-distant future. In this framework, decolonization of their algorithms becomes imperative so as not to reproduce the ethnic and cultural biases that prevail in contemporary human society. By using a pre-trained transformer-based language model (GPT-2) (Radford et al. 2019a), retrained with poetry in Spanish, fine-tuned on examples of South American poetry recited by two different text-to-speech synthesis systems – the Tacotron 2 (Radford et al. 2019b) + Waveglow (Prenger et al. 2018) – coupled posteriorly using the ESPnet-TTS toolkit (Hayashi et al. 2020), trained on an Argentinean voice dataset fine-tuned on voice snippets of Peruvian poet Jorge Eduardo Eielson, I came up with a selection of spoken-word poems in a distinctly Latin American voice that ended up presented as the El Tiempo del Hombre (‘The Time of Man’) album, printed on a set of four 7-inch lathe-cut stereo vinyl discs. This process turns into a self-reflecting gesture when the dataset used for training is based on South American Artistic Traditions of both the present and the past.\",\"PeriodicalId\":36145,\"journal\":{\"name\":\"Journal of Interdisciplinary Voice Studies\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Interdisciplinary Voice Studies\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1386/jivs_00052_1\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"Arts and Humanities\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Interdisciplinary Voice Studies","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1386/jivs_00052_1","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Arts and Humanities","Score":null,"Total":0}
引用次数: 0
摘要
人机交互很快将被定义为两个主体之间的对话,而不是将人类实体的需求和欲望强加给惰性机器。随着后者似乎变得更加聪明,我们将见证他们如何在不远的将来重塑艺术、知识和社会。在这个框架下,他们的算法必须去殖民化,以免再现当代人类社会普遍存在的种族和文化偏见。通过使用预先训练的基于转换器的语言模型(GPT-2)(Radford等人,2019a),用西班牙语诗歌进行再训练,对两个不同的文本到语音合成系统——Tacotron 2(Radford et al.,2019b)+Waveglow(Prenger et al.,2018)——背诵的南美诗歌示例进行微调,并使用ESPnet TTS工具包(Hayashi等人,2020)进行后耦合,我在一个阿根廷语音数据集上接受了训练,该数据集根据秘鲁诗人Jorge Eduardo Eielson的语音片段进行了微调,我用一种独特的拉丁美洲声音创作了一些口语诗,最终以El Tiempo del Hombre(《人的时代》)专辑的形式呈现,印在一套四张7英寸车床切割的立体声黑胶唱片上。当用于训练的数据集基于南美现在和过去的艺术传统时,这个过程就变成了一种自我反思的姿态。
AIELSON: A neural spoken-word poetry generator with a distinct South American voice
Human–computer interaction will soon be framed as a dialogue in-between two agents, rather than the imposition of the needs and desires of the human entity over the inert machine. As the latter become seemingly more intelligent, we will witness how they reshape art, knowledge and society in general even more in the not-so-distant future. In this framework, decolonization of their algorithms becomes imperative so as not to reproduce the ethnic and cultural biases that prevail in contemporary human society. By using a pre-trained transformer-based language model (GPT-2) (Radford et al. 2019a), retrained with poetry in Spanish, fine-tuned on examples of South American poetry recited by two different text-to-speech synthesis systems – the Tacotron 2 (Radford et al. 2019b) + Waveglow (Prenger et al. 2018) – coupled posteriorly using the ESPnet-TTS toolkit (Hayashi et al. 2020), trained on an Argentinean voice dataset fine-tuned on voice snippets of Peruvian poet Jorge Eduardo Eielson, I came up with a selection of spoken-word poems in a distinctly Latin American voice that ended up presented as the El Tiempo del Hombre (‘The Time of Man’) album, printed on a set of four 7-inch lathe-cut stereo vinyl discs. This process turns into a self-reflecting gesture when the dataset used for training is based on South American Artistic Traditions of both the present and the past.