Camryn Terblanche, Tyler T Schnoor, Michal Harty, Benjamin V Tucker
{"title":"南非三种语言中儿童合成语音的发展。","authors":"Camryn Terblanche, Tyler T Schnoor, Michal Harty, Benjamin V Tucker","doi":"10.1080/07434618.2024.2374312","DOIUrl":null,"url":null,"abstract":"<p><p>It is well-known that children with expressive communication difficulties have the right to communicate, but they should also have the right to do so in whichever language they choose, with a voice that closely matches their age, gender, and dialect. This study aimed to develop naturalistic synthetic child speech, matching the vocal identity of three children with expressive communication difficulties, using Tacotron 2, for three under-resourced South African languages, namely South African English (SAE), Afrikaans, and isiXhosa. Due to the scarcity of child speech corpora, 2 hours of child speech data per child was collected from three 11- to 12-year-old children. Two adult models were used to \"warm start\" the child speech synthesis. To determine the naturalness of the synthetic voices, 124 listeners participated in a mean opinion score survey (Likert Score) and optionally gave qualitative feedback. Despite limited training data used in this study, we successfully developed a synthesized child voice of adequate quality in each language. This study highlights that with recent technological advancements, it is possible to develop synthetic child speech that matches the vocal identity of a child with expressive communication difficulties in different under-resourced languages.</p>","PeriodicalId":49234,"journal":{"name":"Augmentative and Alternative Communication","volume":" ","pages":"1-12"},"PeriodicalIF":2.1000,"publicationDate":"2024-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The development of synthetic child speech in three South African languages.\",\"authors\":\"Camryn Terblanche, Tyler T Schnoor, Michal Harty, Benjamin V Tucker\",\"doi\":\"10.1080/07434618.2024.2374312\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>It is well-known that children with expressive communication difficulties have the right to communicate, but they should also have the right to do so in whichever language they choose, with a voice that closely matches their age, gender, and dialect. This study aimed to develop naturalistic synthetic child speech, matching the vocal identity of three children with expressive communication difficulties, using Tacotron 2, for three under-resourced South African languages, namely South African English (SAE), Afrikaans, and isiXhosa. Due to the scarcity of child speech corpora, 2 hours of child speech data per child was collected from three 11- to 12-year-old children. Two adult models were used to \\\"warm start\\\" the child speech synthesis. To determine the naturalness of the synthetic voices, 124 listeners participated in a mean opinion score survey (Likert Score) and optionally gave qualitative feedback. Despite limited training data used in this study, we successfully developed a synthesized child voice of adequate quality in each language. This study highlights that with recent technological advancements, it is possible to develop synthetic child speech that matches the vocal identity of a child with expressive communication difficulties in different under-resourced languages.</p>\",\"PeriodicalId\":49234,\"journal\":{\"name\":\"Augmentative and Alternative Communication\",\"volume\":\" \",\"pages\":\"1-12\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2024-07-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Augmentative and Alternative Communication\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1080/07434618.2024.2374312\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUDIOLOGY & SPEECH-LANGUAGE PATHOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Augmentative and Alternative Communication","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1080/07434618.2024.2374312","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUDIOLOGY & SPEECH-LANGUAGE PATHOLOGY","Score":null,"Total":0}
The development of synthetic child speech in three South African languages.
It is well-known that children with expressive communication difficulties have the right to communicate, but they should also have the right to do so in whichever language they choose, with a voice that closely matches their age, gender, and dialect. This study aimed to develop naturalistic synthetic child speech, matching the vocal identity of three children with expressive communication difficulties, using Tacotron 2, for three under-resourced South African languages, namely South African English (SAE), Afrikaans, and isiXhosa. Due to the scarcity of child speech corpora, 2 hours of child speech data per child was collected from three 11- to 12-year-old children. Two adult models were used to "warm start" the child speech synthesis. To determine the naturalness of the synthetic voices, 124 listeners participated in a mean opinion score survey (Likert Score) and optionally gave qualitative feedback. Despite limited training data used in this study, we successfully developed a synthesized child voice of adequate quality in each language. This study highlights that with recent technological advancements, it is possible to develop synthetic child speech that matches the vocal identity of a child with expressive communication difficulties in different under-resourced languages.
期刊介绍:
As the official journal of the International Society for Augmentative and Alternative Communication (ISAAC), Augmentative and Alternative Communication (AAC) publishes scientific articles related to the field of augmentative and alternative communication (AAC) that report research concerning assessment, treatment, rehabilitation, and education of people who use or have the potential to use AAC systems; or that discuss theory, technology, and systems development relevant to AAC. The broad range of topic included in the Journal reflects the development of this field internationally. Manuscripts submitted to AAC should fall within one of the following categories, AND MUST COMPLY with associated page maximums listed on page 3 of the Manuscript Preparation Guide.
Research articles (full peer review), These manuscripts report the results of original empirical research, including studies using qualitative and quantitative methodologies, with both group and single-case experimental research designs (e.g, Binger et al., 2008; Petroi et al., 2014).
Technical, research, and intervention notes (full peer review): These are brief manuscripts that address methodological, statistical, technical, or clinical issues or innovations that are of relevance to the AAC community and are designed to bring the research community’s attention to areas that have been minimally or poorly researched in the past (e.g., research note: Thunberg et al., 2016; intervention notes: Laubscher et al., 2019).