Senne M. Van Hoecke, Iris Schrijver, Isabelle S. Robert
Empirical research on cognitive processing in AVT has been on the rise in recent years. A number of overarching works have recommended more standardised approaches and methodological frameworks to contribute to more streamlined, replicable, reproducible and valid future AVT research. To date, the issue of comparability of research materials (e.g., clips, subtitle tracks, comprehension questionnaires) and, more specifically, how to achieve comparability in quasi-experimental and experimental studies, particularly those involving repeated measures, has received little attention. This paper aims to address this knowledge gap by proposing a common-sense ten-step preparatory process for quasi-experimental and experimental subtitling studies. This preparatory process has previously been used in the S4AE project. The paper will focus on the final four steps, consisting of the preparation and comparison of multiple subtitle tracks. These steps were conceptualized taking into account the present research on subtitle parameters and the obstacles encountered while preparing comparable subtitle tracks.
{"title":"Preparing and comparing subtitles for quasi-experimental and experimental research in audiovisual translation\u0000 studies","authors":"Senne M. Van Hoecke, Iris Schrijver, Isabelle S. Robert","doi":"10.1075/ts.21038.van","DOIUrl":"https://doi.org/10.1075/ts.21038.van","url":null,"abstract":"\u0000 Empirical research on cognitive processing in AVT has been on the rise in recent years. A number of overarching\u0000 works have recommended more standardised approaches and methodological frameworks to contribute to more streamlined, replicable,\u0000 reproducible and valid future AVT research. To date, the issue of comparability of research materials (e.g., clips, subtitle\u0000 tracks, comprehension questionnaires) and, more specifically, how to achieve comparability in quasi-experimental and experimental\u0000 studies, particularly those involving repeated measures, has received little attention. This paper aims to address this knowledge\u0000 gap by proposing a common-sense ten-step preparatory process for quasi-experimental and experimental subtitling studies. This\u0000 preparatory process has previously been used in the S4AE project. The paper will focus on the final four steps, consisting of the\u0000 preparation and comparison of multiple subtitle tracks. These steps were conceptualized taking into account the present research\u0000 on subtitle parameters and the obstacles encountered while preparing comparable subtitle tracks.","PeriodicalId":43764,"journal":{"name":"Translation Spaces","volume":" ","pages":""},"PeriodicalIF":1.6,"publicationDate":"2022-07-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46243560","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Breno B. Silva, David Orrego-Carmona, A. Szarkowska
In this paper, we aim to promote the use of linear mixed models (LMMs) in eye-tracking research on subtitling. Using eye tracking to study viewers’ reading of subtitles often warrants controlling for many confounding variables. However, even assuming that these variables are known to researchers, such control may not be possible or desired. Traditional statistical methods such as t-tests or ANOVAs exacerbate the problem due to the use of aggregated data: each participant has one data point per dependent variable. As a solution, we propose the use of LMMs, which are better suited to account for a number of subtitle and participant characteristics, thus explaining more variance. We introduce essential theoretical aspects of LMMs and highlight some of their advantages over traditional statistical methods. To illustrate our point, we compare two analyses of the same dataset: one using a t-test; another using LMMs.
{"title":"Using linear mixed models to analyze data from eye-tracking research on subtitling","authors":"Breno B. Silva, David Orrego-Carmona, A. Szarkowska","doi":"10.1075/ts.21013.sil","DOIUrl":"https://doi.org/10.1075/ts.21013.sil","url":null,"abstract":"\u0000 In this paper, we aim to promote the use of linear mixed models (LMMs) in eye-tracking research on subtitling. Using eye tracking to study viewers’ reading of subtitles often warrants controlling for many confounding variables. However, even assuming that these variables are known to researchers, such control may not be possible or desired. Traditional statistical methods such as t-tests or ANOVAs exacerbate the problem due to the use of aggregated data: each participant has one data point per dependent variable. As a solution, we propose the use of LMMs, which are better suited to account for a number of subtitle and participant characteristics, thus explaining more variance. We introduce essential theoretical aspects of LMMs and highlight some of their advantages over traditional statistical methods. To illustrate our point, we compare two analyses of the same dataset: one using a t-test; another using LMMs.","PeriodicalId":43764,"journal":{"name":"Translation Spaces","volume":" ","pages":""},"PeriodicalIF":1.6,"publicationDate":"2022-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"43778669","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Recent developments in neural machine translation, and especially speech translation, are gradually but firmly entering the field of audiovisual translation (AVT). Automation in subtitling is extending from a machine translation (MT) component to fully automatic subtitling, which comprises MT, auto-spotting and automatic segmentation. The rise of this new paradigm renders MT-oriented experimental designs inadequate for the evaluation and investigation of automatic subtitling, since they fail to encompass the multimodal nature and technical requirements of subtitling. This paper highlights the methodological gaps to be addressed by multidisciplinary efforts in order to overcome these inadequacies and obtain metrics and methods that lead to rigorous experimental research in automatic subtitling. It presents a review of previous experimental designs in MT for subtitling, identifies their limitations for conducting research under the new paradigm and proposes a set of recommendations towards achieving replicability and reproducibility in experimental research at the crossroads between AVT and MT.
{"title":"Experimental research in automatic subtitling","authors":"Alina Karakanta","doi":"10.1075/ts.21021.kar","DOIUrl":"https://doi.org/10.1075/ts.21021.kar","url":null,"abstract":"\u0000Recent developments in neural machine translation, and especially speech translation, are gradually but firmly entering the field of audiovisual translation (AVT). Automation in subtitling is extending from a machine translation (MT) component to fully automatic subtitling, which comprises MT, auto-spotting and automatic segmentation. The rise of this new paradigm renders MT-oriented experimental designs inadequate for the evaluation and investigation of automatic subtitling, since they fail to encompass the multimodal nature and technical requirements of subtitling. This paper highlights the methodological gaps to be addressed by multidisciplinary efforts in order to overcome these inadequacies and obtain metrics and methods that lead to rigorous experimental research in automatic subtitling. It presents a review of previous experimental designs in MT for subtitling, identifies their limitations for conducting research under the new paradigm and proposes a set of recommendations towards achieving replicability and reproducibility in experimental research at the crossroads between AVT and MT.","PeriodicalId":43764,"journal":{"name":"Translation Spaces","volume":" ","pages":""},"PeriodicalIF":1.6,"publicationDate":"2022-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48563634","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Mixed methods have an established trajectory in the social sciences. Audiovisual Translation and Media Accessibility (MA) Studies are also increasingly applying the “third research paradigm” (Johnson et al., 2007, 112). Yet, publications in our field often fail to discuss the mixed-method nature of the study in depth, be it because of space limitations or a lack of deliberate integration of the methods. Concurrently, MA has seen a boom in experimental research, as descriptive approaches have given way to reception and user-centred studies that engage in the cognitive processes and immersion of audiences (Orero et al. 2018). This article proposes a methodological basis for MA researchers to design studies employing physiological instruments within a mixed methods framework. The core mixed methods designs (convergent, explanatory, and exploratory) are presented, and examples of their applications to research employing physiological instruments are discussed.
混合方法在社会科学中有着既定的轨迹。视听翻译和媒体可及性(MA)研究也越来越多地应用“第三种研究范式”(Johnson et al.， 2007， 112)。然而，由于空间限制或缺乏对方法的刻意整合，我们领域的出版物往往未能深入讨论研究的混合方法性质。与此同时，MA在实验研究方面也出现了蓬勃发展，因为描述性方法已经让位于以接受和用户为中心的研究，这些研究涉及受众的认知过程和沉浸感(oreo等人，2018)。本文提出了MA研究人员在混合方法框架内使用生理仪器设计研究的方法学基础。介绍了核心的混合方法设计(收敛、解释和探索)，并讨论了它们在使用生理仪器进行研究中的应用实例。
{"title":"Physiological instruments meet mixed methods in Media Accessibility","authors":"Irene Hermosa-Ramírez","doi":"10.1075/ts.21020.her","DOIUrl":"https://doi.org/10.1075/ts.21020.her","url":null,"abstract":"\u0000Mixed methods have an established trajectory in the social sciences. Audiovisual Translation and Media Accessibility (MA) Studies are also increasingly applying the “third research paradigm” (Johnson et al., 2007, 112). Yet, publications in our field often fail to discuss the mixed-method nature of the study in depth, be it because of space limitations or a lack of deliberate integration of the methods. Concurrently, MA has seen a boom in experimental research, as descriptive approaches have given way to reception and user-centred studies that engage in the cognitive processes and immersion of audiences (Orero et al. 2018). This article proposes a methodological basis for MA researchers to design studies employing physiological instruments within a mixed methods framework. The core mixed methods designs (convergent, explanatory, and exploratory) are presented, and examples of their applications to research employing physiological instruments are discussed.","PeriodicalId":43764,"journal":{"name":"Translation Spaces","volume":"1 1","pages":""},"PeriodicalIF":1.6,"publicationDate":"2022-05-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41489474","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Museums face a particular challenge in enabling blind and partially sighted (BPS) visitors to engage emotionally with the narrative(s) they present. In collaboration with a world-leading tourist attraction (Titanic Belfast) and the Royal National Institute of Blind People (RNIB), we have applied several different approaches for improving emotional engagement for BPS visitors. This paper addresses the critical challenge of how to obtain reliable evidence for evaluating the emotional response of BPS visitors to the museum’s audio description (AD) and overall experience. We consider six different methods for measuring emotional engagement, and consider their potential for providing reliable experimental evidence. Based on BPS-user feedback, we present a qualitative comparison of these methods, uniquely all applied to the same museum context.
{"title":"Evaluating audio description and emotional engagement for BPS visitors in a museum context","authors":"Xi Wang, D. Crookes, S. Harding, David Johnston","doi":"10.1075/ts.21019.wan","DOIUrl":"https://doi.org/10.1075/ts.21019.wan","url":null,"abstract":"\u0000Museums face a particular challenge in enabling blind and partially sighted (BPS) visitors to engage emotionally with the narrative(s) they present. In collaboration with a world-leading tourist attraction (Titanic Belfast) and the Royal National Institute of Blind People (RNIB), we have applied several different approaches for improving emotional engagement for BPS visitors. This paper addresses the critical challenge of how to obtain reliable evidence for evaluating the emotional response of BPS visitors to the museum’s audio description (AD) and overall experience. We consider six different methods for measuring emotional engagement, and consider their potential for providing reliable experimental evidence. Based on BPS-user feedback, we present a qualitative comparison of these methods, uniquely all applied to the same museum context.","PeriodicalId":43764,"journal":{"name":"Translation Spaces","volume":" ","pages":""},"PeriodicalIF":1.6,"publicationDate":"2022-05-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48242314","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This article presents the results of a study involving the translation of a short story by Kurt Vonnegut from English to Catalan and Dutch using three modalities: machine-translation (MT), post-editing (PE) and translation without aid (HT). Our aim is to explore creativity, understood to involve novelty and acceptability, from a quantitative perspective. The results show that HT has the highest creativity score, followed by PE, and lastly, MT, and this is unanimous from all reviewers. A neural MT system trained on literary data does not currently have the necessary capabilities for a creative translation; it renders literal solutions to translation problems. More importantly, using MT to post-edit raw output constrains the creativity of translators, resulting in a poorer translation often not fit for publication, according to experts.
{"title":"Creativity in translation","authors":"Ana Guerberof-Arenas, Antonio Toral","doi":"10.1075/ts.21025.gue","DOIUrl":"https://doi.org/10.1075/ts.21025.gue","url":null,"abstract":"\u0000This article presents the results of a study involving the translation of a short story by Kurt Vonnegut from English to Catalan and Dutch using three modalities: machine-translation (MT), post-editing (PE) and translation without aid (HT). Our aim is to explore creativity, understood to involve novelty and acceptability, from a quantitative perspective. The results show that HT has the highest creativity score, followed by PE, and lastly, MT, and this is unanimous from all reviewers. A neural MT system trained on literary data does not currently have the necessary capabilities for a creative translation; it renders literal solutions to translation problems. More importantly, using MT to post-edit raw output constrains the creativity of translators, resulting in a poorer translation often not fit for publication, according to experts.","PeriodicalId":43764,"journal":{"name":"Translation Spaces","volume":" ","pages":""},"PeriodicalIF":1.6,"publicationDate":"2022-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45201608","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This article intends to contribute to the current debate on the quality of neural machine translation (NMT) vs. (professional) human translation quality, where recently claims concerning (super)human performance of NMT systems have emerged. The article will critically analyse some current machine translation (MT) quality evaluation methodologies employed in studies claiming such performance of their MT systems. This analysis aims to identify areas where these methodologies are potentially biased in favour of MT and hence may overvalue MT performance while undervaluing human translation performance. Then, the article provides some Translation Studies informed suggestions for improving or debiasing these methodologies in order to arrive at a more balanced picture of MT vs. (professional) human translation quality.
{"title":"Some Translation Studies informed suggestions for further balancing methodologies for machine translation quality evaluation","authors":"Ralph Krüger","doi":"10.1075/ts.21026.kru","DOIUrl":"https://doi.org/10.1075/ts.21026.kru","url":null,"abstract":"This article intends to contribute to the current debate on the quality of neural machine translation (NMT) vs. (professional) human translation quality, where recently claims concerning (super)human performance of NMT systems have emerged. The article will critically analyse some current machine translation (MT) quality evaluation methodologies employed in studies claiming such performance of their MT systems. This analysis aims to identify areas where these methodologies are potentially biased in favour of MT and hence may overvalue MT performance while undervaluing human translation performance. Then, the article provides some Translation Studies informed suggestions for improving or debiasing these methodologies in order to arrive at a more balanced picture of MT vs. (professional) human translation quality.","PeriodicalId":43764,"journal":{"name":"Translation Spaces","volume":" ","pages":""},"PeriodicalIF":1.6,"publicationDate":"2022-03-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"46872071","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Wikipedia is a multilingual, user-driven online encyclopaedia available in 325 languages and language varieties. Such linguistic diversity has drawn the attention of translation scholars over the past decade. Previous research has addressed, among other issues, the quality of translated Wikipedia entries, the motivations driving editors-translators, and the taxing negotiations behind editorial changes. Nevertheless, the processes underpinning translation practices in the encyclopaedia have often been overlooked. Consequently, this paper adopts a praxeological approach to translation by analysing documented standards across four Wikipedia language communities and the extent to which 16 experienced translators have assimilated them. The findings suggest that Wikipedia guidelines on translation have slight but tangible differences across the communities under investigation. Moreover, the interview data showed a tendency among participants to attach more importance to cross-wiki editing policies than to any local translation guidelines. This preference ultimately reinforces previous claims that translation and editing in Wikipedia form a continuum.
{"title":"Assessing the impact of translation guidelines in Wikipedia","authors":"José Gustavo Góngora-Goloubintseff","doi":"10.1075/ts.21028.gon","DOIUrl":"https://doi.org/10.1075/ts.21028.gon","url":null,"abstract":"Wikipedia is a multilingual, user-driven online encyclopaedia available in 325 languages and language varieties. Such linguistic diversity has drawn the attention of translation scholars over the past decade. Previous research has addressed, among other issues, the quality of translated Wikipedia entries, the motivations driving editors-translators, and the taxing negotiations behind editorial changes. Nevertheless, the processes underpinning translation practices in the encyclopaedia have often been overlooked. Consequently, this paper adopts a praxeological approach to translation by analysing documented standards across four Wikipedia language communities and the extent to which 16 experienced translators have assimilated them. The findings suggest that Wikipedia guidelines on translation have slight but tangible differences across the communities under investigation. Moreover, the interview data showed a tendency among participants to attach more importance to cross-wiki editing policies than to any local translation guidelines. This preference ultimately reinforces previous claims that translation and editing in Wikipedia form a continuum.","PeriodicalId":43764,"journal":{"name":"Translation Spaces","volume":" ","pages":""},"PeriodicalIF":1.6,"publicationDate":"2022-02-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42999437","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
This article proposes the term Big Translation History (BTH) to describe a translation history that can be analysed computationally and that we define as involving: (1) large-scale research (geographical and chronological); (2) massive data understood as big data, accompanied by little data, and drawing on a wide range of often heterogeneous and non-structured sources; and (3) the use of computational techniques as part of the research process, and for the production of knowledge, rather than helping only with visualisation of data. We advance the hypothesis that one of the main possibilities of BTH, as a conceptual framework and a methodology, is to help decentralize translation history and literary and cultural history, in a broad sense. The article goes on to present an analysis of the circulation of literary translations and the agents involved in the Spanish-speaking world between 1898 and 1945 as a case study in BTH.
{"title":"Big translation history","authors":"Diana Roig-Sanz, Laura Fólica","doi":"10.1075/ts.21012.roi","DOIUrl":"https://doi.org/10.1075/ts.21012.roi","url":null,"abstract":"\u0000 This article proposes the term Big Translation History (BTH) to describe a translation history that can be\u0000 analysed computationally and that we define as involving: (1) large-scale research (geographical and chronological); (2) massive\u0000 data understood as big data, accompanied by little data, and drawing on a wide range of often heterogeneous and non-structured\u0000 sources; and (3) the use of computational techniques as part of the research process, and for the production of knowledge, rather\u0000 than helping only with visualisation of data. We advance the hypothesis that one of the main possibilities of BTH, as a conceptual\u0000 framework and a methodology, is to help decentralize translation history and literary and cultural history, in a broad sense. The\u0000 article goes on to present an analysis of the circulation of literary translations and the agents involved in the Spanish-speaking\u0000 world between 1898 and 1945 as a case study in BTH.","PeriodicalId":43764,"journal":{"name":"Translation Spaces","volume":" ","pages":""},"PeriodicalIF":1.6,"publicationDate":"2021-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"45543526","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The article fills a gap in the existing array of translation metaphors by introducing maze-walkers as a metaphor for translators at work. Ten similarities and five dissimilarities between translating and walking through a hedge maze are discussed. Translators’ control over their actions is compared to that of maze-walkers and of four other metaphorical agents: stage and musical performers, puppeteers, echoborgs and ghost-writers. Most existing metaphors convey attitudes toward translations and translators, whereas the maze-walking metaphor captures the varied actions of a translating translator. The metaphor may be of value to anyone explaining translation to students.
{"title":"Maze-walkers and echoborgs","authors":"B. Mossop","doi":"10.1075/ts.21001.mos","DOIUrl":"https://doi.org/10.1075/ts.21001.mos","url":null,"abstract":"\u0000 The article fills a gap in the existing array of translation metaphors by introducing maze-walkers as a metaphor\u0000 for translators at work. Ten similarities and five dissimilarities between translating and walking through a hedge maze are\u0000 discussed. Translators’ control over their actions is compared to that of maze-walkers and of four other metaphorical agents:\u0000 stage and musical performers, puppeteers, echoborgs and ghost-writers. Most existing metaphors convey attitudes toward\u0000 translations and translators, whereas the maze-walking metaphor captures the varied actions of a translating translator. The\u0000 metaphor may be of value to anyone explaining translation to students.","PeriodicalId":43764,"journal":{"name":"Translation Spaces","volume":" ","pages":""},"PeriodicalIF":1.6,"publicationDate":"2021-09-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42005979","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：