{"title":"Using rating scales to assess interpretation: Practices, problems and prospects","authors":"Chao Han","doi":"10.1075/INTP.00003.HAN","DOIUrl":null,"url":null,"abstract":"Over the past decade, interpretation assessment has played an increasingly important role in interpreter education, professional certification, and interpreting research. The time-honored assessment method is based on analysis of (para)linguistic features of interpretation (including such items as omissions, substitutions, un/filled pauses and self-corrections). Recently, use of descriptor-based rating scales to assess interpretation has emerged as a viable alternative (e.g., Angelelli 2009 ; Han 2015 , 2016 ; J. Lee 2008 ; Tiselius 2009 ), arguably providing a basis for reliable, valid and practical assessments. However, little work has been done in interpreting studies to ascertain the assumed benefits of this emerging assessment practice. Based on 17 international peer-reviewed journals over the last twelve years (2004–2015), and other related publications (e.g., scholarly books, reports, documents), this article provides an overview of practices in scale-based interpretation assessment, focusing on four major aspects: (a) rating scales; (b) raters; (c) rating procedures; (d) reporting of assessment outcomes. Problem areas and possible emerging trends in interpretation assessment are examined, identifying a number of future research needs.","PeriodicalId":51746,"journal":{"name":"Interpreting","volume":"20 1","pages":"59-95"},"PeriodicalIF":1.8000,"publicationDate":"2018-04-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1075/INTP.00003.HAN","citationCount":"20","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Interpreting","FirstCategoryId":"98","ListUrlMain":"https://doi.org/10.1075/INTP.00003.HAN","RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"LANGUAGE & LINGUISTICS","Score":null,"Total":0}
引用次数: 20
Abstract
Over the past decade, interpretation assessment has played an increasingly important role in interpreter education, professional certification, and interpreting research. The time-honored assessment method is based on analysis of (para)linguistic features of interpretation (including such items as omissions, substitutions, un/filled pauses and self-corrections). Recently, use of descriptor-based rating scales to assess interpretation has emerged as a viable alternative (e.g., Angelelli 2009 ; Han 2015 , 2016 ; J. Lee 2008 ; Tiselius 2009 ), arguably providing a basis for reliable, valid and practical assessments. However, little work has been done in interpreting studies to ascertain the assumed benefits of this emerging assessment practice. Based on 17 international peer-reviewed journals over the last twelve years (2004–2015), and other related publications (e.g., scholarly books, reports, documents), this article provides an overview of practices in scale-based interpretation assessment, focusing on four major aspects: (a) rating scales; (b) raters; (c) rating procedures; (d) reporting of assessment outcomes. Problem areas and possible emerging trends in interpretation assessment are examined, identifying a number of future research needs.
在过去的十年中,口译评估在口译教育、专业认证和口译研究中发挥着越来越重要的作用。历史悠久的评估方法是基于对口译(段落)语言特征的分析(包括省略、替换、未填/未填的停顿和自我纠正等项目)。最近,使用基于描述符的评分量表来评估口译已成为一种可行的替代方案(例如,Angelelli 2009;韩2015,2016;J. Lee 2008;Tiselius 2009),可以说为可靠、有效和实用的评估提供了基础。然而,在解释研究以确定这种新兴评估实践的假定好处方面所做的工作很少。本文基于过去12年(2004-2015)的17种国际同行评议期刊,以及其他相关出版物(如学术书籍、报告和文件),概述了基于量表的口译评估的实践,重点关注四个主要方面:(a)评级量表;(b)评级机构;(c)评级程序;(d)报告评估结果。研究了口译评估的问题领域和可能出现的趋势,确定了一些未来的研究需求。
期刊介绍:
Interpreting serves as a medium for research and debate on all aspects of interpreting, in its various modes, modalities (spoken and signed) and settings (conferences, media, courtroom, healthcare and others). Striving to promote our understanding of the socio-cultural, cognitive and linguistic dimensions of interpreting as an activity and process, the journal covers theoretical and methodological concerns, explores the history and professional ecology of interpreting and its role in society, and addresses current issues in professional practice and training.