Implementation of a Multi-Source Feedback System for Quality Assurance for the College of Medical Radiation Technologists of Ontario

Under the Health Professions procedural code of the Regulated Health Professions Act, 1991 (RHPA), the College of Medical Radiation Technologists of Ontario (CMRTO) is required to provide a means to assess how people in the profession actually perform in practice. As the first step in satisfying the practice assessment requirement of the Quality Assurance program in 2004, the CMRTO retained Edumetrics Ltd. to undertake the development of a multi-source feedback (MSF) program specific to the profession of medical radiation technology.

In a comprehensive study led by Dr. Claudio Violato, a professor in the Department of Community Health Sciences, Faculty of Medicine at the University of Calgary and an expert in the development of program evaluations, psychometrics, research methods and statistics, the CMRTO developed a 'multi-source' assessment process that provides a means for peers, colleagues, patients and the assessed person to complete a survey focused on the standards of practice. The assessed person receives a summary assessment report or feedback about his or her performance. The multi-source feedback assessment provides a formative evaluation, providing continuous reaction to the performance of a medical radiation technologist (MRT). It compares the MRT's clinical performance to that of other MRTs. The CMRTO multi-source practice assessment approach was piloted in 2005.

A number of strategies were used to recruit 327 MRTs to take part in the pilot study. Recruitment strategies included consultation with MRTs respecting the standards of practice as the basis of the MSF project, a detailed communication strategy and telephone recruitment. Although the CMRTO staff experienced challenges in recruiting MRTs to take part in the pilot study and dealing with the resultant feedback, the pilot study was considered a success.