Renee M. Hartz, Kaitlin M. Gould, Jill M. Harper, J. Luiselli
{"title":"Assessing Interobserver Agreement (IOA) with Procedural Integrity: Evaluation of Training Methods among Classroom Instructors","authors":"Renee M. Hartz, Kaitlin M. Gould, Jill M. Harper, J. Luiselli","doi":"10.1080/00168890.2020.1848404","DOIUrl":null,"url":null,"abstract":"Abstract This study evaluated training methods to improve procedural integrity of classroom instructorswhen assessing interobserver agreement (IOA) with their students. Compared to baseline conditions in a multiple baseline across settings design, training that included a memo-task analysis review did not improve procedural integrity. Subsequent intervention consisting of single-session group administered behavioral skills training (BST: instruction, demonstration, role-playing, performance feedback) increased and stabilized procedural integrity of all instructors. These findings support previous training research concerned with procedural integrity of care providers and a competency-based approach towards improving IOA assessment.","PeriodicalId":46418,"journal":{"name":"Child & Family Behavior Therapy","volume":null,"pages":null},"PeriodicalIF":0.4000,"publicationDate":"2020-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Child & Family Behavior Therapy","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1080/00168890.2020.1848404","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"FAMILY STUDIES","Score":null,"Total":0}
引用次数: 0
Abstract
Abstract This study evaluated training methods to improve procedural integrity of classroom instructorswhen assessing interobserver agreement (IOA) with their students. Compared to baseline conditions in a multiple baseline across settings design, training that included a memo-task analysis review did not improve procedural integrity. Subsequent intervention consisting of single-session group administered behavioral skills training (BST: instruction, demonstration, role-playing, performance feedback) increased and stabilized procedural integrity of all instructors. These findings support previous training research concerned with procedural integrity of care providers and a competency-based approach towards improving IOA assessment.