Carlomagno C Panlilio, Lisa Famularo, Jessica Masters, Sarah Dore, Nicole Verdiglione, Chengwu Yang, Erik Lehman, Robert M Hamm, Richard Fiene, David Bard, Karl M Kapp, Benjamin H Levi
{"title":"Integrating Validity Evidence to Revise a Child Abuse Knowledge Test for Early Childhood Education Providers: A Mixed Methods Approach.","authors":"Carlomagno C Panlilio, Lisa Famularo, Jessica Masters, Sarah Dore, Nicole Verdiglione, Chengwu Yang, Erik Lehman, Robert M Hamm, Richard Fiene, David Bard, Karl M Kapp, Benjamin H Levi","doi":"10.1177/10982140211002901","DOIUrl":null,"url":null,"abstract":"<p><p>Knowledge tests used to evaluate child protection training program effectiveness for early childhood education providers may suffer from threats to construct validity given the contextual variability inherent within state-specific regulations around mandated reporting requirements. Unfortunately, guidance on instrument revision that accounts for such state-specific mandated reporting requirements is lacking across research on evaluation practices. This study, therefore, explored how collection and integration of validity evidence using a mixed methods framework can guide the instrument revision process to arrive at a more valid program outcome measure.</p>","PeriodicalId":74933,"journal":{"name":"","volume":"43 4","pages":"559-583"},"PeriodicalIF":0.0,"publicationDate":"2022-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9733792/pdf/nihms-1810124.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"","FirstCategoryId":"90","ListUrlMain":"https://doi.org/10.1177/10982140211002901","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2021/11/22 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Knowledge tests used to evaluate child protection training program effectiveness for early childhood education providers may suffer from threats to construct validity given the contextual variability inherent within state-specific regulations around mandated reporting requirements. Unfortunately, guidance on instrument revision that accounts for such state-specific mandated reporting requirements is lacking across research on evaluation practices. This study, therefore, explored how collection and integration of validity evidence using a mixed methods framework can guide the instrument revision process to arrive at a more valid program outcome measure.