掌握评估能力:评估能力工具绘图的结果

S. B. Nielsen, Sebastian Lemire, Isabelle Bourgeois, Leslie A. Fierro
{"title":"掌握评估能力:评估能力工具绘图的结果","authors":"S. B. Nielsen, Sebastian Lemire, Isabelle Bourgeois, Leslie A. Fierro","doi":"10.3138/cjpe-2024-0001","DOIUrl":null,"url":null,"abstract":"This article surveys the literature on organizational evaluation capacity (EC) instruments. Over the past 25 years, articles have been published in four waves covering the development of organizational evaluation capacity models, surveys of the evaluation capacity and practice landscape, the development of EC instruments, and their replication and adaptation. Altogether, the authors identified 20 studies applying 16 EC instruments. Several studies applied variants of the same instrument. We found instruments of three types: checklists, rubrics, and questionnaires. The instruments vary in terms of type, purpose, scoring, dimensions, number of items, and validation processes. In general, the validation studies demonstrated acceptable face, content, construct validity, and internal consistency. Only two studies tested for predictive validity. No studies covered concurrent validity and test–retest, or inter-rater reliability.","PeriodicalId":504262,"journal":{"name":"Canadian Journal of Program Evaluation","volume":"19 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Capturing Evaluation Capacity: Findings from a Mapping of Evaluation Capacity Instruments\",\"authors\":\"S. B. Nielsen, Sebastian Lemire, Isabelle Bourgeois, Leslie A. Fierro\",\"doi\":\"10.3138/cjpe-2024-0001\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This article surveys the literature on organizational evaluation capacity (EC) instruments. Over the past 25 years, articles have been published in four waves covering the development of organizational evaluation capacity models, surveys of the evaluation capacity and practice landscape, the development of EC instruments, and their replication and adaptation. Altogether, the authors identified 20 studies applying 16 EC instruments. Several studies applied variants of the same instrument. We found instruments of three types: checklists, rubrics, and questionnaires. The instruments vary in terms of type, purpose, scoring, dimensions, number of items, and validation processes. In general, the validation studies demonstrated acceptable face, content, construct validity, and internal consistency. Only two studies tested for predictive validity. No studies covered concurrent validity and test–retest, or inter-rater reliability.\",\"PeriodicalId\":504262,\"journal\":{\"name\":\"Canadian Journal of Program Evaluation\",\"volume\":\"19 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Canadian Journal of Program Evaluation\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.3138/cjpe-2024-0001\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Canadian Journal of Program Evaluation","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3138/cjpe-2024-0001","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

本文概述了有关组织评估能力(EC)工具的文献。在过去的 25 年中,共发表了四批文章,内容涉及组织评估能力模型的开发、评估能力和实践状况调查、EC 工具的开发及其复制和调整。作者共发现了 20 项应用 16 种评价工具的研究。有几项研究使用了同一工具的变体。我们发现了三种类型的工具:核对表、评分标准和调查问卷。这些工具在类型、目的、评分、维度、项目数量和验证过程方面各不相同。总体而言,验证研究显示了可接受的表面效度、内容效度、结构效度和内部一致性。只有两项研究测试了预测效度。没有研究涉及并发效度、测试-再测试或评分者之间的可靠性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Capturing Evaluation Capacity: Findings from a Mapping of Evaluation Capacity Instruments
This article surveys the literature on organizational evaluation capacity (EC) instruments. Over the past 25 years, articles have been published in four waves covering the development of organizational evaluation capacity models, surveys of the evaluation capacity and practice landscape, the development of EC instruments, and their replication and adaptation. Altogether, the authors identified 20 studies applying 16 EC instruments. Several studies applied variants of the same instrument. We found instruments of three types: checklists, rubrics, and questionnaires. The instruments vary in terms of type, purpose, scoring, dimensions, number of items, and validation processes. In general, the validation studies demonstrated acceptable face, content, construct validity, and internal consistency. Only two studies tested for predictive validity. No studies covered concurrent validity and test–retest, or inter-rater reliability.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
期刊最新文献
Exploring the Edges: Identifying the Next Generation of Evaluation Capacity Building Research and Practice Through Adjacency Strengthening Evaluation Capacity Building Practice Through Competition: The Max Bell School of Public Policy’s Evaluation Capacity Case Challenge Meeting the Challenge: How the City of Kingston Is Working to Propel Evaluation Growth Capturing Evaluation Capacity: Findings from a Mapping of Evaluation Capacity Instruments Evaluation Capacity Building: Experiential Learning Through Community–University Collaboratives
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1