首页 > 最新文献

Evaluation Journal of Australasia最新文献

英文 中文
Utilising existing data for a pilot social return on investment analysis of the family wellbeing empowerment program: A justification and framework 利用现有数据对家庭幸福赋权计划进行社会投资回报试点分析:理由和框架
Q2 Social Sciences Pub Date : 2024-02-29 DOI: 10.1177/1035719x241236779
Clare Nolan, Rosie Bridge, Grace Holland, M. Whiteside, L. Baird, Suzanne Andrews, Anita Lee Hong, K. Tsey
Demand is growing in the public, private, and philanthropic sector for economic and quantifiable outcome data to guide decisions regarding the allocation of resources. This paper explores the challenges and opportunities in economically evaluating an Aboriginal Social and Emotional Wellbeing intervention, emphasising the value of utilising existing data. Driven by local and national Indigenous research priorities, the study involved a pilot Social Return on Investment analysis of the Aboriginal Family Wellbeing empowerment program. Underpinned by a collaborative mixed-methods approach, designed to mitigate data limitations and bolster trustworthiness, the analysis was undertaken across four stages, including a literature review to identify impacts and create a theory of change; co-design of an impacts framework; a targeted literature review to inform impact quantification and attribution; and calculation of the Social Return on Investment results. Results indicate that for every US dollar of investment in delivering Family Wellbeing between 2001 and 2021 in the Yarrabah Aboriginal community, US$4.60 of benefits were produced for participants and the community. The return is expected to be higher if important community and cultural impacts of the program were included in the monetisation. Data limitations and implications for future mixed methods economic evaluation of social interventions are explored.
公共、私营和慈善部门对经济和可量化成果数据的需求日益增长,以指导有关资源分配的决策。本文探讨了对原住民社会和情感福祉干预措施进行经济评估的挑战和机遇,强调了利用现有数据的价值。在地方和国家土著研究优先事项的推动下,该研究对土著家庭幸福赋权计划进行了社会投资回报分析试点。该分析以合作式混合方法为基础,旨在减少数据局限性并提高可信度,分为四个阶段进行,包括文献综述,以确定影响并创建变革理论;共同设计影响框架;有针对性的文献综述,为影响量化和归因提供信息;以及计算社会投资回报结果。结果表明,2001 年至 2021 年期间,在亚拉巴原住民社区,每投资 1 美元用于实施 "家庭幸福 "计划,就能为参与者和社区带来 4.60 美元的收益。如果将该计划对社区和文化的重要影响纳入货币化,预计收益会更高。本文探讨了数据局限性以及对未来社会干预混合方法经济评估的影响。
{"title":"Utilising existing data for a pilot social return on investment analysis of the family wellbeing empowerment program: A justification and framework","authors":"Clare Nolan, Rosie Bridge, Grace Holland, M. Whiteside, L. Baird, Suzanne Andrews, Anita Lee Hong, K. Tsey","doi":"10.1177/1035719x241236779","DOIUrl":"https://doi.org/10.1177/1035719x241236779","url":null,"abstract":"Demand is growing in the public, private, and philanthropic sector for economic and quantifiable outcome data to guide decisions regarding the allocation of resources. This paper explores the challenges and opportunities in economically evaluating an Aboriginal Social and Emotional Wellbeing intervention, emphasising the value of utilising existing data. Driven by local and national Indigenous research priorities, the study involved a pilot Social Return on Investment analysis of the Aboriginal Family Wellbeing empowerment program. Underpinned by a collaborative mixed-methods approach, designed to mitigate data limitations and bolster trustworthiness, the analysis was undertaken across four stages, including a literature review to identify impacts and create a theory of change; co-design of an impacts framework; a targeted literature review to inform impact quantification and attribution; and calculation of the Social Return on Investment results. Results indicate that for every US dollar of investment in delivering Family Wellbeing between 2001 and 2021 in the Yarrabah Aboriginal community, US$4.60 of benefits were produced for participants and the community. The return is expected to be higher if important community and cultural impacts of the program were included in the monetisation. Data limitations and implications for future mixed methods economic evaluation of social interventions are explored.","PeriodicalId":37231,"journal":{"name":"Evaluation Journal of Australasia","volume":"27 28","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-02-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140409035","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluation at the cutting edge: Driving innovation and quality 前沿评估:推动创新和提高质量
Q2 Social Sciences Pub Date : 2024-01-31 DOI: 10.1177/1035719x241230835
John Guenther
{"title":"Evaluation at the cutting edge: Driving innovation and quality","authors":"John Guenther","doi":"10.1177/1035719x241230835","DOIUrl":"https://doi.org/10.1177/1035719x241230835","url":null,"abstract":"","PeriodicalId":37231,"journal":{"name":"Evaluation Journal of Australasia","volume":"514 3","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140479908","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The best medicine: Lessons from health for policy randomistas 最好的药物:政策随机学家从健康领域汲取的经验教训
Q2 Social Sciences Pub Date : 2024-01-09 DOI: 10.1177/1035719x231226437
Andrew Leigh
The Australian Government has established the Australian Centre for Evaluation, with a mandate to conduct rigorous evaluations, including randomised trials. This approach draws heavily on the transformation of medicine. During the 20th century, medicine evolved into a discipline that is largely driven by evidence from clinical trials. Drawing appropriate lessons from health has the potential to substantially improve the equity and effectiveness of policymaking in Australia.
澳大利亚政府成立了澳大利亚评估中心,其任务是进行严格的评估,包括随机试验。这种方法在很大程度上借鉴了医学的变革。20 世纪,医学发展成为一门主要由临床试验证据驱动的学科。从卫生领域汲取适当的经验教训,有可能大大提高澳大利亚政策制定的公平性和有效性。
{"title":"The best medicine: Lessons from health for policy randomistas","authors":"Andrew Leigh","doi":"10.1177/1035719x231226437","DOIUrl":"https://doi.org/10.1177/1035719x231226437","url":null,"abstract":"The Australian Government has established the Australian Centre for Evaluation, with a mandate to conduct rigorous evaluations, including randomised trials. This approach draws heavily on the transformation of medicine. During the 20th century, medicine evolved into a discipline that is largely driven by evidence from clinical trials. Drawing appropriate lessons from health has the potential to substantially improve the equity and effectiveness of policymaking in Australia.","PeriodicalId":37231,"journal":{"name":"Evaluation Journal of Australasia","volume":"19 2","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139444372","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Evaluator perspective: Meet an Australian Evaluation Society Fellow – Nan Wehipeihana 评估员视角:认识澳大利亚评估协会研究员 - Nan Wehipeihana
Q2 Social Sciences Pub Date : 2023-12-11 DOI: 10.1177/1035719x231220958
{"title":"Evaluator perspective: Meet an Australian Evaluation Society Fellow – Nan Wehipeihana","authors":"","doi":"10.1177/1035719x231220958","DOIUrl":"https://doi.org/10.1177/1035719x231220958","url":null,"abstract":"","PeriodicalId":37231,"journal":{"name":"Evaluation Journal of Australasia","volume":"20 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139010389","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Meta-evaluation: Validating program evaluation standards through the United Nations Evaluation Quality Assessment (EQAs) 元评价:通过联合国评价质量评估(EQAs)验证计划评价标准
Q2 Social Sciences Pub Date : 2023-12-07 DOI: 10.1177/1035719x231220979
Sandra Ayoo, Meghan Leeming, Stacy R Huff
The 2015 United Nation’s ‘Eval Year’ declaration heightened program evaluation’s significance in achieving the Sustainable Development Goals. However, uncertainties persist regarding evaluating high-quality evaluations and addressing social justice concerns in meta-evaluations. The field lacks consensus on both conducting meta-evaluation and the standards to use. To address this, we reviewed meta-evaluation literature, mapped the American Evaluation Association’s foundational documents with the United Nations Evaluation Group’s Norms and Standards to explore their intersectionality on social justice, and analysed 62 United Nations Population Fund evaluation reports alongside their management responses. Our findings indicate that addressing social justice concerns in meta-evaluation is contingent on context rather than established standards. Thus, it’s crucial for evaluators to prioritise social justice in evaluation design and implementation, and to select quality assurance tools that match the evaluation context and professional association guidelines, especially in the absence of standardised guidelines.
2015年联合国“评估年”宣言强调了项目评估对实现可持续发展目标的重要性。然而,在评估高质量评估和解决元评估中的社会公正问题方面,不确定性仍然存在。该领域在进行元评估和使用标准方面缺乏共识。为了解决这个问题,我们回顾了元评估文献,将美国评估协会的基础文件与联合国评估小组的规范和标准进行了对比,以探索它们在社会正义方面的相互关系,并分析了62份联合国人口基金评估报告及其管理层的回应。我们的研究结果表明,在元评价中解决社会公正问题取决于环境,而不是既定的标准。因此,对于评估人员来说,在评估设计和实施中优先考虑社会公正,并选择与评估背景和专业协会指南相匹配的质量保证工具是至关重要的,特别是在缺乏标准化指南的情况下。
{"title":"Meta-evaluation: Validating program evaluation standards through the United Nations Evaluation Quality Assessment (EQAs)","authors":"Sandra Ayoo, Meghan Leeming, Stacy R Huff","doi":"10.1177/1035719x231220979","DOIUrl":"https://doi.org/10.1177/1035719x231220979","url":null,"abstract":"The 2015 United Nation’s ‘Eval Year’ declaration heightened program evaluation’s significance in achieving the Sustainable Development Goals. However, uncertainties persist regarding evaluating high-quality evaluations and addressing social justice concerns in meta-evaluations. The field lacks consensus on both conducting meta-evaluation and the standards to use. To address this, we reviewed meta-evaluation literature, mapped the American Evaluation Association’s foundational documents with the United Nations Evaluation Group’s Norms and Standards to explore their intersectionality on social justice, and analysed 62 United Nations Population Fund evaluation reports alongside their management responses. Our findings indicate that addressing social justice concerns in meta-evaluation is contingent on context rather than established standards. Thus, it’s crucial for evaluators to prioritise social justice in evaluation design and implementation, and to select quality assurance tools that match the evaluation context and professional association guidelines, especially in the absence of standardised guidelines.","PeriodicalId":37231,"journal":{"name":"Evaluation Journal of Australasia","volume":"7 11","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138591621","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Four suppositions about emergent properties of complex interventions that operate and function as systems: A call for evaluation research 关于作为系统运行和发挥作用的复杂干预措施的新特性的四个假设:呼吁开展评估研究
Q2 Social Sciences Pub Date : 2023-11-20 DOI: 10.1177/1035719x231217335
Ralph Renger, Jessica Renger, Melanie T Pescud, Richard N. Van Eck, M. Basson, Jirina Renger
This article focuses on evaluating the emergent properties of complex interventions that operate and function as systems. After defining key terms, four suppositions of emergence are presented. The suppositions are based on the authors’ reflections on evaluating several complex interventions using a systems approach. Supposition 1 posits that there is an operational emergent property, paralleling the theory-driven evaluation concept of implementation theory noted by Carol Weiss. Supposition 2 suggests that every complex intervention also has a functional emergent property that speaks to the effectiveness of the intervention. Several important distinctions between a functional emergent property and the long-term outcomes derived based on a reductionist worldview are noted. Supposition 3 builds on the work of Chalmers to posit that it is possible for a complex intervention to simultaneously have more than one operational emergent property and more than one functional emergent property. Supposition 4 is grounded in the system definition to propose that operational emergence is a prerequisite for functional emergence. Suppositions by definition require proof to become theories. The article calls for evaluators to share whether their experiences support these suppositions and encourages investments in evaluation research to test them.
本文的重点是评估作为系统运行和发挥作用的复杂干预措施的新兴特性。在对关键术语进行定义后,提出了关于新兴的四个假设。这些假设基于作者对使用系统方法评估若干复杂干预措施的思考。假设 1 假设存在一种可操作的新兴属性,这与卡罗尔-韦斯指出的实施理论的理论驱动评估概念相类似。假设 2 认为,每一种复杂的干预措施都有一种功能性的突发特性,它能说明干预措施的有效性。我们注意到了功能性新兴属性与基于还原论世界观得出的长期结果之间的一些重要区别。假设 3 以查尔莫斯的研究为基础,认为复杂的干预措施有可能同时具有一个以上的操作性突发特性和一个以上的功能性突发特性。假设 4 以系统定义为基础,提出操作性涌现是功能性涌现的先决条件。根据定义,假设需要证明才能成为理论。文章呼吁评估人员分享他们的经验是否支持这些假设,并鼓励对评估研究进行投资,以检验这些假设。
{"title":"Four suppositions about emergent properties of complex interventions that operate and function as systems: A call for evaluation research","authors":"Ralph Renger, Jessica Renger, Melanie T Pescud, Richard N. Van Eck, M. Basson, Jirina Renger","doi":"10.1177/1035719x231217335","DOIUrl":"https://doi.org/10.1177/1035719x231217335","url":null,"abstract":"This article focuses on evaluating the emergent properties of complex interventions that operate and function as systems. After defining key terms, four suppositions of emergence are presented. The suppositions are based on the authors’ reflections on evaluating several complex interventions using a systems approach. Supposition 1 posits that there is an operational emergent property, paralleling the theory-driven evaluation concept of implementation theory noted by Carol Weiss. Supposition 2 suggests that every complex intervention also has a functional emergent property that speaks to the effectiveness of the intervention. Several important distinctions between a functional emergent property and the long-term outcomes derived based on a reductionist worldview are noted. Supposition 3 builds on the work of Chalmers to posit that it is possible for a complex intervention to simultaneously have more than one operational emergent property and more than one functional emergent property. Supposition 4 is grounded in the system definition to propose that operational emergence is a prerequisite for functional emergence. Suppositions by definition require proof to become theories. The article calls for evaluators to share whether their experiences support these suppositions and encourages investments in evaluation research to test them.","PeriodicalId":37231,"journal":{"name":"Evaluation Journal of Australasia","volume":"9 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139259138","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Getting evaluation right in diverse contexts 在不同的环境中进行正确的评估
Q2 Social Sciences Pub Date : 2023-06-22 DOI: 10.1177/1035719x231185286
J. Guenther
Our September 2023 issue of the Evaluation Journal of Australasia offers articles from Australian, Canadian and New Zealand contexts. They offer implications for evaluation practice and partnerships, with a particular focus on public/allied health and community-based program implementation. As I read these articles, I see how the authors are grappling with ‘ getting evaluation right ’ , not just from a pragmatic and technical perspective but also from a philosophical and ethical perspective. The practice article by Katina D ’ Onise and Katherine Pontifex provides an in-sightful re fl ection on a response to population health needs in the context of COVID-19 vaccination strategies. The urgency associated with various COVID-19 responses has led to innovations and rapid, fl exible approaches that otherwise might not have been considered (see also Iyamu et al., 2023; Kelly, 2023). And in this regard, D ’ Onise and Pontifex ’ s article demonstrates a similar dynamic. What is different here though is the application of the ‘ Lean start-up model ’ , which is designed to work with development of new products in uncertain contexts. The approach employed ‘ evaluative thinking ’ as a way of critically thinking and acting on evidence as it rapidly emerges (see also Cole, 2023 in the last issue for a detailed discussion of this topic). As I read through the lessons learned, the bene fi t of the approach used lies in its ability to quickly respond in a rapidly changing environment to implement policy initiatives, which include an evidence base. However, there are risks, as there are with any innovation. Haste and authoritative mandates may result in corners being cut, which may compromise ethical imperatives. Nevertheless, one of the key learnings from this work is that evidence can be quickly generated where there is a need for an urgent response to a complex problem. The
我们2023年9月刊的《澳大拉西亚评价杂志》提供来自澳大利亚、加拿大和新西兰的文章。它们为评估实践和伙伴关系提供了启示,特别侧重于公共/联合卫生和以社区为基础的项目实施。当我阅读这些文章时,我看到作者是如何努力解决“正确评估”的问题的,不仅是从实用主义和技术的角度,而且是从哲学和伦理的角度。Katina D ' Onise和Katherine Pontifex的实践文章对在COVID-19疫苗接种战略背景下应对人口卫生需求进行了深刻的反思。各种COVID-19应对措施的紧迫性导致了创新和快速灵活的方法,否则这些方法可能不会被考虑(另见Iyamu等人,2023;凯利,2023)。在这方面,D ' Onise和Pontifex的文章展示了类似的动态。这里的不同之处在于“精益创业模式”的应用,该模式旨在与不确定环境下的新产品开发一起工作。该方法采用“评估性思维”作为一种批判性思维方式,并根据迅速出现的证据采取行动(参见科尔,2023年最后一期关于该主题的详细讨论)。在我阅读这些经验教训时,所采用的方法的好处在于它能够在快速变化的环境中迅速作出反应,实施政策举措,其中包括一个证据基础。然而,就像任何创新一样,风险也是存在的。匆忙和权威的命令可能会导致偷工减料,这可能会损害道德要求。尽管如此,从这项工作中得到的一个重要教训是,在需要对复杂问题作出紧急反应的地方,可以迅速产生证据。的
{"title":"Getting evaluation right in diverse contexts","authors":"J. Guenther","doi":"10.1177/1035719x231185286","DOIUrl":"https://doi.org/10.1177/1035719x231185286","url":null,"abstract":"Our September 2023 issue of the Evaluation Journal of Australasia offers articles from Australian, Canadian and New Zealand contexts. They offer implications for evaluation practice and partnerships, with a particular focus on public/allied health and community-based program implementation. As I read these articles, I see how the authors are grappling with ‘ getting evaluation right ’ , not just from a pragmatic and technical perspective but also from a philosophical and ethical perspective. The practice article by Katina D ’ Onise and Katherine Pontifex provides an in-sightful re fl ection on a response to population health needs in the context of COVID-19 vaccination strategies. The urgency associated with various COVID-19 responses has led to innovations and rapid, fl exible approaches that otherwise might not have been considered (see also Iyamu et al., 2023; Kelly, 2023). And in this regard, D ’ Onise and Pontifex ’ s article demonstrates a similar dynamic. What is different here though is the application of the ‘ Lean start-up model ’ , which is designed to work with development of new products in uncertain contexts. The approach employed ‘ evaluative thinking ’ as a way of critically thinking and acting on evidence as it rapidly emerges (see also Cole, 2023 in the last issue for a detailed discussion of this topic). As I read through the lessons learned, the bene fi t of the approach used lies in its ability to quickly respond in a rapidly changing environment to implement policy initiatives, which include an evidence base. However, there are risks, as there are with any innovation. Haste and authoritative mandates may result in corners being cut, which may compromise ethical imperatives. Nevertheless, one of the key learnings from this work is that evidence can be quickly generated where there is a need for an urgent response to a complex problem. The","PeriodicalId":37231,"journal":{"name":"Evaluation Journal of Australasia","volume":"11 1","pages":"123 - 125"},"PeriodicalIF":0.0,"publicationDate":"2023-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"65871917","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring action research as a method of creating evidence that is informed by Aboriginal and Torres Strait Islander ways of being, doing and knowing 探索行动研究作为一种创造证据的方法,根据原住民和托雷斯海峡岛民的存在、行为和认识方式
Q2 Social Sciences Pub Date : 2023-06-08 DOI: 10.1177/1035719x231182433
Lucas Moore, Reno French
Over the past two decades there has been growing acknowledgement of the need to decolonise approaches to evaluation policy, programs and services impacting on the lives of Aboriginal and Torres Strait Islander Peoples. Action research methodologies have been identified as the most appropriate approach ( Evans et al., 2014 ). This article outlines how a community controlled peak body is utilising an action research approach guided by First Nations wisdom and knowledge to drive evaluation. Examination of two action research projects undertaken by Queensland Aboriginal and Torres Strait Islander Child Protection Peak (QATSICPP) demonstrate how action research embodies the principles of self-determination and Indigenous Data Sovereignty in evaluative processes. The article also highlights how evaluative evidence informs new approaches to address the overrepresentation of Aboriginal and Torres Strait Islander children in child protection. Project reflections suggest participants found the action research approach inclusive, participatory, and effective in assisting them to address critical practice and systemic issues. The importance of ensuring evaluative methodologies are meaningful for Aboriginal and Torres Strait Islander people was also highlighted.
在过去的二十年里,人们越来越认识到,有必要对影响原住民和托雷斯海峡岛民生活的评估政策、方案和服务采取非殖民化方法。行动研究方法已被确定为最合适的方法(Evans等人,2014)。本文概述了一个由社区控制的高峰机构如何利用以原住民智慧和知识为指导的行动研究方法来推动评估。对昆士兰原住民和托雷斯海峡岛民儿童保护高峰组织开展的两个行动研究项目的审查表明,行动研究如何在评估过程中体现自决和土著数据主权的原则。这篇文章还强调了评估证据如何为解决土著和托雷斯海峡岛民儿童在儿童保护中比例过高的问题提供新的方法。项目反思表明,参与者发现行动研究方法具有包容性、参与性和有效性,有助于他们解决关键实践和系统性问题。还强调了确保评价方法对土著和托雷斯海峡岛民有意义的重要性。
{"title":"Exploring action research as a method of creating evidence that is informed by Aboriginal and Torres Strait Islander ways of being, doing and knowing","authors":"Lucas Moore, Reno French","doi":"10.1177/1035719x231182433","DOIUrl":"https://doi.org/10.1177/1035719x231182433","url":null,"abstract":"Over the past two decades there has been growing acknowledgement of the need to decolonise approaches to evaluation policy, programs and services impacting on the lives of Aboriginal and Torres Strait Islander Peoples. Action research methodologies have been identified as the most appropriate approach ( Evans et al., 2014 ). This article outlines how a community controlled peak body is utilising an action research approach guided by First Nations wisdom and knowledge to drive evaluation. Examination of two action research projects undertaken by Queensland Aboriginal and Torres Strait Islander Child Protection Peak (QATSICPP) demonstrate how action research embodies the principles of self-determination and Indigenous Data Sovereignty in evaluative processes. The article also highlights how evaluative evidence informs new approaches to address the overrepresentation of Aboriginal and Torres Strait Islander children in child protection. Project reflections suggest participants found the action research approach inclusive, participatory, and effective in assisting them to address critical practice and systemic issues. The importance of ensuring evaluative methodologies are meaningful for Aboriginal and Torres Strait Islander people was also highlighted.","PeriodicalId":37231,"journal":{"name":"Evaluation Journal of Australasia","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42394908","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Embedding evaluation in non-profit organisations: lessons from evaluation advocates 在非营利组织中嵌入评估:来自评估倡导者的教训
Q2 Social Sciences Pub Date : 2023-05-29 DOI: 10.1177/1035719x231179256
Alison Rogers, A. Gullickson
Integrating evaluation initiatives in organisations as part of routine operations to support organisational learning and development can be difficult; extant literature lacks detail on the factors enhancing sustainability. This article presents research undertaken with evaluation advocates attempting to embed evaluation in their Australian non-profit organisations. The research involved interviewing seventeen participants, four of whom also were the focus of organisational case studies. The researchers used social interdependence theory to understand participants’ strategies for embedding evaluation and found that some elements of cooperative teamwork were more prominent than others. Participants in high hierarchical positions, or those who had influence, worked intentionally and incorporated strategies that aligned with all five elements. Examples of those strategies and their use in context presented herein may help leaders and internal and external evaluators increase the likelihood of embedding evaluation in organisational systems.
将评估作为日常运作的一部分整合到组织中以支持组织学习和发展可能是困难的;现有文献缺乏关于增强可持续性因素的详细信息。本文提出了与评估倡导者进行的研究,试图将评估嵌入其澳大利亚非营利组织。这项研究采访了17名参与者,其中4人也是组织案例研究的重点。研究人员运用社会相互依赖理论来理解参与者的嵌入评价策略,发现合作团队的某些要素比其他要素更突出。地位较高的参与者,或那些有影响力的参与者,有意地工作,并采用与所有五个要素一致的策略。这些策略的例子及其在本文中提出的背景下的使用可以帮助领导者和内部和外部评估人员增加在组织系统中嵌入评估的可能性。
{"title":"Embedding evaluation in non-profit organisations: lessons from evaluation advocates","authors":"Alison Rogers, A. Gullickson","doi":"10.1177/1035719x231179256","DOIUrl":"https://doi.org/10.1177/1035719x231179256","url":null,"abstract":"Integrating evaluation initiatives in organisations as part of routine operations to support organisational learning and development can be difficult; extant literature lacks detail on the factors enhancing sustainability. This article presents research undertaken with evaluation advocates attempting to embed evaluation in their Australian non-profit organisations. The research involved interviewing seventeen participants, four of whom also were the focus of organisational case studies. The researchers used social interdependence theory to understand participants’ strategies for embedding evaluation and found that some elements of cooperative teamwork were more prominent than others. Participants in high hierarchical positions, or those who had influence, worked intentionally and incorporated strategies that aligned with all five elements. Examples of those strategies and their use in context presented herein may help leaders and internal and external evaluators increase the likelihood of embedding evaluation in organisational systems.","PeriodicalId":37231,"journal":{"name":"Evaluation Journal of Australasia","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44039770","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Advancing an ethical imperative for collaborative approaches to evaluation with low incidence and underserved communities: Insights from a DeafBlind Support Services pilot program evaluation 推进低发病率和服务不足社区的协作评估方法的伦理必要性:来自聋哑盲人支持服务试点项目评估的见解
Q2 Social Sciences Pub Date : 2023-05-26 DOI: 10.1177/1035719X231179984
Vannesa Joly, Colleen McClure, Cheryl Poth, Navida Bachan, Roni McCarthy, Cheryl Redhead, Jacqueline Pei
This practice article advances an ethical imperative for guiding collaborative approaches to evaluation with low incidence and underserved communities. We describe our evaluation processes for building transformative partnerships during a DeafBlind Support Services pilot program evaluation in Western Canada using collaborative approaches to evaluation. This program was designed to enable adults living with dual sensory loss to experience self-determined activities in the community that enhance resilience and belonging. Key features involve specialised Support Service Providers who assist DeafBlind community members with accessing and participating in essential community services and social, vocational, educational, and recreational activities. In presenting our co-generated evaluation insights, we advance an ethical imperative describing philosophical foundations, pragmatic actions, and political leadership for implementation of collaborative approaches to evaluation with a low incidence and underserved community.
这篇实践文章提出了指导低发病率和服务不足社区的合作评估方法的伦理必要性。我们描述了在加拿大西部的聋人支持服务试点项目评估中,使用合作评估方法建立变革性伙伴关系的评估过程。该计划旨在使生活在双重感官丧失中的成年人能够在社区中体验自主活动,增强韧性和归属感。主要功能包括专业的支持服务提供商,他们帮助聋人社区成员获得和参与基本的社区服务以及社会、职业、教育和娱乐活动。在介绍我们共同产生的评估见解时,我们提出了一个道德要求,描述了在低发病率和服务不足的社区实施合作评估方法的哲学基础、务实行动和政治领导力。
{"title":"Advancing an ethical imperative for collaborative approaches to evaluation with low incidence and underserved communities: Insights from a DeafBlind Support Services pilot program evaluation","authors":"Vannesa Joly, Colleen McClure, Cheryl Poth, Navida Bachan, Roni McCarthy, Cheryl Redhead, Jacqueline Pei","doi":"10.1177/1035719X231179984","DOIUrl":"https://doi.org/10.1177/1035719X231179984","url":null,"abstract":"This practice article advances an ethical imperative for guiding collaborative approaches to evaluation with low incidence and underserved communities. We describe our evaluation processes for building transformative partnerships during a DeafBlind Support Services pilot program evaluation in Western Canada using collaborative approaches to evaluation. This program was designed to enable adults living with dual sensory loss to experience self-determined activities in the community that enhance resilience and belonging. Key features involve specialised Support Service Providers who assist DeafBlind community members with accessing and participating in essential community services and social, vocational, educational, and recreational activities. In presenting our co-generated evaluation insights, we advance an ethical imperative describing philosophical foundations, pragmatic actions, and political leadership for implementation of collaborative approaches to evaluation with a low incidence and underserved community.","PeriodicalId":37231,"journal":{"name":"Evaluation Journal of Australasia","volume":"23 1","pages":"150 - 162"},"PeriodicalIF":0.0,"publicationDate":"2023-05-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47128729","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Evaluation Journal of Australasia
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1