{"title":"职权范围-芬兰发展合作评价的见解","authors":"S. Väth, Maja Flaig, Hansjörg Gaus","doi":"10.31244/zfe.2023.01.03","DOIUrl":null,"url":null,"abstract":"High-quality terms of reference (ToRs) point to solid evaluation objectives, precise evaluation questions, appropriately capturing of OECD/DAC criteria and specific methodological requirements. They guide evaluators by facilitating focussed evaluations, thus, more tailored data collection and analysis, which in turn is expected to uplift the quality of evaluation reports. Based on a meta-evaluation commissioned by Finland’s Ministry for Foreign Affairs, we assess the impact of ToRs on the quality of evaluation reports. For a sample of 70 mid-term and final evaluations of development interventions, we run different ordinary least square regressions with robust standard errors. We find that a one-unit increase of quality of ToRs (on a scale from 1 to 4) is statistically significantly associated to a third of a unit increase of quality of evaluation reports (on a scale from 1 to 4). Therefore, we conclude: it is plausible that ToRs matter.","PeriodicalId":41629,"journal":{"name":"Zeitschrift Fur Evaluation","volume":" ","pages":""},"PeriodicalIF":0.3000,"publicationDate":"2023-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Terms of Reference Matter – Insights from Evaluations of Finnish Development Cooperation\",\"authors\":\"S. Väth, Maja Flaig, Hansjörg Gaus\",\"doi\":\"10.31244/zfe.2023.01.03\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"High-quality terms of reference (ToRs) point to solid evaluation objectives, precise evaluation questions, appropriately capturing of OECD/DAC criteria and specific methodological requirements. They guide evaluators by facilitating focussed evaluations, thus, more tailored data collection and analysis, which in turn is expected to uplift the quality of evaluation reports. Based on a meta-evaluation commissioned by Finland’s Ministry for Foreign Affairs, we assess the impact of ToRs on the quality of evaluation reports. For a sample of 70 mid-term and final evaluations of development interventions, we run different ordinary least square regressions with robust standard errors. We find that a one-unit increase of quality of ToRs (on a scale from 1 to 4) is statistically significantly associated to a third of a unit increase of quality of evaluation reports (on a scale from 1 to 4). Therefore, we conclude: it is plausible that ToRs matter.\",\"PeriodicalId\":41629,\"journal\":{\"name\":\"Zeitschrift Fur Evaluation\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":0.3000,\"publicationDate\":\"2023-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Zeitschrift Fur Evaluation\",\"FirstCategoryId\":\"90\",\"ListUrlMain\":\"https://doi.org/10.31244/zfe.2023.01.03\",\"RegionNum\":4,\"RegionCategory\":\"社会学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Zeitschrift Fur Evaluation","FirstCategoryId":"90","ListUrlMain":"https://doi.org/10.31244/zfe.2023.01.03","RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Terms of Reference Matter – Insights from Evaluations of Finnish Development Cooperation
High-quality terms of reference (ToRs) point to solid evaluation objectives, precise evaluation questions, appropriately capturing of OECD/DAC criteria and specific methodological requirements. They guide evaluators by facilitating focussed evaluations, thus, more tailored data collection and analysis, which in turn is expected to uplift the quality of evaluation reports. Based on a meta-evaluation commissioned by Finland’s Ministry for Foreign Affairs, we assess the impact of ToRs on the quality of evaluation reports. For a sample of 70 mid-term and final evaluations of development interventions, we run different ordinary least square regressions with robust standard errors. We find that a one-unit increase of quality of ToRs (on a scale from 1 to 4) is statistically significantly associated to a third of a unit increase of quality of evaluation reports (on a scale from 1 to 4). Therefore, we conclude: it is plausible that ToRs matter.