Research impact assessment: Developing and applying a viable model for the social sciences

IF 2.9 4区 管理学 Q1 INFORMATION SCIENCE & LIBRARY SCIENCE Research Evaluation Pub Date : 2024-05-17 DOI:10.1093/reseval/rvae022
Thomaz Wood, Adriana Wilner
{"title":"Research impact assessment: Developing and applying a viable model for the social sciences","authors":"Thomaz Wood, Adriana Wilner","doi":"10.1093/reseval/rvae022","DOIUrl":null,"url":null,"abstract":"\n Prompted by research funding agencies and regulatory bodies, universities need to demonstrate and manage the impact of their research. Therefore, models for evaluating research impacts that can be applied quickly and at a reasonable cost are needed. However, the development of these models presents considerable challenges: research impact is multidimensional and can occur over time because of multiple interactions between different agents. Furthermore, impact assessment can demand substantial time and resources. Considering this challenging context, this study proposes a research impact assessment model capable of optimizing benefits and costs. The model was based on a multidimensional impact perspective and an application-oriented way of generating and transmitting knowledge. It was applied to a large teaching and research institution with a predominant role in the social sciences. The assessment involved a survey of the leaders of 133 research projects. The main findings of the application of the assessment model were as follows: first, knowledge production is transitioning from a traditional mode (aimed to impact science) to a new mode (aimed to impact multiple stakeholders); second, project leaders still perceive the prevalence of scientific impact over other types of impact; and third, the survey revealed how certain characteristics of the knowledge production mode relate to (perceived) impact. The viable research impact assessment model was demonstrated to be useful and cost-effective; thus, with adaptations and improvements, it may be used by other institutions, particularly those with internal research funding programs. This article also presents the model’s limitations, suggesting directions for future research.","PeriodicalId":47668,"journal":{"name":"Research Evaluation","volume":null,"pages":null},"PeriodicalIF":2.9000,"publicationDate":"2024-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research Evaluation","FirstCategoryId":"91","ListUrlMain":"https://doi.org/10.1093/reseval/rvae022","RegionNum":4,"RegionCategory":"管理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"INFORMATION SCIENCE & LIBRARY SCIENCE","Score":null,"Total":0}
引用次数: 0

Abstract

Prompted by research funding agencies and regulatory bodies, universities need to demonstrate and manage the impact of their research. Therefore, models for evaluating research impacts that can be applied quickly and at a reasonable cost are needed. However, the development of these models presents considerable challenges: research impact is multidimensional and can occur over time because of multiple interactions between different agents. Furthermore, impact assessment can demand substantial time and resources. Considering this challenging context, this study proposes a research impact assessment model capable of optimizing benefits and costs. The model was based on a multidimensional impact perspective and an application-oriented way of generating and transmitting knowledge. It was applied to a large teaching and research institution with a predominant role in the social sciences. The assessment involved a survey of the leaders of 133 research projects. The main findings of the application of the assessment model were as follows: first, knowledge production is transitioning from a traditional mode (aimed to impact science) to a new mode (aimed to impact multiple stakeholders); second, project leaders still perceive the prevalence of scientific impact over other types of impact; and third, the survey revealed how certain characteristics of the knowledge production mode relate to (perceived) impact. The viable research impact assessment model was demonstrated to be useful and cost-effective; thus, with adaptations and improvements, it may be used by other institutions, particularly those with internal research funding programs. This article also presents the model’s limitations, suggesting directions for future research.
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
研究影响评估:为社会科学开发和应用可行的模式
在研究资助机构和监管机构的推动下,大学需要展示和管理其研究的影响。因此,需要能够快速应用、成本合理的研究影响评估模型。然而,这些模型的开发面临着相当大的挑战:研究影响是多层面的,而且可能随着时间的推移而发生,因为不同主体之间存在多种相互作用。此外,影响评估可能需要大量的时间和资源。考虑到这一具有挑战性的背景,本研究提出了一种能够优化收益和成本的研究影响评估模型。该模型基于多维影响视角和以应用为导向的知识生成与传播方式。该模型适用于一家以社会科学为主的大型教学和研究机构。评估工作包括对 133 个研究项目的负责人进行调查。应用该评估模式的主要发现如下:第一,知识生产正在从传统模式(旨在影响科学)向新模式(旨在影响多个利益相关者)过渡;第二,项目负责人仍然认为科学影响优先于其他类型的影响;第三,调查显示了知识生产模式的某些特征与(认为的)影响之间的关系。可行的研究影响评估模型被证明是有用的、具有成本效益的;因此,经过调整和改进,其他机构,特别是那些有内部研究资助计划的机构,可以使用该模型。本文还介绍了该模型的局限性,并提出了未来的研究方向。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Research Evaluation
Research Evaluation INFORMATION SCIENCE & LIBRARY SCIENCE-
CiteScore
6.00
自引率
18.20%
发文量
42
期刊介绍: Research Evaluation is a peer-reviewed, international journal. It ranges from the individual research project up to inter-country comparisons of research performance. Research projects, researchers, research centres, and the types of research output are all relevant. It includes public and private sectors, natural and social sciences. The term "evaluation" applies to all stages from priorities and proposals, through the monitoring of on-going projects and programmes, to the use of the results of research.
期刊最新文献
Societal interaction plans—A tool for enhancing societal engagement of strategic research in Finland Research impact assessment: Developing and applying a viable model for the social sciences The forced battle between peer-review and scientometric research assessment: Why the CoARA initiative is unsound Policy variation in the external evaluation of research for tenure at U.S. universities The quality landscape of economics: The top five and beyond
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1