[Translated article] Development and consensus of a dashboard model to evaluate research activity in Spanish Hospital Pharmacy Services

Abstract

Objective

To develop by consensus a dashboard model to standardise and promote the evaluation of research activity in Spanish Hospital Pharmacy Services.

Methods

The study was carried out in 5 phases following the modified Delphi methodology: constitution of the coordinating group, elaboration of a list of scenarios, selection of participating centres, evaluation of the list of scenarios, and analysis of the results.

The coordinating group designed a questionnaire with 114 questions. General research questions and different scenarios (indicators) were included to form the dashboard. The Hospital Pharmacy Services with the highest number of publications were identified to participate in the Delphi consultation. Two rounds of consultations were conducted in which the “Need” and/or “Feasibility” of their measurement was evaluated for each of the scenarios, using a numerical scale from 1 (lowest score) to 9 (highest score).

Results

Sixteen Hospital Pharmacy Services, belonging to 8 different Autonomous Communities, participated in the Delphi consultation. A total of 100% of them responded to all the questions in the 2 rounds of consultations. It was considered that the Hospital Pharmacy Services should have a research dashboard (Need = 100%) with a basic structure and a common minimum set of data for all them (Need = 87.5%). The consensus was reached on distinguishing research projects led by the Hospital Pharmacy Services from those led by other groups in which the Hospital Pharmacy Services collaborate (Need = 87.5%), and a definition was approved on the leadership of these projects according to whether they are single-centre or multicentre.

A consensus was reached on 40 indicators to form the dashboard, which evaluates publications (13 indicators), human resources (12 indicators), research projects (9 indicators), doctoral theses (4 indicators), and patents and intellectual property registrations (2 indicators).

Conclusions

This is the first consensus dashboard developed to evaluate the research activity of the Hospital Pharmacy Services, which will help to analyse the productivity and impact of research systematically and continuously. In addition, it will allow comparison between them and will help to establish synergies and identify trends, patterns, and challenges.