Assessing the Value of Provider-Facing Digital Health Technologies Used in Chronic Disease Management: Toward a Value Framework Based on Multistakeholder Perceptions.

Abstract

Objectives: Hardly any value frameworks exist that are focused on provider-facing digital health technologies (DHTs) for managing chronic disease with diverse stakeholder participation in their creation. Our study aimed to 1) understanding different stakeholder opinions on where value lies in provider-facing technologies and 2) create a comprehensive value assessment framework for DHT assessment.

Methods: Mixed-methods comprising both primary and secondary evidence were used. A scoping review enabled a greater understanding of the evidence base and generated the initial indicators. Thirty-four indicators were proposed within 6 value domains: health inequalities (3), data rights and governance (6), technical and security characteristics (6), clinical characteristics (7), economic characteristics (9), and user preferences (3). Subsequently, a 3-round Web-Delphi was conducted to rate the indicators' importance in the context of technology assessment and determine whether there was consensus.

Results: The framework was adapted to 45 indicators based on participant contributions in round 1 and delivered 16 stable indicators with consensus after rounds 2 and 3. Twenty-nine indicators showed instability and/or dissensus, particularly the data rights domain, in which all 5 indicators were unstable, showcasing the novelty of the concept of data rights. Significant instability between important and very important ratings was present within stakeholder groups, particularly clinicians and policy experts, indicating they were unsure how different aspects should be valued.

Conclusions: Our study provides a comprehensive value assessment framework for assessing provider-facing DHTs incorporating diverse stakeholder perspectives. Instability for specific indicators was expected due to the novelty of data and analytics integration in health technologies and their assessment. Further work is needed to ensure that, across all types of stakeholders, there is a clear understanding of the potential impacts of provider-facing DHTs.

Highlights: Current health technology assessment (HTA) methods may not be well suited for evaluating digital health technologies (DHTs) because of their complexity and wide-ranging impact on the health system.This article adds to the literature by exploring a wide range of stakeholder opinions on the value of provider-facing DHTs, creating a holistic value framework for these technologies, and highlighting areas in which further discussions are needed to align stakeholders on DHTs' value attributes.A Web-based Delphi co-creation approach was used involving key stakeholders from throughout the digital health space to generate a widely applicable value framework for assessing provider-facing DHTs. The stakeholders include patients, health care professionals, supply-side actors, decision makers, and academia from the United States, United Kingdom, and Germany.High levels of instability among stakeholders and value domains are demonstrated, indicating the novelty of assessing provider-facing DHTs and their impact on the health system.