对遗传或基因组测试评估报告的范围审查显示,对临床效用关键维度的考虑不一致。

IF 5.2 2区 医学 Q1 HEALTH CARE SCIENCES & SERVICES Journal of Clinical Epidemiology Pub Date : 2025-05-01 Epub Date: 2025-02-20 DOI:10.1016/j.jclinepi.2025.111729
Angelo Maria Pezzullo , Angelica Valz Gris , Nicolò Scarsi , Diego Maria Tona , Martina Porcelli , Matteo Di Pumpo , Peter Piko , Roza Adany , Pragathy Kannan , Markus Perola , Maria Luis Cardoso , Alexandra Costa , Astrid M. Vicente , Anu Reigo , Mariliis Vaht , Andres Metspalu , Mark Kroese , Roberta Pastorino , Stefania Boccia
{"title":"对遗传或基因组测试评估报告的范围审查显示,对临床效用关键维度的考虑不一致。","authors":"Angelo Maria Pezzullo ,&nbsp;Angelica Valz Gris ,&nbsp;Nicolò Scarsi ,&nbsp;Diego Maria Tona ,&nbsp;Martina Porcelli ,&nbsp;Matteo Di Pumpo ,&nbsp;Peter Piko ,&nbsp;Roza Adany ,&nbsp;Pragathy Kannan ,&nbsp;Markus Perola ,&nbsp;Maria Luis Cardoso ,&nbsp;Alexandra Costa ,&nbsp;Astrid M. Vicente ,&nbsp;Anu Reigo ,&nbsp;Mariliis Vaht ,&nbsp;Andres Metspalu ,&nbsp;Mark Kroese ,&nbsp;Roberta Pastorino ,&nbsp;Stefania Boccia","doi":"10.1016/j.jclinepi.2025.111729","DOIUrl":null,"url":null,"abstract":"<div><h3>Objectives</h3><div>Genetic and genomic tests are the cornerstone of personalized preventive approaches. Inconsistency in evaluating their clinical utility is often cited as a reason for their limited implementation in clinical practice. Previous reviews have primarily focused on theoretical frameworks used for clinical utility evaluations of genetic tests, rather than actual assessments and examined dimensions, rather than specific indicators within these dimensions. We aimed to review the dimensions and the specific indicators measured in published assessment reports of genetic or genomic tests.</div></div><div><h3>Study Design and Setting</h3><div>We conducted a scoping review of assessment reports of genetic and genomic tests used for prevention, searching through PubMed, Web of Science, Scopus, the websites of 20 different organizations, Google, and Google Scholar. From the included assessments, we extracted the reported indicators of clinical utility, compiling a list of disease-specific indicators that detailed their numerator, denominator, and calculation methods. We analyzed the extracted indicators by stratifying them according to ten comprehensive dimensions of clinical utility, the assessment framework used, and the type of indicator (categorized as quantitative, qualitative, reference, or no evidence reported). From these indicators, we then distilled a list of general indicators.</div></div><div><h3>Results</h3><div>We reviewed 3054 unique references and 12,000 results from gray literature searches, ultimately selecting 57 assessment reports. The reference frameworks used were health technology assessment (HTA) (42%), Evaluation of Genomic Applications in Practice and Prevention (EGAPP) (25%), ACCE (21%), and others (12%). We identified 951 disease-specific indicators. The dimensions most frequently evaluated (ie, had at least one indicator) were analytic validity (60%), clinical validity (79%), clinical efficacy (79%), and economic impact (58%). Only 12 assessments compared health outcomes between tested and untested groups, and fewer than 15% of the assessments addressed equity, acceptability, legitimacy, and personal value.</div></div><div><h3>Conclusion</h3><div>Our study illustrates that, although dimensions such as equity and acceptability, are significantly emphasized in traditional evaluation frameworks, these are often not considered in the assessments. Additionally, our study has underscored a significant dearth of reported primary evidence concerning the clinical efficacy of these tests.</div></div><div><h3>Plain Language Summary</h3><div>Genetic and genomic tests analyze a person's genes to predict health risks and guide healthcare decisions, potentially identifying who might benefit from certain treatments or check-ups. However, determining whether these tests are genuinely useful for wide use in health services is complex, because there is no standard way to define “clinical utility” of a genetic test. To understand how these tests are evaluated, we reviewed 57 evaluation reports from high-income countries, most of which focused on cancer-related genetic tests. We found that many evaluations looked mainly at how well a test predicted a condition (validity) and considered some form of effectiveness, yet often failed to measure whether the test truly improved patient health outcomes, such as lowering death rates or enhancing the quality of life. Moreover, factors like patient acceptance, equity, and personal relevance (eg, reducing anxiety) were frequently overlooked. Without including these broader considerations, evaluations risk missing critical evidence that would indicate whether a test is helpful, fair, and worth using. From over 900 unique indicators used to measure clinical utility, we created a simpler list of about 150 general indicators that can guide future evaluations. This consolidated list can help test developers decide which factors to investigate, evaluators determine what to measure, and policymakers identify what might be missing before deciding if a test should be adopted in healthcare. By highlighting the gaps—areas that should be assessed but currently are not—our study encourages a more comprehensive approach to evaluating genetic tests. If we fail to consider issues like equity, patient preferences, and proven health benefits, we risk investing in tests that may do little good or even harm patients. Ultimately, recognizing these shortcomings can lead to better-informed decisions, ensuring that genetic testing is used in ways that truly benefit patients and deliver safer, more personalized, and fairer healthcare for everyone.</div></div>","PeriodicalId":51079,"journal":{"name":"Journal of Clinical Epidemiology","volume":"181 ","pages":"Article 111729"},"PeriodicalIF":5.2000,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A scoping review of the assessment reports of genetic or genomic tests reveals inconsistent consideration of key dimensions of clinical utility\",\"authors\":\"Angelo Maria Pezzullo ,&nbsp;Angelica Valz Gris ,&nbsp;Nicolò Scarsi ,&nbsp;Diego Maria Tona ,&nbsp;Martina Porcelli ,&nbsp;Matteo Di Pumpo ,&nbsp;Peter Piko ,&nbsp;Roza Adany ,&nbsp;Pragathy Kannan ,&nbsp;Markus Perola ,&nbsp;Maria Luis Cardoso ,&nbsp;Alexandra Costa ,&nbsp;Astrid M. Vicente ,&nbsp;Anu Reigo ,&nbsp;Mariliis Vaht ,&nbsp;Andres Metspalu ,&nbsp;Mark Kroese ,&nbsp;Roberta Pastorino ,&nbsp;Stefania Boccia\",\"doi\":\"10.1016/j.jclinepi.2025.111729\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Objectives</h3><div>Genetic and genomic tests are the cornerstone of personalized preventive approaches. Inconsistency in evaluating their clinical utility is often cited as a reason for their limited implementation in clinical practice. Previous reviews have primarily focused on theoretical frameworks used for clinical utility evaluations of genetic tests, rather than actual assessments and examined dimensions, rather than specific indicators within these dimensions. We aimed to review the dimensions and the specific indicators measured in published assessment reports of genetic or genomic tests.</div></div><div><h3>Study Design and Setting</h3><div>We conducted a scoping review of assessment reports of genetic and genomic tests used for prevention, searching through PubMed, Web of Science, Scopus, the websites of 20 different organizations, Google, and Google Scholar. From the included assessments, we extracted the reported indicators of clinical utility, compiling a list of disease-specific indicators that detailed their numerator, denominator, and calculation methods. We analyzed the extracted indicators by stratifying them according to ten comprehensive dimensions of clinical utility, the assessment framework used, and the type of indicator (categorized as quantitative, qualitative, reference, or no evidence reported). From these indicators, we then distilled a list of general indicators.</div></div><div><h3>Results</h3><div>We reviewed 3054 unique references and 12,000 results from gray literature searches, ultimately selecting 57 assessment reports. The reference frameworks used were health technology assessment (HTA) (42%), Evaluation of Genomic Applications in Practice and Prevention (EGAPP) (25%), ACCE (21%), and others (12%). We identified 951 disease-specific indicators. The dimensions most frequently evaluated (ie, had at least one indicator) were analytic validity (60%), clinical validity (79%), clinical efficacy (79%), and economic impact (58%). Only 12 assessments compared health outcomes between tested and untested groups, and fewer than 15% of the assessments addressed equity, acceptability, legitimacy, and personal value.</div></div><div><h3>Conclusion</h3><div>Our study illustrates that, although dimensions such as equity and acceptability, are significantly emphasized in traditional evaluation frameworks, these are often not considered in the assessments. Additionally, our study has underscored a significant dearth of reported primary evidence concerning the clinical efficacy of these tests.</div></div><div><h3>Plain Language Summary</h3><div>Genetic and genomic tests analyze a person's genes to predict health risks and guide healthcare decisions, potentially identifying who might benefit from certain treatments or check-ups. However, determining whether these tests are genuinely useful for wide use in health services is complex, because there is no standard way to define “clinical utility” of a genetic test. To understand how these tests are evaluated, we reviewed 57 evaluation reports from high-income countries, most of which focused on cancer-related genetic tests. We found that many evaluations looked mainly at how well a test predicted a condition (validity) and considered some form of effectiveness, yet often failed to measure whether the test truly improved patient health outcomes, such as lowering death rates or enhancing the quality of life. Moreover, factors like patient acceptance, equity, and personal relevance (eg, reducing anxiety) were frequently overlooked. Without including these broader considerations, evaluations risk missing critical evidence that would indicate whether a test is helpful, fair, and worth using. From over 900 unique indicators used to measure clinical utility, we created a simpler list of about 150 general indicators that can guide future evaluations. This consolidated list can help test developers decide which factors to investigate, evaluators determine what to measure, and policymakers identify what might be missing before deciding if a test should be adopted in healthcare. By highlighting the gaps—areas that should be assessed but currently are not—our study encourages a more comprehensive approach to evaluating genetic tests. If we fail to consider issues like equity, patient preferences, and proven health benefits, we risk investing in tests that may do little good or even harm patients. Ultimately, recognizing these shortcomings can lead to better-informed decisions, ensuring that genetic testing is used in ways that truly benefit patients and deliver safer, more personalized, and fairer healthcare for everyone.</div></div>\",\"PeriodicalId\":51079,\"journal\":{\"name\":\"Journal of Clinical Epidemiology\",\"volume\":\"181 \",\"pages\":\"Article 111729\"},\"PeriodicalIF\":5.2000,\"publicationDate\":\"2025-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Clinical Epidemiology\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0895435625000629\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/2/20 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q1\",\"JCRName\":\"HEALTH CARE SCIENCES & SERVICES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Clinical Epidemiology","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0895435625000629","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/2/20 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0

摘要

目的:基因和基因组检测是个性化预防方法的基石。评估其临床效用的不一致通常被认为是其在临床实践中实施有限的原因,以前的评论主要集中在用于基因检测临床效用评估的理论框架上,而不是实际评估,以及检查的维度,而不是这些维度中的具体指标。我们的目的是回顾已发表的基因或基因组测试评估报告中测量的维度和具体指标。设计和背景:我们通过PubMed、Web of Science、Scopus、20个不同组织的网站、谷歌和谷歌Scholar,对用于预防的基因和基因组检测的评估报告进行了范围审查。从纳入的评估中,我们提取了报道的临床效用指标,编制了一份疾病特异性指标清单,详细说明了它们的分子、分母和计算方法。我们根据临床效用的十个综合维度、使用的评估框架和指标类型(定量、定性、参考、无证据报告)对提取的指标进行分层分析。从这些指标中,我们提炼出一份一般指标清单。结果:我们从灰色文献检索中审核了3054篇独立参考文献和12000篇结果,最终选择了57篇评估报告。使用的参考框架为HTA(42%)、EGAPP(25%)、ACCE(21%)和其他(12%)。我们确定了951种疾病特异性指标。最常评估的维度(即至少有一个指标)是分析效度(60%)、临床效度(79%)、临床疗效(79%)和经济影响(58%)。只有12项评估比较了测试组和未测试组之间的健康结果,不到15%的评估涉及公平性、可接受性、合法性和个人价值。结论:我们的研究表明,尽管公平和可接受性等维度在传统的评估框架中得到了显著的强调,但在评估中往往没有考虑到这些。此外,我们的研究强调了关于这些测试的临床疗效的报告的主要证据的显著缺乏。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
A scoping review of the assessment reports of genetic or genomic tests reveals inconsistent consideration of key dimensions of clinical utility

Objectives

Genetic and genomic tests are the cornerstone of personalized preventive approaches. Inconsistency in evaluating their clinical utility is often cited as a reason for their limited implementation in clinical practice. Previous reviews have primarily focused on theoretical frameworks used for clinical utility evaluations of genetic tests, rather than actual assessments and examined dimensions, rather than specific indicators within these dimensions. We aimed to review the dimensions and the specific indicators measured in published assessment reports of genetic or genomic tests.

Study Design and Setting

We conducted a scoping review of assessment reports of genetic and genomic tests used for prevention, searching through PubMed, Web of Science, Scopus, the websites of 20 different organizations, Google, and Google Scholar. From the included assessments, we extracted the reported indicators of clinical utility, compiling a list of disease-specific indicators that detailed their numerator, denominator, and calculation methods. We analyzed the extracted indicators by stratifying them according to ten comprehensive dimensions of clinical utility, the assessment framework used, and the type of indicator (categorized as quantitative, qualitative, reference, or no evidence reported). From these indicators, we then distilled a list of general indicators.

Results

We reviewed 3054 unique references and 12,000 results from gray literature searches, ultimately selecting 57 assessment reports. The reference frameworks used were health technology assessment (HTA) (42%), Evaluation of Genomic Applications in Practice and Prevention (EGAPP) (25%), ACCE (21%), and others (12%). We identified 951 disease-specific indicators. The dimensions most frequently evaluated (ie, had at least one indicator) were analytic validity (60%), clinical validity (79%), clinical efficacy (79%), and economic impact (58%). Only 12 assessments compared health outcomes between tested and untested groups, and fewer than 15% of the assessments addressed equity, acceptability, legitimacy, and personal value.

Conclusion

Our study illustrates that, although dimensions such as equity and acceptability, are significantly emphasized in traditional evaluation frameworks, these are often not considered in the assessments. Additionally, our study has underscored a significant dearth of reported primary evidence concerning the clinical efficacy of these tests.

Plain Language Summary

Genetic and genomic tests analyze a person's genes to predict health risks and guide healthcare decisions, potentially identifying who might benefit from certain treatments or check-ups. However, determining whether these tests are genuinely useful for wide use in health services is complex, because there is no standard way to define “clinical utility” of a genetic test. To understand how these tests are evaluated, we reviewed 57 evaluation reports from high-income countries, most of which focused on cancer-related genetic tests. We found that many evaluations looked mainly at how well a test predicted a condition (validity) and considered some form of effectiveness, yet often failed to measure whether the test truly improved patient health outcomes, such as lowering death rates or enhancing the quality of life. Moreover, factors like patient acceptance, equity, and personal relevance (eg, reducing anxiety) were frequently overlooked. Without including these broader considerations, evaluations risk missing critical evidence that would indicate whether a test is helpful, fair, and worth using. From over 900 unique indicators used to measure clinical utility, we created a simpler list of about 150 general indicators that can guide future evaluations. This consolidated list can help test developers decide which factors to investigate, evaluators determine what to measure, and policymakers identify what might be missing before deciding if a test should be adopted in healthcare. By highlighting the gaps—areas that should be assessed but currently are not—our study encourages a more comprehensive approach to evaluating genetic tests. If we fail to consider issues like equity, patient preferences, and proven health benefits, we risk investing in tests that may do little good or even harm patients. Ultimately, recognizing these shortcomings can lead to better-informed decisions, ensuring that genetic testing is used in ways that truly benefit patients and deliver safer, more personalized, and fairer healthcare for everyone.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Clinical Epidemiology
Journal of Clinical Epidemiology 医学-公共卫生、环境卫生与职业卫生
CiteScore
12.00
自引率
6.90%
发文量
320
审稿时长
44 days
期刊介绍: The Journal of Clinical Epidemiology strives to enhance the quality of clinical and patient-oriented healthcare research by advancing and applying innovative methods in conducting, presenting, synthesizing, disseminating, and translating research results into optimal clinical practice. Special emphasis is placed on training new generations of scientists and clinical practice leaders.
期刊最新文献
The experiences and perceptions of guideline developers and people with lived experience working together to create Australian clinical practice guidelines: a qualitative study Association between potentially inappropriate prescribing and adverse patient outcomes using codified STOPP-START and Beers criteria in large, routinely collected population health datasets: a retrospective cohort study Learning from every patient: the ‘outpatient innovation clinic’ Enhancing trustworthiness checks of randomized controlled trials: a pathway to more reliable evidence Sample size and consensus methods used in Delphi studies are heterogeneous: meta-research study
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1