Treatment response in hemato-oncology in the context of the German early benefit assessment of drugs compared to clinical practice

IF 3.6 2区 医学 Q1 MEDICINE, GENERAL & INTERNAL Journal of Evidence‐Based Medicine Pub Date : 2023-12-21 DOI:10.1111/jebm.12575
Nannette Baltes, Andrea Icks, Charalabos-Markos Dintsios
{"title":"Treatment response in hemato-oncology in the context of the German early benefit assessment of drugs compared to clinical practice","authors":"Nannette Baltes,&nbsp;Andrea Icks,&nbsp;Charalabos-Markos Dintsios","doi":"10.1111/jebm.12575","DOIUrl":null,"url":null,"abstract":"<p>High payer deficits resulted in a regulation in 2010, which forced new pharmaceuticals in Germany after market access to undergo an early benefit assessment (EBA) based on patient-relevant outcomes to prove an added benefit compared to existing therapies.<span><sup>1, 2</sup></span> This process had been described in detail elsewhere.<span><sup>3</sup></span></p><p>In hemato-oncology, the heterogeneity of the clinical pictures resulted in a large number of endpoints. Survival was often considered decisive. Even survival was not biased by subjective interpretation, it was only suitable to a limited extent due to various factors, including (i) increasing clinical trial duration as longer survival times were achieved even in the palliative setting; (ii) emerging therapies increasingly focused on early-stage diseases and survival might not be measurable in cancers with good prognosis; (iii) fatal events were rare when cancer prognosis was good, leading to increasing sample size to demonstrate statistical difference; (iv) wider therapeutic options and additional number of treatment lines increased the complexity to isolate the effect of the drug, intensified even more due to bias linked to crossover effects; (v) in settings with long postprogression survival due to effective posttrial therapy or crossover, progression could be used as the primary endpoint.<span><sup>4-7</sup></span> This was reflected in the approach of the European Medicines Agency, which had chosen a decisive endpoint other than survival in more than half of the newly approved hemato-oncology drugs since 2009.<span><sup>8</sup></span> However, the value of treatment response endpoints (TREs) in hemato-oncology has not been systematically investigated within the framework of EBA and compared with everyday clinical practice.</p><p>All EBAs of hemato-oncological drugs with a resolution of the decision maker (Federal Joint Committee, FJC) were included. Regarding the consideration of the TREs by the FJC, the binomial proportion was determined on an indication-specific basis.<span><sup>9</sup></span> TREs used by the manufacturers to prove an added benefit were described and their significance in clinical practice was presented. The assessment of TREs relevance in clinical practice was derived from the German Onkopedia Guidelines and Oncology Guidelines Program regarding therapy goals, prognosis, and influence on therapy decisions. The acceptance of TREs by the FJC was contrasted with their relevance in clinical practice using Cohen's Kappa and interpreting the results according to Altmann et al.<span><sup>10</sup></span></p><p>Until end of 2021, there were 72 FJC resolutions for hemato-oncological drugs, of which in 48 cases 64 TREs were used by the manufacturer to demonstrate an added benefit (Table 1). Of these cases, 71% used one, 25% two, and 4% three TREs.</p><p>The FJC only accepted a total of nine TREs as patient relevant in eight EBAs. Of the 55 nonaccepted TREs, 29% were primary endpoints in pivotal trials. In total, there were FJC resolutions in 17 hemato-oncological indications. The eight EBAs with accepted patient-relevant TREs were distributed across the following indications: chronic lymphocytic leukemia (CLL), Hodgkin's lymphoma, cutaneous T-cell lymphoma, myelofibrosis, polycythemia vera, and systemic anaplastic large cell lymphoma (Table 1).</p><p>The overview showed that the TREs accepted by the FJC either (i) in 6/9 TREs a symptom response associated with the endpoint could be shown (EBAs of Brentuximab vedotin for the treatment of relapsed/refractory Hodgkin's lymphoma, relapsed/refractory systemic anaplastic large cell lymphoma, and CD30+ cutaneous T-cell lymphoma, TRE: complete remission; EBA of Fedratinib for the treatment of myelofibrosis and EBAs of Ruxolitinib for the treatment of polycythemia vera and myelofibrosis, TRE: spleen response) or (ii) in 2/9 TREs a treatment that was burdensome for patients and associated with an increased risk of treatment-related side effects could be prevented by reaching a target value (EBA of Ropeginterferon alfa-2b for the treatment of polycythemia vera, TRE: hematological response; EBA of Ruxolitinib for the treatment of polycythemia vera, TRE: hematocrit control) or (iii) in 1/9 TREs the high healthcare relevance of the effects of the therapy justifies the acceptance (EBA of Idelalisib for the first-line treatment of CLL with 17p-deletion/TP53-mutation in combination with Rituximab, TRE: overall response rate). The most common reason for accepting a TRE was that a symptom response associated with the endpoint could be shown.</p><p>Out of 55 not-accepted TREs, the rejection as a patient-relevant endpoint was clearly justified by the FJC in the supporting reasons in 23 cases. It turned out that the reasons for rejection were distributed very differently in the individual indications. In acute lymphatic leukemia (ALL) and acute myeloid leukemia (AML), clear reasons were given for almost all TREs as to why they were not recognized as patient relevant in the EBA. In indications such as CLL and multiple myeloma, the rejection was only clearly justified for a few TREs by the FJC.</p><p>A comparison with the TREs accepted as patient relevant by the FJC showed that the endpoint “complete remission” was accepted as patient relevant in three EBAs, whereas in 16 cases, it was not accepted. The cases differed in the operationalization of the endpoint. All nonaccepted TREs were not symptom-related but were recorded exclusively on the basis of laboratory tests or imaging procedures such as PET.</p><p>The second main reason for rejection was that the TRE was not validated as a surrogate parameter for other patient-relevant endpoints. The hurdles in surrogate validation as part of the EBA have already been discussed elsewhere.<span><sup>11</sup></span></p><p>The binomial proportion of TREs being accepted depends on indication (Table 1). In 10 of 16 indications, no TRE was accepted by the FJC. Within the indications with accepted TREs the proportion of acceptance ranged between 8.3% in CLL and 100.0% in myelofibrosis. Overall indications, the binomial proportion was 0.14 (95% confidence intervals (CI) 0.07 to 0.25). With the exception of the indications of ALL, CLL, and multiple myeloma, the 95% CIs included 0.50 due to the relatively small numbers of TREs observed and the strong heterogeneity between the indications (chi-square test = 36.417, df = 15, <i>p</i> = 0.002).</p><p>Of the 11 cases with agreement, five endpoints were accepted as part of the EBA and, according to the guidelines, were also relevant in clinical practice. Six endpoints were not accepted by the FJC as patient relevant and were not listed in the guidelines (Table 1). Except for two cases, the decisions of the FJC were consistent; that is, a specific TRE was accepted or rejected in one indication regarding all EBAs within this indication. In the indication of systemic anaplastic lymphoma, the FJC accepted the endpoint of complete remission in one case but not in another case. In the EBA of brentuximab vedotin (systemic anaplastic large cell lymphoma; first line; combination with cyclophosphamide, doxorubicin, and prednisone), in which the complete remission was not accepted, there was a significant difference across the entire patient population, but the difference was not statistically significant in patients with B symptoms at baseline.<span><sup>12</sup></span></p><p>Of the 18 TREs with disagreement on the value in the EBA compared to the clinical practice, 17 were recognized by the FJC as not being patient-relevant. In contrast, these endpoints were listed in the guidelines as therapeutic goals or were relevant for prognosis or the treatment decision. Only reduction of spleen volume by ≥35% in polycythemia vera was accepted by the FJC, which was not listed as a relevant endpoint in the guideline.</p><p>Summing up the TREs in the various indications, 47 of 64 TREs were not accepted in the respective EBAs, which according to the guideline were important in clinical practice. With a Cohen's Kappa = 0.01 (standard error = 0.04, 95% CI −0.07 to 0.08), there was only a poor agreement between accepted TREs in EBA and their value in clinical practice. In addition, the respective odds ratio of TREs acceptance in clinical guidelines compared to EBAs indicated with 1.17 (95% CI 0.13 to 10.79) statistical independence between both.</p><p>It became apparent that the EBA in Germany and their preceding market authorization as well as the guidelines often came to different conclusions on the value of endpoints, although they were usually based on identical clinical evidence. This was also discussed by relevant medical societies and also applied at the European level.<span><sup>13, 14</sup></span> TREs had a relevant meaning in clinical practice in many therapeutic areas and especially in hemato-oncology as overall survival oftentimes could not be captured in regular study duration. For example, the median survival time for multiple myeloma had more than tripled over the last 20 years to almost 70 months.<span><sup>15</sup></span> Minimal residual disease was an important prognostic factor in the treatment of ALL, CLL, and multiple myeloma. Achieving a complete remission was often the primary therapy goal in the treatment of ALL, AML, or diffuse large B-cell lymphoma, because this moved patients usually on to follow-up care and there was no need for any further burdensome treatment associated with side effects. In CLL, a change in therapy was necessary if no complete or partial remission was achieved after first-line therapy. In Hodgkin's lymphoma and mantle cell lymphoma, allogeneic transplantation, a potentially curative treatment, was an option for relapsed patients if they had achieved (partial) remission.</p><p>The question arises whether patient-relevance was defined too narrowly in hemato-oncology in the context of EBA ignoring the value of TREs in clinical practice. It is therefore crucial that the chosen endpoints are meaningful to clinicians, patients, and policymakers that are the end-users of evidence generated by these trials.</p>","PeriodicalId":16090,"journal":{"name":"Journal of Evidence‐Based Medicine","volume":"16 4","pages":"451-454"},"PeriodicalIF":3.6000,"publicationDate":"2023-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/jebm.12575","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Evidence‐Based Medicine","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/jebm.12575","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0

Abstract

High payer deficits resulted in a regulation in 2010, which forced new pharmaceuticals in Germany after market access to undergo an early benefit assessment (EBA) based on patient-relevant outcomes to prove an added benefit compared to existing therapies.1, 2 This process had been described in detail elsewhere.3

In hemato-oncology, the heterogeneity of the clinical pictures resulted in a large number of endpoints. Survival was often considered decisive. Even survival was not biased by subjective interpretation, it was only suitable to a limited extent due to various factors, including (i) increasing clinical trial duration as longer survival times were achieved even in the palliative setting; (ii) emerging therapies increasingly focused on early-stage diseases and survival might not be measurable in cancers with good prognosis; (iii) fatal events were rare when cancer prognosis was good, leading to increasing sample size to demonstrate statistical difference; (iv) wider therapeutic options and additional number of treatment lines increased the complexity to isolate the effect of the drug, intensified even more due to bias linked to crossover effects; (v) in settings with long postprogression survival due to effective posttrial therapy or crossover, progression could be used as the primary endpoint.4-7 This was reflected in the approach of the European Medicines Agency, which had chosen a decisive endpoint other than survival in more than half of the newly approved hemato-oncology drugs since 2009.8 However, the value of treatment response endpoints (TREs) in hemato-oncology has not been systematically investigated within the framework of EBA and compared with everyday clinical practice.

All EBAs of hemato-oncological drugs with a resolution of the decision maker (Federal Joint Committee, FJC) were included. Regarding the consideration of the TREs by the FJC, the binomial proportion was determined on an indication-specific basis.9 TREs used by the manufacturers to prove an added benefit were described and their significance in clinical practice was presented. The assessment of TREs relevance in clinical practice was derived from the German Onkopedia Guidelines and Oncology Guidelines Program regarding therapy goals, prognosis, and influence on therapy decisions. The acceptance of TREs by the FJC was contrasted with their relevance in clinical practice using Cohen's Kappa and interpreting the results according to Altmann et al.10

Until end of 2021, there were 72 FJC resolutions for hemato-oncological drugs, of which in 48 cases 64 TREs were used by the manufacturer to demonstrate an added benefit (Table 1). Of these cases, 71% used one, 25% two, and 4% three TREs.

The FJC only accepted a total of nine TREs as patient relevant in eight EBAs. Of the 55 nonaccepted TREs, 29% were primary endpoints in pivotal trials. In total, there were FJC resolutions in 17 hemato-oncological indications. The eight EBAs with accepted patient-relevant TREs were distributed across the following indications: chronic lymphocytic leukemia (CLL), Hodgkin's lymphoma, cutaneous T-cell lymphoma, myelofibrosis, polycythemia vera, and systemic anaplastic large cell lymphoma (Table 1).

The overview showed that the TREs accepted by the FJC either (i) in 6/9 TREs a symptom response associated with the endpoint could be shown (EBAs of Brentuximab vedotin for the treatment of relapsed/refractory Hodgkin's lymphoma, relapsed/refractory systemic anaplastic large cell lymphoma, and CD30+ cutaneous T-cell lymphoma, TRE: complete remission; EBA of Fedratinib for the treatment of myelofibrosis and EBAs of Ruxolitinib for the treatment of polycythemia vera and myelofibrosis, TRE: spleen response) or (ii) in 2/9 TREs a treatment that was burdensome for patients and associated with an increased risk of treatment-related side effects could be prevented by reaching a target value (EBA of Ropeginterferon alfa-2b for the treatment of polycythemia vera, TRE: hematological response; EBA of Ruxolitinib for the treatment of polycythemia vera, TRE: hematocrit control) or (iii) in 1/9 TREs the high healthcare relevance of the effects of the therapy justifies the acceptance (EBA of Idelalisib for the first-line treatment of CLL with 17p-deletion/TP53-mutation in combination with Rituximab, TRE: overall response rate). The most common reason for accepting a TRE was that a symptom response associated with the endpoint could be shown.

Out of 55 not-accepted TREs, the rejection as a patient-relevant endpoint was clearly justified by the FJC in the supporting reasons in 23 cases. It turned out that the reasons for rejection were distributed very differently in the individual indications. In acute lymphatic leukemia (ALL) and acute myeloid leukemia (AML), clear reasons were given for almost all TREs as to why they were not recognized as patient relevant in the EBA. In indications such as CLL and multiple myeloma, the rejection was only clearly justified for a few TREs by the FJC.

A comparison with the TREs accepted as patient relevant by the FJC showed that the endpoint “complete remission” was accepted as patient relevant in three EBAs, whereas in 16 cases, it was not accepted. The cases differed in the operationalization of the endpoint. All nonaccepted TREs were not symptom-related but were recorded exclusively on the basis of laboratory tests or imaging procedures such as PET.

The second main reason for rejection was that the TRE was not validated as a surrogate parameter for other patient-relevant endpoints. The hurdles in surrogate validation as part of the EBA have already been discussed elsewhere.11

The binomial proportion of TREs being accepted depends on indication (Table 1). In 10 of 16 indications, no TRE was accepted by the FJC. Within the indications with accepted TREs the proportion of acceptance ranged between 8.3% in CLL and 100.0% in myelofibrosis. Overall indications, the binomial proportion was 0.14 (95% confidence intervals (CI) 0.07 to 0.25). With the exception of the indications of ALL, CLL, and multiple myeloma, the 95% CIs included 0.50 due to the relatively small numbers of TREs observed and the strong heterogeneity between the indications (chi-square test = 36.417, df = 15, p = 0.002).

Of the 11 cases with agreement, five endpoints were accepted as part of the EBA and, according to the guidelines, were also relevant in clinical practice. Six endpoints were not accepted by the FJC as patient relevant and were not listed in the guidelines (Table 1). Except for two cases, the decisions of the FJC were consistent; that is, a specific TRE was accepted or rejected in one indication regarding all EBAs within this indication. In the indication of systemic anaplastic lymphoma, the FJC accepted the endpoint of complete remission in one case but not in another case. In the EBA of brentuximab vedotin (systemic anaplastic large cell lymphoma; first line; combination with cyclophosphamide, doxorubicin, and prednisone), in which the complete remission was not accepted, there was a significant difference across the entire patient population, but the difference was not statistically significant in patients with B symptoms at baseline.12

Of the 18 TREs with disagreement on the value in the EBA compared to the clinical practice, 17 were recognized by the FJC as not being patient-relevant. In contrast, these endpoints were listed in the guidelines as therapeutic goals or were relevant for prognosis or the treatment decision. Only reduction of spleen volume by ≥35% in polycythemia vera was accepted by the FJC, which was not listed as a relevant endpoint in the guideline.

Summing up the TREs in the various indications, 47 of 64 TREs were not accepted in the respective EBAs, which according to the guideline were important in clinical practice. With a Cohen's Kappa = 0.01 (standard error = 0.04, 95% CI −0.07 to 0.08), there was only a poor agreement between accepted TREs in EBA and their value in clinical practice. In addition, the respective odds ratio of TREs acceptance in clinical guidelines compared to EBAs indicated with 1.17 (95% CI 0.13 to 10.79) statistical independence between both.

It became apparent that the EBA in Germany and their preceding market authorization as well as the guidelines often came to different conclusions on the value of endpoints, although they were usually based on identical clinical evidence. This was also discussed by relevant medical societies and also applied at the European level.13, 14 TREs had a relevant meaning in clinical practice in many therapeutic areas and especially in hemato-oncology as overall survival oftentimes could not be captured in regular study duration. For example, the median survival time for multiple myeloma had more than tripled over the last 20 years to almost 70 months.15 Minimal residual disease was an important prognostic factor in the treatment of ALL, CLL, and multiple myeloma. Achieving a complete remission was often the primary therapy goal in the treatment of ALL, AML, or diffuse large B-cell lymphoma, because this moved patients usually on to follow-up care and there was no need for any further burdensome treatment associated with side effects. In CLL, a change in therapy was necessary if no complete or partial remission was achieved after first-line therapy. In Hodgkin's lymphoma and mantle cell lymphoma, allogeneic transplantation, a potentially curative treatment, was an option for relapsed patients if they had achieved (partial) remission.

The question arises whether patient-relevance was defined too narrowly in hemato-oncology in the context of EBA ignoring the value of TREs in clinical practice. It is therefore crucial that the chosen endpoints are meaningful to clinicians, patients, and policymakers that are the end-users of evidence generated by these trials.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
德国药物早期效益评估与临床实践的血液肿瘤学治疗反应对比。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Journal of Evidence‐Based Medicine
Journal of Evidence‐Based Medicine MEDICINE, GENERAL & INTERNAL-
CiteScore
11.20
自引率
1.40%
发文量
42
期刊介绍: The Journal of Evidence-Based Medicine (EMB) is an esteemed international healthcare and medical decision-making journal, dedicated to publishing groundbreaking research outcomes in evidence-based decision-making, research, practice, and education. Serving as the official English-language journal of the Cochrane China Centre and West China Hospital of Sichuan University, we eagerly welcome editorials, commentaries, and systematic reviews encompassing various topics such as clinical trials, policy, drug and patient safety, education, and knowledge translation.
期刊最新文献
Extraversion and the Brain: A Coordinate-Based Meta-Analysis of Functional Brain Imaging Studies on Positive Affect. Characteristics of Quality Improvement Projects in Health Services: A Systematic Scoping Review. Clinical Practice Guidelines for Topical NSAIDs in the Treatment of Sports Injuries. Issue Information Barriers and Facilitators to the Participation of Pregnant Women in Clinical Research: A Mixed-Methods Systematic Review
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1