Gelareh Farshid, Jane Armes, Benjamin Dessauvagie, Amardeep Gilhotra, Beena Kumar, Hema Mahajan, Ewan Millar, Nirmala Pathmanathan, Cameron Snell
{"title":"独立验证低her2聚焦IHC评分系统提高病理学家的准确性和一致性。","authors":"Gelareh Farshid, Jane Armes, Benjamin Dessauvagie, Amardeep Gilhotra, Beena Kumar, Hema Mahajan, Ewan Millar, Nirmala Pathmanathan, Cameron Snell","doi":"10.1016/j.modpat.2024.100693","DOIUrl":null,"url":null,"abstract":"<p><p>For 2 decades, the American Society of Clinial Oncology-College of American Pathologists human epidermal growth factor receptor 2 (HER2) testing criteria have included 0 and 1+ scores, but this distinction was inconsequential. Now, based on the DESTINY Breast-04 Trial (DB-04) results, for patients with metastatic breast cancer it underpins eligibility for trastuzumab-deruxtecan treatment. Discerning 0 from 1+ immunohistochemistry (IHC) staining is challenging, as HER2 low is not a biologically distinct cancer subset, there are no reference standards or controls, and second-tier tests (eg, in situ hybridization) do not apply. Prior reports cast doubt on the reliability of pathologists' IHC scoring, with resulting treatment misalignments. With institutional review board approval, our group of 9 breast pathologists from 8 Australian laboratories had previously established HER2-low-focused scoring conventions, based on the American Society of Clinial Oncology-College of American Pathologists 2018 HER2 guidelines, and specifying common staining pitfalls. We reported the results of the first set of 60 breast cancers evaluated with these methods. After a 5-month washout, for the present validation study, we have compiled a second set of 64 HER2-negative invasive breast cancer core biopsies, all assessed with the Ventana 4B5 HER2 assay. We have each scored digitized images of HER2 IHC slides of the cases. Using the majority opinion as the target score, we have calculated our performance metrics. We have compared the results of our performance in set 1 and set 2 to assess the effectiveness of our approach and learning retention. The cases in this validation set included 40 (62.5%) HER2 low, 10 (17.2%) ultralow (UL), and 13 (18.8%) null cancers. Concordance was not achieved in 1 case. For distinguishing HER2 low from other cancers (UL and null combined) the mean values of our performance metrics were accuracy 89.58%, sensitivity 90.83%, specificity 87.50%, positive predictive value 95.63%, negative predictive value 83.59%, and Cohen kappa score 0.81. Comparing these results with our initial study, we have maintained our high level of performance across these parameters. Our mean kappa score is now in the excellent range for concordance. Maintaining high performance across a range of measures in 2 separate data sets validates the effectiveness of our HER2-low-focused scoring conventions. Having validated our approach, we will use these reference case sets with expert-level consensus scores for peer training and updating our national HER2 IHC external quality assurance program. In our ongoing studies, we are also assessing the performance of software algorithms to determine their suitability for the prescreening of HER2 IHC slides.</p>","PeriodicalId":18706,"journal":{"name":"Modern Pathology","volume":" ","pages":"100693"},"PeriodicalIF":7.1000,"publicationDate":"2024-12-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Independent Validation of a HER2-Low Focused Immunohistochemistry Scoring System for Enhanced Pathologist Precision and Consistency.\",\"authors\":\"Gelareh Farshid, Jane Armes, Benjamin Dessauvagie, Amardeep Gilhotra, Beena Kumar, Hema Mahajan, Ewan Millar, Nirmala Pathmanathan, Cameron Snell\",\"doi\":\"10.1016/j.modpat.2024.100693\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>For 2 decades, the American Society of Clinial Oncology-College of American Pathologists human epidermal growth factor receptor 2 (HER2) testing criteria have included 0 and 1+ scores, but this distinction was inconsequential. Now, based on the DESTINY Breast-04 Trial (DB-04) results, for patients with metastatic breast cancer it underpins eligibility for trastuzumab-deruxtecan treatment. Discerning 0 from 1+ immunohistochemistry (IHC) staining is challenging, as HER2 low is not a biologically distinct cancer subset, there are no reference standards or controls, and second-tier tests (eg, in situ hybridization) do not apply. Prior reports cast doubt on the reliability of pathologists' IHC scoring, with resulting treatment misalignments. With institutional review board approval, our group of 9 breast pathologists from 8 Australian laboratories had previously established HER2-low-focused scoring conventions, based on the American Society of Clinial Oncology-College of American Pathologists 2018 HER2 guidelines, and specifying common staining pitfalls. We reported the results of the first set of 60 breast cancers evaluated with these methods. After a 5-month washout, for the present validation study, we have compiled a second set of 64 HER2-negative invasive breast cancer core biopsies, all assessed with the Ventana 4B5 HER2 assay. We have each scored digitized images of HER2 IHC slides of the cases. Using the majority opinion as the target score, we have calculated our performance metrics. We have compared the results of our performance in set 1 and set 2 to assess the effectiveness of our approach and learning retention. The cases in this validation set included 40 (62.5%) HER2 low, 10 (17.2%) ultralow (UL), and 13 (18.8%) null cancers. Concordance was not achieved in 1 case. For distinguishing HER2 low from other cancers (UL and null combined) the mean values of our performance metrics were accuracy 89.58%, sensitivity 90.83%, specificity 87.50%, positive predictive value 95.63%, negative predictive value 83.59%, and Cohen kappa score 0.81. Comparing these results with our initial study, we have maintained our high level of performance across these parameters. Our mean kappa score is now in the excellent range for concordance. Maintaining high performance across a range of measures in 2 separate data sets validates the effectiveness of our HER2-low-focused scoring conventions. Having validated our approach, we will use these reference case sets with expert-level consensus scores for peer training and updating our national HER2 IHC external quality assurance program. In our ongoing studies, we are also assessing the performance of software algorithms to determine their suitability for the prescreening of HER2 IHC slides.</p>\",\"PeriodicalId\":18706,\"journal\":{\"name\":\"Modern Pathology\",\"volume\":\" \",\"pages\":\"100693\"},\"PeriodicalIF\":7.1000,\"publicationDate\":\"2024-12-24\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Modern Pathology\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1016/j.modpat.2024.100693\",\"RegionNum\":1,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PATHOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Modern Pathology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.modpat.2024.100693","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PATHOLOGY","Score":null,"Total":0}
引用次数: 0
摘要
二十年来,ASCO CAP HER2检测标准包括0和1+分,但这种区别是无关紧要的。现在,基于DESTINY breast -04试验(DB-04)的结果,对于转移性乳腺癌患者,它支持T-DXd治疗的资格。区分0和1+ IHC染色具有挑战性,因为HER2低并不是生物学上独特的癌症亚群,没有参考标准或对照,也不适用二级检测。先前的报告对病理学家的IHC评分的可靠性表示怀疑,导致治疗错位。经IRB批准,我们来自8个澳大利亚实验室的9名乳腺病理学家小组先前根据ASCO CAP 2018 HER2指南建立了HER2低焦点评分惯例,并指定了常见的染色陷阱。我们报告了用这些方法评估的第一组60例乳腺癌的结果。在5个月的洗脱期后,对于目前的验证研究,我们编制了第二组64例HER2阴性的浸润性乳腺癌核心活检,所有活检均采用Ventana 4B5 HER2检测进行评估。我们分别对病例的HER2 IHC玻片的数字化图像进行了评分。使用多数意见作为目标分数,我们计算出了我们的性能指标。我们比较了第一组和第二组的表现结果,以评估我们的方法和学习保留的有效性。该验证集中的病例包括40例(62.5%)her2低,10例(17.2%)超低(UL)和13例(18.8%)零癌。1例未达到一致性。对于区分HER2低与其他癌症(UL和null合并),我们的性能指标的平均值为:准确性89.58%,敏感性90.83%,特异性87.50%,阳性预测值95.63%,阴性预测值83.59%,Cohen's kappa评分0.81。将这些结果与我们最初的研究结果进行比较,我们在这些参数中保持了高水平的性能。我们的平均卡帕评分现在处于一致性的优秀范围内。在两个独立的数据集中保持一系列指标的高性能,验证了我们的HER2低焦点评分惯例的有效性。在验证了我们的方法之后,我们将使用这些具有专家水平共识分数的参考案例集进行同行培训,并更新我们的国家HER2 IHC外部质量保证计划。在我们正在进行的研究中,我们也在评估软件算法的性能,以确定它们对HER2 IHC载玻片预筛选的适用性。
Independent Validation of a HER2-Low Focused Immunohistochemistry Scoring System for Enhanced Pathologist Precision and Consistency.
For 2 decades, the American Society of Clinial Oncology-College of American Pathologists human epidermal growth factor receptor 2 (HER2) testing criteria have included 0 and 1+ scores, but this distinction was inconsequential. Now, based on the DESTINY Breast-04 Trial (DB-04) results, for patients with metastatic breast cancer it underpins eligibility for trastuzumab-deruxtecan treatment. Discerning 0 from 1+ immunohistochemistry (IHC) staining is challenging, as HER2 low is not a biologically distinct cancer subset, there are no reference standards or controls, and second-tier tests (eg, in situ hybridization) do not apply. Prior reports cast doubt on the reliability of pathologists' IHC scoring, with resulting treatment misalignments. With institutional review board approval, our group of 9 breast pathologists from 8 Australian laboratories had previously established HER2-low-focused scoring conventions, based on the American Society of Clinial Oncology-College of American Pathologists 2018 HER2 guidelines, and specifying common staining pitfalls. We reported the results of the first set of 60 breast cancers evaluated with these methods. After a 5-month washout, for the present validation study, we have compiled a second set of 64 HER2-negative invasive breast cancer core biopsies, all assessed with the Ventana 4B5 HER2 assay. We have each scored digitized images of HER2 IHC slides of the cases. Using the majority opinion as the target score, we have calculated our performance metrics. We have compared the results of our performance in set 1 and set 2 to assess the effectiveness of our approach and learning retention. The cases in this validation set included 40 (62.5%) HER2 low, 10 (17.2%) ultralow (UL), and 13 (18.8%) null cancers. Concordance was not achieved in 1 case. For distinguishing HER2 low from other cancers (UL and null combined) the mean values of our performance metrics were accuracy 89.58%, sensitivity 90.83%, specificity 87.50%, positive predictive value 95.63%, negative predictive value 83.59%, and Cohen kappa score 0.81. Comparing these results with our initial study, we have maintained our high level of performance across these parameters. Our mean kappa score is now in the excellent range for concordance. Maintaining high performance across a range of measures in 2 separate data sets validates the effectiveness of our HER2-low-focused scoring conventions. Having validated our approach, we will use these reference case sets with expert-level consensus scores for peer training and updating our national HER2 IHC external quality assurance program. In our ongoing studies, we are also assessing the performance of software algorithms to determine their suitability for the prescreening of HER2 IHC slides.
期刊介绍:
Modern Pathology, an international journal under the ownership of The United States & Canadian Academy of Pathology (USCAP), serves as an authoritative platform for publishing top-tier clinical and translational research studies in pathology.
Original manuscripts are the primary focus of Modern Pathology, complemented by impactful editorials, reviews, and practice guidelines covering all facets of precision diagnostics in human pathology. The journal's scope includes advancements in molecular diagnostics and genomic classifications of diseases, breakthroughs in immune-oncology, computational science, applied bioinformatics, and digital pathology.