Fang Jiang, Thomas K. L. Lui, Chengsheng Ju, Chuan-Guo Guo, Ka Shing Cheung, Wallis C. Y. Lau, Wai K. Leung
{"title":"预测幽门螺杆菌治疗失败的机器学习模型:两国验证研究","authors":"Fang Jiang, Thomas K. L. Lui, Chengsheng Ju, Chuan-Guo Guo, Ka Shing Cheung, Wallis C. Y. Lau, Wai K. Leung","doi":"10.1111/hel.13051","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background</h3>\n \n <p>The success rate of clarithromycin-containing <i>Helicobacter pylori</i> treatment had declined globally. This study aims to explore the role of different machine learning algorithms in predicting failure of <i>H. pylori</i> treatment.</p>\n </section>\n \n <section>\n \n <h3> Materials and Methods</h3>\n \n <p>We included 84,609 adult patients who had received the first course of clarithromycin-containing triple therapy for <i>H. pylori</i> in Hong Kong from 2003 to 2013 as training set. Results were validated in patients who had received similar triple therapy with 27,736 Hong Kong patients between 2014 and 2017 (internal cohort); and 18,050 UK patients between 2012 and 2017 (external cohort). The performance of 11 available machine learning algorithms were used to predict the failure of triple therapy. The performance was determined by the area under receiver operating characteristic curve (AUC).</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>The treatment failure rates in the training, internal and external validation cohort was 5.9%, 9.5%, and 6.1%, respectively. In the internal validation set, Extra-Tree (ET) Classifier had the best AUC (0.88; 95% CI, 0.87–0.88), sensitivity (79.6%; 95% CI, 79.0–80.2) and specificity (79.4%; 95% CI, 79.0–79.8). In the external validation set, ET Classifier also had the best AUC (0.85; 95% CI, 0.85–0.86), sensitivity (80.1%; 95% CI, 79.5–80.9), and specificity (80.2%; 95% CI, 78.8–81.3). Top features of importance used by ET Classifier in predicting treatment failure included time interval between antibiotic use and triple therapy (48.8%), age (29.1%) and triple therapy regime (6.28%).</p>\n </section>\n \n <section>\n \n <h3> Conclusions</h3>\n \n <p>Machine learning algorithm, based on simple baseline clinical parameters, could help to identify patients at high risk of failure from clarithromycin-containing triple therapy for <i>H. pylori</i>.</p>\n </section>\n </div>","PeriodicalId":13223,"journal":{"name":"Helicobacter","volume":"29 1","pages":""},"PeriodicalIF":4.3000,"publicationDate":"2024-01-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/hel.13051","citationCount":"0","resultStr":"{\"title\":\"Machine learning models in predicting failure of Helicobacter pylori treatment: A two country validation study\",\"authors\":\"Fang Jiang, Thomas K. L. Lui, Chengsheng Ju, Chuan-Guo Guo, Ka Shing Cheung, Wallis C. Y. Lau, Wai K. Leung\",\"doi\":\"10.1111/hel.13051\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n \\n <section>\\n \\n <h3> Background</h3>\\n \\n <p>The success rate of clarithromycin-containing <i>Helicobacter pylori</i> treatment had declined globally. This study aims to explore the role of different machine learning algorithms in predicting failure of <i>H. pylori</i> treatment.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Materials and Methods</h3>\\n \\n <p>We included 84,609 adult patients who had received the first course of clarithromycin-containing triple therapy for <i>H. pylori</i> in Hong Kong from 2003 to 2013 as training set. Results were validated in patients who had received similar triple therapy with 27,736 Hong Kong patients between 2014 and 2017 (internal cohort); and 18,050 UK patients between 2012 and 2017 (external cohort). The performance of 11 available machine learning algorithms were used to predict the failure of triple therapy. The performance was determined by the area under receiver operating characteristic curve (AUC).</p>\\n </section>\\n \\n <section>\\n \\n <h3> Results</h3>\\n \\n <p>The treatment failure rates in the training, internal and external validation cohort was 5.9%, 9.5%, and 6.1%, respectively. In the internal validation set, Extra-Tree (ET) Classifier had the best AUC (0.88; 95% CI, 0.87–0.88), sensitivity (79.6%; 95% CI, 79.0–80.2) and specificity (79.4%; 95% CI, 79.0–79.8). In the external validation set, ET Classifier also had the best AUC (0.85; 95% CI, 0.85–0.86), sensitivity (80.1%; 95% CI, 79.5–80.9), and specificity (80.2%; 95% CI, 78.8–81.3). Top features of importance used by ET Classifier in predicting treatment failure included time interval between antibiotic use and triple therapy (48.8%), age (29.1%) and triple therapy regime (6.28%).</p>\\n </section>\\n \\n <section>\\n \\n <h3> Conclusions</h3>\\n \\n <p>Machine learning algorithm, based on simple baseline clinical parameters, could help to identify patients at high risk of failure from clarithromycin-containing triple therapy for <i>H. pylori</i>.</p>\\n </section>\\n </div>\",\"PeriodicalId\":13223,\"journal\":{\"name\":\"Helicobacter\",\"volume\":\"29 1\",\"pages\":\"\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-01-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1111/hel.13051\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Helicobacter\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1111/hel.13051\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"GASTROENTEROLOGY & HEPATOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Helicobacter","FirstCategoryId":"3","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/hel.13051","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GASTROENTEROLOGY & HEPATOLOGY","Score":null,"Total":0}
Machine learning models in predicting failure of Helicobacter pylori treatment: A two country validation study
Background
The success rate of clarithromycin-containing Helicobacter pylori treatment had declined globally. This study aims to explore the role of different machine learning algorithms in predicting failure of H. pylori treatment.
Materials and Methods
We included 84,609 adult patients who had received the first course of clarithromycin-containing triple therapy for H. pylori in Hong Kong from 2003 to 2013 as training set. Results were validated in patients who had received similar triple therapy with 27,736 Hong Kong patients between 2014 and 2017 (internal cohort); and 18,050 UK patients between 2012 and 2017 (external cohort). The performance of 11 available machine learning algorithms were used to predict the failure of triple therapy. The performance was determined by the area under receiver operating characteristic curve (AUC).
Results
The treatment failure rates in the training, internal and external validation cohort was 5.9%, 9.5%, and 6.1%, respectively. In the internal validation set, Extra-Tree (ET) Classifier had the best AUC (0.88; 95% CI, 0.87–0.88), sensitivity (79.6%; 95% CI, 79.0–80.2) and specificity (79.4%; 95% CI, 79.0–79.8). In the external validation set, ET Classifier also had the best AUC (0.85; 95% CI, 0.85–0.86), sensitivity (80.1%; 95% CI, 79.5–80.9), and specificity (80.2%; 95% CI, 78.8–81.3). Top features of importance used by ET Classifier in predicting treatment failure included time interval between antibiotic use and triple therapy (48.8%), age (29.1%) and triple therapy regime (6.28%).
Conclusions
Machine learning algorithm, based on simple baseline clinical parameters, could help to identify patients at high risk of failure from clarithromycin-containing triple therapy for H. pylori.
期刊介绍:
Helicobacter is edited by Professor David Y Graham. The editorial and peer review process is an independent process. Whenever there is a conflict of interest, the editor and editorial board will declare their interests and affiliations. Helicobacter recognises the critical role that has been established for Helicobacter pylori in peptic ulcer, gastric adenocarcinoma, and primary gastric lymphoma. As new helicobacter species are now regularly being discovered, Helicobacter covers the entire range of helicobacter research, increasing communication among the fields of gastroenterology; microbiology; vaccine development; laboratory animal science.