Pub Date : 2024-04-24DOI: 10.1016/S2589-7500(24)00028-1
Sally Boylan MSc , Catherine Arsenault PhD , Marcos Barreto PhD , Fernando A Bozza PhD MD , Adalton Fonseca PhD , Eoghan Forde PhD , Lauren Hookham MBBS , Georgina S Humphreys PhD , Maria Yury Ichihara PhD , Prof Kirsty Le Doare PhD , Xiao Fan Liu PhD , Edel McNamara LLM , Jean Claude Mugunga MD MS , Juliane F Oliveira PhD , Joseph Ouma PhD , Neil Postlethwaite BSc , Matthew Retford BCompSci , Luis Felipe Reyes PhD MD , Prof Andrew D Morris MD , Anne Wozencraft PhD
The COVID-19 pandemic highlighted the importance of international data sharing and access to improve health outcomes for all. The International COVID-19 Data Alliance (ICODA) programme enabled 12 exemplar or driver projects to use existing health-related data to address major research questions relating to the pandemic, and developed data science approaches that helped each research team to overcome challenges, accelerate the data research cycle, and produce rapid insights and outputs. These approaches also sought to address inequity in data access and use, test approaches to ethical health data use, and make summary datasets and outputs accessible to a wider group of researchers. This Health Policy paper focuses on the challenges and lessons learned from ten of the ICODA driver projects, involving researchers from 19 countries and a range of health-related datasets. The ICODA programme reviewed the time taken for each project to complete stages of the health data research cycle and identified common challenges in areas such as data sharing agreements and data curation. Solutions included provision of standard data sharing templates, additional data curation expertise at an early stage, and a trusted research environment that facilitated data sharing across national boundaries and reduced risk. These approaches enabled the driver projects to rapidly produce research outputs, including publications, shared code, dashboards, and innovative resources, which can all be accessed and used by other research teams to address global health challenges.
{"title":"Data challenges for international health emergencies: lessons learned from ten international COVID-19 driver projects","authors":"Sally Boylan MSc , Catherine Arsenault PhD , Marcos Barreto PhD , Fernando A Bozza PhD MD , Adalton Fonseca PhD , Eoghan Forde PhD , Lauren Hookham MBBS , Georgina S Humphreys PhD , Maria Yury Ichihara PhD , Prof Kirsty Le Doare PhD , Xiao Fan Liu PhD , Edel McNamara LLM , Jean Claude Mugunga MD MS , Juliane F Oliveira PhD , Joseph Ouma PhD , Neil Postlethwaite BSc , Matthew Retford BCompSci , Luis Felipe Reyes PhD MD , Prof Andrew D Morris MD , Anne Wozencraft PhD","doi":"10.1016/S2589-7500(24)00028-1","DOIUrl":"https://doi.org/10.1016/S2589-7500(24)00028-1","url":null,"abstract":"<div><p>The COVID-19 pandemic highlighted the importance of international data sharing and access to improve health outcomes for all. The International COVID-19 Data Alliance (ICODA) programme enabled 12 exemplar or driver projects to use existing health-related data to address major research questions relating to the pandemic, and developed data science approaches that helped each research team to overcome challenges, accelerate the data research cycle, and produce rapid insights and outputs. These approaches also sought to address inequity in data access and use, test approaches to ethical health data use, and make summary datasets and outputs accessible to a wider group of researchers. This Health Policy paper focuses on the challenges and lessons learned from ten of the ICODA driver projects, involving researchers from 19 countries and a range of health-related datasets. The ICODA programme reviewed the time taken for each project to complete stages of the health data research cycle and identified common challenges in areas such as data sharing agreements and data curation. Solutions included provision of standard data sharing templates, additional data curation expertise at an early stage, and a trusted research environment that facilitated data sharing across national boundaries and reduced risk. These approaches enabled the driver projects to rapidly produce research outputs, including publications, shared code, dashboards, and innovative resources, which can all be accessed and used by other research teams to address global health challenges.</p></div>","PeriodicalId":48534,"journal":{"name":"Lancet Digital Health","volume":"6 5","pages":"Pages e354-e366"},"PeriodicalIF":30.8,"publicationDate":"2024-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2589750024000281/pdfft?md5=1de0ec661e76c5de270161eaab230bb2&pid=1-s2.0-S2589750024000281-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140644538","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-24DOI: 10.1016/S2589-7500(24)00044-X
Vincent Alcazer MD , Grégoire Le Meur MD , Marie Roccon PharmD , Sabrina Barriere MD , Baptiste Le Calvez MD , Bouchra Badaoui MD , Agathe Spaeth PharmD , Prof Olivier Kosmider PharmD , Nicolas Freynet MD , Prof Marion Eveillard PharmD , Carolyne Croizier MD , Simon Chevalier PharmD , Prof Pierre Sujobert MD
<div><h3>Background</h3><p>Acute leukaemias are life-threatening haematological cancers characterised by the infiltration of transformed immature haematopoietic cells in the blood and bone marrow. Prompt and accurate diagnosis of the three main acute leukaemia subtypes (ie acute lymphocytic leukaemia [ALL], acute myeloid leukaemia [AML], and acute promyelocytic leukaemia [APL]) is of utmost importance to guide initial treatment and prevent early mortality but requires cytological expertise that is not always available. We aimed to benchmark different machine-learning strategies using a custom variable selection algorithm to propose an extreme gradient boosting model to predict leukaemia subtypes on the basis of routine laboratory parameters.</p></div><div><h3>Methods</h3><p>This multicentre model development and validation study was conducted with data from six independent French university hospital databases. Patients aged 18 years or older diagnosed with AML, APL, or ALL in any one of these six hospital databases between March 1, 2012, and Dec 31, 2021, were recruited. 22 routine parameters were collected at the time of initial disease evaluation; variables with more than 25% of missing values in two datasets were not used for model training, leading to the final inclusion of 19 parameters. The performances of the final model were evaluated on internal testing and external validation sets with area under the receiver operating characteristic curves (AUCs), and clinically relevant cutoffs were chosen to guide clinical decision making. The final tool, Artificial Intelligence Prediction of Acute Leukemia (AI-PAL), was developed from this model.</p></div><div><h3>Findings</h3><p>1410 patients diagnosed with AML, APL, or ALL were included. Data quality control showed few missing values for each cohort, with the exception of uric acid and lactate dehydrogenase for the cohort from Hôpital Cochin. 679 patients from Hôpital Lyon Sud and Centre Hospitalier Universitaire de Clermont-Ferrand were split into the training (n=477) and internal testing (n=202) sets. 731 patients from the four other cohorts were used for external validation. Overall AUCs across all validation cohorts were 0·97 (95% CI 0·95–0·99) for APL, 0·90 (0·83–0·97) for ALL, and 0·89 (0·82–0·95) for AML. Cutoffs were then established on the overall cohort of 1410 patients to guide clinical decisions. Confident cutoffs showed two (0·14%) wrong predictions for ALL, four (0·28%) wrong predictions for APL, and three (0·21%) wrong predictions for AML. Use of the overall cutoff greatly reduced the number of missing predictions; diagnosis was proposed for 1375 (97·5%) of 1410 patients for each category, with only a slight increase in wrong predictions. The final model evaluation across both the internal testing and external validation sets showed accuracy of 99·5% for ALL diagnosis, 98·8% for AML diagnosis, and 99·7% for APL diagnosis in the confident model and accuracy of 87·9% for ALL diagnosis
背景急性白血病是一种危及生命的血液肿瘤,其特点是血液和骨髓中的未成熟造血细胞浸润转化。及时准确地诊断三种主要的急性白血病亚型(即急性淋巴细胞白血病、急性髓性白血病和急性早幼粒细胞白血病)对于指导初始治疗和预防早期死亡至关重要,但这需要细胞学方面的专业知识,而这些专业知识并非总能获得。我们的目标是使用自定义变量选择算法对不同的机器学习策略进行基准测试,以提出一种极端梯度提升模型,根据常规实验室参数预测白血病亚型。研究人员招募了 2012 年 3 月 1 日至 2021 年 12 月 31 日期间在这六家医院数据库中任何一家医院确诊为 AML、APL 或 ALL 的 18 岁或以上患者。初始疾病评估时收集了 22 个常规参数;两个数据集中缺失值超过 25% 的变量未用于模型训练,因此最终纳入了 19 个参数。最终模型的性能在内部测试集和外部验证集上用接收器操作特征曲线下面积(AUC)进行了评估,并选择了与临床相关的临界值来指导临床决策。根据该模型开发了最终工具--急性白血病人工智能预测模型(AI-PAL)。数据质量控制显示,除科钦医院队列中的尿酸和乳酸脱氢酶外,每个队列中几乎没有缺失值。里昂南方医院和克莱蒙费朗大学中心医院的679名患者被分为训练组(477人)和内部测试组(202人)。来自其他四个队列的 731 名患者被用于外部验证。所有验证队列的总AUC分别为:APL 0-97(95% CI 0-95-0-99),ALL 0-90(0-83-0-97),AML 0-89(0-82-0-95)。然后在 1410 例患者的总体队列中确定了临界值,以指导临床决策。可靠的临界值显示,对 ALL 的错误预测有 2 次(0-14%),对 APL 的错误预测有 4 次(0-28%),对 AML 的错误预测有 3 次(0-21%)。使用总体临界值大大减少了预测缺失的数量;在每个类别的 1410 例患者中,有 1375 例(97-5%)提出了诊断,错误预测仅略有增加。对内部测试集和外部验证集进行的最终模型评估显示,自信模型对 ALL 诊断的准确率为 99-5%,对 AML 诊断的准确率为 98-8%,对 APL 诊断的准确率为 99-7%;整体模型对 ALL 诊断的准确率为 87-9%,对 AML 诊断的准确率为 86-3%,对 APL 诊断的准确率为 96-1%。基于十个简单的实验室参数,在缺乏细胞学专业知识的情况下,如在低收入国家,它的广泛应用有助于指导初始治疗。
{"title":"Evaluation of a machine-learning model based on laboratory parameters for the prediction of acute leukaemia subtypes: a multicentre model development and validation study in France","authors":"Vincent Alcazer MD , Grégoire Le Meur MD , Marie Roccon PharmD , Sabrina Barriere MD , Baptiste Le Calvez MD , Bouchra Badaoui MD , Agathe Spaeth PharmD , Prof Olivier Kosmider PharmD , Nicolas Freynet MD , Prof Marion Eveillard PharmD , Carolyne Croizier MD , Simon Chevalier PharmD , Prof Pierre Sujobert MD","doi":"10.1016/S2589-7500(24)00044-X","DOIUrl":"https://doi.org/10.1016/S2589-7500(24)00044-X","url":null,"abstract":"<div><h3>Background</h3><p>Acute leukaemias are life-threatening haematological cancers characterised by the infiltration of transformed immature haematopoietic cells in the blood and bone marrow. Prompt and accurate diagnosis of the three main acute leukaemia subtypes (ie acute lymphocytic leukaemia [ALL], acute myeloid leukaemia [AML], and acute promyelocytic leukaemia [APL]) is of utmost importance to guide initial treatment and prevent early mortality but requires cytological expertise that is not always available. We aimed to benchmark different machine-learning strategies using a custom variable selection algorithm to propose an extreme gradient boosting model to predict leukaemia subtypes on the basis of routine laboratory parameters.</p></div><div><h3>Methods</h3><p>This multicentre model development and validation study was conducted with data from six independent French university hospital databases. Patients aged 18 years or older diagnosed with AML, APL, or ALL in any one of these six hospital databases between March 1, 2012, and Dec 31, 2021, were recruited. 22 routine parameters were collected at the time of initial disease evaluation; variables with more than 25% of missing values in two datasets were not used for model training, leading to the final inclusion of 19 parameters. The performances of the final model were evaluated on internal testing and external validation sets with area under the receiver operating characteristic curves (AUCs), and clinically relevant cutoffs were chosen to guide clinical decision making. The final tool, Artificial Intelligence Prediction of Acute Leukemia (AI-PAL), was developed from this model.</p></div><div><h3>Findings</h3><p>1410 patients diagnosed with AML, APL, or ALL were included. Data quality control showed few missing values for each cohort, with the exception of uric acid and lactate dehydrogenase for the cohort from Hôpital Cochin. 679 patients from Hôpital Lyon Sud and Centre Hospitalier Universitaire de Clermont-Ferrand were split into the training (n=477) and internal testing (n=202) sets. 731 patients from the four other cohorts were used for external validation. Overall AUCs across all validation cohorts were 0·97 (95% CI 0·95–0·99) for APL, 0·90 (0·83–0·97) for ALL, and 0·89 (0·82–0·95) for AML. Cutoffs were then established on the overall cohort of 1410 patients to guide clinical decisions. Confident cutoffs showed two (0·14%) wrong predictions for ALL, four (0·28%) wrong predictions for APL, and three (0·21%) wrong predictions for AML. Use of the overall cutoff greatly reduced the number of missing predictions; diagnosis was proposed for 1375 (97·5%) of 1410 patients for each category, with only a slight increase in wrong predictions. The final model evaluation across both the internal testing and external validation sets showed accuracy of 99·5% for ALL diagnosis, 98·8% for AML diagnosis, and 99·7% for APL diagnosis in the confident model and accuracy of 87·9% for ALL diagnosis","PeriodicalId":48534,"journal":{"name":"Lancet Digital Health","volume":"6 5","pages":"Pages e323-e333"},"PeriodicalIF":30.8,"publicationDate":"2024-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S258975002400044X/pdfft?md5=98d113fd5143121b2cc564451bf756e5&pid=1-s2.0-S258975002400044X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140644480","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-24DOI: 10.1016/S2589-7500(24)00046-3
Prof Maree Teesson PhD , Louise Birrell PhD , Prof Tim Slade PhD , Louise R Mewton PhD , Nick Olsen PhD , Prof Leanne Hides PhD , Nyanda McBride PhD , Mary Lou Chatterton PharmD , Prof Steve Allsop PhD , Ainsley Furneaux-Bate BPsy , Zachary Bryant MPH , Rhiannon Ellem BPsyScH , Megan J Baker MPH , Annalise Healy BPsyHons , Jennifer Debenham PhD , Julia Boyle BPsyHons , Marius Mather Mbiostat , Prof Cathrine Mihalopoulos PhD , Prof Catherine Chapman PhD , Prof Nicola C Newton PhD
<div><h3>Background</h3><p>The CSC study found that the universal delivery of a school-based, online programme for the prevention of mental health and substance use disorders among adolescents resulted in improvements in mental health and substance use outcomes at 30-month follow-up. We aimed to compare the long-term effects of four interventions—Climate Schools Combined (CSC) mental health and substance use, Climate Schools Substance Use (CSSU) alone, Climate Schools Mental Health (CSMH) alone, and standard health education—on mental health and substance use outcomes among adolescents at 72-month follow-up into early adulthood.</p></div><div><h3>Methods</h3><p>This long-term study followed up adolescents from a multicentre, cluster-randomised trial conducted across three states in Australia (New South Wales, Queensland, and Western Australia) enrolled between Sept 1, 2013, and Feb 28, 2014, for up to 72 months after baseline assessment. Adolescents (aged 18–20 years) from the original CSC study who accepted contact at 30-month follow-up and provided informed consent at 60-month follow-up were eligible. The interventions were delivered in school classrooms through an online delivery format and used a mixture of peer cartoon storyboards and classroom activities that were focused on alcohol, cannabis, anxiety, and depression. Participants took part in two web-based assessments at 60-month and 72-month follow-up. Primary outcomes were alcohol use, cannabis use, anxiety, and depression, measured by self-reported surveys and analysed by intention to treat (ie, in all students who were eligible at baseline). This trial is registered with the Australian New Zealand Clinical Trials Registry (ACTRN12613000723785), including the extended follow-up study.</p></div><div><h3>Findings</h3><p>Of 6386 students enrolled from 71 schools, 1556 (24·4%) were randomly assigned to education as usual, 1739 (27·2%) to CSSU, 1594 (25·0%) to CSMH, and 1497 (23·4%) to CSC. 311 (22·2%) of 1401 participants in the control group, 394 (26·4%) of 1495 in the CSSU group, 477 (37·%) of 1289 in the CSMH group, and 400 (32·5%) of 1232 in the CSC group completed follow-up at 72 months. Adolescents in the CSC group reported slower year-by-year increases in weekly alcohol use (odds ratio 0·78 [95% CI 0·66–0·92]; p=0·0028) and heavy episodic drinking (0·69 [0·58–0·81]; p<0·0001) than did the control group. However, significant baseline differences between groups for drinking outcomes, and no difference in the predicted probability of weekly or heavy episodic drinking between groups were observed at 72 months. Sensitivity analyses increased uncertainty around estimates. No significant long-term differences were observed in relation to alcohol use disorder, cannabis use, cannabis use disorder, anxiety, or depression. No adverse events were reported during the trial.</p></div><div><h3>Interpretation</h3><p>We found some evidence that a universal online programme for the prevention of an
{"title":"Effectiveness of a universal, school-based, online programme for the prevention of anxiety, depression, and substance misuse among adolescents in Australia: 72-month outcomes from a cluster-randomised controlled trial","authors":"Prof Maree Teesson PhD , Louise Birrell PhD , Prof Tim Slade PhD , Louise R Mewton PhD , Nick Olsen PhD , Prof Leanne Hides PhD , Nyanda McBride PhD , Mary Lou Chatterton PharmD , Prof Steve Allsop PhD , Ainsley Furneaux-Bate BPsy , Zachary Bryant MPH , Rhiannon Ellem BPsyScH , Megan J Baker MPH , Annalise Healy BPsyHons , Jennifer Debenham PhD , Julia Boyle BPsyHons , Marius Mather Mbiostat , Prof Cathrine Mihalopoulos PhD , Prof Catherine Chapman PhD , Prof Nicola C Newton PhD","doi":"10.1016/S2589-7500(24)00046-3","DOIUrl":"https://doi.org/10.1016/S2589-7500(24)00046-3","url":null,"abstract":"<div><h3>Background</h3><p>The CSC study found that the universal delivery of a school-based, online programme for the prevention of mental health and substance use disorders among adolescents resulted in improvements in mental health and substance use outcomes at 30-month follow-up. We aimed to compare the long-term effects of four interventions—Climate Schools Combined (CSC) mental health and substance use, Climate Schools Substance Use (CSSU) alone, Climate Schools Mental Health (CSMH) alone, and standard health education—on mental health and substance use outcomes among adolescents at 72-month follow-up into early adulthood.</p></div><div><h3>Methods</h3><p>This long-term study followed up adolescents from a multicentre, cluster-randomised trial conducted across three states in Australia (New South Wales, Queensland, and Western Australia) enrolled between Sept 1, 2013, and Feb 28, 2014, for up to 72 months after baseline assessment. Adolescents (aged 18–20 years) from the original CSC study who accepted contact at 30-month follow-up and provided informed consent at 60-month follow-up were eligible. The interventions were delivered in school classrooms through an online delivery format and used a mixture of peer cartoon storyboards and classroom activities that were focused on alcohol, cannabis, anxiety, and depression. Participants took part in two web-based assessments at 60-month and 72-month follow-up. Primary outcomes were alcohol use, cannabis use, anxiety, and depression, measured by self-reported surveys and analysed by intention to treat (ie, in all students who were eligible at baseline). This trial is registered with the Australian New Zealand Clinical Trials Registry (ACTRN12613000723785), including the extended follow-up study.</p></div><div><h3>Findings</h3><p>Of 6386 students enrolled from 71 schools, 1556 (24·4%) were randomly assigned to education as usual, 1739 (27·2%) to CSSU, 1594 (25·0%) to CSMH, and 1497 (23·4%) to CSC. 311 (22·2%) of 1401 participants in the control group, 394 (26·4%) of 1495 in the CSSU group, 477 (37·%) of 1289 in the CSMH group, and 400 (32·5%) of 1232 in the CSC group completed follow-up at 72 months. Adolescents in the CSC group reported slower year-by-year increases in weekly alcohol use (odds ratio 0·78 [95% CI 0·66–0·92]; p=0·0028) and heavy episodic drinking (0·69 [0·58–0·81]; p<0·0001) than did the control group. However, significant baseline differences between groups for drinking outcomes, and no difference in the predicted probability of weekly or heavy episodic drinking between groups were observed at 72 months. Sensitivity analyses increased uncertainty around estimates. No significant long-term differences were observed in relation to alcohol use disorder, cannabis use, cannabis use disorder, anxiety, or depression. No adverse events were reported during the trial.</p></div><div><h3>Interpretation</h3><p>We found some evidence that a universal online programme for the prevention of an","PeriodicalId":48534,"journal":{"name":"Lancet Digital Health","volume":"6 5","pages":"Pages e334-e344"},"PeriodicalIF":30.8,"publicationDate":"2024-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2589750024000463/pdfft?md5=42535618a1ebcdf24793f471ab1860a2&pid=1-s2.0-S2589750024000463-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140644481","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-24DOI: 10.1016/S2589-7500(24)00048-7
Prof Cristiano Spada MD PhD , Stefania Piccirelli MD , Prof Cesare Hassan MD PhD , Clarissa Ferrari PhD , Ervin Toth MD PhD , Begoña González-Suárez MD PhD , Martin Keuchel MD PhD , Marc McAlindon MD PhD , Ádám Finta MD , András Rosztóczy MD PhD , Prof Xavier Dray MD PhD , Daniele Salvi MD , Maria Elena Riccioni MD PhD , Robert Benamouzig MD PhD , Amit Chattree MD , Adam Humphries MD PhD , Prof Jean-Christophe Saurin MD PhD , Edward J Despott MD PhD , Alberto Murino MD , Gabriele Wurm Johansson , Prof Guido Costamagna MD PhD
Background
Capsule endoscopy reading is time consuming, and readers are required to maintain attention so as not to miss significant findings. Deep convolutional neural networks can recognise relevant findings, possibly exceeding human performances and reducing the reading time of capsule endoscopy. Our primary aim was to assess the non-inferiority of artificial intelligence (AI)-assisted reading versus standard reading for potentially small bowel bleeding lesions (high P2, moderate P1; Saurin classification) at per-patient analysis. The mean reading time in both reading modalities was evaluated among the secondary endpoints.
Methods
Patients aged 18 years or older with suspected small bowel bleeding (with anaemia with or without melena or haematochezia, and negative bidirectional endoscopy) were prospectively enrolled at 14 European centres. Patients underwent small bowel capsule endoscopy with the Navicam SB system (Ankon, China), which is provided with a deep neural network-based AI system (ProScan) for automatic detection of lesions. Initial reading was performed in standard reading mode. Second blinded reading was performed with AI assistance (the AI operated a first-automated reading, and only AI-selected images were assessed by human readers). The primary endpoint was to assess the non-inferiority of AI-assisted reading versus standard reading in the detection (diagnostic yield) of potentially small bowel bleeding P1 and P2 lesions in a per-patient analysis. This study is registered with ClinicalTrials.gov, NCT04821349.
Findings
From Feb 17, 2021 to Dec 29, 2021, 137 patients were prospectively enrolled. 133 patients were included in the final analysis (73 [55%] female, mean age 66·5 years [SD 14·4]; 112 [84%] completed capsule endoscopy). At per-patient analysis, the diagnostic yield of P1 and P2 lesions in AI-assisted reading (98 [73·7%] of 133 lesions) was non-inferior (p<0·0001) and superior (p=0·0213) to standard reading (82 [62·4%] of 133; 95% CI 3·6–19·0). Mean small bowel reading time was 33·7 min (SD 22·9) in standard reading and 3·8 min (3·3) in AI-assisted reading (p<0·0001).
Interpretation
AI-assisted reading might provide more accurate and faster detection of clinically relevant small bowel bleeding lesions than standard reading.
Funding
ANKON Technologies, China and AnX Robotica, USA provided the NaviCam SB system.
{"title":"AI-assisted capsule endoscopy reading in suspected small bowel bleeding: a multicentre prospective study","authors":"Prof Cristiano Spada MD PhD , Stefania Piccirelli MD , Prof Cesare Hassan MD PhD , Clarissa Ferrari PhD , Ervin Toth MD PhD , Begoña González-Suárez MD PhD , Martin Keuchel MD PhD , Marc McAlindon MD PhD , Ádám Finta MD , András Rosztóczy MD PhD , Prof Xavier Dray MD PhD , Daniele Salvi MD , Maria Elena Riccioni MD PhD , Robert Benamouzig MD PhD , Amit Chattree MD , Adam Humphries MD PhD , Prof Jean-Christophe Saurin MD PhD , Edward J Despott MD PhD , Alberto Murino MD , Gabriele Wurm Johansson , Prof Guido Costamagna MD PhD","doi":"10.1016/S2589-7500(24)00048-7","DOIUrl":"https://doi.org/10.1016/S2589-7500(24)00048-7","url":null,"abstract":"<div><h3>Background</h3><p>Capsule endoscopy reading is time consuming, and readers are required to maintain attention so as not to miss significant findings. Deep convolutional neural networks can recognise relevant findings, possibly exceeding human performances and reducing the reading time of capsule endoscopy. Our primary aim was to assess the non-inferiority of artificial intelligence (AI)-assisted reading versus standard reading for potentially small bowel bleeding lesions (high P2, moderate P1; Saurin classification) at per-patient analysis. The mean reading time in both reading modalities was evaluated among the secondary endpoints.</p></div><div><h3>Methods</h3><p>Patients aged 18 years or older with suspected small bowel bleeding (with anaemia with or without melena or haematochezia, and negative bidirectional endoscopy) were prospectively enrolled at 14 European centres. Patients underwent small bowel capsule endoscopy with the Navicam SB system (Ankon, China), which is provided with a deep neural network-based AI system (ProScan) for automatic detection of lesions. Initial reading was performed in standard reading mode. Second blinded reading was performed with AI assistance (the AI operated a first-automated reading, and only AI-selected images were assessed by human readers). The primary endpoint was to assess the non-inferiority of AI-assisted reading versus standard reading in the detection (diagnostic yield) of potentially small bowel bleeding P1 and P2 lesions in a per-patient analysis. This study is registered with <span>ClinicalTrials.gov</span><svg><path></path></svg>, <span>NCT04821349</span><svg><path></path></svg>.</p></div><div><h3>Findings</h3><p>From Feb 17, 2021 to Dec 29, 2021, 137 patients were prospectively enrolled. 133 patients were included in the final analysis (73 [55%] female, mean age 66·5 years [SD 14·4]; 112 [84%] completed capsule endoscopy). At per-patient analysis, the diagnostic yield of P1 and P2 lesions in AI-assisted reading (98 [73·7%] of 133 lesions) was non-inferior (p<0·0001) and superior (p=0·0213) to standard reading (82 [62·4%] of 133; 95% CI 3·6–19·0). Mean small bowel reading time was 33·7 min (SD 22·9) in standard reading and 3·8 min (3·3) in AI-assisted reading (p<0·0001).</p></div><div><h3>Interpretation</h3><p>AI-assisted reading might provide more accurate and faster detection of clinically relevant small bowel bleeding lesions than standard reading.</p></div><div><h3>Funding</h3><p>ANKON Technologies, China and AnX Robotica, USA provided the NaviCam SB system.</p></div>","PeriodicalId":48534,"journal":{"name":"Lancet Digital Health","volume":"6 5","pages":"Pages e345-e353"},"PeriodicalIF":30.8,"publicationDate":"2024-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2589750024000487/pdfft?md5=71adf0dd8695092a27675c17467d9f94&pid=1-s2.0-S2589750024000487-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140644537","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-24DOI: 10.1016/S2589-7500(24)00060-8
Shan Chen , Marco Guevara , Shalini Moningi , Frank Hoebers , Hesham Elhalawani , Benjamin H Kann , Fallon E Chipidza , Jonathan Leeman , Hugo J W L Aerts , Timothy Miller , Guergana K Savova , Jack Gallifant , Leo A Celi , Raymond H Mak , Maryam Lustberg , Majid Afshar , Danielle S Bitterman
{"title":"The effect of using a large language model to respond to patient messages","authors":"Shan Chen , Marco Guevara , Shalini Moningi , Frank Hoebers , Hesham Elhalawani , Benjamin H Kann , Fallon E Chipidza , Jonathan Leeman , Hugo J W L Aerts , Timothy Miller , Guergana K Savova , Jack Gallifant , Leo A Celi , Raymond H Mak , Maryam Lustberg , Majid Afshar , Danielle S Bitterman","doi":"10.1016/S2589-7500(24)00060-8","DOIUrl":"10.1016/S2589-7500(24)00060-8","url":null,"abstract":"","PeriodicalId":48534,"journal":{"name":"Lancet Digital Health","volume":"6 6","pages":"Pages e379-e381"},"PeriodicalIF":30.8,"publicationDate":"2024-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2589750024000608/pdfft?md5=b841e47b03a1ce7f2f68408f9ba3b0dd&pid=1-s2.0-S2589750024000608-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140862783","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-24DOI: 10.1016/S2589-7500(24)00064-5
Robyn Gayle K Dychiao , Isabelle Rose I Alberto , Jose Carlo M Artiaga , Recivall P Salongcay , Leo Anthony Celi
{"title":"Large language model integration in Philippine ophthalmology: early challenges and steps forward","authors":"Robyn Gayle K Dychiao , Isabelle Rose I Alberto , Jose Carlo M Artiaga , Recivall P Salongcay , Leo Anthony Celi","doi":"10.1016/S2589-7500(24)00064-5","DOIUrl":"https://doi.org/10.1016/S2589-7500(24)00064-5","url":null,"abstract":"","PeriodicalId":48534,"journal":{"name":"Lancet Digital Health","volume":"6 5","pages":"Page e308"},"PeriodicalIF":30.8,"publicationDate":"2024-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2589750024000645/pdfft?md5=a618cc89acb0da9a2b4b4875fe87565d&pid=1-s2.0-S2589750024000645-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140643969","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-24DOI: 10.1016/S2589-7500(24)00047-5
Ryan Han MS , Julián N Acosta MD , Zahra Shakeri PhD , Prof John P A Ioannidis MD DSc , Prof Eric J Topol MD , Pranav Rajpurkar PhD
This scoping review of randomised controlled trials on artificial intelligence (AI) in clinical practice reveals an expanding interest in AI across clinical specialties and locations. The USA and China are leading in the number of trials, with a focus on deep learning systems for medical imaging, particularly in gastroenterology and radiology. A majority of trials (70 [81%] of 86) report positive primary endpoints, primarily related to diagnostic yield or performance; however, the predominance of single-centre trials, little demographic reporting, and varying reports of operational efficiency raise concerns about the generalisability and practicality of these results. Despite the promising outcomes, considering the likelihood of publication bias and the need for more comprehensive research including multicentre trials, diverse outcome measures, and improved reporting standards is crucial. Future AI trials should prioritise patient-relevant outcomes to fully understand AI's true effects and limitations in health care.
{"title":"Randomised controlled trials evaluating artificial intelligence in clinical practice: a scoping review","authors":"Ryan Han MS , Julián N Acosta MD , Zahra Shakeri PhD , Prof John P A Ioannidis MD DSc , Prof Eric J Topol MD , Pranav Rajpurkar PhD","doi":"10.1016/S2589-7500(24)00047-5","DOIUrl":"https://doi.org/10.1016/S2589-7500(24)00047-5","url":null,"abstract":"<div><p>This scoping review of randomised controlled trials on artificial intelligence (AI) in clinical practice reveals an expanding interest in AI across clinical specialties and locations. The USA and China are leading in the number of trials, with a focus on deep learning systems for medical imaging, particularly in gastroenterology and radiology. A majority of trials (70 [81%] of 86) report positive primary endpoints, primarily related to diagnostic yield or performance; however, the predominance of single-centre trials, little demographic reporting, and varying reports of operational efficiency raise concerns about the generalisability and practicality of these results. Despite the promising outcomes, considering the likelihood of publication bias and the need for more comprehensive research including multicentre trials, diverse outcome measures, and improved reporting standards is crucial. Future AI trials should prioritise patient-relevant outcomes to fully understand AI's true effects and limitations in health care.</p></div>","PeriodicalId":48534,"journal":{"name":"Lancet Digital Health","volume":"6 5","pages":"Pages e367-e373"},"PeriodicalIF":30.8,"publicationDate":"2024-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2589750024000475/pdfft?md5=9d9e22118ce0622e5f971accc65430f7&pid=1-s2.0-S2589750024000475-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140644539","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-04-23DOI: 10.1016/S2589-7500(24)00061-X
Jasmine Chiat Ling Ong PharmD , Shelley Yin-Hsi Chang MD , Wasswa William PhD , Prof Atul J Butte PhD , Prof Nigam H Shah PhD , Lita Sui Tjien Chew MMedSc , Nan Liu PhD , Prof Finale Doshi-Velez PhD , Wei Lu PhD , Prof Julian Savulescu PhD , Daniel Shu Wei Ting PhD
With the rapid growth of interest in and use of large language models (LLMs) across various industries, we are facing some crucial and profound ethical concerns, especially in the medical field. The unique technical architecture and purported emergent abilities of LLMs differentiate them substantially from other artificial intelligence (AI) models and natural language processing techniques used, necessitating a nuanced understanding of LLM ethics. In this Viewpoint, we highlight ethical concerns stemming from the perspectives of users, developers, and regulators, notably focusing on data privacy and rights of use, data provenance, intellectual property contamination, and broad applications and plasticity of LLMs. A comprehensive framework and mitigating strategies will be imperative for the responsible integration of LLMs into medical practice, ensuring alignment with ethical principles and safeguarding against potential societal risks.
{"title":"Ethical and regulatory challenges of large language models in medicine","authors":"Jasmine Chiat Ling Ong PharmD , Shelley Yin-Hsi Chang MD , Wasswa William PhD , Prof Atul J Butte PhD , Prof Nigam H Shah PhD , Lita Sui Tjien Chew MMedSc , Nan Liu PhD , Prof Finale Doshi-Velez PhD , Wei Lu PhD , Prof Julian Savulescu PhD , Daniel Shu Wei Ting PhD","doi":"10.1016/S2589-7500(24)00061-X","DOIUrl":"10.1016/S2589-7500(24)00061-X","url":null,"abstract":"<div><p>With the rapid growth of interest in and use of large language models (LLMs) across various industries, we are facing some crucial and profound ethical concerns, especially in the medical field. The unique technical architecture and purported emergent abilities of LLMs differentiate them substantially from other artificial intelligence (AI) models and natural language processing techniques used, necessitating a nuanced understanding of LLM ethics. In this Viewpoint, we highlight ethical concerns stemming from the perspectives of users, developers, and regulators, notably focusing on data privacy and rights of use, data provenance, intellectual property contamination, and broad applications and plasticity of LLMs. A comprehensive framework and mitigating strategies will be imperative for the responsible integration of LLMs into medical practice, ensuring alignment with ethical principles and safeguarding against potential societal risks.</p></div>","PeriodicalId":48534,"journal":{"name":"Lancet Digital Health","volume":"6 6","pages":"Pages e428-e432"},"PeriodicalIF":30.8,"publicationDate":"2024-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S258975002400061X/pdfft?md5=39a73cb24f24224e1864903fab51b512&pid=1-s2.0-S258975002400061X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140873049","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-20DOI: 10.1016/S2589-7500(24)00049-9
The Lancet Digital Health
{"title":"Retraction remedy: a resource for transparent science","authors":"The Lancet Digital Health","doi":"10.1016/S2589-7500(24)00049-9","DOIUrl":"https://doi.org/10.1016/S2589-7500(24)00049-9","url":null,"abstract":"","PeriodicalId":48534,"journal":{"name":"Lancet Digital Health","volume":"6 4","pages":"Page e230"},"PeriodicalIF":30.8,"publicationDate":"2024-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2589750024000499/pdfft?md5=bb41889cc627fd386d772925840536aa&pid=1-s2.0-S2589750024000499-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140181151","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-03-20DOI: 10.1016/S2589-7500(24)00022-0
Rumi Chunara , Jessica Gjonaj , Eileen Immaculate , Iris Wanga , James Alaro , Lori A J Scott-Sheldon , Judith Mangeni , Ann Mwangi , Rajesh Vedanthan , Joseph Hogan
{"title":"Social determinants of health: the need for data science methods and capacity","authors":"Rumi Chunara , Jessica Gjonaj , Eileen Immaculate , Iris Wanga , James Alaro , Lori A J Scott-Sheldon , Judith Mangeni , Ann Mwangi , Rajesh Vedanthan , Joseph Hogan","doi":"10.1016/S2589-7500(24)00022-0","DOIUrl":"https://doi.org/10.1016/S2589-7500(24)00022-0","url":null,"abstract":"","PeriodicalId":48534,"journal":{"name":"Lancet Digital Health","volume":"6 4","pages":"Pages e235-e237"},"PeriodicalIF":30.8,"publicationDate":"2024-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2589750024000220/pdfft?md5=d498ae1129e6de33c63a41ded7c96e2d&pid=1-s2.0-S2589750024000220-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140181154","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}