Kristoffer Mazanti Cold, Amihai Heen, Anishan Vamadevan, Andreas Slot Vilmann, Lars Konge, Morten Rasmussen, Morten Bo Søndergaard Svendsen
{"title":"Development and validation of the Open-Source Automatic Bowel Preparation Scale.","authors":"Kristoffer Mazanti Cold, Amihai Heen, Anishan Vamadevan, Andreas Slot Vilmann, Lars Konge, Morten Rasmussen, Morten Bo Søndergaard Svendsen","doi":"10.1016/j.gie.2024.11.022","DOIUrl":null,"url":null,"abstract":"<p><strong>Background and aims: </strong>Insufficient bowel preparation accounts for up to 42% of missed adenomas in colonoscopy. However, major analysis programs found no correlation between adenoma detection rate and the human-rated Boston Bowel Preparation Scale (BBPS), indicating limitations of the scale. We therefore aimed to develop an open-source automatic bowel preparation scale (OSABPS) based on artificial intelligence that is correlated to the polyp detection rate (PDR).</p><p><strong>Methods: </strong>OSABPS was trained on 50,000 frames from 20 colonoscopies from three hospitals. It involved quantifying the presence of fecal matter within the colonoscopy frames, using an approach termed the fecal ratio - the proportion of pixels identified as feces (F) relative to those identified as mucosal tissue (M) (OSABPS = F/M) - thereby making 0 the optimal score indicating a perfect cleansing. Youden's J was used to set the threshold, as it determines the optimal balance between sensitivity and specificity. The algorithm was then tested on 1,405 colonoscopies from three hospitals (internal validation), and 5,525 frames from a public colonoscopy database (Nerthus, external validation).</p><p><strong>Results: </strong>Internal validation: OSABPS correlated significantly with BBPS (Pearson's r = -.42, P<.001). A threshold of .09 OSABPS was determined using Youden's J. PDR was higher for colonoscopies below the threshold of Youden's J (Two proportion z-test, P<.001). External validation: OSABPS correlated significantly with BBPS (Pearson's r = -.70, P<.001).</p><p><strong>Conclusions: </strong>OSABPS can automatically, instantly and without human bias assess bowel preparation quality. Colonoscopies with an OSABPS > .09 should be considered for reexamination. OSABPS' open-source nature allows free implementation.</p>","PeriodicalId":12542,"journal":{"name":"Gastrointestinal endoscopy","volume":" ","pages":""},"PeriodicalIF":6.7000,"publicationDate":"2024-11-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Gastrointestinal endoscopy","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.gie.2024.11.022","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GASTROENTEROLOGY & HEPATOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background and aims: Insufficient bowel preparation accounts for up to 42% of missed adenomas in colonoscopy. However, major analysis programs found no correlation between adenoma detection rate and the human-rated Boston Bowel Preparation Scale (BBPS), indicating limitations of the scale. We therefore aimed to develop an open-source automatic bowel preparation scale (OSABPS) based on artificial intelligence that is correlated to the polyp detection rate (PDR).
Methods: OSABPS was trained on 50,000 frames from 20 colonoscopies from three hospitals. It involved quantifying the presence of fecal matter within the colonoscopy frames, using an approach termed the fecal ratio - the proportion of pixels identified as feces (F) relative to those identified as mucosal tissue (M) (OSABPS = F/M) - thereby making 0 the optimal score indicating a perfect cleansing. Youden's J was used to set the threshold, as it determines the optimal balance between sensitivity and specificity. The algorithm was then tested on 1,405 colonoscopies from three hospitals (internal validation), and 5,525 frames from a public colonoscopy database (Nerthus, external validation).
Results: Internal validation: OSABPS correlated significantly with BBPS (Pearson's r = -.42, P<.001). A threshold of .09 OSABPS was determined using Youden's J. PDR was higher for colonoscopies below the threshold of Youden's J (Two proportion z-test, P<.001). External validation: OSABPS correlated significantly with BBPS (Pearson's r = -.70, P<.001).
Conclusions: OSABPS can automatically, instantly and without human bias assess bowel preparation quality. Colonoscopies with an OSABPS > .09 should be considered for reexamination. OSABPS' open-source nature allows free implementation.
期刊介绍:
Gastrointestinal Endoscopy is a journal publishing original, peer-reviewed articles on endoscopic procedures for studying, diagnosing, and treating digestive diseases. It covers outcomes research, prospective studies, and controlled trials of new endoscopic instruments and treatment methods. The online features include full-text articles, video and audio clips, and MEDLINE links. The journal serves as an international forum for the latest developments in the specialty, offering challenging reports from authorities worldwide. It also publishes abstracts of significant articles from other clinical publications, accompanied by expert commentaries.