James K Ruffle, Samia Mohinta, Kelly Pegoretti Baruteau, Rebekah Rajiah, Faith Lee, Sebastian Brandner, Parashkev Nachev, Harpreet Hyare
{"title":"VASARI-auto:胶质瘤磁共振成像的公平、高效和经济功能化","authors":"James K Ruffle, Samia Mohinta, Kelly Pegoretti Baruteau, Rebekah Rajiah, Faith Lee, Sebastian Brandner, Parashkev Nachev, Harpreet Hyare","doi":"arxiv-2404.15318","DOIUrl":null,"url":null,"abstract":"The VASARI MRI feature set is a quantitative system designed to standardise\nglioma imaging descriptions. Though effective, deriving VASARI is\ntime-consuming and seldom used in clinical practice. This is a problem that\nmachine learning could plausibly automate. Using glioma data from 1172\npatients, we developed VASARI-auto, an automated labelling software applied to\nboth open-source lesion masks and our openly available tumour segmentation\nmodel. In parallel, two consultant neuroradiologists independently quantified\nVASARI features in a subsample of 100 glioblastoma cases. We quantified: 1)\nagreement across neuroradiologists and VASARI-auto; 2) calibration of\nperformance equity; 3) an economic workforce analysis; and 4) fidelity in\npredicting patient survival. Tumour segmentation was compatible with the\ncurrent state of the art and equally performant regardless of age or sex. A\nmodest inter-rater variability between in-house neuroradiologists was\ncomparable to between neuroradiologists and VASARI-auto, with far higher\nagreement between VASARI-auto methods. The time taken for neuroradiologists to\nderive VASARI was substantially higher than VASARI-auto (mean time per case 317\nvs. 3 seconds). A UK hospital workforce analysis forecast that three years of\nVASARI featurisation would demand 29,777 consultant neuroradiologist workforce\nhours ({\\pounds}1,574,935), reducible to 332 hours of computing time (and\n{\\pounds}146 of power) with VASARI-auto. The best-performing survival model\nutilised VASARI-auto features as opposed to those derived by neuroradiologists.\nVASARI-auto is a highly efficient automated labelling system with equitable\nperformance across patient age or sex, a favourable economic profile if used as\na decision support tool, and with non-inferior fidelity in downstream patient\nsurvival prediction. Future work should iterate upon and integrate such tools\nto enhance patient care.","PeriodicalId":501572,"journal":{"name":"arXiv - QuanBio - Tissues and Organs","volume":"2 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"VASARI-auto: equitable, efficient, and economical featurisation of glioma MRI\",\"authors\":\"James K Ruffle, Samia Mohinta, Kelly Pegoretti Baruteau, Rebekah Rajiah, Faith Lee, Sebastian Brandner, Parashkev Nachev, Harpreet Hyare\",\"doi\":\"arxiv-2404.15318\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The VASARI MRI feature set is a quantitative system designed to standardise\\nglioma imaging descriptions. Though effective, deriving VASARI is\\ntime-consuming and seldom used in clinical practice. This is a problem that\\nmachine learning could plausibly automate. Using glioma data from 1172\\npatients, we developed VASARI-auto, an automated labelling software applied to\\nboth open-source lesion masks and our openly available tumour segmentation\\nmodel. In parallel, two consultant neuroradiologists independently quantified\\nVASARI features in a subsample of 100 glioblastoma cases. We quantified: 1)\\nagreement across neuroradiologists and VASARI-auto; 2) calibration of\\nperformance equity; 3) an economic workforce analysis; and 4) fidelity in\\npredicting patient survival. Tumour segmentation was compatible with the\\ncurrent state of the art and equally performant regardless of age or sex. A\\nmodest inter-rater variability between in-house neuroradiologists was\\ncomparable to between neuroradiologists and VASARI-auto, with far higher\\nagreement between VASARI-auto methods. The time taken for neuroradiologists to\\nderive VASARI was substantially higher than VASARI-auto (mean time per case 317\\nvs. 3 seconds). A UK hospital workforce analysis forecast that three years of\\nVASARI featurisation would demand 29,777 consultant neuroradiologist workforce\\nhours ({\\\\pounds}1,574,935), reducible to 332 hours of computing time (and\\n{\\\\pounds}146 of power) with VASARI-auto. The best-performing survival model\\nutilised VASARI-auto features as opposed to those derived by neuroradiologists.\\nVASARI-auto is a highly efficient automated labelling system with equitable\\nperformance across patient age or sex, a favourable economic profile if used as\\na decision support tool, and with non-inferior fidelity in downstream patient\\nsurvival prediction. Future work should iterate upon and integrate such tools\\nto enhance patient care.\",\"PeriodicalId\":501572,\"journal\":{\"name\":\"arXiv - QuanBio - Tissues and Organs\",\"volume\":\"2 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-04-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"arXiv - QuanBio - Tissues and Organs\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/arxiv-2404.15318\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - QuanBio - Tissues and Organs","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2404.15318","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
VASARI-auto: equitable, efficient, and economical featurisation of glioma MRI
The VASARI MRI feature set is a quantitative system designed to standardise
glioma imaging descriptions. Though effective, deriving VASARI is
time-consuming and seldom used in clinical practice. This is a problem that
machine learning could plausibly automate. Using glioma data from 1172
patients, we developed VASARI-auto, an automated labelling software applied to
both open-source lesion masks and our openly available tumour segmentation
model. In parallel, two consultant neuroradiologists independently quantified
VASARI features in a subsample of 100 glioblastoma cases. We quantified: 1)
agreement across neuroradiologists and VASARI-auto; 2) calibration of
performance equity; 3) an economic workforce analysis; and 4) fidelity in
predicting patient survival. Tumour segmentation was compatible with the
current state of the art and equally performant regardless of age or sex. A
modest inter-rater variability between in-house neuroradiologists was
comparable to between neuroradiologists and VASARI-auto, with far higher
agreement between VASARI-auto methods. The time taken for neuroradiologists to
derive VASARI was substantially higher than VASARI-auto (mean time per case 317
vs. 3 seconds). A UK hospital workforce analysis forecast that three years of
VASARI featurisation would demand 29,777 consultant neuroradiologist workforce
hours ({\pounds}1,574,935), reducible to 332 hours of computing time (and
{\pounds}146 of power) with VASARI-auto. The best-performing survival model
utilised VASARI-auto features as opposed to those derived by neuroradiologists.
VASARI-auto is a highly efficient automated labelling system with equitable
performance across patient age or sex, a favourable economic profile if used as
a decision support tool, and with non-inferior fidelity in downstream patient
survival prediction. Future work should iterate upon and integrate such tools
to enhance patient care.