L. McCullum, Hasan Saeed, Benjamin Moody, D. Perry, Eric Gottlieb, T. Pollard, Xavier Borrat Frigola, Qiao Li, Gari D. Clifford, R. Mark, Li-wei H. Lehman
{"title":"PhysioTag: An Open-Source Platform for Collaborative Annotation of Physiological Waveforms","authors":"L. McCullum, Hasan Saeed, Benjamin Moody, D. Perry, Eric Gottlieb, T. Pollard, Xavier Borrat Frigola, Qiao Li, Gari D. Clifford, R. Mark, Li-wei H. Lehman","doi":"10.22489/CinC.2022.335","DOIUrl":null,"url":null,"abstract":"To develop robust algorithms for automated diagnosis of medical conditions such as cardiac arrhythmias, researchers require large collections of data with human expert annotations. Currently, there is a lack of accessible, open-source platforms for human experts to collaboratively develop these annotated datasets through a web interface. In this work, we developed a flexible, generalizable, web-based framework to enable multiple users to create and share annotations on multi-channel physiological waveforms. Using the developed annotation platform, we carried out a pilot study to assess the validity of ventricular tachycardia (VT) alarms from multiple commercial monitors. Thus far, four clinical experts have used this annotation tool to annotate a total of 5,658 VT alarm events, among which approximately 44%(N=2,468) have been labeled by two independent annotators.","PeriodicalId":117840,"journal":{"name":"2022 Computing in Cardiology (CinC)","volume":"41 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 Computing in Cardiology (CinC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.22489/CinC.2022.335","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
To develop robust algorithms for automated diagnosis of medical conditions such as cardiac arrhythmias, researchers require large collections of data with human expert annotations. Currently, there is a lack of accessible, open-source platforms for human experts to collaboratively develop these annotated datasets through a web interface. In this work, we developed a flexible, generalizable, web-based framework to enable multiple users to create and share annotations on multi-channel physiological waveforms. Using the developed annotation platform, we carried out a pilot study to assess the validity of ventricular tachycardia (VT) alarms from multiple commercial monitors. Thus far, four clinical experts have used this annotation tool to annotate a total of 5,658 VT alarm events, among which approximately 44%(N=2,468) have been labeled by two independent annotators.