J. Dolcini, S. Gomez-Montes, Raquel Obregón, Marck Collado, F. Barbabella, C. Chiatti, F. Tessarolo
{"title":"基于拉曼的新型耐多药细菌早期检测技术的准确性","authors":"J. Dolcini, S. Gomez-Montes, Raquel Obregón, Marck Collado, F. Barbabella, C. Chiatti, F. Tessarolo","doi":"10.1109/MeMeA54994.2022.9856540","DOIUrl":null,"url":null,"abstract":"Cultural methods, although time consuming, are still the gold standard for the microbial detection, combining high sensitivity and specificity. Vibrational spectroscopies, such as Raman spectroscopy, have been recently proposed as an alternative, being label-free, non-invasive, and highly specific. This study aimed to evaluate the accuracy of a new technology (AMR-S3DP, Sens Solutions, Barcelona, Spain) based on Raman spectroscopy to detect the presence of three clinically relevant multidrug resistant pathogens (Clostridium difficile, Klebsiella pneumoniae and methicillin resistant Staphylococcus aureus). Different machine learning strategies for analyzing the collected Raman spectra were compared to find a solution trading-off between accuracy and computational cost. Experimental datasets were collected in controlled conditions using pure cultures of the three microorganisms of interest. Then, nine state-of-the-art classifiers and several instances of a Multi-Layer Perceptron Neural Network were trained and tested using the dataset. Three experiments were ran: (i) classification of only the three bacteria strains, (ii) classification of the three bacteria strains and the absence of bacteria, (iii) the same settings with standardized and normalized data. All the experiments were performed following a 10-Fold stratified Cross-validation approach. Tested methods included: Logistic regression, Nearest Neighbor Classifier, Support vector machines, Gaussian process, Decision Trees, Random Forest, Boosting, and Quadratic Classifier Naïve Bayes. Data distributions were highly nonlinear, nevertheless, Gaussian Process and Logistic Regression clearly outperformed the other tested methods when training and testing data sets were normalized and standardized. Gaussian Processes failed in providing a competitive solution to be executed in low-cost devices, being several orders of magnitude slower than Logistic Regression. With the most performant analytical method, a precision >94% and a recall rate >95% was obtained for all the three microorganisms of interest, making the system suitable to detect MDR pathogens and competitive with current gold standard techniques in term of time to detection.","PeriodicalId":106228,"journal":{"name":"2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA)","volume":"40 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Accuracy of a novel Raman-based technology for the early detection of multidrug-resistant bacteria\",\"authors\":\"J. Dolcini, S. Gomez-Montes, Raquel Obregón, Marck Collado, F. Barbabella, C. Chiatti, F. Tessarolo\",\"doi\":\"10.1109/MeMeA54994.2022.9856540\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Cultural methods, although time consuming, are still the gold standard for the microbial detection, combining high sensitivity and specificity. Vibrational spectroscopies, such as Raman spectroscopy, have been recently proposed as an alternative, being label-free, non-invasive, and highly specific. This study aimed to evaluate the accuracy of a new technology (AMR-S3DP, Sens Solutions, Barcelona, Spain) based on Raman spectroscopy to detect the presence of three clinically relevant multidrug resistant pathogens (Clostridium difficile, Klebsiella pneumoniae and methicillin resistant Staphylococcus aureus). Different machine learning strategies for analyzing the collected Raman spectra were compared to find a solution trading-off between accuracy and computational cost. Experimental datasets were collected in controlled conditions using pure cultures of the three microorganisms of interest. Then, nine state-of-the-art classifiers and several instances of a Multi-Layer Perceptron Neural Network were trained and tested using the dataset. Three experiments were ran: (i) classification of only the three bacteria strains, (ii) classification of the three bacteria strains and the absence of bacteria, (iii) the same settings with standardized and normalized data. All the experiments were performed following a 10-Fold stratified Cross-validation approach. Tested methods included: Logistic regression, Nearest Neighbor Classifier, Support vector machines, Gaussian process, Decision Trees, Random Forest, Boosting, and Quadratic Classifier Naïve Bayes. Data distributions were highly nonlinear, nevertheless, Gaussian Process and Logistic Regression clearly outperformed the other tested methods when training and testing data sets were normalized and standardized. Gaussian Processes failed in providing a competitive solution to be executed in low-cost devices, being several orders of magnitude slower than Logistic Regression. With the most performant analytical method, a precision >94% and a recall rate >95% was obtained for all the three microorganisms of interest, making the system suitable to detect MDR pathogens and competitive with current gold standard techniques in term of time to detection.\",\"PeriodicalId\":106228,\"journal\":{\"name\":\"2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA)\",\"volume\":\"40 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-06-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/MeMeA54994.2022.9856540\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE International Symposium on Medical Measurements and Applications (MeMeA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/MeMeA54994.2022.9856540","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
培养法虽然耗时,但具有较高的灵敏度和特异性,仍然是微生物检测的金标准。振动光谱,如拉曼光谱,最近被提出作为一种替代方法,无标签,非侵入性和高度特异性。本研究旨在评估一种基于拉曼光谱的新技术(AMR-S3DP, Sens Solutions, Barcelona, Spain)检测三种临床相关多药耐药病原体(艰难梭菌、肺炎克雷伯菌和耐甲氧西林金黄色葡萄球菌)的准确性。比较了用于分析收集的拉曼光谱的不同机器学习策略,以找到在精度和计算成本之间权衡的解决方案。实验数据集收集在受控条件下使用纯培养感兴趣的三种微生物。然后,使用该数据集训练和测试了9个最先进的分类器和多层感知器神经网络的几个实例。进行三种实验:(i)仅对三种细菌进行分类,(ii)对三种细菌进行分类和不含细菌,(iii)采用标准化和规范化数据进行相同设置。所有实验均采用10倍分层交叉验证方法进行。测试方法包括:逻辑回归,最近邻分类器,支持向量机,高斯过程,决策树,随机森林,增强和二次分类器Naïve贝叶斯。数据分布是高度非线性的,然而,当训练和测试数据集被归一化和标准化时,高斯过程和逻辑回归明显优于其他测试方法。高斯过程无法在低成本设备上提供有竞争力的解决方案,比逻辑回归慢几个数量级。使用最高效的分析方法,对所有三种感兴趣的微生物获得了精密度>94%和召回率>95%,使该系统适用于检测MDR病原体,并在检测时间方面与当前的金标准技术竞争。
Accuracy of a novel Raman-based technology for the early detection of multidrug-resistant bacteria
Cultural methods, although time consuming, are still the gold standard for the microbial detection, combining high sensitivity and specificity. Vibrational spectroscopies, such as Raman spectroscopy, have been recently proposed as an alternative, being label-free, non-invasive, and highly specific. This study aimed to evaluate the accuracy of a new technology (AMR-S3DP, Sens Solutions, Barcelona, Spain) based on Raman spectroscopy to detect the presence of three clinically relevant multidrug resistant pathogens (Clostridium difficile, Klebsiella pneumoniae and methicillin resistant Staphylococcus aureus). Different machine learning strategies for analyzing the collected Raman spectra were compared to find a solution trading-off between accuracy and computational cost. Experimental datasets were collected in controlled conditions using pure cultures of the three microorganisms of interest. Then, nine state-of-the-art classifiers and several instances of a Multi-Layer Perceptron Neural Network were trained and tested using the dataset. Three experiments were ran: (i) classification of only the three bacteria strains, (ii) classification of the three bacteria strains and the absence of bacteria, (iii) the same settings with standardized and normalized data. All the experiments were performed following a 10-Fold stratified Cross-validation approach. Tested methods included: Logistic regression, Nearest Neighbor Classifier, Support vector machines, Gaussian process, Decision Trees, Random Forest, Boosting, and Quadratic Classifier Naïve Bayes. Data distributions were highly nonlinear, nevertheless, Gaussian Process and Logistic Regression clearly outperformed the other tested methods when training and testing data sets were normalized and standardized. Gaussian Processes failed in providing a competitive solution to be executed in low-cost devices, being several orders of magnitude slower than Logistic Regression. With the most performant analytical method, a precision >94% and a recall rate >95% was obtained for all the three microorganisms of interest, making the system suitable to detect MDR pathogens and competitive with current gold standard techniques in term of time to detection.