The development of medical science allows the treatment of more and more health problems that in the past were not a factor of consumption of health resources, because at that time medical science did not have protocols for their treatment. Health problems that are now treatable, hereafter referred as "new health problems", often affect large population groups and require increased consumption of health resources. It therefore becomes necessary to increase the number of staff providing health services (doctors, nurses, etc.) and other resources. This raises the question: is it feasible to manage the "new health problems" by the existing medical staff? If not, are there other solutions? Could technology help the existing Medical Staff to sufficiently manage the "new health problems"? We will examine a pilot system "Recording and visualizing of outpatient monitoring data with smart mobile phones", which seeks to ensure the competence of existing medical staff in the effective treatment of the ever-increasing volume of transplant patients.
{"title":"Use Technology to Help Medical Staff Treat \"New Health Problems\" Arising Constantly.","authors":"Nikitas N Karanikolas","doi":"10.3233/SHTI241067","DOIUrl":"https://doi.org/10.3233/SHTI241067","url":null,"abstract":"<p><p>The development of medical science allows the treatment of more and more health problems that in the past were not a factor of consumption of health resources, because at that time medical science did not have protocols for their treatment. Health problems that are now treatable, hereafter referred as \"new health problems\", often affect large population groups and require increased consumption of health resources. It therefore becomes necessary to increase the number of staff providing health services (doctors, nurses, etc.) and other resources. This raises the question: is it feasible to manage the \"new health problems\" by the existing medical staff? If not, are there other solutions? Could technology help the existing Medical Staff to sufficiently manage the \"new health problems\"? We will examine a pilot system \"Recording and visualizing of outpatient monitoring data with smart mobile phones\", which seeks to ensure the competence of existing medical staff in the effective treatment of the ever-increasing volume of transplant patients.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"79-83"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690237","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Healthcare systems worldwide face escalating costs and demographic changes, necessitating effective evaluation tools to understand their underlying challenges. Switzerland's high-quality yet costly healthcare system underscores the need for robust assessment methods. Existing international rankings often lack transparency and comparability, highlighting the value of structured frameworks like the Health System Performance Assessment (HSPA) by the World Health Organization (WHO). This framework evaluates healthcare systems across multiple dimensions including governance, resource generation, financing, and service delivery. This paper aims to integrate Swiss healthcare indicators from the Swiss Health Observatory (Obsan) into the HSPA framework, addressing the central research question: How can these indicators be mapped to the HSPA framework, and what insights does this integration provide? Our methodology includes selecting and categorizing Obsan indicators, manually mapping them to HSPA sub-functions, and validating these mappings using word embeddings and cosine similarity. An R Shiny application was developed for interactive visualization. Results demonstrate accurate indicator assignment, enabling intuitive visualization and enhancing data structuring.
{"title":"Mapping of Health System Performance Indicators to the WHO HSPA Framework.","authors":"Lucien Adam, Anthéa Helene Leung, Murat Sariyar","doi":"10.3233/SHTI241050","DOIUrl":"https://doi.org/10.3233/SHTI241050","url":null,"abstract":"<p><p>Healthcare systems worldwide face escalating costs and demographic changes, necessitating effective evaluation tools to understand their underlying challenges. Switzerland's high-quality yet costly healthcare system underscores the need for robust assessment methods. Existing international rankings often lack transparency and comparability, highlighting the value of structured frameworks like the Health System Performance Assessment (HSPA) by the World Health Organization (WHO). This framework evaluates healthcare systems across multiple dimensions including governance, resource generation, financing, and service delivery. This paper aims to integrate Swiss healthcare indicators from the Swiss Health Observatory (Obsan) into the HSPA framework, addressing the central research question: How can these indicators be mapped to the HSPA framework, and what insights does this integration provide? Our methodology includes selecting and categorizing Obsan indicators, manually mapping them to HSPA sub-functions, and validating these mappings using word embeddings and cosine similarity. An R Shiny application was developed for interactive visualization. Results demonstrate accurate indicator assignment, enabling intuitive visualization and enhancing data structuring.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"2-6"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690290","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Norbert Gal-Nadasan, Vasile Stoicu-Tivadar, Emanuela Gal-Nadasan, Anca Raluca Dinu
This paper proposes to create an Robotic Process Automation style application that can digitalize and extract data from handwritten medical forms. The RPA robot uses OpenAI ChatGPT4o model to extract handwritten medical data and transform it into typed data. The handwritten data is transcribed correctly at a rate of 100%. The data interpretation is accomplished by the UiPath machine learning API. By creating new nonstandard form templates and associated taxonomies the system can be scaled as desired. After the data extraction process the saved data can be sent to a database, spreadsheet. The access to this medical data is restricted to the physicians and medical nurses employed at the medical facility.
本文建议创建一个机器人流程自动化风格的应用程序,它可以从手写医疗表格中数字化并提取数据。RPA 机器人使用 OpenAI ChatGPT4o 模型提取手写医疗数据,并将其转换为打字数据。手写数据的转录正确率达到 100%。数据解释由 UiPath 机器学习 API 完成。通过创建新的非标准表单模板和相关分类标准,该系统可根据需要进行扩展。数据提取过程结束后,保存的数据可以发送到数据库或电子表格中。这些医疗数据的访问权限仅限于医疗机构的医生和护士。
{"title":"Handwritten Data Extraction Using OpenAI ChatGPT4o and Robotic Process Automation.","authors":"Norbert Gal-Nadasan, Vasile Stoicu-Tivadar, Emanuela Gal-Nadasan, Anca Raluca Dinu","doi":"10.3233/SHTI241101","DOIUrl":"https://doi.org/10.3233/SHTI241101","url":null,"abstract":"<p><p>This paper proposes to create an Robotic Process Automation style application that can digitalize and extract data from handwritten medical forms. The RPA robot uses OpenAI ChatGPT4o model to extract handwritten medical data and transform it into typed data. The handwritten data is transcribed correctly at a rate of 100%. The data interpretation is accomplished by the UiPath machine learning API. By creating new nonstandard form templates and associated taxonomies the system can be scaled as desired. After the data extraction process the saved data can be sent to a database, spreadsheet. The access to this medical data is restricted to the physicians and medical nurses employed at the medical facility.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"245-249"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Thomas Alassane Ouattara, Seydou Golo Barro, Pascal Staccini
This article explores the transition from a traditional histopathological examination system to an innovative platform using artificial intelligence (AI) for breast cancer detection from histopathological images in Burkina Faso. The existing system is analyzed in detail, highlighting the steps of querying, sample preparation, analysis by the pathologist, and validation by the physician. From this analysis, the needs and challenges are identified, emphasizing the opportunities for AI to improve the efficiency and accuracy of the diagnosis. The design of the AI platform is then presented, including data collection, AI model development, and its integration into existing processes. Finally, the expected results and implications for improving healthcare in Burkina Faso are discussed, highlighting the potential benefits and challenges to overcome for the successful adoption of this promising technology.
{"title":"Development of an AI Platform for Advanced Breast Cancer Management.","authors":"Thomas Alassane Ouattara, Seydou Golo Barro, Pascal Staccini","doi":"10.3233/SHTI241095","DOIUrl":"https://doi.org/10.3233/SHTI241095","url":null,"abstract":"<p><p>This article explores the transition from a traditional histopathological examination system to an innovative platform using artificial intelligence (AI) for breast cancer detection from histopathological images in Burkina Faso. The existing system is analyzed in detail, highlighting the steps of querying, sample preparation, analysis by the pathologist, and validation by the physician. From this analysis, the needs and challenges are identified, emphasizing the opportunities for AI to improve the efficiency and accuracy of the diagnosis. The design of the AI platform is then presented, including data collection, AI model development, and its integration into existing processes. Finally, the expected results and implications for improving healthcare in Burkina Faso are discussed, highlighting the potential benefits and challenges to overcome for the successful adoption of this promising technology.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"215-219"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690261","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Common Data Models (CDM) are developed to solve integration problems that arise in the secondary use of health data. The OMOP CDM is such a model that is mainly used for healthcare data, so this paper examines whether it is also suitable for mapping research data. An exemplary research dataset is mapped to the model and the model is tested for suitability. For this purpose, an ETL process is first designed with the OHDSI tools and finally implemented with Talend Open Studio for Data Integration. The data quality is checked, and the mapping and the model, together with the tools, are evaluated. Overall, all but three data fields from the source dataset could be mapped to the OMOP model, so that the model's suitability for research data can be confirmed.
通用数据模型(CDM)的开发是为了解决医疗数据二次利用过程中出现的整合问题。OMOP CDM 就是这样一个主要用于医疗保健数据的模型,因此本文将研究它是否也适合映射研究数据。我们将一个示范性研究数据集映射到该模型中,并测试该模型是否适用。为此,首先使用 OHDSI 工具设计了一个 ETL 流程,最后使用 Talend Open Studio for Data Integration 实现了该流程。对数据质量进行检查,并对映射和模型以及工具进行评估。总体而言,除了三个数据字段外,源数据集的所有数据字段都可以映射到 OMOP 模型,因此可以确认该模型适用于研究数据。
{"title":"Suitability of the OMOP Common Data Model for Mapping Datasets of Medical Research Studies Using the Example of a Multicenter Registry.","authors":"Milla Kurtz, Alfred Winter, Matthias Löbe","doi":"10.3233/SHTI241086","DOIUrl":"https://doi.org/10.3233/SHTI241086","url":null,"abstract":"<p><p>Common Data Models (CDM) are developed to solve integration problems that arise in the secondary use of health data. The OMOP CDM is such a model that is mainly used for healthcare data, so this paper examines whether it is also suitable for mapping research data. An exemplary research dataset is mapped to the model and the model is tested for suitability. For this purpose, an ETL process is first designed with the OHDSI tools and finally implemented with Talend Open Studio for Data Integration. The data quality is checked, and the mapping and the model, together with the tools, are evaluated. Overall, all but three data fields from the source dataset could be mapped to the OMOP model, so that the model's suitability for research data can be confirmed.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"170-174"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690062","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Polypharmacy (PP) and hyperpolypharmacy (HPP), are prevalent among cancer patients and are associated with an increased risk of drug-drug interactions (DDI) and potentially inappropriate medications (PIM). This study aimed to characterize PP, HPP, DDI, and PIM in patients with hematological malignancies hospitalized for hematopoietic stem cell transplantation (HSCT) by introducing a novel metric: cumulative drug exposure. Clinical data warehouse (CDW) records were employed to develop algorithms that quantified patients' cumulative exposure to these prescribing determinants during hospitalization. This entailed determining the number of days during the hospital stay when the patient was exposed to PP, HPP, PIM and/or DDI. For PIM and DDI, the number of PIMs or DDIs administered per day was taken into account in this calculation. Among 339 HSCT patients, PP and HPP were highly prevalent (over 67% of HSCT patients), almost all patients experienced DDI (over 98% of HSCT patients) and almost all elderly patients were exposed to PIM (over 98% of HSCT patients). Cumulative drug exposure differed between allogeneic and autologous HSCT patients, with allogeneic patients being more exposed to HPP (28.5 days vs 4.7 days for autologous HSCT patients) and DDI (255.6 days vs 58.4 for autologous HSCT patients). This study proposes a novel approach to assessing the impact of prescribing determinants on patient outcomes and provides insights for future research into the association between drug exposure and adverse events. Indeed, the use of cumulative drug exposure as a metric provides a comprehensive view of patient exposure throughout hospitalization, thereby enhancing understanding of the impact of prescribing practices on clinical outcomes.
{"title":"Measurement of Cumulative Drug Exposure from Clinical Data Warehouse.","authors":"Mathilde Bories, Aurélie Bannay, Morgane Pierre-Jean, Guillaume Bouzille, Pascal Le Corre","doi":"10.3233/SHTI241085","DOIUrl":"https://doi.org/10.3233/SHTI241085","url":null,"abstract":"<p><p>Polypharmacy (PP) and hyperpolypharmacy (HPP), are prevalent among cancer patients and are associated with an increased risk of drug-drug interactions (DDI) and potentially inappropriate medications (PIM). This study aimed to characterize PP, HPP, DDI, and PIM in patients with hematological malignancies hospitalized for hematopoietic stem cell transplantation (HSCT) by introducing a novel metric: cumulative drug exposure. Clinical data warehouse (CDW) records were employed to develop algorithms that quantified patients' cumulative exposure to these prescribing determinants during hospitalization. This entailed determining the number of days during the hospital stay when the patient was exposed to PP, HPP, PIM and/or DDI. For PIM and DDI, the number of PIMs or DDIs administered per day was taken into account in this calculation. Among 339 HSCT patients, PP and HPP were highly prevalent (over 67% of HSCT patients), almost all patients experienced DDI (over 98% of HSCT patients) and almost all elderly patients were exposed to PIM (over 98% of HSCT patients). Cumulative drug exposure differed between allogeneic and autologous HSCT patients, with allogeneic patients being more exposed to HPP (28.5 days vs 4.7 days for autologous HSCT patients) and DDI (255.6 days vs 58.4 for autologous HSCT patients). This study proposes a novel approach to assessing the impact of prescribing determinants on patient outcomes and provides insights for future research into the association between drug exposure and adverse events. Indeed, the use of cumulative drug exposure as a metric provides a comprehensive view of patient exposure throughout hospitalization, thereby enhancing understanding of the impact of prescribing practices on clinical outcomes.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"165-169"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690291","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The existing pill dispenser systems help elderly people to improve their quality of life, and medication adherence. But these systems lack interactive capabilities with caregivers, a crucial element in comprehensive home care management. The suggested CareConnect aims to bridge this gap by introducing a Telecare extension that not only manages medication adherence but also facilitates interaction between the patient and their caregivers. The system is described in terms of this new approach, the functions, hardware and software. The operation of the system is briefly described. A discussion about the advantages of CareConnect system and the future development directions is finally done as a conclusion.
{"title":"Pill Dispenser with Telecare Extension.","authors":"Sebastian-Bogdan Zigrea, Vasile Stoicu-Tivadar","doi":"10.3233/SHTI241074","DOIUrl":"https://doi.org/10.3233/SHTI241074","url":null,"abstract":"<p><p>The existing pill dispenser systems help elderly people to improve their quality of life, and medication adherence. But these systems lack interactive capabilities with caregivers, a crucial element in comprehensive home care management. The suggested CareConnect aims to bridge this gap by introducing a Telecare extension that not only manages medication adherence but also facilitates interaction between the patient and their caregivers. The system is described in terms of this new approach, the functions, hardware and software. The operation of the system is briefly described. A discussion about the advantages of CareConnect system and the future development directions is finally done as a conclusion.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"114-118"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690308","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Georgios Feretzakis, Athanasios Anastasiou, Stavros Pitoglou, Evgenia Paxinou, Aris Gkoulalas-Divanis, Konstantinos Kalodanis, Ioannis Tsapelas, Dimitris Kalles, Vassilios S Verykios
In Generative Artificial Intelligence (AI), Large Language Models (LLMs) like GPT-4, Gemini, Claude, and Llama, significantly impact healthcare by aiding in patient care, medical research, and administrative tasks. AI-powered chatbots offer real-time responses and manage chronic diseases, improving patient outcomes and operational efficiency. However, these models pose security and ethical challenges, necessitating robust data privacy, adversarial training, and ethical guidelines. This paper proposes a secure, ethical pipeline for deploying AI healthcare chatbots, integrating advanced privacy-preserving techniques and continuous security assessments to enhance data privacy, resilience, and user trust.
{"title":"Securing a Generative AI-Powered Healthcare Chatbot.","authors":"Georgios Feretzakis, Athanasios Anastasiou, Stavros Pitoglou, Evgenia Paxinou, Aris Gkoulalas-Divanis, Konstantinos Kalodanis, Ioannis Tsapelas, Dimitris Kalles, Vassilios S Verykios","doi":"10.3233/SHTI241091","DOIUrl":"https://doi.org/10.3233/SHTI241091","url":null,"abstract":"<p><p>In Generative Artificial Intelligence (AI), Large Language Models (LLMs) like GPT-4, Gemini, Claude, and Llama, significantly impact healthcare by aiding in patient care, medical research, and administrative tasks. AI-powered chatbots offer real-time responses and manage chronic diseases, improving patient outcomes and operational efficiency. However, these models pose security and ethical challenges, necessitating robust data privacy, adversarial training, and ethical guidelines. This paper proposes a secure, ethical pipeline for deploying AI healthcare chatbots, integrating advanced privacy-preserving techniques and continuous security assessments to enhance data privacy, resilience, and user trust.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"195-199"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690043","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Eduardo Alonso, Xabier Calle, Ibai Gurrutxaga, Andoni Beristain
The most well-established risk factor for lung cancer (LC) is smoking, responsible for approximately 85% of cases. The Lung Cancer Risk Assessment Tool (LCRAT) is a key advancement in this field, which predicts individual risk based on factors like smoking habits, demographic details, personal and family medical history, and environmental exposures. This paper proposes a model with fewer features that improves state of the art performance, using a simplified stacking ensemble, making it more accessible and easier to implement in routine healthcare practice. The data used in this work were derived from two cohorts in the United States: The National Lung Screening Trial (NLST) and the Prostate, Lung, Colorectal, and Ovarian (PLCO) Cancer Screening Trial. Both our model and LCRAT achieve an AUC of 0.799 and 0.782 on test respectively. In terms of percentage of positives, in the 50% of the population, both detect 0.766 and 0.754 of the cases. The ensemble of different survival models enhances robustness by mitigating the weakness of individual models and directly impacts the efficiency of the model, increasing the efficiency and generalizability.
{"title":"Survival Stacking Ensemble Model for Lung Cancer Risk Prediction.","authors":"Eduardo Alonso, Xabier Calle, Ibai Gurrutxaga, Andoni Beristain","doi":"10.3233/SHTI241083","DOIUrl":"https://doi.org/10.3233/SHTI241083","url":null,"abstract":"<p><p>The most well-established risk factor for lung cancer (LC) is smoking, responsible for approximately 85% of cases. The Lung Cancer Risk Assessment Tool (LCRAT) is a key advancement in this field, which predicts individual risk based on factors like smoking habits, demographic details, personal and family medical history, and environmental exposures. This paper proposes a model with fewer features that improves state of the art performance, using a simplified stacking ensemble, making it more accessible and easier to implement in routine healthcare practice. The data used in this work were derived from two cohorts in the United States: The National Lung Screening Trial (NLST) and the Prostate, Lung, Colorectal, and Ovarian (PLCO) Cancer Screening Trial. Both our model and LCRAT achieve an AUC of 0.799 and 0.782 on test respectively. In terms of percentage of positives, in the 50% of the population, both detect 0.766 and 0.754 of the cases. The ensemble of different survival models enhances robustness by mitigating the weakness of individual models and directly impacts the efficiency of the model, increasing the efficiency and generalizability.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"155-159"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142689984","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Gleb Danilov, Oleg Pilipenko, Vasiliy Kostyumov, Sergey Trubetskoy, Narek Maloyan, Bulat Nutfullin, Eugeniy Ilyushin, David Pitskhelauri, Alexandra Zelenova, Andrey Bykanov
The ability to recognize anatomical landmarks, microsurgical instruments, and complex scenes and events in a surgical wound using computer vision presents new opportunities for studying microsurgery effectiveness. In this study, we aimed to develop an artificial intelligence-based solution for detecting, segmenting, and tracking microinstruments using a neurosurgical microscope. We have developed a technique to process videos from microscope camera, which involves creating a segmentation mask for the instrument and subsequently tracking it. We compared two segmentation approaches: (1) semantic segmentation using Visual Transformers (pre-trained domain-specific EndoViT model), enhanced with tracking as described by Cheng Y. et al. (our proposed approach), and (2) instance segmentation with tracking based on the YOLOv8l-seg architecture. We conducted experiments using the CholecSeg8k dataset and our proprietary set of neurosurgical videos (PSNV) from microscope. Our approach with tracking outperformed YOLOv8l-seg-based solutions and EndoViT model with no tracking on both CholecSeg8k (mean IoT = 0.8158, mean Dice = 0.8657) and PSNV (mean IoT = 0.7196, mean Dice = 0.8202) datasets. Our experiments with identifying neurosurgical instruments in a microscope's field of view showcase the high quality of these technologies and their potential for valuable applications.
{"title":"A Neurosurgical Instrument Segmentation Approach to Assess Microsurgical Movements.","authors":"Gleb Danilov, Oleg Pilipenko, Vasiliy Kostyumov, Sergey Trubetskoy, Narek Maloyan, Bulat Nutfullin, Eugeniy Ilyushin, David Pitskhelauri, Alexandra Zelenova, Andrey Bykanov","doi":"10.3233/SHTI241089","DOIUrl":"https://doi.org/10.3233/SHTI241089","url":null,"abstract":"<p><p>The ability to recognize anatomical landmarks, microsurgical instruments, and complex scenes and events in a surgical wound using computer vision presents new opportunities for studying microsurgery effectiveness. In this study, we aimed to develop an artificial intelligence-based solution for detecting, segmenting, and tracking microinstruments using a neurosurgical microscope. We have developed a technique to process videos from microscope camera, which involves creating a segmentation mask for the instrument and subsequently tracking it. We compared two segmentation approaches: (1) semantic segmentation using Visual Transformers (pre-trained domain-specific EndoViT model), enhanced with tracking as described by Cheng Y. et al. (our proposed approach), and (2) instance segmentation with tracking based on the YOLOv8l-seg architecture. We conducted experiments using the CholecSeg8k dataset and our proprietary set of neurosurgical videos (PSNV) from microscope. Our approach with tracking outperformed YOLOv8l-seg-based solutions and EndoViT model with no tracking on both CholecSeg8k (mean IoT = 0.8158, mean Dice = 0.8657) and PSNV (mean IoT = 0.7196, mean Dice = 0.8202) datasets. Our experiments with identifying neurosurgical instruments in a microscope's field of view showcase the high quality of these technologies and their potential for valuable applications.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"185-189"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690231","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}