首页 > 最新文献

Studies in health technology and informatics最新文献

英文 中文
Generating Synthetic Healthcare Dialogues in Emergency Medicine Using Large Language Models. 利用大型语言模型生成急诊医学中的合成医疗对话。
Pub Date : 2024-11-22 DOI: 10.3233/SHTI241099
Denis Moser, Matthias Bender, Murat Sariyar

Natural Language Processing (NLP) has shown promise in fields like radiology for converting unstructured into structured data, but acquiring suitable datasets poses several challenges, including privacy concerns. Specifically, we aim to utilize Large Language Models (LLMs) to extract medical information from dialogues between ambulance staff and patients to populate emergency protocol forms. However, we currently lack dialogues with known content that can serve as a gold standard for an evaluation. We designed a pipeline using the quantized LLM "Zephyr-7b-beta" for initial dialogue generation, followed by refinement and translation using OpenAI's GPT-4 Turbo. The MIMIC-IV database provided relevant medical data. The evaluation involved accuracy assessment via Retrieval-Augmented Generation (RAG) and sentiment analysis using multilingual models. Initial results showed a high accuracy of 94% with "Zephyr-7b-beta," slightly decreasing to 87% after refinement with GPT-4 Turbo. Sentiment analysis indicated a qualitative shift towards more positive sentiment post-refinement. These findings highlight the potential and challenges of using LLMs for generating synthetic medical dialogues, informing future NLP system development in healthcare.

自然语言处理(NLP)已在放射学等领域显示出将非结构化数据转换为结构化数据的前景,但获取合适的数据集却面临着一些挑战,其中包括隐私问题。具体来说,我们的目标是利用大型语言模型(LLMs)从救护人员和病人之间的对话中提取医疗信息,以填充紧急协议表格。然而,我们目前缺乏已知内容的对话,无法作为评估的黄金标准。我们设计了一个管道,使用量化 LLM "Zephyr-7b-beta "进行初始对话生成,然后使用 OpenAI 的 GPT-4 Turbo 进行细化和翻译。MIMIC-IV 数据库提供了相关的医疗数据。评估包括通过检索增强生成(RAG)进行准确性评估,以及使用多语言模型进行情感分析。初步结果显示,"Zephyr-7b-beta "的准确率高达 94%,在使用 GPT-4 Turbo 进行改进后,准确率略有下降,为 87%。情感分析表明,经过改进后,情感发生了质的变化,变得更加积极。这些发现凸显了使用 LLM 生成合成医疗对话的潜力和挑战,为未来医疗保健领域的 NLP 系统开发提供了参考。
{"title":"Generating Synthetic Healthcare Dialogues in Emergency Medicine Using Large Language Models.","authors":"Denis Moser, Matthias Bender, Murat Sariyar","doi":"10.3233/SHTI241099","DOIUrl":"https://doi.org/10.3233/SHTI241099","url":null,"abstract":"<p><p>Natural Language Processing (NLP) has shown promise in fields like radiology for converting unstructured into structured data, but acquiring suitable datasets poses several challenges, including privacy concerns. Specifically, we aim to utilize Large Language Models (LLMs) to extract medical information from dialogues between ambulance staff and patients to populate emergency protocol forms. However, we currently lack dialogues with known content that can serve as a gold standard for an evaluation. We designed a pipeline using the quantized LLM \"Zephyr-7b-beta\" for initial dialogue generation, followed by refinement and translation using OpenAI's GPT-4 Turbo. The MIMIC-IV database provided relevant medical data. The evaluation involved accuracy assessment via Retrieval-Augmented Generation (RAG) and sentiment analysis using multilingual models. Initial results showed a high accuracy of 94% with \"Zephyr-7b-beta,\" slightly decreasing to 87% after refinement with GPT-4 Turbo. Sentiment analysis indicated a qualitative shift towards more positive sentiment post-refinement. These findings highlight the potential and challenges of using LLMs for generating synthetic medical dialogues, informing future NLP system development in healthcare.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"235-239"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690281","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Achieving Digital Medicine Learning Outcomes Through an Interdisciplinary Course: A Pilot Study. 通过跨学科课程实现数字医学学习成果:试点研究。
Pub Date : 2024-11-22 DOI: 10.3233/SHTI241058
Annabelle Mielitz, Hendrik Friederichs, Anja Bittner, Urs-Vito Albrecht

Incorporating digital medicine into medical education equips students for the evolving landscape of healthcare. This study aimed to assess a digital medicine course developed at Bielefeld University by evaluating student attainment of learning outcomes outlined by Foadi et al. In the course, the students designed a digital application for various medical conditions, taking into account interdisciplinary factors. The course took place in 2023 with medical students who attended the course due to the focus of their studies. In a pilot study, the progress of ten participants was assessed using a pre-post survey design. Results revealed substantial improvement in students' achievement of learning outcomes post-course (median = 2, IQR 1-2) compared to pre-course (median = 3, IQR 3-4), suggesting the course's efficacy in effectively teaching digital medicine.

将数字医学纳入医学教育可使学生适应不断发展的医疗保健领域。本研究旨在评估比勒费尔德大学开发的数字医学课程,评估学生对 Foadi 等人概述的学习成果的掌握情况。该课程于 2023 年举办,参加者为医学专业的学生,他们的学习重点是该课程。在一项试点研究中,采用了事前事后调查的设计,对十名学员的学习进度进行了评估。结果显示,与课程前(中位数 = 3,IQR 3-4)相比,课程后(中位数 = 2,IQR 1-2)学生的学习成绩有了大幅提高,这表明该课程在有效开展数字医学教学方面卓有成效。
{"title":"Achieving Digital Medicine Learning Outcomes Through an Interdisciplinary Course: A Pilot Study.","authors":"Annabelle Mielitz, Hendrik Friederichs, Anja Bittner, Urs-Vito Albrecht","doi":"10.3233/SHTI241058","DOIUrl":"https://doi.org/10.3233/SHTI241058","url":null,"abstract":"<p><p>Incorporating digital medicine into medical education equips students for the evolving landscape of healthcare. This study aimed to assess a digital medicine course developed at Bielefeld University by evaluating student attainment of learning outcomes outlined by Foadi et al. In the course, the students designed a digital application for various medical conditions, taking into account interdisciplinary factors. The course took place in 2023 with medical students who attended the course due to the focus of their studies. In a pilot study, the progress of ten participants was assessed using a pre-post survey design. Results revealed substantial improvement in students' achievement of learning outcomes post-course (median = 2, IQR 1-2) compared to pre-course (median = 3, IQR 3-4), suggesting the course's efficacy in effectively teaching digital medicine.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"38-42"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690235","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Utilizing Open Source Clinical Information Systems in European Countries: Potential and Barriers. 欧洲国家利用开源临床信息系统:潜力与障碍。
Pub Date : 2024-11-22 DOI: 10.3233/SHTI241073
Fatma-Zahra Magdub, Sakirnth Nagarasa, Florian Frick, Murat Sariyar

GNU Health, an open-source clinical information system, offers a comprehensive solution for managing health records, hospital information, and laboratory data. Despite its robust functionality and cost-effective nature, GNU Health remains underutilized in the European healthcare context. This paper explores the potential benefits of implementing GNU Health in European healthcare systems, emphasizing its capacity for customization, integration, and scalability. We also examine the barriers to its widespread adoption, including regulatory challenges, interoperability issues, and resistance to change from established proprietary systems. Through one case study and expert interviews, we provide insights into why these obstacles can hardly be overcome.

GNU Health 是一个开源临床信息系统,为管理健康记录、医院信息和实验室数据提供了一个全面的解决方案。尽管 GNU Health 功能强大、成本低廉,但在欧洲医疗保健领域仍未得到充分利用。本文探讨了在欧洲医疗系统中实施 GNU Health 的潜在好处,强调了其定制、集成和可扩展性的能力。我们还探讨了广泛采用 GNU Health 的障碍,包括监管挑战、互操作性问题以及对既有专有系统变革的抵制。通过一个案例研究和专家访谈,我们深入探讨了这些障碍难以克服的原因。
{"title":"Utilizing Open Source Clinical Information Systems in European Countries: Potential and Barriers.","authors":"Fatma-Zahra Magdub, Sakirnth Nagarasa, Florian Frick, Murat Sariyar","doi":"10.3233/SHTI241073","DOIUrl":"https://doi.org/10.3233/SHTI241073","url":null,"abstract":"<p><p>GNU Health, an open-source clinical information system, offers a comprehensive solution for managing health records, hospital information, and laboratory data. Despite its robust functionality and cost-effective nature, GNU Health remains underutilized in the European healthcare context. This paper explores the potential benefits of implementing GNU Health in European healthcare systems, emphasizing its capacity for customization, integration, and scalability. We also examine the barriers to its widespread adoption, including regulatory challenges, interoperability issues, and resistance to change from established proprietary systems. Through one case study and expert interviews, we provide insights into why these obstacles can hardly be overcome.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"109-113"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690247","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Collaboration Across Disciplines to Integrate Clinical Expertise into Medical Software Development: The Approach of the Dedalus Medical Office. 跨学科合作,将临床专业知识融入医疗软件开发:Dedalus 医疗办公室的方法。
Pub Date : 2024-11-22 DOI: 10.3233/SHTI241059
Dennis Rausch, Michael Dahlweid, Irina Kozinova, Clementine Wraith, Ingrid Hochheim, Lise Marin, Jane Johnson, Tracy McClelland, Laurent Gout, Gaurav Kumar, Mobin Yasini

Medical informatics is a multidisciplinary field combining clinical and technical expertise. Addressing the challenge of aligning software design with clinicians' real-world needs, Dedalus established the Medical Office, a dedicated department designed to integrate clinical expertise directly into the software development process, in 2022. This paper details the approach and impact of the Medical Office. An international team of 15 healthcare professionals with experience in medical informatics was assembled. The team employed a multifaceted approach, incorporating global communication sessions and a ticketing system to track and analyze service requests. Over two years, 398 tickets were received, categorized into nine areas: clinical content curation, medical terminologies, clinical safety, clinical evaluation, design support, clinical UX, research & publication, real-world medical cases, and pre-sales support. The average duration of ticket resolution decreased over time, attributed to process fine-tuning and the formation of a relevant expert group. A preliminary satisfaction survey indicated positive feedback from technical teams. The collaborative model improved software design, usability, and clinical safety, demonstrating the value of clinician involvement. While preliminary results are promising, ongoing evaluation and adaptation are essential. The study emphasizes the importance of interdisciplinary collaboration in medical informatics and the benefits of clinician involvement in healthcare technology development. Future studies should explore this model's long-term impacts and scalability in other organizations and healthcare systems.

医学信息学是一个结合了临床和技术专业知识的多学科领域。为了应对软件设计与临床医生的实际需求相一致这一挑战,Dedalus 于 2022 年成立了医学办公室,这是一个专门的部门,旨在将临床专业知识直接融入软件开发流程。本文详细介绍了医疗办公室的工作方法和影响。Dedalus 组建了一支由 15 名具有医疗信息学经验的医疗保健专业人士组成的国际团队。该团队采用了多方面的方法,包括全球交流会和跟踪和分析服务请求的票务系统。两年来,共收到 398 份单子,分为九个领域:临床内容整理、医学术语、临床安全、临床评估、设计支持、临床用户体验、研究与出版、真实世界医疗案例和售前支持。随着时间的推移,票单解决的平均持续时间有所缩短,这归功于流程的微调和相关专家组的组建。初步满意度调查显示,技术团队给予了积极反馈。合作模式改进了软件设计、可用性和临床安全性,证明了临床医生参与的价值。虽然初步结果令人鼓舞,但持续的评估和调整是必不可少的。这项研究强调了医学信息学跨学科合作的重要性,以及临床医生参与医疗技术开发的益处。未来的研究应探索该模式在其他组织和医疗系统中的长期影响和可扩展性。
{"title":"Collaboration Across Disciplines to Integrate Clinical Expertise into Medical Software Development: The Approach of the Dedalus Medical Office.","authors":"Dennis Rausch, Michael Dahlweid, Irina Kozinova, Clementine Wraith, Ingrid Hochheim, Lise Marin, Jane Johnson, Tracy McClelland, Laurent Gout, Gaurav Kumar, Mobin Yasini","doi":"10.3233/SHTI241059","DOIUrl":"https://doi.org/10.3233/SHTI241059","url":null,"abstract":"<p><p>Medical informatics is a multidisciplinary field combining clinical and technical expertise. Addressing the challenge of aligning software design with clinicians' real-world needs, Dedalus established the Medical Office, a dedicated department designed to integrate clinical expertise directly into the software development process, in 2022. This paper details the approach and impact of the Medical Office. An international team of 15 healthcare professionals with experience in medical informatics was assembled. The team employed a multifaceted approach, incorporating global communication sessions and a ticketing system to track and analyze service requests. Over two years, 398 tickets were received, categorized into nine areas: clinical content curation, medical terminologies, clinical safety, clinical evaluation, design support, clinical UX, research & publication, real-world medical cases, and pre-sales support. The average duration of ticket resolution decreased over time, attributed to process fine-tuning and the formation of a relevant expert group. A preliminary satisfaction survey indicated positive feedback from technical teams. The collaborative model improved software design, usability, and clinical safety, demonstrating the value of clinician involvement. While preliminary results are promising, ongoing evaluation and adaptation are essential. The study emphasizes the importance of interdisciplinary collaboration in medical informatics and the benefits of clinician involvement in healthcare technology development. Future studies should explore this model's long-term impacts and scalability in other organizations and healthcare systems.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"43-47"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690255","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Horse Diagnosis and Triage Accuracy of GPT-4o. GPT-4o 的马匹诊断和分诊准确性。
Pub Date : 2024-11-22 DOI: 10.3233/SHTI241092
Laura Haase, Dagmar Monett, Martin Sedlmayr

Animal owners may increasingly rely on large language models for gathering animal health information alongside internet sources in the future. This study therefore aims to provide initial results on the accuracy of ChatGPT-4o in triage and tentative diagnostics, using horses as a case study. Ten test vignettes were used to prompt situation assessments from the tool, which were then compared to original assessments made by a veterinary specialist for horses. The most probable diagnosis suggested by ChatGPT-4o was found to be quite accurate in most cases, with the urgency to contact a veterinarian sometimes assessed as higher than necessary. When provided with all relevant information, the tool does not seem to compromise horse health by recommending excessively long waiting times, although there is still potential for improving the relief of veterinarians' workload.

未来,动物主人可能会越来越多地依赖大型语言模型来收集动物健康信息和互联网信息。因此,本研究旨在以马为案例,就 ChatGPT-4o 在分流和初步诊断方面的准确性提供初步结果。本研究使用了十个测试片段来提示该工具的情况评估,然后将其与兽医专家对马匹的原始评估进行比较。结果发现,在大多数情况下,ChatGPT-4o 提出的最有可能的诊断结果都相当准确,而联系兽医的紧迫性有时被评估为高于必要程度。在获得所有相关信息的情况下,该工具似乎不会因为建议过长的等待时间而损害马匹的健康,但仍有可能减轻兽医的工作量。
{"title":"Horse Diagnosis and Triage Accuracy of GPT-4o.","authors":"Laura Haase, Dagmar Monett, Martin Sedlmayr","doi":"10.3233/SHTI241092","DOIUrl":"https://doi.org/10.3233/SHTI241092","url":null,"abstract":"<p><p>Animal owners may increasingly rely on large language models for gathering animal health information alongside internet sources in the future. This study therefore aims to provide initial results on the accuracy of ChatGPT-4o in triage and tentative diagnostics, using horses as a case study. Ten test vignettes were used to prompt situation assessments from the tool, which were then compared to original assessments made by a veterinary specialist for horses. The most probable diagnosis suggested by ChatGPT-4o was found to be quite accurate in most cases, with the urgency to contact a veterinarian sometimes assessed as higher than necessary. When provided with all relevant information, the tool does not seem to compromise horse health by recommending excessively long waiting times, although there is still potential for improving the relief of veterinarians' workload.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"200-204"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690284","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Clinical Informatics Foundations of 57 Years Sentinel and Genomic Surveillance: Data Quality, Linkage and Access. 57 年哨点和基因组监测的临床信息学基础:数据质量、链接和访问。
Pub Date : 2024-11-22 DOI: 10.3233/SHTI241077
Simon de Lusignan, Mark Joy, Maria Zambon

Sentinel surveillance networks are sophisticated health information systems that warn about outbreaks and spread of infectious diseases with epidemic or pandemic potential, the effectiveness of countermeasures and pressures on health systems. They are underpinned by their ability to turn data into information and knowledge in a timely way. The Royal College of General Practitioners (RCGP) Research and Surveillance Centre (RSC) is one of Europe's oldest. We report its progressive use of technology to improve the scope of sentinel surveillance, with a focus on genomic surveillance. The technologies include terminologies, phenotypes, compute capability, virology including virial genome sequencing, and serology. The RSC's data collection developed from partial, then full extraction of computerised medical record (CMR) data. with increasing sophistication in its creation of phenotypes. The scope of surveillance in 1967 was clinical diagnosis, influenza-like-illness (ILI) was its focus. In the 1992-1993 winter virology sampling started, with progressively more sophisticated sequencing of the viral genome. From 2008 viral sequencing was comprehensive with the Global Initiative on Sharing All Influenza Data (GISAID) the primary repository, supplemented by the COVID-19 Genomics UK (COG-UK) consortium in-pandemic. High quality primary care data captures sociodemographic features, risk group status, and vaccine exposure; linked hospital and death data informs about severe outcomes; virology identified the causative organism and genomic surveillance the variant. Timely data access and analysis will enable identification of new variants resistant to vaccination or other countermeasures and enable new interventions to be developed.

哨点监测网络是复杂的卫生信息系统,可对具有流行或大流行潜力的传染病的爆发和传播、应对措施的有效性以及卫生系统面临的压力发出警报。它们的基础是能够及时将数据转化为信息和知识。皇家全科医师学院(RCGP)研究与监测中心(RSC)是欧洲历史最悠久的研究与监测中心之一。我们报告了该中心逐步利用技术改善哨点监测范围的情况,重点是基因组监测。这些技术包括术语、表型、计算能力、病毒学(包括病毒基因组测序)和血清学。RSC 的数据收集工作从部分提取计算机化病历 (CMR) 数据发展到全面提取。1967 年的监测范围是临床诊断,重点是流感样疾病(ILI)。1992-1993 年冬季开始进行病毒学采样,病毒基因组的测序工作逐渐复杂化。从 2008 年开始,病毒测序工作全面展开,全球流感数据共享计划(GISAID)是主要的储存库,在流感大流行时,英国 COVID-19 基因组学联盟(COG-UK)对其进行补充。高质量的初级保健数据可捕捉社会人口特征、风险群体状况和疫苗接种情况;关联的医院和死亡数据可提供有关严重后果的信息;病毒学可确定致病菌,基因组监测可确定变异体。及时的数据访问和分析将有助于识别对疫苗接种或其他应对措施有抵抗力的新变种,并开发新的干预措施。
{"title":"Clinical Informatics Foundations of 57 Years Sentinel and Genomic Surveillance: Data Quality, Linkage and Access.","authors":"Simon de Lusignan, Mark Joy, Maria Zambon","doi":"10.3233/SHTI241077","DOIUrl":"https://doi.org/10.3233/SHTI241077","url":null,"abstract":"<p><p>Sentinel surveillance networks are sophisticated health information systems that warn about outbreaks and spread of infectious diseases with epidemic or pandemic potential, the effectiveness of countermeasures and pressures on health systems. They are underpinned by their ability to turn data into information and knowledge in a timely way. The Royal College of General Practitioners (RCGP) Research and Surveillance Centre (RSC) is one of Europe's oldest. We report its progressive use of technology to improve the scope of sentinel surveillance, with a focus on genomic surveillance. The technologies include terminologies, phenotypes, compute capability, virology including virial genome sequencing, and serology. The RSC's data collection developed from partial, then full extraction of computerised medical record (CMR) data. with increasing sophistication in its creation of phenotypes. The scope of surveillance in 1967 was clinical diagnosis, influenza-like-illness (ILI) was its focus. In the 1992-1993 winter virology sampling started, with progressively more sophisticated sequencing of the viral genome. From 2008 viral sequencing was comprehensive with the Global Initiative on Sharing All Influenza Data (GISAID) the primary repository, supplemented by the COVID-19 Genomics UK (COG-UK) consortium in-pandemic. High quality primary care data captures sociodemographic features, risk group status, and vaccine exposure; linked hospital and death data informs about severe outcomes; virology identified the causative organism and genomic surveillance the variant. Timely data access and analysis will enable identification of new variants resistant to vaccination or other countermeasures and enable new interventions to be developed.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"129-133"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690251","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Measurement of Explanations Generated by XAI Methods Using Features. 利用特征测量 XAI 方法生成的解释。
Pub Date : 2024-11-22 DOI: 10.3233/SHTI241102
Cătălin-Mihai Pesecan, Lăcrămioara Stoicu-Tivadar

An increasing number of explainability methods began to emerge as a response for the black-box methods used to make decisions that could not be easily explained. This created the need for a better evaluation for these methods. In this paper we propose a new method for evaluation based on features. The main advantage of applying the proposed method to CNNs explanations are: a fully automated way to measure the quality of an explanation and the fact that the score uses the same information as the CNN, in this way being able to offer a measure of the quality of explanation that can be obtained automatically, ensuring that the human bias will not be present in the measurement of the explanation.

越来越多的可解释性方法开始出现,作为对黑箱方法的回应,黑箱方法用于做出不易解释的决策。这就需要对这些方法进行更好的评估。在本文中,我们提出了一种基于特征的新评估方法。将所提出的方法应用于 CNN 解释的主要优势在于:采用完全自动化的方式来衡量解释的质量,而且评分使用与 CNN 相同的信息,从而能够提供一种可自动获得的解释质量衡量方法,确保在衡量解释时不会出现人为偏差。
{"title":"Measurement of Explanations Generated by XAI Methods Using Features.","authors":"Cătălin-Mihai Pesecan, Lăcrămioara Stoicu-Tivadar","doi":"10.3233/SHTI241102","DOIUrl":"https://doi.org/10.3233/SHTI241102","url":null,"abstract":"<p><p>An increasing number of explainability methods began to emerge as a response for the black-box methods used to make decisions that could not be easily explained. This created the need for a better evaluation for these methods. In this paper we propose a new method for evaluation based on features. The main advantage of applying the proposed method to CNNs explanations are: a fully automated way to measure the quality of an explanation and the fact that the score uses the same information as the CNN, in this way being able to offer a measure of the quality of explanation that can be obtained automatically, ensuring that the human bias will not be present in the measurement of the explanation.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"250-253"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690292","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Frameworks and Tasks Used in Usability Testing Scripts: A Scoping Review. 可用性测试脚本中使用的框架和任务:范围审查。
Pub Date : 2024-11-22 DOI: 10.3233/SHTI241051
Sunil Seoparson, Elizabeth M Borycki, Andre W Kushniruk, Joseph Kannry

Usability is understood as a critical component to the success of electronic health records and other related healthcare technologies. Usability testing methods routinely employ scripts that help researchers understand how a particular tool works under real world conditions. This scoping review sought to better understand the guiding frameworks, principles, and methodologies employed when generating usability testing scripts to better understand how script generation occurs. Three main themes emerged through qualitative analysis: researchers sought to observe the baseline functionality being tested, the most representative tasks, or the most complex tasks. This scoping review highlights a lack of consistent processes in usability test script generation. There is a need to create standardized usability testing scripts for usability testing.

可用性被认为是电子病历和其他相关医疗保健技术取得成功的关键因素。可用性测试方法通常会使用脚本,帮助研究人员了解特定工具在真实世界条件下的工作原理。本次范围界定审查旨在更好地了解生成可用性测试脚本时所采用的指导框架、原则和方法,从而更好地了解脚本是如何生成的。通过定性分析,我们发现了三大主题:研究人员试图观察正在测试的基线功能、最具代表性的任务或最复杂的任务。这次范围审查凸显了可用性测试脚本生成过程缺乏一致性。有必要为可用性测试创建标准化的可用性测试脚本。
{"title":"Frameworks and Tasks Used in Usability Testing Scripts: A Scoping Review.","authors":"Sunil Seoparson, Elizabeth M Borycki, Andre W Kushniruk, Joseph Kannry","doi":"10.3233/SHTI241051","DOIUrl":"https://doi.org/10.3233/SHTI241051","url":null,"abstract":"<p><p>Usability is understood as a critical component to the success of electronic health records and other related healthcare technologies. Usability testing methods routinely employ scripts that help researchers understand how a particular tool works under real world conditions. This scoping review sought to better understand the guiding frameworks, principles, and methodologies employed when generating usability testing scripts to better understand how script generation occurs. Three main themes emerged through qualitative analysis: researchers sought to observe the baseline functionality being tested, the most representative tasks, or the most complex tasks. This scoping review highlights a lack of consistent processes in usability test script generation. There is a need to create standardized usability testing scripts for usability testing.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"7-11"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690280","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
ALSATION Study Protocol: Romanian Translation of Three Health Literacy Surveys. ALSATION 研究协议:三项健康素养调查的罗马尼亚语翻译。
Pub Date : 2024-11-22 DOI: 10.3233/SHTI241052
Ariana-Anamaria Cordoş, Sebastian-Aurelian Ştefănigă, Călin Muntean, Corina Violeta Vernic, Sorana D Bolboacă

Access to the internet and online resources changes the concept of health and increases people's autonomy. In this context, Health Literacy (HL) is a critical determinant of health-related choices. At World Health Organization (WHO) level, M-POHL (Action Network on Measuring Population and Organizational Health Literacy of WHO-Europe) created and validated on European population four questionnaires: digital HL (HLS19-DIGI), communication HL (with doctors from health care services - HLS19-COM-P-Q11 long version and HLS19-COM-P-Q6 short version), online navigation HL (HLS19-NAV), and vaccination HL (HLS19-VAC). Based on the expertise of the team, the present study aimed to report the study protocol for Romanian translation, culturally adapting and psychometric testing the following three M-POHL health literacy tools: HLS19-DIGI, HLS19-NAV, and HLS19-COM-P-Q11, HLS19-COM-P-Q6. We will conduct a qualitative descriptive study design in seven steps to translate and adapt the HLS19-DIGI, HLS19-NAV, and HLS19-COM-P-Q11, HLS19-COM-P-Q6 to the Romanian speakers. The study will begin with the translation of English (En)-Romanian (Ro) (2 researchers involved) (step 1), followed by the evaluation of the translation by a bilingual researcher independent of the two researchers who did the En-Ro translation (step 2), the translation of Ro-En (2 researchers but not those in step 1; step 3), the evaluation of the translation by a bilingual researcher independent of the two researchers who did the Ro-En translation (step 4), evaluation of the translation of the tool in an expert group (step 5), pilot testing on a sample of the target population (step 6) and full psychometric testing of the version resulting from step 6 (step 7).

互联网和在线资源的使用改变了人们的健康观念,提高了人们的自主性。在这种情况下,健康素养(HL)是决定与健康有关的选择的关键因素。在世界卫生组织(WHO)层面,M-POHL(世界卫生组织欧洲人口与组织健康素养测量行动网络)在欧洲人口中创建并验证了四份问卷:数字健康素养(HLS19-DIGI)、沟通健康素养(与医疗服务机构医生的沟通--HLS19-COM-P-Q11 长版和 HLS19-COM-P-Q6 短版)、在线导航健康素养(HLS19-NAV)和疫苗接种健康素养(HLS19-VAC)。基于该团队的专业知识,本研究旨在报告以下三种 M-POHL 健康素养工具的罗马尼亚语翻译、文化适应和心理测试研究方案:HLS19-DIGI、HLS19-NAV 和 HLS19-COM-P-Q11、HLS19-COM-P-Q6。我们将采用定性描述研究设计,分七个步骤翻译并改编 HLS19-DIGI、HLS19-NAV 和 HLS19-COM-P-Q11 及 HLS19-COM-P-Q6 以适应罗马尼亚语使用者。研究将从英语(En)-罗马尼亚语(Ro)的翻译(两名研究人员参与)(第 1 步)开始,然后由一名独立于 En-Ro 翻译的两名研究人员的双语研究人员对翻译进行评估(第 2 步)、Ro-En 翻译(两名研究人员,但不包括第 1 步中的研究人员;第 3 步),由一名独立于进行 Ro-En 翻译的两名研究人员的双语研究人员对翻译进行评估(第 4 步),由一个专家组对工具的翻译进行评估(第 5 步),在目标人群中进行抽样试点测试(第 6 步),以及对第 6 步得出的版本进行全面心理测试(第 7 步)。
{"title":"ALSATION Study Protocol: Romanian Translation of Three Health Literacy Surveys.","authors":"Ariana-Anamaria Cordoş, Sebastian-Aurelian Ştefănigă, Călin Muntean, Corina Violeta Vernic, Sorana D Bolboacă","doi":"10.3233/SHTI241052","DOIUrl":"https://doi.org/10.3233/SHTI241052","url":null,"abstract":"<p><p>Access to the internet and online resources changes the concept of health and increases people's autonomy. In this context, Health Literacy (HL) is a critical determinant of health-related choices. At World Health Organization (WHO) level, M-POHL (Action Network on Measuring Population and Organizational Health Literacy of WHO-Europe) created and validated on European population four questionnaires: digital HL (HLS19-DIGI), communication HL (with doctors from health care services - HLS19-COM-P-Q11 long version and HLS19-COM-P-Q6 short version), online navigation HL (HLS19-NAV), and vaccination HL (HLS19-VAC). Based on the expertise of the team, the present study aimed to report the study protocol for Romanian translation, culturally adapting and psychometric testing the following three M-POHL health literacy tools: HLS19-DIGI, HLS19-NAV, and HLS19-COM-P-Q11, HLS19-COM-P-Q6. We will conduct a qualitative descriptive study design in seven steps to translate and adapt the HLS19-DIGI, HLS19-NAV, and HLS19-COM-P-Q11, HLS19-COM-P-Q6 to the Romanian speakers. The study will begin with the translation of English (En)-Romanian (Ro) (2 researchers involved) (step 1), followed by the evaluation of the translation by a bilingual researcher independent of the two researchers who did the En-Ro translation (step 2), the translation of Ro-En (2 researchers but not those in step 1; step 3), the evaluation of the translation by a bilingual researcher independent of the two researchers who did the Ro-En translation (step 4), evaluation of the translation of the tool in an expert group (step 5), pilot testing on a sample of the target population (step 6) and full psychometric testing of the version resulting from step 6 (step 7).</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"12-16"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690245","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Qualitative Assessment of Attitudes Towards Telerehabilitation in Patients with Metastatic Prostate Cancer. 对转移性前列腺癌患者远程康复态度的定性评估。
Pub Date : 2024-11-22 DOI: 10.3233/SHTI241072
Aileen S Gabriel, Patricia Rocco, C Mahony Reategui-Rivera, Aref Smiley, Jennifer Lloyd, Manish Kohli, Joseph Finkelstein

Prostate cancer (PC) is one of the leading causes of cancer-related mortality among men. Androgen Deprivation Therapy (ADT) has been shown to increase survival in men with metastatic PC. Despite its efficacy, ADT's long-term use adversely impacts quality of life (QoL) due to multiple side effects. Multimodal cancer rehabilitation (CR) programs improve QoL but face limited uptake. This study explores perspectives of patients with metastatic PC on a Home Automated Telemanagement (HAT) system using semi-structured interviews. Findings indicate that patients appreciated the ease of use, guided exercise content, and progress tracking features of the HAT system. Significant benefits in symptom management, cognitive support, and QoL improvements were reported, suggesting the program's potential for long-term health management. In summary, the HAT system is a promising tool for supporting CR in patients with metastatic PC. Future developments should address technical issues, incorporate motivational elements, and enhance user feedback to optimize patient engagement and satisfaction.

前列腺癌(PC)是导致男性癌症相关死亡的主要原因之一。研究表明,雄激素剥夺疗法(ADT)可提高转移性前列腺癌患者的生存率。尽管效果显著,但由于多种副作用,长期使用 ADT 会对生活质量(QoL)产生不利影响。多模式癌症康复(CR)计划可改善 QoL,但使用率有限。本研究通过半结构式访谈,探讨了转移性 PC 患者对家庭自动远程管理(HAT)系统的看法。研究结果表明,患者对 HAT 系统的易用性、指导性锻炼内容和进展跟踪功能表示赞赏。据报告,该系统在症状管理、认知支持和生活质量改善方面具有显著优势,表明该计划具有长期健康管理的潜力。总之,HAT 系统是支持转移性 PC 患者进行 CR 治疗的一种很有前景的工具。未来的发展应解决技术问题、融入激励元素并加强用户反馈,以优化患者的参与度和满意度。
{"title":"Qualitative Assessment of Attitudes Towards Telerehabilitation in Patients with Metastatic Prostate Cancer.","authors":"Aileen S Gabriel, Patricia Rocco, C Mahony Reategui-Rivera, Aref Smiley, Jennifer Lloyd, Manish Kohli, Joseph Finkelstein","doi":"10.3233/SHTI241072","DOIUrl":"https://doi.org/10.3233/SHTI241072","url":null,"abstract":"<p><p>Prostate cancer (PC) is one of the leading causes of cancer-related mortality among men. Androgen Deprivation Therapy (ADT) has been shown to increase survival in men with metastatic PC. Despite its efficacy, ADT's long-term use adversely impacts quality of life (QoL) due to multiple side effects. Multimodal cancer rehabilitation (CR) programs improve QoL but face limited uptake. This study explores perspectives of patients with metastatic PC on a Home Automated Telemanagement (HAT) system using semi-structured interviews. Findings indicate that patients appreciated the ease of use, guided exercise content, and progress tracking features of the HAT system. Significant benefits in symptom management, cognitive support, and QoL improvements were reported, suggesting the program's potential for long-term health management. In summary, the HAT system is a promising tool for supporting CR in patients with metastatic PC. Future developments should address technical issues, incorporate motivational elements, and enhance user feedback to optimize patient engagement and satisfaction.</p>","PeriodicalId":94357,"journal":{"name":"Studies in health technology and informatics","volume":"321 ","pages":"104-108"},"PeriodicalIF":0.0,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142690073","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Studies in health technology and informatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1