首页 > 最新文献

Eurographics Workshop on Visual Computing for Biomedicine最新文献

英文 中文
PerSleep: A Visual Analytics Approach for Performance Assessment of Sleep Staging Models perssleep:一种用于睡眠分期模型性能评估的可视化分析方法
Pub Date : 2021-01-01 DOI: 10.2312/vcbm.20211352
H. S. G. Caballero, A. Corvó, F. B. Meulen, P. Fonseca, S. Overeem, J. V. Wijk, M. A. Westenberg
Machine learning is becoming increasingly popular in the medical domain. In the near future, clinicians expect predictive models to support daily tasks such as diagnosis and prognostic analysis. For this reason, it is utterly important to evaluate and compare the performance of such models so that clinicians can safely rely on them. In this paper, we focus on sleep staging wherein machine learning models can be used to automate or support sleep scoring. Evaluation of these models is complex because sleep is a natural process, which varies among patients. For adoption in clinical routine, it is important to understand how the models perform for different groups of patients. Moreover, models can be trained to recognize different characteristics in the data, and model developers need to understand why and how performance of the different models varies. To address these challenges, we present a visual analytics approach to evaluate the performance of predictive models on sleep staging and to help experts better understand these models with respect to patient data (e.g., conditions, medication, etc.). We illustrate the effectiveness of our approach by comparing multiple models trained on real-world sleep staging data with experts.
机器学习在医疗领域越来越受欢迎。在不久的将来,临床医生希望预测模型能够支持诊断和预后分析等日常任务。因此,评估和比较这些模型的性能是非常重要的,以便临床医生可以安全地依赖它们。在本文中,我们专注于睡眠分期,其中机器学习模型可用于自动化或支持睡眠评分。对这些模型的评估是复杂的,因为睡眠是一个自然过程,因人而异。为了在临床常规中采用,了解模型在不同患者群体中的表现是很重要的。此外,可以训练模型来识别数据中的不同特征,模型开发人员需要了解不同模型的性能变化的原因和方式。为了应对这些挑战,我们提出了一种可视化分析方法来评估睡眠分期预测模型的性能,并帮助专家更好地理解这些模型与患者数据(例如,条件,药物等)的关系。我们通过与专家比较在真实世界睡眠阶段数据上训练的多个模型来说明我们方法的有效性。
{"title":"PerSleep: A Visual Analytics Approach for Performance Assessment of Sleep Staging Models","authors":"H. S. G. Caballero, A. Corvó, F. B. Meulen, P. Fonseca, S. Overeem, J. V. Wijk, M. A. Westenberg","doi":"10.2312/vcbm.20211352","DOIUrl":"https://doi.org/10.2312/vcbm.20211352","url":null,"abstract":"Machine learning is becoming increasingly popular in the medical domain. In the near future, clinicians expect predictive models to support daily tasks such as diagnosis and prognostic analysis. For this reason, it is utterly important to evaluate and compare the performance of such models so that clinicians can safely rely on them. In this paper, we focus on sleep staging wherein machine learning models can be used to automate or support sleep scoring. Evaluation of these models is complex because sleep is a natural process, which varies among patients. For adoption in clinical routine, it is important to understand how the models perform for different groups of patients. Moreover, models can be trained to recognize different characteristics in the data, and model developers need to understand why and how performance of the different models varies. To address these challenges, we present a visual analytics approach to evaluate the performance of predictive models on sleep staging and to help experts better understand these models with respect to patient data (e.g., conditions, medication, etc.). We illustrate the effectiveness of our approach by comparing multiple models trained on real-world sleep staging data with experts.","PeriodicalId":88872,"journal":{"name":"Eurographics Workshop on Visual Computing for Biomedicine","volume":"78 1","pages":"123-133"},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74590307","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Vologram: An Educational Holographic Sculpture for Volumetric Medical Data Physicalization 体积图:一种用于体积医学数据物化的教育全息雕塑
Pub Date : 2021-01-01 DOI: 10.2312/vcbm.20211341
Daniel Pahr, Hsiang-Yun Wu, R. Raidou
Real-world sculptures that display patient imaging data for anatomical education purposes have seen a recent resurgence through the field of data physicalization . In this paper, we describe an automated process for the computer-assisted generation of sculptures that can be employed for anatomical education among the general population. We propose a workflow that supports non-expert users to generate and physically display volumetric medical data in a visually appealing and engaging way. Our approach generates slide-based, interactive sculptures—called volograms —that resemble holograms of underlying medical data. The volograms are made out of affordable and readily available materials (e.g., transparent foils and cardboard) and can be produced through commonly available means. To evaluate the educational value of the proposed approach with our target audience, we assess the volograms, as opposed to classical, on-screen medical visualizations in a user study. The results of our study, while highlighting current weaknesses of our physicalization, also point to interesting future directions.
现实世界的雕塑,显示病人的成像数据解剖教育的目的已经看到了最近的复苏,通过数据物质化领域。在本文中,我们描述了一个计算机辅助生成雕塑的自动化过程,可以用于普通人群的解剖教育。我们提出了一个工作流,支持非专业用户以视觉上吸引人的方式生成和物理显示体积医疗数据。我们的方法产生基于幻灯片的交互式雕塑——称为volograms——类似于底层医疗数据的全息图。volograms由经济实惠且易于获得的材料(例如,透明箔和纸板)制成,并且可以通过通常可用的方法生产。为了对我们的目标受众评估拟议方法的教育价值,我们在用户研究中评估了volograms,而不是经典的屏幕医学可视化。我们的研究结果,虽然突出了目前我们物质化的弱点,也指出了有趣的未来方向。
{"title":"Vologram: An Educational Holographic Sculpture for Volumetric Medical Data Physicalization","authors":"Daniel Pahr, Hsiang-Yun Wu, R. Raidou","doi":"10.2312/vcbm.20211341","DOIUrl":"https://doi.org/10.2312/vcbm.20211341","url":null,"abstract":"Real-world sculptures that display patient imaging data for anatomical education purposes have seen a recent resurgence through the field of data physicalization . In this paper, we describe an automated process for the computer-assisted generation of sculptures that can be employed for anatomical education among the general population. We propose a workflow that supports non-expert users to generate and physically display volumetric medical data in a visually appealing and engaging way. Our approach generates slide-based, interactive sculptures—called volograms —that resemble holograms of underlying medical data. The volograms are made out of affordable and readily available materials (e.g., transparent foils and cardboard) and can be produced through commonly available means. To evaluate the educational value of the proposed approach with our target audience, we assess the volograms, as opposed to classical, on-screen medical visualizations in a user study. The results of our study, while highlighting current weaknesses of our physicalization, also point to interesting future directions.","PeriodicalId":88872,"journal":{"name":"Eurographics Workshop on Visual Computing for Biomedicine","volume":"16 1","pages":"19-23"},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"91216027","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Strategies for Generating Multi-Time Frame Localization of Cardiac MRI 心脏MRI多时间帧定位生成策略
Pub Date : 2021-01-01 DOI: 10.2312/vcbm.20211342
Samin Sabokrohiyeh, Kathleen Ang, F. Samavati
4D Flow MRI is a recent promising technology that is able to capture blood flow information within the heart chambers over a cardiac cycle. To accurately study the flow inside the chambers, there is a need for a high quality anatomical reference which can be provided by another scan known as 3D cine MRI (short-axis 3D (multiple 2D slices) cine SSFP). To take advantage of both scans, data fusion can be done using an intensity-based registration. To reduce the impact of noise on the registration result and the chance of misalignment between the organs, defining a region of interest (localization) should be done prior to the registration. Localizing a dataset – especially a time-varying dataset – can be a daunting task since the localization should be provided for all time frames. We design and evaluate different strategies for extending single time frame localization to time varying data in order to register the 4D Flow MRI and 3D cine MRI over the cardiac cycle. CCS Concepts • Applied computing → Life and medical sciences;
4D Flow MRI是一项最近很有前途的技术,它能够在心脏周期内捕获心脏腔内的血流信息。为了准确地研究腔室内部的流动,需要高质量的解剖学参考,这可以通过另一种称为3D电影MRI(短轴3D(多个2D切片)电影SSFP)的扫描提供。为了利用这两种扫描,可以使用基于强度的配准来进行数据融合。为了减少噪声对配准结果的影响和器官之间不对齐的机会,应该在配准之前定义一个感兴趣的区域(定位)。本地化数据集——尤其是时变数据集——可能是一项艰巨的任务,因为本地化应该为所有时间框架提供。我们设计并评估了将单一时间框架定位扩展到时变数据的不同策略,以便在心脏周期内记录4D Flow MRI和3D电影MRI。•应用计算→生命和医学科学;
{"title":"Strategies for Generating Multi-Time Frame Localization of Cardiac MRI","authors":"Samin Sabokrohiyeh, Kathleen Ang, F. Samavati","doi":"10.2312/vcbm.20211342","DOIUrl":"https://doi.org/10.2312/vcbm.20211342","url":null,"abstract":"4D Flow MRI is a recent promising technology that is able to capture blood flow information within the heart chambers over a cardiac cycle. To accurately study the flow inside the chambers, there is a need for a high quality anatomical reference which can be provided by another scan known as 3D cine MRI (short-axis 3D (multiple 2D slices) cine SSFP). To take advantage of both scans, data fusion can be done using an intensity-based registration. To reduce the impact of noise on the registration result and the chance of misalignment between the organs, defining a region of interest (localization) should be done prior to the registration. Localizing a dataset – especially a time-varying dataset – can be a daunting task since the localization should be provided for all time frames. We design and evaluate different strategies for extending single time frame localization to time varying data in order to register the 4D Flow MRI and 3D cine MRI over the cardiac cycle. CCS Concepts • Applied computing → Life and medical sciences;","PeriodicalId":88872,"journal":{"name":"Eurographics Workshop on Visual Computing for Biomedicine","volume":"1 1","pages":"25-29"},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76656003","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Automatic Cutting and Flattening of Carotid Artery Geometries 颈动脉几何形状的自动切割和平坦
Pub Date : 2021-01-01 DOI: 10.2312/vcbm.20211347
P. Eulzer, K. Richter, M. Meuschke, A. Hundertmark, K. Lawonn
We propose a novel method to cut and flatten vascular geometry that results in an intuitive mapping between the 3D and 2D domains. Our approach is fully automatic, and the sole input is the vessel geometry. We aim to simplify parameter analysis on vessel walls for research on vascular disease and computational hemodynamics. We present a use case for the flattening to aid efforts in investigating the pathophysiology of carotid stenoses (vessel constrictions that are a root cause of stroke). To achieve an intuitive mapping, we introduce the notion of natural vessel cuts. They remain on one side of vessel branches, meaning they adhere to the longitudinal direction and thus result in a comprehensible unfolding of the geometry. Vessel branches and endpoints are automatically detected, and a 2D layout configuration is found that retains the original branch layout. We employ a quasi-isometric surface parameterization to map the geometry to the 2D domain as a single patch. The flattened depiction resolves the need for tedious 3D interaction as the whole surface is visible at once. We found this overview particularly beneficial for exploring temporally resolved parameters.
我们提出了一种新颖的方法来切割和平坦血管几何形状,从而在3D和2D域之间产生直观的映射。我们的方法是全自动的,唯一的输入是容器的几何形状。我们的目的是简化血管壁的参数分析,用于血管疾病和计算血流动力学的研究。我们提出了一个用例,以帮助研究颈动脉狭窄的病理生理学(血管收缩是中风的根本原因)。为了实现直观的映射,我们引入了自然血管切割的概念。它们保持在容器分支的一侧,这意味着它们坚持纵向方向,从而导致几何形状的可理解展开。自动检测血管分支和端点,并找到保留原始分支布局的二维布局配置。我们采用准等距表面参数化将几何图形映射到二维域作为单个补丁。扁平的描绘解决了繁琐的3D交互的需要,因为整个表面一次可见。我们发现这个概述对于探索暂时解析的参数特别有用。
{"title":"Automatic Cutting and Flattening of Carotid Artery Geometries","authors":"P. Eulzer, K. Richter, M. Meuschke, A. Hundertmark, K. Lawonn","doi":"10.2312/vcbm.20211347","DOIUrl":"https://doi.org/10.2312/vcbm.20211347","url":null,"abstract":"We propose a novel method to cut and flatten vascular geometry that results in an intuitive mapping between the 3D and 2D domains. Our approach is fully automatic, and the sole input is the vessel geometry. We aim to simplify parameter analysis on vessel walls for research on vascular disease and computational hemodynamics. We present a use case for the flattening to aid efforts in investigating the pathophysiology of carotid stenoses (vessel constrictions that are a root cause of stroke). To achieve an intuitive mapping, we introduce the notion of natural vessel cuts. They remain on one side of vessel branches, meaning they adhere to the longitudinal direction and thus result in a comprehensible unfolding of the geometry. Vessel branches and endpoints are automatically detected, and a 2D layout configuration is found that retains the original branch layout. We employ a quasi-isometric surface parameterization to map the geometry to the 2D domain as a single patch. The flattened depiction resolves the need for tedious 3D interaction as the whole surface is visible at once. We found this overview particularly beneficial for exploring temporally resolved parameters.","PeriodicalId":88872,"journal":{"name":"Eurographics Workshop on Visual Computing for Biomedicine","volume":"1 1","pages":"79-89"},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86516001","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Interactive Multimodal Imaging Visualization for Multiple Sclerosis Lesion Analysis 交互式多模态影像可视化用于多发性硬化症病变分析
Pub Date : 2021-01-01 DOI: 10.2312/vcbm.20211346
Sherin Sugathan, H. Bartsch, F. Riemer, R. Grüner, K. Lawonn, N. Smit
Multiple Sclerosis (MS) is a brain disease that is diagnosed and monitored extensively through MRI scans. One of the criteria is the appearance of so-called brain lesions. The lesions show up on MRI scans as regions with elevated or reduced contrast compared to the surrounding healthy tissue. Understanding the complex interplay of contrast, location and shape in images from multiple modalities from 2D MRI slices is challenging. Advanced visualization of appearanceand location-related features of lesions would help researchers in defining better disease characterization through MS research. Since a permanent cure is not possible in MS and medication-based disease modification is a common treatment path, providing better visualizations would strengthen research which investigates the effect of white matter lesions. Here we present an advanced visualization solution that supports analysis from multiple imaging modalities acquired in a clinical routine examination. The solution holds potential for enabling researchers to have a more intuitive perception of lesion features. As an example for enhancing the analytic possibilities, we demonstrate the benefits of lesion projection using both Diffusion Tensor Imaging (DTI) and gradient-based techniques. This approach enables users to assess brain structures across individuals as the atlas-based analysis provides 3D anchoring and labeling of regions across a series of brain scans from the same participant and across different participants. The projections on the brain surface also enable researchers to conduct detailed studies on the relationship between cognitive disabilities and location of lesions. This allows researchers to correlate lesions to Brodmann areas and related brain functions. We realize the solutions in a prototype application that supports both DTI and structural data. A qualitative evaluation demonstrates that our approach supports MS researchers by providing new opportunities for MS research. CCS Concepts • Human-centered computing → Visualization application domains;
多发性硬化症(MS)是一种脑部疾病,通过MRI扫描进行诊断和监测。其中一个标准是所谓的脑损伤的外观。在MRI扫描中,病变表现为与周围健康组织相比对比度升高或降低的区域。从二维MRI切片的多种模式图像中理解对比度、位置和形状的复杂相互作用是具有挑战性的。病变的外观和位置相关特征的高级可视化将帮助研究人员通过MS研究更好地定义疾病特征。由于多发性硬化症不可能永久治愈,基于药物的疾病改变是一种常见的治疗途径,提供更好的可视化将加强研究白质病变的影响。在这里,我们提出了一种先进的可视化解决方案,支持从临床常规检查中获得的多种成像模式进行分析。该解决方案有可能使研究人员对病变特征有更直观的感知。作为增强分析可能性的一个例子,我们展示了使用扩散张量成像(DTI)和基于梯度的技术进行病变投影的好处。这种方法使用户能够评估个体之间的大脑结构,因为基于地图集的分析提供了来自同一参与者和不同参与者的一系列大脑扫描的3D锚定和区域标记。大脑表面的投影也使研究人员能够对认知障碍与病变位置之间的关系进行详细的研究。这使得研究人员能够将损伤与布罗德曼区和相关的大脑功能联系起来。我们在一个支持DTI和结构数据的原型应用程序中实现了解决方案。一项定性评估表明,我们的方法通过为质谱研究提供新的机会来支持质谱研究人员。CCS概念•以人为中心的计算→可视化应用领域;
{"title":"Interactive Multimodal Imaging Visualization for Multiple Sclerosis Lesion Analysis","authors":"Sherin Sugathan, H. Bartsch, F. Riemer, R. Grüner, K. Lawonn, N. Smit","doi":"10.2312/vcbm.20211346","DOIUrl":"https://doi.org/10.2312/vcbm.20211346","url":null,"abstract":"Multiple Sclerosis (MS) is a brain disease that is diagnosed and monitored extensively through MRI scans. One of the criteria is the appearance of so-called brain lesions. The lesions show up on MRI scans as regions with elevated or reduced contrast compared to the surrounding healthy tissue. Understanding the complex interplay of contrast, location and shape in images from multiple modalities from 2D MRI slices is challenging. Advanced visualization of appearanceand location-related features of lesions would help researchers in defining better disease characterization through MS research. Since a permanent cure is not possible in MS and medication-based disease modification is a common treatment path, providing better visualizations would strengthen research which investigates the effect of white matter lesions. Here we present an advanced visualization solution that supports analysis from multiple imaging modalities acquired in a clinical routine examination. The solution holds potential for enabling researchers to have a more intuitive perception of lesion features. As an example for enhancing the analytic possibilities, we demonstrate the benefits of lesion projection using both Diffusion Tensor Imaging (DTI) and gradient-based techniques. This approach enables users to assess brain structures across individuals as the atlas-based analysis provides 3D anchoring and labeling of regions across a series of brain scans from the same participant and across different participants. The projections on the brain surface also enable researchers to conduct detailed studies on the relationship between cognitive disabilities and location of lesions. This allows researchers to correlate lesions to Brodmann areas and related brain functions. We realize the solutions in a prototype application that supports both DTI and structural data. A qualitative evaluation demonstrates that our approach supports MS researchers by providing new opportunities for MS research. CCS Concepts • Human-centered computing → Visualization application domains;","PeriodicalId":88872,"journal":{"name":"Eurographics Workshop on Visual Computing for Biomedicine","volume":"123 1","pages":"65-77"},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79481672","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Automatic Animations to Analyze Blood Flow Data 自动动画分析血流数据
Pub Date : 2021-01-01 DOI: 10.2312/vcbm.20211349
Vikram Apilla, B. Behrendt, K. Lawonn, B. Preim, M. Meuschke
We present an approach for computing camera animations composed of optimal views to support the visual exploration of blood flow data using cerebral aneurysms as major example. Medical researchers are interested in hemodynamic parameters and vessel wall characteristics. The time-dependent character of blood flow data complicates the visual analysis. Our approach is modeled as an optimization problem to automatically determine camera paths during the cardiac cycle. These consist of optimal viewpoints showing regions with suspicious characteristics of walland flow-related parameters. This provides medical researchers with an efficient method of obtaining a fast overview of patient-specific blood flow data. CCS Concepts • Applied computing → Life and medical sciences; • Human-centered computing → Visualization;
我们提出了一种计算由最佳视图组成的摄像机动画的方法,以支持以脑动脉瘤为主要示例的血流数据的视觉探索。医学研究者对血流动力学参数和血管壁特性很感兴趣。血流数据的时变特性使可视化分析变得复杂。我们的方法是建模为一个优化问题,以自动确定相机路径在心脏周期。这些由最佳视点组成,显示具有可疑特征的壁面和流动相关参数的区域。这为医学研究人员提供了一种获得患者特定血流数据快速概述的有效方法。•应用计算→生命和医学科学;•以人为本→可视化;
{"title":"Automatic Animations to Analyze Blood Flow Data","authors":"Vikram Apilla, B. Behrendt, K. Lawonn, B. Preim, M. Meuschke","doi":"10.2312/vcbm.20211349","DOIUrl":"https://doi.org/10.2312/vcbm.20211349","url":null,"abstract":"We present an approach for computing camera animations composed of optimal views to support the visual exploration of blood flow data using cerebral aneurysms as major example. Medical researchers are interested in hemodynamic parameters and vessel wall characteristics. The time-dependent character of blood flow data complicates the visual analysis. Our approach is modeled as an optimization problem to automatically determine camera paths during the cardiac cycle. These consist of optimal viewpoints showing regions with suspicious characteristics of walland flow-related parameters. This provides medical researchers with an efficient method of obtaining a fast overview of patient-specific blood flow data. CCS Concepts • Applied computing → Life and medical sciences; • Human-centered computing → Visualization;","PeriodicalId":88872,"journal":{"name":"Eurographics Workshop on Visual Computing for Biomedicine","volume":"1 1","pages":"101-105"},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73849596","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Projection Mapping for In-Situ Surgery Planning by the Example of DIEP Flap Breast Reconstruction 以DIEP皮瓣乳房重建为例,投影测绘在原位手术规划中的应用
Pub Date : 2021-01-01 DOI: 10.2312/vcbm.20211354
Jana Martschinke, V. Klein, Philipp Kurth, K. Engel, I. Ludolph, T. Hauck, R. Horch, M. Stamminger
Nowadays, many surgical procedures require preoperative planning, mostly relying on data from 3D imaging techniques like computed tomography or magnetic resonance imaging. However, preoperative assessment of this data is carried out on the PC (using classical CT/MR viewing software) and not on the patient’s body itself. Therefore, surgeons need to transfer both their overall understanding of the patient’s individual anatomy and also specific markers and labels for important points from the PC to the patient only with the help of imaginative power or approximative measurement. In order to close the gap between preoperative planning on the PC and surgery on the patient, we propose a system to directly project preoperative knowledge to the body surface by projection mapping. As a result, we are able to display both assigned labels and a volumetric and view-dependent view of the 3D data in-situ. Furthermore, we offer a method to interactively navigate through the data and add 3D markers directly in the projected volumetric view. We demonstrate the benefits of our approach using DIEP flap breast reconstruction as an example. By means of a small pilot study, we show that our method outperforms standard surgical planning in accuracy and can easily be understood and utilized even by persons without any medical knowledge. CCS Concepts • Applied computing → Health informatics; • Computing methodologies → Ray tracing; Mixed / augmented reality;
如今,许多外科手术都需要术前计划,主要依赖于计算机断层扫描或磁共振成像等3D成像技术的数据。然而,术前对这些数据的评估是在PC上进行的(使用经典的CT/MR查看软件),而不是在患者身上进行的。因此,外科医生需要在想象力或近似测量的帮助下,将他们对患者个体解剖结构的总体理解以及重要部位的特定标记和标签从PC转移到患者身上。为了缩小PC上的术前规划与患者手术之间的差距,我们提出了一种通过投影映射将术前知识直接投影到体表的系统。因此,我们能够同时显示分配的标签和三维数据的体积和视图依赖视图。此外,我们还提供了一种交互式导航数据的方法,并直接在投影体视图中添加3D标记。我们以DIEP皮瓣乳房重建为例,展示了我们的方法的好处。通过一个小的试点研究,我们表明,我们的方法优于标准的手术计划的准确性,可以很容易地理解和使用,即使是没有任何医学知识的人。•应用计算→健康信息学;•计算方法→光线追踪;混合/增强现实;
{"title":"Projection Mapping for In-Situ Surgery Planning by the Example of DIEP Flap Breast Reconstruction","authors":"Jana Martschinke, V. Klein, Philipp Kurth, K. Engel, I. Ludolph, T. Hauck, R. Horch, M. Stamminger","doi":"10.2312/vcbm.20211354","DOIUrl":"https://doi.org/10.2312/vcbm.20211354","url":null,"abstract":"Nowadays, many surgical procedures require preoperative planning, mostly relying on data from 3D imaging techniques like computed tomography or magnetic resonance imaging. However, preoperative assessment of this data is carried out on the PC (using classical CT/MR viewing software) and not on the patient’s body itself. Therefore, surgeons need to transfer both their overall understanding of the patient’s individual anatomy and also specific markers and labels for important points from the PC to the patient only with the help of imaginative power or approximative measurement. In order to close the gap between preoperative planning on the PC and surgery on the patient, we propose a system to directly project preoperative knowledge to the body surface by projection mapping. As a result, we are able to display both assigned labels and a volumetric and view-dependent view of the 3D data in-situ. Furthermore, we offer a method to interactively navigate through the data and add 3D markers directly in the projected volumetric view. We demonstrate the benefits of our approach using DIEP flap breast reconstruction as an example. By means of a small pilot study, we show that our method outperforms standard surgical planning in accuracy and can easily be understood and utilized even by persons without any medical knowledge. CCS Concepts • Applied computing → Health informatics; • Computing methodologies → Ray tracing; Mixed / augmented reality;","PeriodicalId":88872,"journal":{"name":"Eurographics Workshop on Visual Computing for Biomedicine","volume":"66 1","pages":"145-153"},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"89333402","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
Multiple Scale Visualization of Electronic Health Records to Support Finding Medical Narratives 支持查找医疗叙述的电子健康记录的多尺度可视化
Pub Date : 2021-01-01 DOI: 10.2312/vcbm.20211351
Sanne van der Linden, J. V. Wijk, M. Funk
Electronic Health Records (EHRs) contain rich medical information about patients, possibly hundreds of notes, lab results, images and other information. Doctors can easily be overwhelmed by this wealth of information. For their daily work, they need to derive narratives from all this information to get insights into the main issues of their patients. Standard solutions show all the information in linear lists, often leading to cognitive overload; research solutions provide timelines and relations between the notes but provide too much fragmented information. We propose MEDeNAR, a system for enabling medical professionals to obtain insights from EHRs based on the different tasks in their workflow. The key aspects of our system are the introduction of an intermediate level that summarizes the information using clustering and NLP methods. The results are visualized along a timeline and provide easy access to the detailed descriptions in notes and lab results at the EHR level. We designed the system using an iterative design process in collaboration with 18 doctors, two nurses and 14 domain experts. During the final evaluation, the doctors ranked our system higher than a standard baseline solution and a variation for the used NLP methods. CCS Concepts • Human-centered computing → Visualization toolkits; User interface toolkits;
电子健康记录(EHRs)包含关于患者的丰富医疗信息,可能包括数百个笔记、实验室结果、图像和其他信息。医生很容易被这些丰富的信息所淹没。对于他们的日常工作,他们需要从所有这些信息中得出叙述,以深入了解患者的主要问题。标准解决方案以线性列表的形式显示所有信息,常常导致认知超载;研究解决方案提供了时间线和笔记之间的关系,但提供了太多碎片化的信息。我们提出MEDeNAR,这是一个使医疗专业人员能够根据其工作流程中的不同任务从电子病历中获得见解的系统。我们系统的关键方面是引入了一个中间层,该层使用聚类和NLP方法总结信息。结果是可视化的时间轴,并提供方便的访问详细说明笔记和实验室结果在EHR水平。我们与18名医生、两名护士和14名领域专家合作,使用迭代设计过程设计了这个系统。在最后的评估中,医生将我们的系统评为高于标准基线解决方案和使用的NLP方法的变体。CCS概念•以人为中心的计算→可视化工具包;用户界面工具包;
{"title":"Multiple Scale Visualization of Electronic Health Records to Support Finding Medical Narratives","authors":"Sanne van der Linden, J. V. Wijk, M. Funk","doi":"10.2312/vcbm.20211351","DOIUrl":"https://doi.org/10.2312/vcbm.20211351","url":null,"abstract":"Electronic Health Records (EHRs) contain rich medical information about patients, possibly hundreds of notes, lab results, images and other information. Doctors can easily be overwhelmed by this wealth of information. For their daily work, they need to derive narratives from all this information to get insights into the main issues of their patients. Standard solutions show all the information in linear lists, often leading to cognitive overload; research solutions provide timelines and relations between the notes but provide too much fragmented information. We propose MEDeNAR, a system for enabling medical professionals to obtain insights from EHRs based on the different tasks in their workflow. The key aspects of our system are the introduction of an intermediate level that summarizes the information using clustering and NLP methods. The results are visualized along a timeline and provide easy access to the detailed descriptions in notes and lab results at the EHR level. We designed the system using an iterative design process in collaboration with 18 doctors, two nurses and 14 domain experts. During the final evaluation, the doctors ranked our system higher than a standard baseline solution and a variation for the used NLP methods. CCS Concepts • Human-centered computing → Visualization toolkits; User interface toolkits;","PeriodicalId":88872,"journal":{"name":"Eurographics Workshop on Visual Computing for Biomedicine","volume":"34 1","pages":"113-122"},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80760744","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
The Role of Depth Perception in XR from a Neuroscience Perspective: A Primer and Survey 从神经科学的角度看深度感知在XR中的作用:入门和综述
Pub Date : 2021-01-01 DOI: 10.2312/vcbm.20211344
Vetle Hushagen, Gustav C. Tresselt, N. Smit, K. Specht
Augmented and virtual reality (XR) are potentially powerful tools for enhancing the efficiency of interactive visualization of complex data in biology and medicine. The benefits of visualization of digital objects in XR mainly arise from enhanced depth perception due to the stereoscopic nature of XR head mounted devices. With the added depth dimension, XR is in a prime position to convey complex information and support tasks where 3D information is important. In order to inform the development of novel XR applications in the biology and medicine domain, we present a survey which reviews the neuroscientific basis underlying the immersive features of XR. To make this literature more accessible to the visualization community, we first describe the basics of the visual system, highlighting how visual features are combined to objects and processed in higher cortical areas with a special focus on depth vision. Based on state of the art findings in neuroscience literature related to depth perception, we provide several recommendations for developers and designers. Our aim is to aid development of XR applications and strengthen development of tools aimed at molecular visualization, medical education, and surgery, as well as inspire new application areas. CCS Concepts • General and reference → Surveys and overviews; • Applied computing → Life and medical sciences; • Human-centered computing → Virtual reality; Mixed / augmented reality;
增强现实和虚拟现实(XR)是提高生物和医学领域复杂数据交互可视化效率的潜在强大工具。XR中数字对象可视化的好处主要来自于XR头戴式设备的立体特性增强的深度感知。随着深度维度的增加,XR在传递复杂信息和支持3D信息很重要的任务方面处于有利地位。为了向生物和医学领域新型XR应用的发展提供信息,我们提出了一项调查,回顾了XR沉浸式特征背后的神经科学基础。为了使这些文献更容易被可视化社区所理解,我们首先描述了视觉系统的基础,强调了视觉特征是如何与物体结合在一起的,并在皮层的高级区域进行处理,特别关注深度视觉。基于深度感知相关的神经科学文献的最新发现,我们为开发者和设计师提供了一些建议。我们的目标是帮助开发XR应用,加强针对分子可视化、医学教育和外科手术的工具的开发,并激发新的应用领域。CCS概念•一般和参考→调查和概述;•应用计算→生命和医学科学;•以人为本→虚拟现实;混合/增强现实;
{"title":"The Role of Depth Perception in XR from a Neuroscience Perspective: A Primer and Survey","authors":"Vetle Hushagen, Gustav C. Tresselt, N. Smit, K. Specht","doi":"10.2312/vcbm.20211344","DOIUrl":"https://doi.org/10.2312/vcbm.20211344","url":null,"abstract":"Augmented and virtual reality (XR) are potentially powerful tools for enhancing the efficiency of interactive visualization of complex data in biology and medicine. The benefits of visualization of digital objects in XR mainly arise from enhanced depth perception due to the stereoscopic nature of XR head mounted devices. With the added depth dimension, XR is in a prime position to convey complex information and support tasks where 3D information is important. In order to inform the development of novel XR applications in the biology and medicine domain, we present a survey which reviews the neuroscientific basis underlying the immersive features of XR. To make this literature more accessible to the visualization community, we first describe the basics of the visual system, highlighting how visual features are combined to objects and processed in higher cortical areas with a special focus on depth vision. Based on state of the art findings in neuroscience literature related to depth perception, we provide several recommendations for developers and designers. Our aim is to aid development of XR applications and strengthen development of tools aimed at molecular visualization, medical education, and surgery, as well as inspire new application areas. CCS Concepts • General and reference → Surveys and overviews; • Applied computing → Life and medical sciences; • Human-centered computing → Virtual reality; Mixed / augmented reality;","PeriodicalId":88872,"journal":{"name":"Eurographics Workshop on Visual Computing for Biomedicine","volume":"52 1","pages":"37-54"},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79454514","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An Exploration of Practice and Preferences for the Visual Communication of Biomedical Processes 生物医学过程视觉传达的实践和偏好的探索
Pub Date : 2021-01-01 DOI: 10.2312/vcbm.20211339
L. Garrison, M. Meuschke, J. Fairman, N. Smit, B. Preim, S. Bruckner
The visual communication of biomedical processes draws from diverse techniques in both visualization and biomedical illustration. However, matching these techniques to their intended audience often relies on practice-based heuristics or narrow-scope evaluations. We present an exploratory study of the criteria that audiences use when evaluating a biomedical process visualization targeted for communication. Designed over a series of expert interviews and focus groups, our study focuses on common communication scenarios of five well-known biomedical processes and their standard visual representations. We framed these scenarios in a survey with participant expertise spanning from minimal to expert knowledge of a given topic. Our results show frequent overlap in abstraction preferences between expert and non-expert audiences, with similar prioritization of clarity and the ability of an asset to meet a given communication objective. We also found that some illustrative conventions are not as clear as we thought, e.g., glows have broadly ambiguous meaning, while other approaches were unexpectedly preferred, e.g., biomedical illustrations in place of data-driven visualizations. Our findings suggest numerous opportunities for the continued convergence of visualization and biomedical illustration techniques for targeted visualization design. CCS Concepts • Human-centered computing → Visualization design and evaluation methods; Scientific visualization; Visualization theory, concepts and paradigms; • Computer Applications → Life and Medical Sciences;
生物医学过程的视觉交流从可视化和生物医学插图的不同技术中汲取。然而,将这些技术与它们的目标受众相匹配通常依赖于基于实践的启发式或窄范围的评估。我们提出了一项探索性研究的标准,观众使用时,评估生物医学过程可视化目标沟通。通过一系列专家访谈和焦点小组的设计,我们的研究侧重于五种知名生物医学过程的常见交流场景及其标准视觉表示。我们在一项调查中构建了这些场景,参与者的专业知识涵盖了给定主题的最小知识到专家知识。我们的结果显示,专家和非专业受众之间的抽象偏好经常重叠,具有相似的清晰度优先级和资产满足给定沟通目标的能力。我们还发现,一些说明性的惯例并不像我们想象的那样清晰,例如,发光具有广泛的模糊含义,而其他方法意外地被首选,例如,生物医学插图代替数据驱动的可视化。我们的研究结果表明,在有针对性的可视化设计中,可视化和生物医学插图技术的持续融合有许多机会。•以人为本的计算→可视化设计与评价方法;科学可视化;可视化理论、概念和范式;•计算机应用→生命和医学科学;
{"title":"An Exploration of Practice and Preferences for the Visual Communication of Biomedical Processes","authors":"L. Garrison, M. Meuschke, J. Fairman, N. Smit, B. Preim, S. Bruckner","doi":"10.2312/vcbm.20211339","DOIUrl":"https://doi.org/10.2312/vcbm.20211339","url":null,"abstract":"The visual communication of biomedical processes draws from diverse techniques in both visualization and biomedical illustration. However, matching these techniques to their intended audience often relies on practice-based heuristics or narrow-scope evaluations. We present an exploratory study of the criteria that audiences use when evaluating a biomedical process visualization targeted for communication. Designed over a series of expert interviews and focus groups, our study focuses on common communication scenarios of five well-known biomedical processes and their standard visual representations. We framed these scenarios in a survey with participant expertise spanning from minimal to expert knowledge of a given topic. Our results show frequent overlap in abstraction preferences between expert and non-expert audiences, with similar prioritization of clarity and the ability of an asset to meet a given communication objective. We also found that some illustrative conventions are not as clear as we thought, e.g., glows have broadly ambiguous meaning, while other approaches were unexpectedly preferred, e.g., biomedical illustrations in place of data-driven visualizations. Our findings suggest numerous opportunities for the continued convergence of visualization and biomedical illustration techniques for targeted visualization design. CCS Concepts • Human-centered computing → Visualization design and evaluation methods; Scientific visualization; Visualization theory, concepts and paradigms; • Computer Applications → Life and Medical Sciences;","PeriodicalId":88872,"journal":{"name":"Eurographics Workshop on Visual Computing for Biomedicine","volume":"95 1","pages":"1-12"},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85713350","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 13
期刊
Eurographics Workshop on Visual Computing for Biomedicine
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1