首页 > 最新文献

Visual Informatics最新文献

英文 中文
Augmented reality for supporting geo-spatial planning: An open access review 用于支持地理空间规划的增强现实:开放获取审查
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-07-17 DOI: 10.1016/j.visinf.2023.07.002
Reint Jansen , Frida Ruiz Mendoza , William Hurst

Augmented reality is gaining traction across many domains. One of these is participation within geo-spatial planning projects. The interactive and three-dimensional nature of augmented reality is suitably placed to cater for a higher quality of communication and information exchange in planning processes. Thus, this research provides an overview of the use of AR in planning processes, specifically regarding the participation aspect, through an open-access systematic literature review, for which the investigation identifies 35 articles concerning the current state-of-the-art of augmented reality in planning. Findings indicate the rather limited use of augmented reality in the overall planning process due to technical limitations. Nonetheless, it shows to be a useful technology where it allows for higher user engagement and a clearer understanding among users in planning projects. Additionally, in participation, the technology offers a motivational solution and creates an overall higher acceptance and awareness of the plan, making the participants more engaged and represented in the planning process.

增强现实正在许多领域获得关注。其中之一是参与地理空间规划项目。增强现实的互动性和三维特性,在规划过程中可以满足更高质量的沟通和信息交流。因此,本研究通过开放获取的系统文献综述,概述了AR在规划过程中的使用,特别是在参与方面,为此调查确定了35篇关于当前规划中增强现实技术的文章。调查结果表明,由于技术限制,增强现实在总体规划过程中的使用相当有限。尽管如此,它仍然是一项有用的技术,它允许更高的用户参与,并在规划项目时更清楚地了解用户。此外,在参与方面,该技术提供了一种激励性解决方案,并创造了对计划的总体更高的接受度和认知度,使参与者在计划过程中更加投入和代表性。
{"title":"Augmented reality for supporting geo-spatial planning: An open access review","authors":"Reint Jansen ,&nbsp;Frida Ruiz Mendoza ,&nbsp;William Hurst","doi":"10.1016/j.visinf.2023.07.002","DOIUrl":"10.1016/j.visinf.2023.07.002","url":null,"abstract":"<div><p>Augmented reality is gaining traction across many domains. One of these is participation within geo-spatial planning projects. The interactive and three-dimensional nature of augmented reality is suitably placed to cater for a higher quality of communication and information exchange in planning processes. Thus, this research provides an overview of the use of AR in planning processes, specifically regarding the participation aspect, through an open-access systematic literature review, for which the investigation identifies 35 articles concerning the current state-of-the-art of augmented reality in planning. Findings indicate the rather limited use of augmented reality in the overall planning process due to technical limitations. Nonetheless, it shows to be a useful technology where it allows for higher user engagement and a clearer understanding among users in planning projects. Additionally, in participation, the technology offers a motivational solution and creates an overall higher acceptance and awareness of the plan, making the participants more engaged and represented in the planning process.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 4","pages":"Pages 1-12"},"PeriodicalIF":3.0,"publicationDate":"2023-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000360/pdfft?md5=490153cba97e8e194080ec3bb1c39e03&pid=1-s2.0-S2468502X23000360-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85988098","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Towards the automation of book typesetting 走向图书排版的自动化
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-06-01 DOI: 10.1016/j.visinf.2023.01.003
Sérgio M. Rebelo, Tiago Martins, Diogo Ferreira, Artur Rebelo

This paper proposes a generative approach for the automatic typesetting of books in desktop publishing. The presented system consists in a computer script that operates inside a widely used design software tool and implements a generative process based on several typographic rules, styles and principles which have been identified in the literature. The performance of the proposed system is tested through an experiment which included the evaluation of its outputs with people. The results reveal the ability of the system to consistently create varied book designs from the same input content as well as visually coherent book designs with different contents while complying with fundamental typographic principles.

本文提出了一种在桌面出版中实现图书自动排版的生成方法。所提出的系统由一个计算机脚本组成,该脚本在一个广泛使用的设计软件工具中运行,并基于文献中确定的几种印刷规则、风格和原则实现生成过程。通过实验测试了所提出的系统的性能,其中包括与人一起评估其输出。结果表明,该系统能够根据相同的输入内容一致地创建不同的书籍设计,以及在符合基本排版原则的情况下,具有不同内容的视觉连贯的书籍设计。
{"title":"Towards the automation of book typesetting","authors":"Sérgio M. Rebelo,&nbsp;Tiago Martins,&nbsp;Diogo Ferreira,&nbsp;Artur Rebelo","doi":"10.1016/j.visinf.2023.01.003","DOIUrl":"https://doi.org/10.1016/j.visinf.2023.01.003","url":null,"abstract":"<div><p>This paper proposes a generative approach for the automatic typesetting of books in desktop publishing. The presented system consists in a computer script that operates inside a widely used design software tool and implements a generative process based on several typographic rules, styles and principles which have been identified in the literature. The performance of the proposed system is tested through an experiment which included the evaluation of its outputs with people. The results reveal the ability of the system to consistently create varied book designs from the same input content as well as visually coherent book designs with different contents while complying with fundamental typographic principles.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 2","pages":"Pages 1-12"},"PeriodicalIF":3.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49709963","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
NetPrune: A sparklines visualization for network pruning NetPrune:网络修剪的火花线可视化
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-06-01 DOI: 10.1016/j.visinf.2023.04.001
Luc-Etienne Pommé, Romain Bourqui, Romain Giot, Jason Vallet, David Auber

Current deep learning approaches are cutting-edge methods for solving classification tasks. Arising transfer learning techniques allows applying large generic model to simple tasks whereas simpler models could be used. Large models raise the major problem of their memory consumption and processor usage and lead to a prohibitive ecological footprint. In that paper, we present a novel visual analytics approach to interactively prune those networks and thus limit that issue. Our technique leverages a novel sparkline matrix visualization technique as well as a novel local metric which evaluates the discriminatory power of a filter to guide the pruning process and make it interpretable. We assess the well- founded of our approach through two realistic case studies and a user study. For both of them, the interactive refinement of the model led to a significantly smaller model having similar prediction accuracy than the original one.

当前的深度学习方法是解决分类任务的前沿方法。出现的迁移学习技术允许将大型通用模型应用于简单的任务,而可以使用更简单的模型。大型模型带来了内存消耗和处理器使用的主要问题,并导致了令人望而却步的生态足迹。在这篇论文中,我们提出了一种新的视觉分析方法来交互式地修剪这些网络,从而限制这个问题。我们的技术利用了一种新的sparkline矩阵可视化技术以及一种评估滤波器判别能力的新的局部度量来指导修剪过程并使其具有可解释性。我们通过两个现实的案例研究和一个用户研究来评估我们的方法的充分性。对于他们两人来说,模型的交互式细化导致了一个明显更小的模型,其预测精度与原始模型相似。
{"title":"NetPrune: A sparklines visualization for network pruning","authors":"Luc-Etienne Pommé,&nbsp;Romain Bourqui,&nbsp;Romain Giot,&nbsp;Jason Vallet,&nbsp;David Auber","doi":"10.1016/j.visinf.2023.04.001","DOIUrl":"https://doi.org/10.1016/j.visinf.2023.04.001","url":null,"abstract":"<div><p>Current deep learning approaches are cutting-edge methods for solving classification tasks. Arising transfer learning techniques allows applying large generic model to simple tasks whereas simpler models could be used. Large models raise the major problem of their memory consumption and processor usage and lead to a prohibitive ecological footprint. In that paper, we present a novel visual analytics approach to interactively prune those networks and thus limit that issue. Our technique leverages a novel sparkline matrix visualization technique as well as a novel local metric which evaluates the discriminatory power of a filter to guide the pruning process and make it interpretable. We assess the well- founded of our approach through two realistic case studies and a user study. For both of them, the interactive refinement of the model led to a significantly smaller model having similar prediction accuracy than the original one.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 2","pages":"Pages 85-99"},"PeriodicalIF":3.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49709998","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Tax-Scheduler: An interactive visualization system for staff shifting and scheduling at tax authorities tax - scheduler:税务机关人员排班和排班的交互式可视化系统
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-06-01 DOI: 10.1016/j.visinf.2023.02.001
Linping Yuan , Boyu Li , Siqi Li , Kam Kwai Wong , Rong Zhang , Huamin Qu

Given a large number of applications and complex processing procedures, how to efficiently shift and schedule tax officers to provide good services to taxpayers is now receiving more attention from tax authorities. The availability of historical application data makes it possible for tax managers to shift and schedule staff with data support, but it is unclear how to properly leverage the historical data. To investigate the problem, this study adopts a user-centered design approach. We first collect user requirements by conducting interviews with tax managers and characterize their requirements of shifting and scheduling into time series prediction and resource scheduling problems. Then, we propose Tax-Scheduler, an interactive visualization system with a time-series prediction algorithm and genetic algorithm to support staff shifting and scheduling in the tax scenarios. To evaluate the effectiveness of the system and understand how non-technical tax managers react to the system with advanced algorithms and visualizations, we conduct user interviews with tax managers and distill several implications for future system design.

鉴于申请数量庞大,处理程序复杂,如何有效地调动和安排税务人员为纳税人提供良好服务,现在正受到税务部门的更多关注。历史应用程序数据的可用性使税务经理有可能在数据支持下转移和安排员工,但尚不清楚如何正确利用历史数据。为了研究这个问题,本研究采用了以用户为中心的设计方法。我们首先通过采访税务经理来收集用户需求,并将他们的转移和调度需求描述为时间序列预测和资源调度问题。然后,我们提出了Tax Scheduler,这是一个具有时间序列预测算法和遗传算法的交互式可视化系统,用于支持税务场景中的人员转移和调度。为了评估系统的有效性,并了解非技术性税务经理如何通过高级算法和可视化对系统做出反应,我们对税务经理进行了用户访谈,并提取了对未来系统设计的一些启示。
{"title":"Tax-Scheduler: An interactive visualization system for staff shifting and scheduling at tax authorities","authors":"Linping Yuan ,&nbsp;Boyu Li ,&nbsp;Siqi Li ,&nbsp;Kam Kwai Wong ,&nbsp;Rong Zhang ,&nbsp;Huamin Qu","doi":"10.1016/j.visinf.2023.02.001","DOIUrl":"https://doi.org/10.1016/j.visinf.2023.02.001","url":null,"abstract":"<div><p>Given a large number of applications and complex processing procedures, how to efficiently shift and schedule tax officers to provide good services to taxpayers is now receiving more attention from tax authorities. The availability of historical application data makes it possible for tax managers to shift and schedule staff with data support, but it is unclear how to properly leverage the historical data. To investigate the problem, this study adopts a user-centered design approach. We first collect user requirements by conducting interviews with tax managers and characterize their requirements of shifting and scheduling into time series prediction and resource scheduling problems. Then, we propose Tax-Scheduler, an interactive visualization system with a time-series prediction algorithm and genetic algorithm to support staff shifting and scheduling in the tax scenarios. To evaluate the effectiveness of the system and understand how non-technical tax managers react to the system with advanced algorithms and visualizations, we conduct user interviews with tax managers and distill several implications for future system design.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 2","pages":"Pages 30-40"},"PeriodicalIF":3.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49732551","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A visual analytics workflow for probabilistic modeling 用于概率建模的可视化分析工作流
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-06-01 DOI: 10.1016/j.visinf.2023.05.001
Julien Klaus, Mark Blacher, Andreas Goral, Philipp Lucas, Joachim Giesen

Probabilistic programming is a powerful means for formally specifying machine learning models. The inference engine of a probabilistic programming environment can be used for serving complex queries on these models. Most of the current research in probabilistic programming is dedicated to the design and implementation of highly efficient inference engines. Much less research aims at making the power of these inference engines accessible to non-expert users. Probabilistic programming means writing code. Yet many potential users from promising application areas such as the social sciences lack programming skills. This prompted recent efforts in synthesizing probabilistic programs directly from data. However, working with synthesized programs still requires the user to read, understand, and write some code, for instance, when invoking the inference engine for answering queries. Here, we present an interactive visual approach to synthesizing and querying probabilistic programs that does not require the user to read or write code.

概率规划是正式指定机器学习模型的一种强大手段。概率编程环境的推理引擎可以用于为这些模型上的复杂查询提供服务。目前概率规划中的大多数研究都致力于高效推理引擎的设计和实现。旨在让非专家用户能够使用这些推理引擎的研究要少得多。概率编程意味着编写代码。然而,许多来自社会科学等有前景的应用领域的潜在用户缺乏编程技能。这促使最近努力直接从数据中综合概率程序。然而,使用合成程序仍然需要用户阅读、理解和编写一些代码,例如,在调用推理引擎回答查询时。在这里,我们提出了一种交互式可视化方法来合成和查询概率程序,该方法不需要用户读或写代码。
{"title":"A visual analytics workflow for probabilistic modeling","authors":"Julien Klaus,&nbsp;Mark Blacher,&nbsp;Andreas Goral,&nbsp;Philipp Lucas,&nbsp;Joachim Giesen","doi":"10.1016/j.visinf.2023.05.001","DOIUrl":"https://doi.org/10.1016/j.visinf.2023.05.001","url":null,"abstract":"<div><p>Probabilistic programming is a powerful means for formally specifying machine learning models. The inference engine of a probabilistic programming environment can be used for serving complex queries on these models. Most of the current research in probabilistic programming is dedicated to the design and implementation of highly efficient inference engines. Much less research aims at making the power of these inference engines accessible to non-expert users. Probabilistic programming means writing code. Yet many potential users from promising application areas such as the social sciences lack programming skills. This prompted recent efforts in synthesizing probabilistic programs directly from data. However, working with synthesized programs still requires the user to read, understand, and write some code, for instance, when invoking the inference engine for answering queries. Here, we present an interactive visual approach to synthesizing and querying probabilistic programs that does not require the user to read or write code.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 2","pages":"Pages 72-84"},"PeriodicalIF":3.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49709997","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Visual interpretation for contextualized word representation 语境化词表示的视觉解释
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-06-01 DOI: 10.1016/j.visinf.2023.06.002
Syu-Ting Deng, Cheng-Jun Tsai, Pei-Chen Chang, Ko-Chih Wang
{"title":"Visual interpretation for contextualized word representation","authors":"Syu-Ting Deng, Cheng-Jun Tsai, Pei-Chen Chang, Ko-Chih Wang","doi":"10.1016/j.visinf.2023.06.002","DOIUrl":"https://doi.org/10.1016/j.visinf.2023.06.002","url":null,"abstract":"","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"16 1","pages":""},"PeriodicalIF":3.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"87198436","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
DTBVis: An interactive visual comparison system for digital twin brain and human brain 数字孪生脑:数字孪生脑与人脑的交互式视觉比较系统
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-06-01 DOI: 10.1016/j.visinf.2023.02.002
Yuxiao Li , Xinhong Li , Siqi Shen , Longbin Zeng , Richen Liu , Qibao Zheng , Jianfeng Feng , Siming Chen

The digital twin brain (DTB) computing model from brain-inspired computing research is an emerging artificial intelligence technique, which is realized by a computational modeling approach of hardware and software. It can achieve various cognitive abilities and their synergistic mechanisms in a manner similar to the human brain. Given that the task of the DTB is to simulate the functions of the human brain, comparing the similarities and differences between the two is crucial. However, the visualization study of the DTB is still under-researched. Moreover, the complexity of the datasets (multilevel spatiotemporal granularity and different types of comparison tasks) presents new challenges to the analysis and exploration of visualization. Therefore, in this study, we proposed DTBVis, a visual analytics system that supports comparison tasks for the DTB. DTBVis supports iterative explorations from different levels and at different granularities. Combined with automatic similarity recommendation, and high-dimensional exploration, DTBVis can assist experts in understanding the similarities and differences between the DTB and the human brain, thus helping them adjust their model and enhance its functionality. The highest level of DTBVis shows an overview of the datasets from the brain, which is used for comparison and exploration of the function and structure of the DTB and the human brain. The medium level is used for the comparison and exploration of a designated brain region. The low level can analyze a designated brain voxel. We worked closely with experts of brain science and held regular seminars with them. Feedback from the experts indicates that our approach helps them conduct comparative studies of the DTB and human brain and make modeling adjustments of the DTB through intuitive visual comparisons and interactive explorations.

基于脑启发计算研究的数字双脑计算模型是一种新兴的人工智能技术,它是通过硬件和软件的计算建模方法实现的。它可以以类似于人脑的方式实现各种认知能力及其协同机制。鉴于DTB的任务是模拟人脑的功能,比较两者之间的异同至关重要。然而,DTB的可视化研究仍处于研究阶段。此外,数据集的复杂性(多级时空粒度和不同类型的比较任务)对可视化的分析和探索提出了新的挑战。因此,在本研究中,我们提出了DTBVis,这是一个支持DTB比较任务的视觉分析系统。DTBVis支持不同层次、不同粒度的迭代探索。结合自动相似性推荐和高维探索,DTBVis可以帮助专家了解DTB和人脑之间的异同,从而帮助他们调整模型并增强其功能。DTBVis的最高级别显示了大脑数据集的概述,用于比较和探索DTB和人脑的功能和结构。中等水平用于对指定的大脑区域进行比较和探索。低级别可以分析指定的大脑体素。我们与脑科学专家密切合作,并定期与他们举行研讨会。专家的反馈表明,我们的方法有助于他们对DTB和人脑进行比较研究,并通过直观的视觉比较和互动探索对DTB进行建模调整。
{"title":"DTBVis: An interactive visual comparison system for digital twin brain and human brain","authors":"Yuxiao Li ,&nbsp;Xinhong Li ,&nbsp;Siqi Shen ,&nbsp;Longbin Zeng ,&nbsp;Richen Liu ,&nbsp;Qibao Zheng ,&nbsp;Jianfeng Feng ,&nbsp;Siming Chen","doi":"10.1016/j.visinf.2023.02.002","DOIUrl":"https://doi.org/10.1016/j.visinf.2023.02.002","url":null,"abstract":"<div><p>The digital twin brain (DTB) computing model from brain-inspired computing research is an emerging artificial intelligence technique, which is realized by a computational modeling approach of hardware and software. It can achieve various cognitive abilities and their synergistic mechanisms in a manner similar to the human brain. Given that the task of the DTB is to simulate the functions of the human brain, comparing the similarities and differences between the two is crucial. However, the visualization study of the DTB is still under-researched. Moreover, the complexity of the datasets (multilevel spatiotemporal granularity and different types of comparison tasks) presents new challenges to the analysis and exploration of visualization. Therefore, in this study, we proposed DTBVis, a visual analytics system that supports comparison tasks for the DTB. DTBVis supports iterative explorations from different levels and at different granularities. Combined with automatic similarity recommendation, and high-dimensional exploration, DTBVis can assist experts in understanding the similarities and differences between the DTB and the human brain, thus helping them adjust their model and enhance its functionality. The highest level of DTBVis shows an overview of the datasets from the brain, which is used for comparison and exploration of the function and structure of the DTB and the human brain. The medium level is used for the comparison and exploration of a designated brain region. The low level can analyze a designated brain voxel. We worked closely with experts of brain science and held regular seminars with them. Feedback from the experts indicates that our approach helps them conduct comparative studies of the DTB and human brain and make modeling adjustments of the DTB through intuitive visual comparisons and interactive explorations.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 2","pages":"Pages 41-53"},"PeriodicalIF":3.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49732158","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 3
Design and validation of a navigation system of multimodal medical images for neurosurgery based on mixed reality 基于混合现实的神经外科多模态医学图像导航系统设计与验证
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-06-01 DOI: 10.1016/j.visinf.2023.05.003
Zeyang Zhou , Zhiyong Yang , Shan Jiang , Tao Zhu , Shixing Ma , Yuhua Li , Jie Zhuo

Purpose:

This paper aims to develop a navigation system based on mixed reality, which can display multimodal medical images in an immersive environment and help surgeons locate the target area and surrounding important tissues precisely.

Methods:

To be displayed properly in mixed reality, medical images are processed in this system. High-quality cerebral vessels and nerve fibers with proper colors are reconstructed and exported to mixed reality environment. Multimodal images and models are registered and fused, extracting their key information. The multiple processed images are fused with the real patient in the same coordinate system to guide the surgery.

Results:

The multimodal image system is designed and validated properly. In phantom experiments, the average error of preoperative registration is 1.003 mm and the standard deviation is 0.096 mm. The average proportion of well-registered areas is 94.9%. In patient experiments, the surgeons who participated in the experiments generally indicated that the system had excellent performance and great application prospect for neurosurgery.

Conclusion:

This article proposes a navigation system of multimodal images for neurosurgery based on mixed reality. Compared with other navigation methods, this system can help surgeons locate the target area and surrounding important tissues more precisely and rapidly.

目的:本文旨在开发一种基于混合现实的导航系统,该系统可以在沉浸式环境中显示多模式医学图像,并帮助外科医生精确定位目标区域和周围重要组织。方法:在该系统中对医学图像进行处理,以使其在混合现实中正确显示。高质量的脑血管和具有适当颜色的神经纤维被重建并输出到混合现实环境中。对多模式图像和模型进行配准和融合,提取其关键信息。将多个处理后的图像与同一坐标系中的真实患者融合,以指导手术。结果:设计并验证了该多模式图像系统。在体模实验中,术前配准的平均误差为1.003 mm,标准偏差为0.096 mm。配准良好区域的平均比例为94.9%。在患者实验中,参与实验的外科医生普遍表示,该系统具有优异的性能,在神经外科有很大的应用前景。结论:本文提出了一种基于混合现实的神经外科多模式图像导航系统。与其他导航方法相比,该系统可以帮助外科医生更准确、快速地定位目标区域和周围重要组织。
{"title":"Design and validation of a navigation system of multimodal medical images for neurosurgery based on mixed reality","authors":"Zeyang Zhou ,&nbsp;Zhiyong Yang ,&nbsp;Shan Jiang ,&nbsp;Tao Zhu ,&nbsp;Shixing Ma ,&nbsp;Yuhua Li ,&nbsp;Jie Zhuo","doi":"10.1016/j.visinf.2023.05.003","DOIUrl":"https://doi.org/10.1016/j.visinf.2023.05.003","url":null,"abstract":"<div><h3>Purpose:</h3><p>This paper aims to develop a navigation system based on mixed reality, which can display multimodal medical images in an immersive environment and help surgeons locate the target area and surrounding important tissues precisely.</p></div><div><h3>Methods:</h3><p>To be displayed properly in mixed reality, medical images are processed in this system. High-quality cerebral vessels and nerve fibers with proper colors are reconstructed and exported to mixed reality environment. Multimodal images and models are registered and fused, extracting their key information. The multiple processed images are fused with the real patient in the same coordinate system to guide the surgery.</p></div><div><h3>Results:</h3><p>The multimodal image system is designed and validated properly. In phantom experiments, the average error of preoperative registration is 1.003 mm and the standard deviation is 0.096 mm. The average proportion of well-registered areas is 94.9%. In patient experiments, the surgeons who participated in the experiments generally indicated that the system had excellent performance and great application prospect for neurosurgery.</p></div><div><h3>Conclusion:</h3><p>This article proposes a navigation system of multimodal images for neurosurgery based on mixed reality. Compared with other navigation methods, this system can help surgeons locate the target area and surrounding important tissues more precisely and rapidly.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 2","pages":"Pages 64-71"},"PeriodicalIF":3.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49709995","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Importance guided stream surface generation and feature exploration 重要的是导流面生成和特征勘探
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-06-01 DOI: 10.1016/j.visinf.2023.05.002
Kunhua Su, Jun Zhang, Deyue Xie, Jun Tao

Exploring flow features and patterns hidden behind the data has received extensive academic attention in flow visualization. In this paper, we introduce an importance-guided surface generation and exploration scheme to explore the features and their connections. The features are expressed as an importance field, which can either be derived from a scalar field or be specified as a flow pattern. Guided by the importance field, we sample a pool of seeding curves along the binormal direction and construct stream surfaces to fit the regions of high- importance values. Our scheme evaluates candidate seeding curves by collecting importance scores from the curve and corresponding streamlines. The candidate seeding curves are refined using the high-score segments to identify the optimal surfaces. Comparative visualization among different kinds of flow features across time steps can be easily derived for flow structure analysis. In order to reduce the visual complexity, we leverage SurfRiver to achieve clearer observation by flattening and aligning the surface. Finally, we apply our surface generation scheme guided by flow patterns and scalar fields to evaluate the effectiveness of the proposed tool.

在流动可视化中,探索隐藏在数据背后的流动特征和模式受到了学术界的广泛关注。在本文中,我们介绍了一种重要的引导曲面生成和探索方案,以探索这些特征及其联系。特征被表示为重要性字段,该字段可以从标量字段导出,也可以指定为流动模式。在重要性场的指导下,我们沿着副法线方向对种子曲线池进行采样,并构建流表面来拟合高重要性值的区域。我们的方案通过从曲线和相应的流线中收集重要性分数来评估候选种子曲线。使用高分分段来细化候选种子曲线,以识别最佳表面。跨时间步长的不同类型的流动特征之间的比较可视化可以很容易地导出用于流动结构分析。为了降低视觉复杂性,我们利用SurfRiver通过压平和对齐表面来实现更清晰的观察。最后,我们应用由流型和标量场引导的曲面生成方案来评估所提出工具的有效性。
{"title":"Importance guided stream surface generation and feature exploration","authors":"Kunhua Su,&nbsp;Jun Zhang,&nbsp;Deyue Xie,&nbsp;Jun Tao","doi":"10.1016/j.visinf.2023.05.002","DOIUrl":"https://doi.org/10.1016/j.visinf.2023.05.002","url":null,"abstract":"<div><p>Exploring flow features and patterns hidden behind the data has received extensive academic attention in flow visualization. In this paper, we introduce an importance-guided surface generation and exploration scheme to explore the features and their connections. The features are expressed as an importance field, which can either be derived from a scalar field or be specified as a flow pattern. Guided by the importance field, we sample a pool of seeding curves along the binormal direction and construct stream surfaces to fit the regions of high- importance values. Our scheme evaluates candidate seeding curves by collecting importance scores from the curve and corresponding streamlines. The candidate seeding curves are refined using the high-score segments to identify the optimal surfaces. Comparative visualization among different kinds of flow features across time steps can be easily derived for flow structure analysis. In order to reduce the visual complexity, we leverage SurfRiver to achieve clearer observation by flattening and aligning the surface. Finally, we apply our surface generation scheme guided by flow patterns and scalar fields to evaluate the effectiveness of the proposed tool.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 2","pages":"Pages 54-63"},"PeriodicalIF":3.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49709994","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
INPHOVIS: Interactive visual analytics for smartphone-based digital phenotyping INPHOVIS:基于智能手机的数字表型交互式可视化分析
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-06-01 DOI: 10.1016/j.visinf.2023.01.002
Hamid Mansoor, Walter Gerych, Abdulaziz Alajaji, Luke Buquicchio, Kavin Chandrasekaran, Emmanuel Agu, Elke Rundensteiner, Angela Incollingo Rodriguez

Digital phenotyping is the characterization of human behavior patterns based on data from digital devices such as smartphones in order to gain insights into the users’ state and especially to identify ailments. To support supervised machine learning, digital phenotyping requires gathering data from study participants’ smartphones as they live their lives. Periodically, participants are then asked to provide ground truth labels about their health status. Analyzing such complex data is challenging due to limited contextual information and imperfect health/wellness labels. We propose INteractive PHOne-o-typing VISualization (INPHOVIS), an interactive visual framework for exploratory analysis of smartphone health data to study phone-o-types. Prior visualization work has focused on mobile health data with clear semantics such as steps or heart rate data collected using dedicated health devices and wearables such as smartwatches. However, unlike smartphones which are owned by over 85 percent of the US population, wearable devices are less prevalent thus reducing the number of people from whom such data can be collected. In contrast, the “low-level” sensor data (e.g., accelerometer or GPS data) supported by INPHOVIS can be easily collected using smartphones. Data visualizations are designed to provide the essential contextualization of such data and thus help analysts discover complex relationships between observed sensor values and health-predictive phone-o-types. To guide the design of INPHOVIS, we performed a hierarchical task analysis of phone-o-typing requirements with health domain experts. We then designed and implemented multiple innovative visualizations integral to INPHOVIS including stacked bar charts to show diurnal behavioral patterns, calendar views to visualize day-level data along with bar charts, and correlation views to visualize important wellness predictive data. We demonstrate the usefulness of INPHOVIS with walk-throughs of use cases. We also evaluated INPHOVIS with expert feedback and received encouraging responses.

数字表型是基于智能手机等数字设备的数据对人类行为模式进行表征,以深入了解用户的状态,尤其是识别疾病。为了支持有监督的机器学习,数字表型需要在研究参与者生活时从他们的智能手机中收集数据。然后,参与者被要求定期提供有关其健康状况的基本事实标签。由于有限的上下文信息和不完善的健康/健康标签,分析这种复杂的数据具有挑战性。我们提出了INPHOVIS,这是一个交互式视觉框架,用于探索性分析智能手机健康数据,以研究手机类型。先前的可视化工作侧重于具有清晰语义的移动健康数据,如使用专用健康设备和智能手表等可穿戴设备收集的步数或心率数据。然而,与85%以上的美国人口拥有的智能手机不同,可穿戴设备并不普及,因此减少了可以收集此类数据的人数。相比之下,INPHOVIS支持的“低级别”传感器数据(例如加速度计或GPS数据)可以使用智能手机轻松收集。数据可视化旨在提供此类数据的基本上下文,从而帮助分析人员发现观察到的传感器值和健康预测电话类型之间的复杂关系。为了指导INPHOVIS的设计,我们与健康领域专家一起对电话打字需求进行了分层任务分析。然后,我们设计并实现了INPHOVIS集成的多个创新可视化,包括显示昼夜行为模式的堆叠条形图、显示日级数据的日历视图以及条形图,以及显示重要健康预测数据的相关性视图。我们通过用例演练展示了INPHOVIS的有用性。我们还利用专家反馈对INPHOVIS进行了评估,并收到了令人鼓舞的回复。
{"title":"INPHOVIS: Interactive visual analytics for smartphone-based digital phenotyping","authors":"Hamid Mansoor,&nbsp;Walter Gerych,&nbsp;Abdulaziz Alajaji,&nbsp;Luke Buquicchio,&nbsp;Kavin Chandrasekaran,&nbsp;Emmanuel Agu,&nbsp;Elke Rundensteiner,&nbsp;Angela Incollingo Rodriguez","doi":"10.1016/j.visinf.2023.01.002","DOIUrl":"https://doi.org/10.1016/j.visinf.2023.01.002","url":null,"abstract":"<div><p>Digital phenotyping is the characterization of human behavior patterns based on data from digital devices such as smartphones in order to gain insights into the users’ state and especially to identify ailments. To support supervised machine learning, digital phenotyping requires gathering data from study participants’ smartphones as they live their lives. Periodically, participants are then asked to provide ground truth labels about their health status. Analyzing such complex data is challenging due to limited contextual information and imperfect health/wellness labels. We propose INteractive PHOne-o-typing VISualization (INPHOVIS), an interactive visual framework for exploratory analysis of smartphone health data to study phone-o-types. Prior visualization work has focused on mobile health data with clear semantics such as steps or heart rate data collected using dedicated health devices and wearables such as smartwatches. However, unlike smartphones which are owned by over 85 percent of the US population, wearable devices are less prevalent thus reducing the number of people from whom such data can be collected. In contrast, the “low-level” sensor data (e.g., accelerometer or GPS data) supported by INPHOVIS can be easily collected using smartphones. Data visualizations are designed to provide the essential contextualization of such data and thus help analysts discover complex relationships between observed sensor values and health-predictive phone-o-types. To guide the design of INPHOVIS, we performed a hierarchical task analysis of phone-o-typing requirements with health domain experts. We then designed and implemented multiple innovative visualizations integral to INPHOVIS including stacked bar charts to show diurnal behavioral patterns, calendar views to visualize day-level data along with bar charts, and correlation views to visualize important wellness predictive data. We demonstrate the usefulness of INPHOVIS with walk-throughs of use cases. We also evaluated INPHOVIS with expert feedback and received encouraging responses.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 2","pages":"Pages 13-29"},"PeriodicalIF":3.0,"publicationDate":"2023-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49732550","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
期刊
Visual Informatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1