首页 > 最新文献

Visual Informatics最新文献

英文 中文
VisCI: A visualization framework for anomaly detection and interactive optimization of composite index VisCI:用于异常检测和交互式优化综合指数的可视化框架
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-04-20 DOI: 10.1016/j.visinf.2024.04.001
Zhiguang Zhou , Yize Li , Yuna Ni , Weiwen Xu , Guoting Hu , Ying Lai , Peixiong Chen , Weihua Su

Composite index is always derived with the weighted aggregation of hierarchical components, which is widely utilized to distill intricate and multidimensional matters in economic and business statistics. However, the composite indices always present inevitable anomalies at different levels oriented from the calculation and expression processes of hierarchical components, thereby impairing the precise depiction of specific economic issues. In this paper, we propose VisCI, a visualization framework for anomaly detection and interactive optimization of composite index. First, LSTM-AE model is performed to detect anomalies from the lower level to the higher level of the composite index. Then, a comprehensive array of visual cues is designed to visualize anomalies, such as hierarchy and anomaly visualization. In addition, an interactive operation is provided to ensure accurate and efficient index optimization, mitigating the adverse impact of anomalies on index calculation and representation. Finally, we implement a visualization framework with interactive interfaces, facilitating both anomaly detection and intuitive composite index optimization. Case studies based on real-world datasets and expert interviews are conducted to demonstrate the effectiveness of our VisCI in commodity index anomaly exploration and anomaly optimization.

综合指数总是通过分层成分的加权汇总得出的,在经济和商业统计中被广泛用于提炼错综复杂的多维问题。然而,在分层成分的计算和表达过程中,综合指数总是不可避免地在不同层面出现异常,从而影响了对具体经济问题的精确描述。在本文中,我们提出了用于异常检测和交互式优化综合指数的可视化框架 VisCI。首先,通过 LSTM-AE 模型检测综合指数从低层到高层的异常情况。然后,设计了一系列全面的视觉线索来可视化异常,如层次结构和异常可视化。此外,我们还提供了一种交互式操作,以确保准确高效地优化索引,减轻异常情况对索引计算和表示的不利影响。最后,我们实施了一个具有交互界面的可视化框架,为异常检测和直观的复合索引优化提供了便利。我们基于真实世界数据集和专家访谈进行了案例研究,以证明我们的 VisCI 在商品指数异常检测和异常优化方面的有效性。
{"title":"VisCI: A visualization framework for anomaly detection and interactive optimization of composite index","authors":"Zhiguang Zhou ,&nbsp;Yize Li ,&nbsp;Yuna Ni ,&nbsp;Weiwen Xu ,&nbsp;Guoting Hu ,&nbsp;Ying Lai ,&nbsp;Peixiong Chen ,&nbsp;Weihua Su","doi":"10.1016/j.visinf.2024.04.001","DOIUrl":"10.1016/j.visinf.2024.04.001","url":null,"abstract":"<div><p>Composite index is always derived with the weighted aggregation of hierarchical components, which is widely utilized to distill intricate and multidimensional matters in economic and business statistics. However, the composite indices always present inevitable anomalies at different levels oriented from the calculation and expression processes of hierarchical components, thereby impairing the precise depiction of specific economic issues. In this paper, we propose VisCI, a visualization framework for anomaly detection and interactive optimization of composite index. First, LSTM-AE model is performed to detect anomalies from the lower level to the higher level of the composite index. Then, a comprehensive array of visual cues is designed to visualize anomalies, such as hierarchy and anomaly visualization. In addition, an interactive operation is provided to ensure accurate and efficient index optimization, mitigating the adverse impact of anomalies on index calculation and representation. Finally, we implement a visualization framework with interactive interfaces, facilitating both anomaly detection and intuitive composite index optimization. Case studies based on real-world datasets and expert interviews are conducted to demonstrate the effectiveness of our VisCI in commodity index anomaly exploration and anomaly optimization.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"8 2","pages":"Pages 1-12"},"PeriodicalIF":3.0,"publicationDate":"2024-04-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X24000147/pdfft?md5=e75183915943bf3b9b9ca949c47ab656&pid=1-s2.0-S2468502X24000147-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140793971","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
DiffMat: Latent diffusion models for image-guided material generation DiffMat:用于图像引导材料生成的潜在扩散模型
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-03-01 DOI: 10.1016/j.visinf.2023.12.001
Liang Yuan , Dingkun Yan , Suguru Saito , Issei Fujishiro

Creating realistic materials is essential in the construction of immersive virtual environments. While existing techniques for material capture and conditional generation rely on flash-lit photos, they often produce artifacts when the illumination mismatches the training data. In this study, we introduce DiffMat, a novel diffusion model that integrates the CLIP image encoder and a multi-layer, cross-attention denoising backbone to generate latent materials from images under various illuminations. Using a pre-trained StyleGAN-based material generator, our method converts these latent materials into high-resolution SVBRDF textures, a process that enables a seamless fit into the standard physically based rendering pipeline, reducing the requirements for vast computational resources and expansive datasets. DiffMat surpasses existing generative methods in terms of material quality and variety, and shows adaptability to a broader spectrum of lighting conditions in reference images.

创建逼真的材料对于构建身临其境的虚拟环境至关重要。虽然现有的材料捕捉和条件生成技术依赖于闪光灯照亮的照片,但当光照与训练数据不匹配时,这些技术往往会产生伪影。在这项研究中,我们引入了 DiffMat,这是一种新型扩散模型,它集成了 CLIP 图像编码器和多层交叉注意力去噪骨干,可从各种光照下的图像生成潜在材料。我们的方法使用预先训练好的基于 StyleGAN 的材料生成器,将这些潜在材料转换为高分辨率 SVBRDF 纹理,这一过程可无缝融入基于物理的标准渲染管道,从而降低对大量计算资源和庞大数据集的要求。DiffMat 在材质质量和多样性方面超越了现有的生成方法,并能适应参考图像中更广泛的光照条件。
{"title":"DiffMat: Latent diffusion models for image-guided material generation","authors":"Liang Yuan ,&nbsp;Dingkun Yan ,&nbsp;Suguru Saito ,&nbsp;Issei Fujishiro","doi":"10.1016/j.visinf.2023.12.001","DOIUrl":"10.1016/j.visinf.2023.12.001","url":null,"abstract":"<div><p>Creating realistic materials is essential in the construction of immersive virtual environments. While existing techniques for material capture and conditional generation rely on flash-lit photos, they often produce artifacts when the illumination mismatches the training data. In this study, we introduce DiffMat, a novel diffusion model that integrates the CLIP image encoder and a multi-layer, cross-attention denoising backbone to generate latent materials from images under various illuminations. Using a pre-trained StyleGAN-based material generator, our method converts these latent materials into high-resolution SVBRDF textures, a process that enables a seamless fit into the standard physically based rendering pipeline, reducing the requirements for vast computational resources and expansive datasets. DiffMat surpasses existing generative methods in terms of material quality and variety, and shows adaptability to a broader spectrum of lighting conditions in reference images.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"8 1","pages":"Pages 6-14"},"PeriodicalIF":3.0,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X24000019/pdfft?md5=fb0200304a9b292debbf18a3162d10e8&pid=1-s2.0-S2468502X24000019-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139396034","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Empirically evaluating virtual reality’s effect on reservoir engineering tasks 实证评估虚拟现实对油藏工程任务的影响
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-03-01 DOI: 10.1016/j.visinf.2023.11.002
Bryson Lawton , Nanjia Wang , Steven Samoil , Parisa Daeijavad , Siqi Xie , Zhangxin Chen , Frank Maurer

To help determine in what ways virtual reality (VR) technologies may benefit reservoir engineering workflows, we conducted a usability study on a prototype VR tool for performing reservoir model analysis tasks. By leveraging the strengths of VR technologies, this tool’s aim is to help advance reservoir analysis workflows beyond conventional methods by improving how one understands, analyzes, and interacts with reservoir model visualizations. To evaluate our tool’s VR approach to this, the study presented herein was conducted with reservoir engineering experts who used the VR tool to perform three common reservoir model analysis tasks: the spatial filtering of model cells using movable planes, the cross-comparison of multiple models, and well path planning. Our study found that accomplishing these tasks with the VR tool was generally regarded as easier, quicker, more effective, and more intuitive than traditional model analysis software while maintaining a feeling of low task workload on average. Overall, participants provided positive feedback regarding their experience with using VR to perform reservoir engineering work tasks, and in general, it was found to improve multi-model cross-analysis and rough object manipulation in 3D. This indicates the potential for VR to be better than conventional means for some work tasks and participants also expressed they could see it best utilized as an addition to current software in their reservoir model analysis workflows. There were, however, some concerns voiced when considering the full adoption of VR into their work that would be best first addressed before this took place.

为了帮助确定虚拟现实(VR)技术在哪些方面可以使油藏工程工作流程受益,我们对用于执行油藏模型分析任务的 VR 工具原型进行了可用性研究。通过利用虚拟现实技术的优势,该工具旨在通过改善人们对油藏模型可视化的理解、分析和交互方式,帮助推进油藏分析工作流程,使其超越传统方法。为了评估我们工具的 VR 方法,本文介绍的研究是与油藏工程专家一起进行的,他们使用 VR 工具执行了三项常见的油藏模型分析任务:使用可移动平面对模型单元进行空间过滤、对多个模型进行交叉比较以及油井路径规划。我们的研究发现,与传统的模型分析软件相比,人们普遍认为使用 VR 工具完成这些任务更简单、更快捷、更有效、更直观,同时平均感觉任务工作量不大。总体而言,参与者对使用 VR 执行水库工程工作任务的体验给予了积极反馈,并普遍认为 VR 可改善多模型交叉分析和三维粗略对象操作。这表明,在某些工作任务中,VR 有可能比传统方法更好。参与者还表示,在他们的油藏模型分析工作流程中,VR 可以作为现有软件的补充。不过,在考虑在工作中全面采用 VR 时,与会者也提出了一些顾虑,最好是在采用 VR 之前先解决这些顾虑。
{"title":"Empirically evaluating virtual reality’s effect on reservoir engineering tasks","authors":"Bryson Lawton ,&nbsp;Nanjia Wang ,&nbsp;Steven Samoil ,&nbsp;Parisa Daeijavad ,&nbsp;Siqi Xie ,&nbsp;Zhangxin Chen ,&nbsp;Frank Maurer","doi":"10.1016/j.visinf.2023.11.002","DOIUrl":"https://doi.org/10.1016/j.visinf.2023.11.002","url":null,"abstract":"<div><p>To help determine in what ways virtual reality (VR) technologies may benefit reservoir engineering workflows, we conducted a usability study on a prototype VR tool for performing reservoir model analysis tasks. By leveraging the strengths of VR technologies, this tool’s aim is to help advance reservoir analysis workflows beyond conventional methods by improving how one understands, analyzes, and interacts with reservoir model visualizations. To evaluate our tool’s VR approach to this, the study presented herein was conducted with reservoir engineering experts who used the VR tool to perform three common reservoir model analysis tasks: the spatial filtering of model cells using movable planes, the cross-comparison of multiple models, and well path planning. Our study found that accomplishing these tasks with the VR tool was generally regarded as easier, quicker, more effective, and more intuitive than traditional model analysis software while maintaining a feeling of low task workload on average. Overall, participants provided positive feedback regarding their experience with using VR to perform reservoir engineering work tasks, and in general, it was found to improve multi-model cross-analysis and rough object manipulation in 3D. This indicates the potential for VR to be better than conventional means for some work tasks and participants also expressed they could see it best utilized as an addition to current software in their reservoir model analysis workflows. There were, however, some concerns voiced when considering the full adoption of VR into their work that would be best first addressed before this took place.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"8 1","pages":"Pages 26-46"},"PeriodicalIF":3.0,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000542/pdfft?md5=1b711e1ac53d26ef09020082f01a69a6&pid=1-s2.0-S2468502X23000542-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140339085","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Malicious webshell family dataset for webshell multi-classification research 用于 Webhell 多分类研究的恶意 Webhell 系列数据集
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-03-01 DOI: 10.1016/j.visinf.2023.06.008
Ying Zhao , Shenglan Lv , Wenwei Long , Yilun Fan , Jian Yuan , Haojin Jiang , Fangfang Zhou

Malicious webshells currently present tremendous threats to cloud security. Most relevant studies and open webshell datasets consider malicious webshell defense as a binary classification problem, that is, identifying whether a webshell is malicious or benign. However, a fine-grained multi-classification is urgently needed to enable precise responses and active defenses on malicious webshell threats. This paper introduces a malicious webshell family dataset named MWF to facilitate webshell multi-classification researches. This dataset contains 1359 malicious webshell samples originally obtained from the cloud servers of Alibaba Cloud. Each of them is provided with a family label. The samples of the same family generally present similar characteristics or behaviors. The dataset has a total of 78 families and 22 outliers. Moreover, this paper introduces the human–machine collaboration process that is adopted to remove benign or duplicate samples, address privacy issues, and determine the family of each sample. This paper also compares the distinguished features of the MWF dataset with previous datasets and summarizes the potential applied areas in cloud security and generalized sequence, graph, and tree data analytics and visualization.

目前,恶意 webshell 对云安全构成了巨大威胁。大多数相关研究和开放式 webshell 数据集将恶意 webshell 防御视为二元分类问题,即识别 webshell 是恶意还是良性。然而,要实现对恶意 webshell 威胁的精确响应和主动防御,迫切需要一种细粒度的多分类方法。本文介绍了一个名为 MWF 的恶意 webshell 系列数据集,以促进 webshell 多分类研究。该数据集包含 1359 个恶意 webshell 样本,这些样本最初来自阿里云的云服务器。每个样本都有一个家族标签。同一家族的样本一般具有相似的特征或行为。该数据集共有 78 个族和 22 个异常值。此外,本文还介绍了人机协作流程,该流程用于去除良性或重复样本、解决隐私问题以及确定每个样本的族。本文还比较了 MWF 数据集与以往数据集的显著特点,并总结了在云安全和广义序列、图和树数据分析及可视化方面的潜在应用领域。
{"title":"Malicious webshell family dataset for webshell multi-classification research","authors":"Ying Zhao ,&nbsp;Shenglan Lv ,&nbsp;Wenwei Long ,&nbsp;Yilun Fan ,&nbsp;Jian Yuan ,&nbsp;Haojin Jiang ,&nbsp;Fangfang Zhou","doi":"10.1016/j.visinf.2023.06.008","DOIUrl":"10.1016/j.visinf.2023.06.008","url":null,"abstract":"<div><p>Malicious webshells currently present tremendous threats to cloud security. Most relevant studies and open webshell datasets consider malicious webshell defense as a binary classification problem, that is, identifying whether a webshell is malicious or benign. However, a fine-grained multi-classification is urgently needed to enable precise responses and active defenses on malicious webshell threats. This paper introduces a malicious webshell family dataset named MWF to facilitate webshell multi-classification researches. This dataset contains 1359 malicious webshell samples originally obtained from the cloud servers of Alibaba Cloud. Each of them is provided with a family label. The samples of the same family generally present similar characteristics or behaviors. The dataset has a total of 78 families and 22 outliers. Moreover, this paper introduces the human–machine collaboration process that is adopted to remove benign or duplicate samples, address privacy issues, and determine the family of each sample. This paper also compares the distinguished features of the MWF dataset with previous datasets and summarizes the potential applied areas in cloud security and generalized sequence, graph, and tree data analytics and visualization.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"8 1","pages":"Pages 47-55"},"PeriodicalIF":3.0,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000335/pdfft?md5=0e04b6b31402572c03a419f9b7597a47&pid=1-s2.0-S2468502X23000335-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75769287","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
TCEVis: Visual analytics of traffic congestion influencing factors based on explainable machine learning TCEVis:基于可解释机器学习的交通拥堵影响因素可视化分析
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-03-01 DOI: 10.1016/j.visinf.2023.11.003
Jialu Dong , Huijie Zhang , Meiqi Cui , Yiming Lin , Hsiang-Yun Wu , Chongke Bi

Traffic congestion is becoming increasingly severe as a result of urbanization, which not only impedes people’s ability to travel but also hinders the economic development of cities. Modeling the correlation between congestion and its influencing factors using machine learning methods makes it possible to quickly identify congested road segments. Due to the intrinsic black-box character of machine learning models, it is difficult for experts to trust the decision results of road congestion prediction models and understand the significance of congestion-causing factors. In this paper, we present a model interpretability method to investigate the potential causes of traffic congestion and quantify the importance of various influencing factors using the SHAP method. Due to the multidimensionality of these factors, it can be challenging to visually represent the impact of all factors. In response, we propose TCEVis, an interactive visual analytics system that enables multi-level exploration of road conditions. Through three case studies utilizing actual data, we demonstrate that the TCEVis system offers advantages for assisting traffic managers in analyzing the causes of traffic congestion and elucidating the significance of various influencing factors.

随着城市化的发展,交通拥堵问题日益严重,这不仅阻碍了人们的出行,也阻碍了城市的经济发展。利用机器学习方法对交通拥堵及其影响因素之间的相关性进行建模,可以快速识别拥堵路段。由于机器学习模型固有的黑箱特性,专家很难相信道路拥堵预测模型的决策结果,也很难理解造成拥堵因素的重要性。本文提出了一种模型可解释性方法,利用 SHAP 方法研究交通拥堵的潜在原因并量化各种影响因素的重要性。由于这些因素的多维性,要直观地表示所有因素的影响可能具有挑战性。为此,我们提出了 TCEVis,这是一个交互式可视化分析系统,可对道路状况进行多层次探索。通过利用实际数据进行的三个案例研究,我们证明了 TCEVis 系统在协助交通管理人员分析交通拥堵原因和阐明各种影响因素的重要性方面所具有的优势。
{"title":"TCEVis: Visual analytics of traffic congestion influencing factors based on explainable machine learning","authors":"Jialu Dong ,&nbsp;Huijie Zhang ,&nbsp;Meiqi Cui ,&nbsp;Yiming Lin ,&nbsp;Hsiang-Yun Wu ,&nbsp;Chongke Bi","doi":"10.1016/j.visinf.2023.11.003","DOIUrl":"https://doi.org/10.1016/j.visinf.2023.11.003","url":null,"abstract":"<div><p>Traffic congestion is becoming increasingly severe as a result of urbanization, which not only impedes people’s ability to travel but also hinders the economic development of cities. Modeling the correlation between congestion and its influencing factors using machine learning methods makes it possible to quickly identify congested road segments. Due to the intrinsic black-box character of machine learning models, it is difficult for experts to trust the decision results of road congestion prediction models and understand the significance of congestion-causing factors. In this paper, we present a model interpretability method to investigate the potential causes of traffic congestion and quantify the importance of various influencing factors using the SHAP method. Due to the multidimensionality of these factors, it can be challenging to visually represent the impact of all factors. In response, we propose TCEVis, an interactive visual analytics system that enables multi-level exploration of road conditions. Through three case studies utilizing actual data, we demonstrate that the TCEVis system offers advantages for assisting traffic managers in analyzing the causes of traffic congestion and elucidating the significance of various influencing factors.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"8 1","pages":"Pages 56-66"},"PeriodicalIF":3.0,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000530/pdfft?md5=71c05bc362850cbe9f83fb75c6e85e7f&pid=1-s2.0-S2468502X23000530-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140341083","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Autoencoder-based conditional optimal transport generative adversarial network for medical image generation 基于自动编码器的条件优化传输生成对抗网络用于医学图像生成
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-03-01 DOI: 10.1016/j.visinf.2023.11.001
Jun Wang , Bohan Lei , Liya Ding , Xiaoyin Xu , Xianfeng Gu , Min Zhang

Medical image generation has recently garnered significant interest among researchers. However, the primary generative models, such as Generative Adversarial Networks (GANs), often encounter challenges during training, including mode collapse. To address these issues, we proposed the AE-COT-GAN model (Autoencoder-based Conditional Optimal Transport Generative Adversarial Network) for the generation of medical images belonging to specific categories. The training process of our model comprises three fundamental components. The training process of our model encompasses three fundamental components. First, we employ an autoencoder model to obtain a low-dimensional manifold representation of real images. Second, we apply extended semi-discrete optimal transport to map Gaussian noise distribution to the latent space distribution and obtain corresponding labels effectively. This procedure leads to the generation of new latent codes with known labels. Finally, we integrate a GAN to train the decoder further to generate medical images. To evaluate the performance of the AE-COT-GAN model, we conducted experiments on two medical image datasets, namely DermaMNIST and BloodMNIST. The model’s performance was compared with state-of-the-art generative models. Results show that the AE-COT-GAN model had excellent performance in generating medical images. Moreover, it effectively addressed the common issues associated with traditional GANs.

医学图像生成最近引起了研究人员的极大兴趣。然而,主要的生成模型,如生成对抗网络(GAN),在训练过程中经常会遇到模式崩溃等挑战。为了解决这些问题,我们提出了 AE-COT-GAN 模型(基于自动编码器的条件优化传输生成对抗网络),用于生成属于特定类别的医学图像。我们模型的训练过程包括三个基本组成部分。我们模型的训练过程包括三个基本组成部分。首先,我们采用自动编码器模型获得真实图像的低维流形表示。其次,我们应用扩展的半离散最优传输将高斯噪声分布映射到潜空间分布,并有效地获得相应的标签。这一过程可生成带有已知标签的新潜码。最后,我们整合了一个 GAN 来进一步训练解码器,以生成医学图像。为了评估 AE-COT-GAN 模型的性能,我们在两个医学图像数据集(即 DermaMNIST 和 BloodMNIST)上进行了实验。我们将该模型的性能与最先进的生成模型进行了比较。结果表明,AE-COT-GAN 模型在生成医学图像方面表现出色。此外,它还有效地解决了与传统 GAN 相关的常见问题。
{"title":"Autoencoder-based conditional optimal transport generative adversarial network for medical image generation","authors":"Jun Wang ,&nbsp;Bohan Lei ,&nbsp;Liya Ding ,&nbsp;Xiaoyin Xu ,&nbsp;Xianfeng Gu ,&nbsp;Min Zhang","doi":"10.1016/j.visinf.2023.11.001","DOIUrl":"https://doi.org/10.1016/j.visinf.2023.11.001","url":null,"abstract":"<div><p>Medical image generation has recently garnered significant interest among researchers. However, the primary generative models, such as Generative Adversarial Networks (GANs), often encounter challenges during training, including mode collapse. To address these issues, we proposed the AE-COT-GAN model (Autoencoder-based Conditional Optimal Transport Generative Adversarial Network) for the generation of medical images belonging to specific categories. The training process of our model comprises three fundamental components. The training process of our model encompasses three fundamental components. First, we employ an autoencoder model to obtain a low-dimensional manifold representation of real images. Second, we apply extended semi-discrete optimal transport to map Gaussian noise distribution to the latent space distribution and obtain corresponding labels effectively. This procedure leads to the generation of new latent codes with known labels. Finally, we integrate a GAN to train the decoder further to generate medical images. To evaluate the performance of the AE-COT-GAN model, we conducted experiments on two medical image datasets, namely DermaMNIST and BloodMNIST. The model’s performance was compared with state-of-the-art generative models. Results show that the AE-COT-GAN model had excellent performance in generating medical images. Moreover, it effectively addressed the common issues associated with traditional GANs.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"8 1","pages":"Pages 15-25"},"PeriodicalIF":3.0,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000529/pdfft?md5=3af566b28e15f895521e10dc5d8d1dbc&pid=1-s2.0-S2468502X23000529-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140339084","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A survey on automatic dashboard recommendation systems 仪表盘自动推荐系统调查
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-03-01 DOI: 10.1016/j.visinf.2024.01.002
Praveen Soni , Cyril de Runz , Fatma Bouali , Gilles Venturini

This paper presents a survey on automatic or semi-automatic recommendation systems that help users create dashboards. It starts by showing the important role that dashboards play in data science, and give an informal definition of dashboards, i.e., a set of visualizations possibly with linkage, a screen layout and user feedback. We are mainly interested in systems that use a fully or partially automatic mechanism to recommend dashboards to users. This automation includes the suggestion of data and visualizations, the optimization of the layout and the use of user feedback. We position our work with respect to existing surveys. Starting from a set of over 1000 papers, we have selected and analyzed 19 papers/systems along several dimensions. The main dimensions were the set of considered visualizations, the suggestion method, the utility/objective functions, the layout, and the user interface. We conclude by highlighting the main achievements in this domain and by proposing perspectives.

本文对帮助用户创建仪表盘的自动或半自动推荐系统进行了调查。本文首先展示了仪表盘在数据科学中扮演的重要角色,并给出了仪表盘的非正式定义,即一组可视化(可能带有链接、屏幕布局和用户反馈)。我们主要关注使用完全或部分自动机制向用户推荐仪表盘的系统。这种自动化包括数据和可视化的建议、布局的优化以及用户反馈的使用。我们将我们的工作定位在现有的调查之上。从 1000 多篇论文开始,我们从多个维度选择并分析了 19 篇论文/系统。主要维度包括所考虑的可视化集合、建议方法、实用/目标功能、布局和用户界面。最后,我们强调了这一领域的主要成就,并提出了展望。
{"title":"A survey on automatic dashboard recommendation systems","authors":"Praveen Soni ,&nbsp;Cyril de Runz ,&nbsp;Fatma Bouali ,&nbsp;Gilles Venturini","doi":"10.1016/j.visinf.2024.01.002","DOIUrl":"10.1016/j.visinf.2024.01.002","url":null,"abstract":"<div><p>This paper presents a survey on automatic or semi-automatic recommendation systems that help users create dashboards. It starts by showing the important role that dashboards play in data science, and give an informal definition of dashboards, i.e., a set of visualizations possibly with linkage, a screen layout and user feedback. We are mainly interested in systems that use a fully or partially automatic mechanism to recommend dashboards to users. This automation includes the suggestion of data and visualizations, the optimization of the layout and the use of user feedback. We position our work with respect to existing surveys. Starting from a set of over 1000 papers, we have selected and analyzed 19 papers/systems along several dimensions. The main dimensions were the set of considered visualizations, the suggestion method, the utility/objective functions, the layout, and the user interface. We conclude by highlighting the main achievements in this domain and by proposing perspectives.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"8 1","pages":"Pages 67-79"},"PeriodicalIF":3.0,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X24000032/pdfft?md5=4f07a8572973789f180c169f5da61d6c&pid=1-s2.0-S2468502X24000032-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139631923","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
An open dataset of data lineage graphs for data governance research 用于数据治理研究的开放式数据集--数据脉络图
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2024-03-01 DOI: 10.1016/j.visinf.2024.01.001
Yunpeng Chen , Ying Zhao , Xuanjing Li , Jiang Zhang , Jiang Long , Fangfang Zhou

Data have become valuable assets for enterprises. Data governance aims to manage and reuse data assets, facilitating enterprise management and enabling product innovations. A data lineage graph (DLG) is an abstracted collection of data assets and their data lineages in data governance. Analyzing DLGs can provide rich data insights for data governance. However, the progress of data governance technologies is hindered by the shortage of available open datasets for DLGs. This paper introduces an open dataset of DLGs, including the DLG model, the dataset construction process, and applied areas. This real-world dataset is sourced from Huawei Cloud Computing Technology Company Limited, which contains 18 DLGs with three types of data assets and two types of relations. To the best of our knowledge, this dataset is the first open dataset of DLGs for data governance. This dataset can also support the development of other application areas, such as graph analytics and visualization.

数据已成为企业的宝贵资产。数据治理旨在管理和重用数据资产,促进企业管理和产品创新。数据脉络图(DLG)是数据治理中数据资产及其数据脉络的抽象集合。分析 DLG 可以为数据治理提供丰富的数据洞察力。然而,由于缺乏可用的 DLG 开放数据集,数据治理技术的发展受到了阻碍。本文介绍了一个 DLG 开放数据集,包括 DLG 模型、数据集构建过程和应用领域。这个真实世界的数据集来自华为云计算技术有限公司,包含 18 个 DLGs,其中有三类数据资产和两类关系。据我们所知,该数据集是首个用于数据治理的 DLGs 开放数据集。该数据集还可支持图分析和可视化等其他应用领域的开发。
{"title":"An open dataset of data lineage graphs for data governance research","authors":"Yunpeng Chen ,&nbsp;Ying Zhao ,&nbsp;Xuanjing Li ,&nbsp;Jiang Zhang ,&nbsp;Jiang Long ,&nbsp;Fangfang Zhou","doi":"10.1016/j.visinf.2024.01.001","DOIUrl":"10.1016/j.visinf.2024.01.001","url":null,"abstract":"<div><p>Data have become valuable assets for enterprises. Data governance aims to manage and reuse data assets, facilitating enterprise management and enabling product innovations. A data lineage graph (DLG) is an abstracted collection of data assets and their data lineages in data governance. Analyzing DLGs can provide rich data insights for data governance. However, the progress of data governance technologies is hindered by the shortage of available open datasets for DLGs. This paper introduces an open dataset of DLGs, including the DLG model, the dataset construction process, and applied areas. This real-world dataset is sourced from Huawei Cloud Computing Technology Company Limited, which contains 18 DLGs with three types of data assets and two types of relations. To the best of our knowledge, this dataset is the first open dataset of DLGs for data governance. This dataset can also support the development of other application areas, such as graph analytics and visualization.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"8 1","pages":"Pages 1-5"},"PeriodicalIF":3.0,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X24000020/pdfft?md5=e1a773bd989e7966f5523d7492f34ffd&pid=1-s2.0-S2468502X24000020-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139636525","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
On generated artistic styles: Image generation experiments with GAN algorithms 关于生成的艺术风格:用GAN算法进行图像生成实验
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-01 DOI: 10.1016/j.visinf.2023.10.005
Jianheng Xiang

As computer graphics technology supports pursuing a photorealistic style, replicated artworks with a photorealistic style overwhelmingly predominate in the computer-generated art circle. Along with the progression of generative technology, this trend may make generative art a virtual world of photorealistic fake, in which the single criterion of expressive style imperils art into the context of a single boring stereotype. This article focuses on the issue of style diversity and its technical feasibility by artistic experiments of generating flower images in StyleGAN. The author insisted that photo both technology and artistic style should not be confined merely for realistic purposes. This proposition was validated in the GAN generation experiment by changing the training materials.

由于计算机图形技术支持追求逼真的风格,因此具有逼真风格的复制艺术品在计算机生成艺术界占据了压倒性的优势。随着生成技术的发展,这种趋势可能会使生成艺术成为一个逼真的虚拟世界,在这个世界中,表达风格的单一标准使艺术陷入单一乏味的刻板印象。本文通过在StyleGAN中生成花卉图像的艺术实验,探讨了风格多样性问题及其技术可行性。作者坚持认为,摄影技术和艺术风格不应仅仅局限于现实目的。通过改变训练材料,在GAN生成实验中验证了这一命题。
{"title":"On generated artistic styles: Image generation experiments with GAN algorithms","authors":"Jianheng Xiang","doi":"10.1016/j.visinf.2023.10.005","DOIUrl":"10.1016/j.visinf.2023.10.005","url":null,"abstract":"<div><p>As computer graphics technology supports pursuing a photorealistic style, replicated artworks with a photorealistic style overwhelmingly predominate in the computer-generated art circle. Along with the progression of generative technology, this trend may make generative art a virtual world of photorealistic fake, in which the single criterion of expressive style imperils art into the context of a single boring stereotype. This article focuses on the issue of style diversity and its technical feasibility by artistic experiments of generating flower images in StyleGAN. The author insisted that photo both technology and artistic style should not be confined merely for realistic purposes. This proposition was validated in the GAN generation experiment by changing the training materials.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 4","pages":"Pages 36-40"},"PeriodicalIF":3.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000505/pdfft?md5=0d5b9b7ecd516c8f2a86795017a23204&pid=1-s2.0-S2468502X23000505-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135614582","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
X-Space: Interaction design of extending mixed reality space from Web2D visualization X-Space:从Web2D可视化扩展混合现实空间的交互设计
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-01 DOI: 10.1016/j.visinf.2023.10.001
Tiemeng Li , Songqian Wu , Yanning Jin , Haopai Shi , Shiran Liu

Mixed reality offers a larger visualization space and more intuitive means of interaction for data exploration, and many works have been dedicated to combining 2D visualizations on screen with mixe reality. However, for each combination, we need to customize the implementation of the corresponding mixed reality 3D visualization. It is a challenge to simplify this development process and enable agile building of mixed reality 3D visualizations for 2D visualizations. In addition, many existing 2D visualizations do not provide interfaces oriented to immersive analytics, so how to extend the mixed reality 3D space from existing 2D visualizations is another challenge. This work presents an agile and flexible approach to interactively transfer visualizations from 2D screens to mixed reality 3D spaces. We designed an interactive process for spatial generation of mixed-reality 3D visualizations, defined a unified data transfer framework, integrated data deconstruction techniques for 2D visualizations, implemented interfaces to immersive visualization building tool-kits, and encapsulated these techniques into a tool named X-Space. We validated that the approach is feasible and effective through 2D visualization cases including scatter plots, stacked bar charts, and adjacency matrix. Finally, we conducted expert interviews to discuss the usability and value of the method.

混合现实为数据探索提供了更大的可视化空间和更直观的交互手段,许多作品致力于将屏幕上的2D可视化与混合现实相结合。但是,对于每种组合,我们都需要定制实现相应的混合现实3D可视化。简化这一开发过程并为2D可视化实现混合现实3D可视化的敏捷构建是一项挑战。此外,许多现有的2D可视化没有提供面向沉浸式分析的界面,因此如何从现有的2D可视化扩展混合现实3D空间是另一个挑战。这项工作提出了一种敏捷和灵活的方法,以交互方式将可视化从2D屏幕转移到混合现实3D空间。我们设计了混合现实三维可视化空间生成的交互流程,定义了统一的数据传输框架,集成了二维可视化的数据解构技术,实现了沉浸式可视化构建工具包的接口,并将这些技术封装到一个名为X-Space的工具中。通过散点图、堆叠条形图和邻接矩阵等二维可视化实例验证了该方法的可行性和有效性。最后,我们进行了专家访谈,以讨论该方法的可用性和价值。
{"title":"X-Space: Interaction design of extending mixed reality space from Web2D visualization","authors":"Tiemeng Li ,&nbsp;Songqian Wu ,&nbsp;Yanning Jin ,&nbsp;Haopai Shi ,&nbsp;Shiran Liu","doi":"10.1016/j.visinf.2023.10.001","DOIUrl":"10.1016/j.visinf.2023.10.001","url":null,"abstract":"<div><p>Mixed reality offers a larger visualization space and more intuitive means of interaction for data exploration, and many works have been dedicated to combining 2D visualizations on screen with mixe reality. However, for each combination, we need to customize the implementation of the corresponding mixed reality 3D visualization. It is a challenge to simplify this development process and enable agile building of mixed reality 3D visualizations for 2D visualizations. In addition, many existing 2D visualizations do not provide interfaces oriented to immersive analytics, so how to extend the mixed reality 3D space from existing 2D visualizations is another challenge. This work presents an agile and flexible approach to interactively transfer visualizations from 2D screens to mixed reality 3D spaces. We designed an interactive process for spatial generation of mixed-reality 3D visualizations, defined a unified data transfer framework, integrated data deconstruction techniques for 2D visualizations, implemented interfaces to immersive visualization building tool-kits, and encapsulated these techniques into a tool named X-Space. We validated that the approach is feasible and effective through 2D visualization cases including scatter plots, stacked bar charts, and adjacency matrix. Finally, we conducted expert interviews to discuss the usability and value of the method.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 4","pages":"Pages 73-83"},"PeriodicalIF":3.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000463/pdfft?md5=327ef25e16772308cc175a2c6dfa9aec&pid=1-s2.0-S2468502X23000463-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135654708","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Visual Informatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1