首页 > 最新文献

Visual Informatics最新文献

英文 中文
Simplifying social networks via triangle-based cohesive subgraphs 通过基于三角形的内聚子图简化社会网络
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-01 DOI: 10.1016/j.visinf.2023.07.003
Rusheng Pan , Yunhai Wang , Jiashun Sun , Hongbo Liu , Ying Zhao , Jiazhi Xia , Wei Chen

One main challenge for simplifying node-link diagrams of large-scale social networks lies in that simplified graphs generally contain dense subgroups or cohesive subgraphs. Graph triangles quantify the solid and stable relationships that maintain cohesive subgraphs. Understanding the mechanism of triangles within cohesive subgraphs contributes to illuminating patterns of connections within social networks. However, prior works can hardly handle and visualize triangles in cohesive subgraphs. In this paper, we propose a triangle-based graph simplification approach that can filter and visualize cohesive subgraphs by leveraging a triangle-connectivity called k-truss and a force-directed algorithm. We design and implement TriGraph, a web-based visual interface that provides detailed information for exploring and analyzing social networks. Quantitative comparisons with existing methods, two case studies on real-world datasets, and feedback from domain experts demonstrate the effectiveness of TriGraph.

简化大型社交网络的节点链接图的一个主要挑战在于,简化的图通常包含密集的子组或内聚子图。图三角形量化了维持内聚子图的坚实和稳定的关系。了解内聚子图中三角形的机制有助于阐明社会网络中的连接模式。然而,以往的研究很难处理和可视化内聚子图中的三角形。在本文中,我们提出了一种基于三角形的图简化方法,该方法可以通过利用称为k-truss的三角形连接和力定向算法来过滤和可视化内聚子图。我们设计并实现了triggraph,一个基于网络的可视化界面,为探索和分析社交网络提供详细的信息。与现有方法的定量比较,对现实世界数据集的两个案例研究以及领域专家的反馈证明了triggraph的有效性。
{"title":"Simplifying social networks via triangle-based cohesive subgraphs","authors":"Rusheng Pan ,&nbsp;Yunhai Wang ,&nbsp;Jiashun Sun ,&nbsp;Hongbo Liu ,&nbsp;Ying Zhao ,&nbsp;Jiazhi Xia ,&nbsp;Wei Chen","doi":"10.1016/j.visinf.2023.07.003","DOIUrl":"10.1016/j.visinf.2023.07.003","url":null,"abstract":"<div><p>One main challenge for simplifying node-link diagrams of large-scale social networks lies in that simplified graphs generally contain dense subgroups or cohesive subgraphs. Graph triangles quantify the solid and stable relationships that maintain cohesive subgraphs. Understanding the mechanism of triangles within cohesive subgraphs contributes to illuminating patterns of connections within social networks. However, prior works can hardly handle and visualize triangles in cohesive subgraphs. In this paper, we propose a triangle-based graph simplification approach that can filter and visualize cohesive subgraphs by leveraging a triangle-connectivity called <span><math><mi>k</mi></math></span>-truss and a force-directed algorithm. We design and implement TriGraph, a web-based visual interface that provides detailed information for exploring and analyzing social networks. Quantitative comparisons with existing methods, two case studies on real-world datasets, and feedback from domain experts demonstrate the effectiveness of TriGraph.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 4","pages":"Pages 84-94"},"PeriodicalIF":3.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000347/pdfft?md5=9f8781159cb5084af8adc00c529e2a37&pid=1-s2.0-S2468502X23000347-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72536742","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
KnowU social teleprompter: Interaction design applied to intervention therapy for language decline in early AD patients KnowU社交提词器:交互设计在早期AD患者语言能力下降干预治疗中的应用
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-01 DOI: 10.1016/j.visinf.2023.10.004
Yi Wu , Minghong Zheng , Changqing Weng

Art therapy as an intervention has been shown to alleviate social impairment in people with AD. Meanwhile, digital technology (DTS) has been shown to perform well in different degenerative dementias through mobile devices and apps. However, it is unclear whether digital art creation therapy has an impact on the speech function of people with early AD. Therefore, the aim of this study was to confirm whether digital art creation therapy has an ameliorating effect on language decline in AD patients through the KnowU social teleprompter. This study was a controlled trial in which 16 patients with early AD worked with us and were divided into a paper-based art creation therapy group (control group) and a KnowU social teleprompter therapy group for a 6-week intervention. In the digital art creation intervention group we introduced the KnowU digital kit, consisting of a creation plug-in for the Procreate app on a tablet and a wearable device and its app. The entire treatment process is recorded and combined with a quantitative analysis of the McNemar χ2 test to analyze the differences in outcomes of verbal communication function in early AD patients after different therapies. Ultimately, it is shown that early AD patients utilizing​ the KnowU social teleprompter are more effective in the intervention treatment of language decline in the real social domain compared to the paper-based art creation therapy group. The discussion further demonstrates that DTs and art therapy can provide a better social experience, creative approach and emotional recall of language loss in early AD patients, as well as increase the collaborative relationship between early AD patients and their caregivers.

艺术疗法作为一种干预手段已被证明可以减轻阿尔茨海默病患者的社交障碍。与此同时,数字技术(DTS)已被证明通过移动设备和应用程序在不同的退行性痴呆中表现良好。然而,数字艺术创作疗法是否对早期AD患者的语言功能有影响尚不清楚。因此,本研究的目的是确认数字艺术创作疗法是否通过KnowU社交提词器对AD患者的语言能力下降有改善作用。本研究是一项对照试验,16名早期AD患者与我们一起工作,分为基于纸张的艺术创作治疗组(对照组)和KnowU社交提词器治疗组,进行为期6周的干预。在数字艺术创作干预组,我们引入了KnowU数字工具包,包括平板电脑上的Procreate应用程序的创作插件和可穿戴设备及其应用程序。记录整个治疗过程,并结合McNemar χ2检验的定量分析,分析不同治疗后早期AD患者言语沟通功能结局的差异。最终,研究表明,使用KnowU社交提词器的早期AD患者在真实社会领域的语言能力下降的干预治疗中比基于纸张的艺术创作治疗组更有效。讨论进一步表明,DTs和艺术治疗可以为早期AD患者提供更好的社会体验、创造性途径和情感回忆,并增加早期AD患者与其照顾者之间的协作关系。
{"title":"KnowU social teleprompter: Interaction design applied to intervention therapy for language decline in early AD patients","authors":"Yi Wu ,&nbsp;Minghong Zheng ,&nbsp;Changqing Weng","doi":"10.1016/j.visinf.2023.10.004","DOIUrl":"10.1016/j.visinf.2023.10.004","url":null,"abstract":"<div><p>Art therapy as an intervention has been shown to alleviate social impairment in people with AD. Meanwhile, digital technology (DTS) has been shown to perform well in different degenerative dementias through mobile devices and apps. However, it is unclear whether digital art creation therapy has an impact on the speech function of people with early AD. Therefore, the aim of this study was to confirm whether digital art creation therapy has an ameliorating effect on language decline in AD patients through the KnowU social teleprompter. This study was a controlled trial in which 16 patients with early AD worked with us and were divided into a paper-based art creation therapy group (control group) and a KnowU social teleprompter therapy group for a 6-week intervention. In the digital art creation intervention group we introduced the KnowU digital kit, consisting of a creation plug-in for the Procreate app on a tablet and a wearable device and its app. The entire treatment process is recorded and combined with a quantitative analysis of the McNemar <span><math><mi>χ</mi></math></span>2 test to analyze the differences in outcomes of verbal communication function in early AD patients after different therapies. Ultimately, it is shown that early AD patients utilizing​ the KnowU social teleprompter are more effective in the intervention treatment of language decline in the real social domain compared to the paper-based art creation therapy group. The discussion further demonstrates that DTs and art therapy can provide a better social experience, creative approach and emotional recall of language loss in early AD patients, as well as increase the collaborative relationship between early AD patients and their caregivers.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 4","pages":"Pages 95-99"},"PeriodicalIF":3.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000487/pdfft?md5=35ae9418ed9642f3582f9831393a0416&pid=1-s2.0-S2468502X23000487-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135455325","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Corrigendum to “The Use of Facial Expressions in Measuring Students’ Interaction with Distance Learning Environments During the COVID-19 Crisis” Visual Informatics, Volume 7, Issue 1, March 2023, Pages 1–17 在 COVID-19 危机中使用面部表情测量学生与远程学习环境的互动》的更正,《视觉信息学》,第 7 卷第 1 期,2023 年 3 月,第 1-17 页
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-01 DOI: 10.1016/j.visinf.2022.12.001
Waleed Maqableh , Faisal Y. Alzyoud , Jamal Zraqou
{"title":"Corrigendum to “The Use of Facial Expressions in Measuring Students’ Interaction with Distance Learning Environments During the COVID-19 Crisis” Visual Informatics, Volume 7, Issue 1, March 2023, Pages 1–17","authors":"Waleed Maqableh ,&nbsp;Faisal Y. Alzyoud ,&nbsp;Jamal Zraqou","doi":"10.1016/j.visinf.2022.12.001","DOIUrl":"10.1016/j.visinf.2022.12.001","url":null,"abstract":"","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 4","pages":"Page 115"},"PeriodicalIF":3.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9747742/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10374441","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Visualization of isomorphism-synesthesia of colour and music 同构的可视化--色彩和音乐的共鸣
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-01 DOI: 10.1016/j.visinf.2023.10.006
Xue Mao, Jie Xu, Jiahong Lang, Shangshu Zhang

Music and colour, as human hearing and visual art, are closely related to human psychological feelings and symbolic associations. There is an isomorphic relationship between music and colour. The article uses the concept of “synesthesia” in psychology and the “co-construction” relationship in mathematics as a bridge, based on Kandinsky’s “inner sound” theory and Mallion’s “tone-colour system”, an interdisciplinary theoretical model of “timbre isomorphism synesthesia” (ISCM) is constructed. At the practical level, based on the ISCM theory, a set of timbre synesthesia visualization tools ASAH and visualization processes are designed, through music data input, graphics mapping visualization, colour mapping visualization, real-time interactive visualization, and finally output timbre synesthesia visualization works. In order to avoid the visual homogenization caused by algorithm design, ASHA has set up a custom editor, which emphasizes the individual differences and multi-sensory experience of tonal synesthesia visualization.

音乐和色彩作为人的听觉和视觉艺术,与人的心理感受和符号联想密切相关。音乐和色彩之间有一种同构关系。本文以心理学中的“联觉”概念和数学中的“共构”关系为桥梁,以康定斯基的“内在声音”理论和马列恩的“音色系统”为基础,构建了一个跨学科的“音色同构联觉”理论模型。在实践层面,基于ISCM理论,设计了一套音色联觉可视化工具ASAH和可视化流程,通过音乐数据输入、图形映射可视化、色彩映射可视化、实时交互可视化,最终输出音色联觉可视化作品。为了避免算法设计造成的视觉同质化,ASHA设置了自定义编辑器,强调了调性联觉可视化的个体差异和多感官体验。
{"title":"Visualization of isomorphism-synesthesia of colour and music","authors":"Xue Mao,&nbsp;Jie Xu,&nbsp;Jiahong Lang,&nbsp;Shangshu Zhang","doi":"10.1016/j.visinf.2023.10.006","DOIUrl":"10.1016/j.visinf.2023.10.006","url":null,"abstract":"<div><p>Music and colour, as human hearing and visual art, are closely related to human psychological feelings and symbolic associations. There is an isomorphic relationship between music and colour. The article uses the concept of “synesthesia” in psychology and the “co-construction” relationship in mathematics as a bridge, based on Kandinsky’s “inner sound” theory and Mallion’s “tone-colour system”, an interdisciplinary theoretical model of “timbre isomorphism synesthesia” (ISCM) is constructed. At the practical level, based on the ISCM theory, a set of timbre synesthesia visualization tools ASAH and visualization processes are designed, through music data input, graphics mapping visualization, colour mapping visualization, real-time interactive visualization, and finally output timbre synesthesia visualization works. In order to avoid the visual homogenization caused by algorithm design, ASHA has set up a custom editor, which emphasizes the individual differences and multi-sensory experience of tonal synesthesia visualization.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 4","pages":"Pages 110-114"},"PeriodicalIF":3.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000517/pdfft?md5=680eca924eb901cc315deae17009a9ef&pid=1-s2.0-S2468502X23000517-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135455178","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Exploring and visualizing temporal relations in multivariate time series 探索和可视化多元时间序列中的时间关系
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-01 DOI: 10.1016/j.visinf.2023.09.001
Gota Shirato , Natalia Andrienko , Gennady Andrienko

This paper introduces an approach to analyzing multivariate time series (MVTS) data through progressive temporal abstraction of the data into patterns characterizing the behavior of the studied dynamic phenomenon. The paper focuses on two core challenges: identifying basic behavior patterns of individual attributes and examining the temporal relations between these patterns across the range of attributes to derive higher-level abstractions of multi-attribute behavior. The proposed approach combines existing methods for univariate pattern extraction, computation of temporal relations according to the Allen’s time interval algebra, visual displays of the temporal relations, and interactive query operations into a cohesive visual analytics workflow. The paper describes the application of the approach to real-world examples of population mobility data during the COVID-19 pandemic and characteristics of episodes in a football match, illustrating its versatility and effectiveness in understanding composite patterns of interrelated attribute behaviors in MVTS data.

本文介绍了一种分析多变量时间序列(MVTS)数据的方法,该方法将数据逐级时间抽象为表征所研究动态现象行为的模式。本文关注两个核心挑战:识别单个属性的基本行为模式和检查这些模式在属性范围内的时间关系,以获得多属性行为的更高级别抽象。该方法将现有的单变量模式提取方法、基于Allen时间间隔代数的时间关系计算方法、时间关系的可视化显示方法和交互式查询操作方法结合成一个内聚的可视化分析工作流。本文介绍了该方法在COVID-19大流行期间人口流动数据和足球比赛事件特征的实际示例中的应用,说明了其在理解MVTS数据中相互关联属性行为复合模式方面的通用性和有效性。
{"title":"Exploring and visualizing temporal relations in multivariate time series","authors":"Gota Shirato ,&nbsp;Natalia Andrienko ,&nbsp;Gennady Andrienko","doi":"10.1016/j.visinf.2023.09.001","DOIUrl":"10.1016/j.visinf.2023.09.001","url":null,"abstract":"<div><p>This paper introduces an approach to analyzing multivariate time series (MVTS) data through <em>progressive temporal abstraction</em> of the data into <em>patterns</em> characterizing the behavior of the studied dynamic phenomenon. The paper focuses on two core challenges: identifying basic behavior patterns of individual attributes and examining the <em>temporal relations</em> between these patterns across the range of attributes to derive higher-level abstractions of multi-attribute behavior. The proposed approach combines existing methods for univariate pattern extraction, computation of temporal relations according to the Allen’s time interval algebra, visual displays of the temporal relations, and interactive query operations into a cohesive visual analytics workflow. The paper describes the application of the approach to real-world examples of population mobility data during the COVID-19 pandemic and characteristics of episodes in a football match, illustrating its versatility and effectiveness in understanding composite patterns of interrelated attribute behaviors in MVTS data.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 4","pages":"Pages 57-72"},"PeriodicalIF":3.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000396/pdfft?md5=9b0ac41932e7ef9a3c5ba8074dca4e23&pid=1-s2.0-S2468502X23000396-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135347772","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Desirable molecule discovery via generative latent space exploration 通过生成潜在空间探索发现理想分子
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-01 DOI: 10.1016/j.visinf.2023.10.002
Wanjie Zheng, Jie Li, Yang Zhang

Drug molecule design is a classic research topic. Drug experts traditionally design molecules relying on their experience. Manual drug design is time-consuming and may produce low-efficacy and off-target molecules. With the popularity of deep learning, drug experts are beginning to use generative models to design drug molecules. A well-trained generative model can learn the distribution of training samples and infinitely generate drug-like molecules similar to the training samples. The automatic process improves design efficiency. However, most existing methods focus on proposing and optimizing generative models. How to discover ideal molecules from massive candidates is still an unresolved challenge. We propose a visualization system to discover ideal drug molecules generated by generative models. In this paper, we investigated the requirements and issues of drug design experts when using generative models, i.e., generating molecular structures with specific constraints and finding other molecular structures similar to potential drug molecular structures. We formalized the first problem as an optimization problem and proposed using a genetic algorithm to solve it. For the second problem, we proposed using a neighborhood sampling algorithm based on the continuity of the latent space to find solutions. We integrated the proposed algorithms into a visualization tool, and a case study for discovering potential drug molecules to make KOR agonists and experiments demonstrated the utility of our approach.

药物分子设计是一个经典的研究课题。药物专家通常依靠他们的经验来设计分子。人工药物设计耗时长,可能产生低疗效和脱靶分子。随着深度学习的普及,药物专家开始使用生成模型来设计药物分子。一个训练良好的生成模型可以学习训练样本的分布,并无限地生成与训练样本相似的类药物分子。自动化流程提高了设计效率。然而,大多数现有的方法都集中在生成模型的提出和优化上。如何从大量候选分子中发现理想分子仍然是一个未解决的挑战。我们提出了一个可视化系统来发现由生成模型生成的理想药物分子。在本文中,我们研究了药物设计专家在使用生成模型时的要求和问题,即生成具有特定约束的分子结构和寻找与潜在药物分子结构相似的其他分子结构。我们将第一个问题形式化为一个优化问题,并提出使用遗传算法来解决它。对于第二个问题,我们提出了一种基于隐空间连续性的邻域采样算法来求解。我们将提出的算法集成到一个可视化工具中,并进行了一个案例研究,用于发现潜在的药物分子来制造KOR激动剂和实验,证明了我们方法的实用性。
{"title":"Desirable molecule discovery via generative latent space exploration","authors":"Wanjie Zheng,&nbsp;Jie Li,&nbsp;Yang Zhang","doi":"10.1016/j.visinf.2023.10.002","DOIUrl":"10.1016/j.visinf.2023.10.002","url":null,"abstract":"<div><p>Drug molecule design is a classic research topic. Drug experts traditionally design molecules relying on their experience. Manual drug design is time-consuming and may produce low-efficacy and off-target molecules. With the popularity of deep learning, drug experts are beginning to use generative models to design drug molecules. A well-trained generative model can learn the distribution of training samples and infinitely generate drug-like molecules similar to the training samples. The automatic process improves design efficiency. However, most existing methods focus on proposing and optimizing generative models. How to discover ideal molecules from massive candidates is still an unresolved challenge. We propose a visualization system to discover ideal drug molecules generated by generative models. In this paper, we investigated the requirements and issues of drug design experts when using generative models, i.e., generating molecular structures with specific constraints and finding other molecular structures similar to potential drug molecular structures. We formalized the first problem as an optimization problem and proposed using a genetic algorithm to solve it. For the second problem, we proposed using a neighborhood sampling algorithm based on the continuity of the latent space to find solutions. We integrated the proposed algorithms into a visualization tool, and a case study for discovering potential drug molecules to make KOR agonists and experiments demonstrated the utility of our approach.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 4","pages":"Pages 13-21"},"PeriodicalIF":3.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000475/pdfft?md5=6a9b7eb869496bec1ac323f40edb7d54&pid=1-s2.0-S2468502X23000475-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135810245","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
IVMS: An immersive virtual meteorological sandbox based on WYSIWYG IVMS:基于所见即所得的沉浸式虚拟气象沙盒
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-01 DOI: 10.1016/j.visinf.2023.08.001
Hao Hu, Song Wang, Yonghui Chen

A novel approach to visually represent meteorological data has emerged with the maturation of Immersive Analytics (IA). We have proposed an immersive meteorological virtual sandbox as a solution to the limitations of 2D analysis in expressing and perceiving data. This innovative visual method enables users to interact directly with data through non-contact aerial gestures (NCAG). Referring to the “What you see is what you get” concept in scientific visualization, we proposed a novel approach for the visual exploration of meteorological data that aims to immerse users in the analysis process. We hope this approach can inspire immersive visualization techniques for other types of geographic data as well. Finally, we conducted a user questionnaire to evaluate our system and work. The evaluation results demonstrate that our system effectively reduces cognitive burden, alleviates mental workload, and enhances users’ retention of analysis findings.

随着沉浸式分析(IA)的成熟,出现了一种可视化表示气象数据的新方法。我们提出了一个沉浸式气象虚拟沙盒,作为二维分析在表达和感知数据方面的局限性的解决方案。这种创新的视觉方法使用户能够通过非接触式空中手势(NCAG)直接与数据交互。参考科学可视化中的“所见即所得”概念,我们提出了一种新的气象数据可视化探索方法,旨在让用户沉浸在分析过程中。我们希望这种方法也能激发其他类型地理数据的沉浸式可视化技术。最后,我们进行了用户问卷调查来评估我们的系统和工作。评价结果表明,系统有效地减轻了认知负担,减轻了心理负担,增强了用户对分析结果的记忆。
{"title":"IVMS: An immersive virtual meteorological sandbox based on WYSIWYG","authors":"Hao Hu,&nbsp;Song Wang,&nbsp;Yonghui Chen","doi":"10.1016/j.visinf.2023.08.001","DOIUrl":"10.1016/j.visinf.2023.08.001","url":null,"abstract":"<div><p>A novel approach to visually represent meteorological data has emerged with the maturation of Immersive Analytics (IA). We have proposed an immersive meteorological virtual sandbox as a solution to the limitations of 2D analysis in expressing and perceiving data. This innovative visual method enables users to interact directly with data through non-contact aerial gestures (NCAG). Referring to the “What you see is what you get” concept in scientific visualization, we proposed a novel approach for the visual exploration of meteorological data that aims to immerse users in the analysis process. We hope this approach can inspire immersive visualization techniques for other types of geographic data as well. Finally, we conducted a user questionnaire to evaluate our system and work. The evaluation results demonstrate that our system effectively reduces cognitive burden, alleviates mental workload, and enhances users’ retention of analysis findings.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 4","pages":"Pages 100-109"},"PeriodicalIF":3.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000384/pdfft?md5=cc9d521a9365aafbe68c4d864b3827fc&pid=1-s2.0-S2468502X23000384-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"73112441","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A survey of immersive visualization: Focus on perception and interaction 沉浸式可视化研究综述:关注感知与互动
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-01 DOI: 10.1016/j.visinf.2023.10.003
Yue Zhang, Zhenyuan Wang, Jinhui Zhang, Guihua Shan, Dong Tian

Immersive visualization utilizes virtual reality, mixed reality devices, and other interactive devices to create a novel visual environment that integrates multimodal perception and interaction. This technology has been maturing in recent years and has found broad applications in various fields. Based on the latest research advancements in visualization, this paper summarizes the state-of-the-art work in immersive visualization from the perspectives of multimodal perception and interaction in immersive environments, additionally discusses the current hardware foundations of immersive setups. By examining the design patterns and research approaches of previous immersive methods, the paper reveals the design factors for multimodal perception and interaction in current immersive environments. Furthermore, the challenges and development trends of immersive multimodal perception and interaction techniques are discussed, and potential areas of growth in immersive visualization design directions are explored.

沉浸式可视化利用虚拟现实、混合现实设备和其他交互设备来创建集成多模态感知和交互的新颖视觉环境。近年来,该技术日趋成熟,在各个领域都有广泛的应用。本文基于当前可视化领域的最新研究进展,从沉浸式环境下的多模态感知和交互的角度总结了沉浸式可视化研究的最新进展,并讨论了当前沉浸式设备的硬件基础。通过对以往沉浸式方法的设计模式和研究方法的分析,揭示了当前沉浸式环境中多模态感知和交互的设计因素。讨论了沉浸式多模态感知与交互技术面临的挑战和发展趋势,并探讨了沉浸式可视化设计方向的潜在增长领域。
{"title":"A survey of immersive visualization: Focus on perception and interaction","authors":"Yue Zhang,&nbsp;Zhenyuan Wang,&nbsp;Jinhui Zhang,&nbsp;Guihua Shan,&nbsp;Dong Tian","doi":"10.1016/j.visinf.2023.10.003","DOIUrl":"https://doi.org/10.1016/j.visinf.2023.10.003","url":null,"abstract":"<div><p>Immersive visualization utilizes virtual reality, mixed reality devices, and other interactive devices to create a novel visual environment that integrates multimodal perception and interaction. This technology has been maturing in recent years and has found broad applications in various fields. Based on the latest research advancements in visualization, this paper summarizes the state-of-the-art work in immersive visualization from the perspectives of multimodal perception and interaction in immersive environments, additionally discusses the current hardware foundations of immersive setups. By examining the design patterns and research approaches of previous immersive methods, the paper reveals the design factors for multimodal perception and interaction in current immersive environments. Furthermore, the challenges and development trends of immersive multimodal perception and interaction techniques are discussed, and potential areas of growth in immersive visualization design directions are explored.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 4","pages":"Pages 22-35"},"PeriodicalIF":3.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000499/pdfft?md5=ca15c57dc835b96ed696bf3f8614e814&pid=1-s2.0-S2468502X23000499-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138467322","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
TopicBubbler: An interactive visual analytics system for cross-level fine-grained exploration of social media data TopicBubbler:一个交互式可视化分析系统,用于跨级别细粒度的社交媒体数据探索
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-12-01 DOI: 10.1016/j.visinf.2023.08.002
Jielin Feng , Kehao Wu , Siming Chen

How to explore fine-grained but meaningful information from the massive amount of social media data is critical but challenging. To address this challenge, we propose the TopicBubbler, a visual analytics system that supports the cross-level fine-grained exploration of social media data. To achieve the goal of cross-level fine-grained exploration, we propose a new workflow. Under the procedure of the workflow, we construct the fine-grained exploration view through the design of bubble-based word clouds. Each bubble contains two rings that can display information through different levels, and recommends six keywords computed by different algorithms. The view supports users collecting information at different levels and to perform fine-grained selection and exploration across different levels based on keyword recommendations. To enable the users to explore the temporal information and the hierarchical structure, we also construct the Temporal View and Hierarchical View, which satisfy users to view the cross-level dynamic trends and the overview hierarchical structure. In addition, we use the storyline metaphor to enable users to consolidate the fragmented information extracted across levels and topics and ultimately present it as a complete story. Case studies from real-world data confirm the capability of the TopicBubbler from different perspectives, including event mining across levels and topics, and fine-grained mining of specific topics to capture events hidden beneath the surface.

如何从大量的社交媒体数据中挖掘出细粒度但有意义的信息是至关重要但具有挑战性的。为了应对这一挑战,我们提出了TopicBubbler,这是一个可视化分析系统,支持对社交媒体数据进行跨级别细粒度的探索。为了实现跨层细粒度探索的目标,提出了一种新的工作流程。在工作流的流程下,我们通过设计基于气泡的词云来构建细粒度的探索视图。每个气泡包含两个环,可以通过不同的层次显示信息,并推荐六个由不同算法计算出的关键词。该视图支持用户在不同级别收集信息,并根据关键字建议在不同级别执行细粒度选择和探索。为了使用户能够浏览时间信息和层次结构,我们还构建了时间视图和层次视图,以满足用户查看跨层动态趋势和概述层次结构。此外,我们使用故事情节隐喻,使用户能够整合跨关卡和主题提取的碎片信息,并最终将其呈现为一个完整的故事。来自真实世界数据的案例研究从不同的角度证实了TopicBubbler的能力,包括跨级别和主题的事件挖掘,以及对特定主题的细粒度挖掘,以捕获隐藏在表面之下的事件。
{"title":"TopicBubbler: An interactive visual analytics system for cross-level fine-grained exploration of social media data","authors":"Jielin Feng ,&nbsp;Kehao Wu ,&nbsp;Siming Chen","doi":"10.1016/j.visinf.2023.08.002","DOIUrl":"10.1016/j.visinf.2023.08.002","url":null,"abstract":"<div><p>How to explore fine-grained but meaningful information from the massive amount of social media data is critical but challenging. To address this challenge, we propose the TopicBubbler, a visual analytics system that supports the cross-level fine-grained exploration of social media data. To achieve the goal of cross-level fine-grained exploration, we propose a new workflow. Under the procedure of the workflow, we construct the fine-grained exploration view through the design of bubble-based word clouds. Each bubble contains two rings that can display information through different levels, and recommends six keywords computed by different algorithms. The view supports users collecting information at different levels and to perform fine-grained selection and exploration across different levels based on keyword recommendations. To enable the users to explore the temporal information and the hierarchical structure, we also construct the Temporal View and Hierarchical View, which satisfy users to view the cross-level dynamic trends and the overview hierarchical structure. In addition, we use the storyline metaphor to enable users to consolidate the fragmented information extracted across levels and topics and ultimately present it as a complete story. Case studies from real-world data confirm the capability of the TopicBubbler from different perspectives, including event mining across levels and topics, and fine-grained mining of specific topics to capture events hidden beneath the surface.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 4","pages":"Pages 41-56"},"PeriodicalIF":3.0,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2468502X23000372/pdfft?md5=85a43c9c0e54f4a8a3bdc84b5a0a856c&pid=1-s2.0-S2468502X23000372-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76676300","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Perspectives on point cloud-based 3D scene modeling and XR presentation within the cloud-edge-client architecture 基于点云的3D场景建模和云边缘客户端架构内的XR表示的观点
IF 3 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS Pub Date : 2023-09-01 DOI: 10.1016/j.visinf.2023.06.007
Hongjia Wu , Hongxin Zhang , Jiang Cheng , Jianwei Guo , Wei Chen

With the support of edge computing, the synergy and collaboration among central cloud, edge cloud, and terminal devices form an integrated computing ecosystem known as the cloud-edge-client architecture. This integration unlocks the value of data and computational power, presenting significant opportunities for large-scale 3D scene modeling and XR presentation. In this paper, we explore the perspectives and highlight new challenges in 3D scene modeling and XR presentation based on point cloud within the cloud-edge-client integrated architecture. We also propose a novel cloud-edge-client integrated technology framework and a demonstration of municipal governance application to address these challenges.

在边缘计算的支持下,中央云、边缘云和终端设备之间的协同与协作形成了一个被称为云边缘客户端架构的集成计算生态系统。这种集成释放了数据和计算能力的价值,为大规模3D场景建模和XR演示提供了重要机会。在本文中,我们探索了云边缘客户端集成架构中基于点云的3D场景建模和XR表示的前景,并强调了新的挑战。我们还提出了一个新的云边缘客户端集成技术框架和市政治理应用程序演示,以应对这些挑战。
{"title":"Perspectives on point cloud-based 3D scene modeling and XR presentation within the cloud-edge-client architecture","authors":"Hongjia Wu ,&nbsp;Hongxin Zhang ,&nbsp;Jiang Cheng ,&nbsp;Jianwei Guo ,&nbsp;Wei Chen","doi":"10.1016/j.visinf.2023.06.007","DOIUrl":"https://doi.org/10.1016/j.visinf.2023.06.007","url":null,"abstract":"<div><p>With the support of edge computing, the synergy and collaboration among central cloud, edge cloud, and terminal devices form an integrated computing ecosystem known as the cloud-edge-client architecture. This integration unlocks the value of data and computational power, presenting significant opportunities for large-scale 3D scene modeling and XR presentation. In this paper, we explore the perspectives and highlight new challenges in 3D scene modeling and XR presentation based on point cloud within the cloud-edge-client integrated architecture. We also propose a novel cloud-edge-client integrated technology framework and a demonstration of municipal governance application to address these challenges.</p></div>","PeriodicalId":36903,"journal":{"name":"Visual Informatics","volume":"7 3","pages":"Pages 59-64"},"PeriodicalIF":3.0,"publicationDate":"2023-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49708299","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
期刊
Visual Informatics
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1