首页 > 最新文献

Computers & Graphics-Uk最新文献

英文 中文
Editorial Note Computers & Graphics Issue 122 编者按 《计算机与图形》第 122 期
IF 2.5 4区 计算机科学 Q2 COMPUTER SCIENCE, SOFTWARE ENGINEERING Pub Date : 2024-08-01 DOI: 10.1016/j.cag.2024.104032
{"title":"Editorial Note Computers & Graphics Issue 122","authors":"","doi":"10.1016/j.cag.2024.104032","DOIUrl":"10.1016/j.cag.2024.104032","url":null,"abstract":"","PeriodicalId":50628,"journal":{"name":"Computers & Graphics-Uk","volume":"122 ","pages":"Article 104032"},"PeriodicalIF":2.5,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142044340","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Foreword to the special section on 3D object retrieval 2023 symposium (3DOR2023) 2023 年 3D 物体检索专题讨论会(3DOR2023)特别部分前言
IF 2.5 4区 计算机科学 Q2 COMPUTER SCIENCE, SOFTWARE ENGINEERING Pub Date : 2024-08-01 DOI: 10.1016/j.cag.2023.12.007
{"title":"Foreword to the special section on 3D object retrieval 2023 symposium (3DOR2023)","authors":"","doi":"10.1016/j.cag.2023.12.007","DOIUrl":"10.1016/j.cag.2023.12.007","url":null,"abstract":"","PeriodicalId":50628,"journal":{"name":"Computers & Graphics-Uk","volume":"122 ","pages":"Article 103865"},"PeriodicalIF":2.5,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138683131","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Foreword to the special section on SIBGRAPI 2023 SIBGRAPI 2023 特别章节前言
IF 2.5 4区 计算机科学 Q2 COMPUTER SCIENCE, SOFTWARE ENGINEERING Pub Date : 2024-08-01 DOI: 10.1016/j.cag.2023.08.031
{"title":"Foreword to the special section on SIBGRAPI 2023","authors":"","doi":"10.1016/j.cag.2023.08.031","DOIUrl":"10.1016/j.cag.2023.08.031","url":null,"abstract":"","PeriodicalId":50628,"journal":{"name":"Computers & Graphics-Uk","volume":"122 ","pages":"Article 103810"},"PeriodicalIF":2.5,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"129764432","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
From aerial LiDAR point clouds to multiscale urban representation levels by a parametric resampling 通过参数重采样从航空激光雷达点云到多尺度城市表示水平
IF 2.5 4区 计算机科学 Q2 COMPUTER SCIENCE, SOFTWARE ENGINEERING Pub Date : 2024-07-31 DOI: 10.1016/j.cag.2024.104022
Chiara Romanengo, Bianca Falcidieno, Silvia Biasotti

Urban simulations that involve disaster prevention, urban design, and assisted navigation heavily rely on urban geometric models. While large urban areas need a lot of time to be acquired terrestrially, government organizations have already conducted massive aerial LiDAR surveys, some even at the national level. This work aims to provide a pipeline for extracting multi-scale point clouds from 2D building footprints and airborne LiDAR data, which depends on whether the points represent buildings, vegetation, or ground. We denoise the roof slopes, match the vegetation, and roughly recreate the building façades frequently hidden to aerial acquisition using a parametric representation of geometric primitives. We then carry out multiple-scale samplings of the urban geometry until a 3D urban representation can be achieved because we annotate the new version of the original point cloud with the parametric equations representing each part. We mainly tested our methodology in a real-world setting – the city of Genoa – which includes historical buildings and is heavily characterized by irregular ground slopes. Moreover, we present the results of urban reconstruction on part of two other cities, Matera, which has a complex morphology like Genoa, and Rotterdam.

涉及防灾、城市设计和辅助导航的城市模拟在很大程度上依赖于城市几何模型。虽然大面积城市区域的地面采集需要大量时间,但政府组织已经开展了大规模的航空激光雷达勘测,有些甚至是国家级的。这项工作旨在提供一个从二维建筑足迹和航空激光雷达数据中提取多尺度点云的管道,这取决于点代表的是建筑、植被还是地面。我们对屋顶坡度进行去噪处理,匹配植被,并使用几何基元的参数表示法大致重现航空采集中经常隐藏的建筑立面。然后,我们对城市几何图形进行多尺度采样,直到可以实现三维城市表示,因为我们在新版本的原始点云上标注了表示每个部分的参数方程。我们主要在热那亚市的实际环境中测试了我们的方法,该城市包括历史建筑,地面坡度不规则。此外,我们还展示了在另外两个城市的部分地区进行城市重建的结果,这两个城市是马泰拉(与热那亚一样具有复杂的形态)和鹿特丹。
{"title":"From aerial LiDAR point clouds to multiscale urban representation levels by a parametric resampling","authors":"Chiara Romanengo,&nbsp;Bianca Falcidieno,&nbsp;Silvia Biasotti","doi":"10.1016/j.cag.2024.104022","DOIUrl":"10.1016/j.cag.2024.104022","url":null,"abstract":"<div><p>Urban simulations that involve disaster prevention, urban design, and assisted navigation heavily rely on urban geometric models. While large urban areas need a lot of time to be acquired terrestrially, government organizations have already conducted massive aerial LiDAR surveys, some even at the national level. This work aims to provide a pipeline for extracting multi-scale point clouds from 2D building footprints and airborne LiDAR data, which depends on whether the points represent buildings, vegetation, or ground. We denoise the roof slopes, match the vegetation, and roughly recreate the building façades frequently hidden to aerial acquisition using a parametric representation of geometric primitives. We then carry out multiple-scale samplings of the urban geometry until a 3D urban representation can be achieved because we annotate the new version of the original point cloud with the parametric equations representing each part. We mainly tested our methodology in a real-world setting – the city of Genoa – which includes historical buildings and is heavily characterized by irregular ground slopes. Moreover, we present the results of urban reconstruction on part of two other cities, Matera, which has a complex morphology like Genoa, and Rotterdam.</p></div>","PeriodicalId":50628,"journal":{"name":"Computers & Graphics-Uk","volume":"123 ","pages":"Article 104022"},"PeriodicalIF":2.5,"publicationDate":"2024-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0097849324001572/pdfft?md5=a617708d0acaf24ecd321d09a5821721&pid=1-s2.0-S0097849324001572-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141942922","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Binary segmentation of relief patterns on point clouds 点云浮雕图案的二进制分割
IF 2.5 4区 计算机科学 Q2 COMPUTER SCIENCE, SOFTWARE ENGINEERING Pub Date : 2024-07-31 DOI: 10.1016/j.cag.2024.104020
Gabriele Paolini , Claudio Tortorici , Stefano Berretti

Analysis of 3D textures, also known as relief patterns is a challenging task that requires separating repetitive surface patterns from the underlying global geometry. Existing works classify entire surfaces based on one or a few patterns by extracting ad-hoc statistical properties. Unfortunately, these methods are not suitable for objects with multiple geometric textures and perform poorly on more complex shapes. In this paper, we propose a neural network for binary segmentation to infer per-point labels based on the presence of surface relief patterns. We evaluated the proposed architecture on a high resolution point cloud dataset, surpassing the state-of-the-art, while maintaining memory and computation efficiency.

分析三维纹理(也称浮雕图案)是一项具有挑战性的任务,需要将重复的表面图案与底层的全局几何图形分离开来。现有研究通过提取临时统计属性,根据一种或几种图案对整个表面进行分类。遗憾的是,这些方法不适用于具有多种几何纹理的物体,而且在处理更复杂的形状时表现不佳。在本文中,我们提出了一种用于二元分割的神经网络,可根据表面浮雕图案的存在推断每点标签。我们在高分辨率点云数据集上对所提出的架构进行了评估,结果超过了最先进的架构,同时保持了内存和计算效率。
{"title":"Binary segmentation of relief patterns on point clouds","authors":"Gabriele Paolini ,&nbsp;Claudio Tortorici ,&nbsp;Stefano Berretti","doi":"10.1016/j.cag.2024.104020","DOIUrl":"10.1016/j.cag.2024.104020","url":null,"abstract":"<div><p>Analysis of 3D textures, also known as relief patterns is a challenging task that requires separating repetitive surface patterns from the underlying global geometry. Existing works classify entire surfaces based on one or a few patterns by extracting ad-hoc statistical properties. Unfortunately, these methods are not suitable for objects with multiple geometric textures and perform poorly on more complex shapes. In this paper, we propose a neural network for binary segmentation to infer per-point labels based on the presence of surface relief patterns. We evaluated the proposed architecture on a high resolution point cloud dataset, surpassing the state-of-the-art, while maintaining memory and computation efficiency.</p></div>","PeriodicalId":50628,"journal":{"name":"Computers & Graphics-Uk","volume":"123 ","pages":"Article 104020"},"PeriodicalIF":2.5,"publicationDate":"2024-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0097849324001559/pdfft?md5=2a3d2170481b5dae4c7f729baa4b2914&pid=1-s2.0-S0097849324001559-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141942923","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
From superpixels to foundational models: An overview of unsupervised and generalizable image segmentation 从超像素到基础模型:无监督和通用图像分割概述
IF 2.5 4区 计算机科学 Q2 COMPUTER SCIENCE, SOFTWARE ENGINEERING Pub Date : 2024-07-29 DOI: 10.1016/j.cag.2024.104014
Cristiano N. Rodrigues , Ian M. Nunes , Matheus B. Pereira , Hugo Oliveira , Jefersson A. dos Santos

Image segmentation is one of the most classical computer vision tasks. Segmentation tasks yield a set of classes attributed to individual pixels instead of sparsely predicted images or patches, such as in classification or detection tasks. However, creating annotation sets for pixelwise tasks is a very costly task, often requiring hours for labeling single samples in images with multiple classes of objects. In this context, unsupervised learning can be leveraged either to expedite the annotation procedure and/or to guide the segmentation algorithms altogether without the need for manual annotations. Classical unsupervised segmentation methods leveraged techniques from areas as graph theory, image processing, clustering or supervised classifiers in order to achieve “shallow” pixelwise classification. These techniques usually aim to achieve superpixel over-segmentations by grouping similar pixels that should pertain to the same object. Modern deep unsupervised approaches for image segmentation aimed to group pixels in a data-driven way by using the capabilities of deep architectures to process unstructured data such as images. Later, self-supervised learning bypassed the need for labels via pretext tasks, compelling deep architectures to learn more generic features capable of enhancing downstream tasks, including segmentation. The generalized representations produced by unsupervised models have propelled the recent progress in self-supervised, few- and zero-shot learning and even general-purpose foundational models in computer vision, yielding state-of-the-art results across diverse tasks and datasets. This paper provides an overview of unsupervised and generalizable approaches for image segmentation, introduces key concepts and terminology, and discusses the main aspects of state-of-the-art methods. Additionally, we highlight prominent applications in various domains such as remote sensing, medical imaging, and geology. Finally, we discuss trends and future directions for state-of-the-art unsupervised image segmentation.

图像分割是最经典的计算机视觉任务之一。分割任务产生一组归属于单个像素而非稀疏预测图像或斑块的类别,例如在分类或检测任务中。然而,为像素任务创建注释集是一项非常昂贵的任务,通常需要数小时才能在包含多类对象的图像中标注单个样本。在这种情况下,可以利用无监督学习来加快标注过程和/或指导分割算法,而无需手动标注。经典的无监督分割方法利用图论、图像处理、聚类或监督分类器等领域的技术来实现 "浅层 "像素分类。这些技术通常旨在通过将应属于同一对象的相似像素分组来实现超像素过度分割。现代深度无监督图像分割方法旨在利用深度架构处理图像等非结构化数据的能力,以数据驱动的方式对像素进行分组。后来,自监督学习通过前置任务绕过了对标签的需求,迫使深度架构学习更多通用特征,以增强包括分割在内的下游任务。无监督模型产生的通用表征推动了计算机视觉领域的自监督学习、少镜头学习和零镜头学习,甚至通用基础模型的最新进展,在各种任务和数据集上取得了最先进的成果。本文概述了用于图像分割的无监督和通用方法,介绍了关键概念和术语,并讨论了最先进方法的主要方面。此外,我们还重点介绍了遥感、医学成像和地质学等不同领域的突出应用。最后,我们讨论了最先进的无监督图像分割技术的发展趋势和未来方向。
{"title":"From superpixels to foundational models: An overview of unsupervised and generalizable image segmentation","authors":"Cristiano N. Rodrigues ,&nbsp;Ian M. Nunes ,&nbsp;Matheus B. Pereira ,&nbsp;Hugo Oliveira ,&nbsp;Jefersson A. dos Santos","doi":"10.1016/j.cag.2024.104014","DOIUrl":"10.1016/j.cag.2024.104014","url":null,"abstract":"<div><p>Image segmentation is one of the most classical computer vision tasks. Segmentation tasks yield a set of classes attributed to individual pixels instead of sparsely predicted images or patches, such as in classification or detection tasks. However, creating annotation sets for pixelwise tasks is a very costly task, often requiring hours for labeling single samples in images with multiple classes of objects. In this context, unsupervised learning can be leveraged either to expedite the annotation procedure and/or to guide the segmentation algorithms altogether without the need for manual annotations. Classical unsupervised segmentation methods leveraged techniques from areas as graph theory, image processing, clustering or supervised classifiers in order to achieve “shallow” pixelwise classification. These techniques usually aim to achieve superpixel over-segmentations by grouping similar pixels that should pertain to the same object. Modern deep unsupervised approaches for image segmentation aimed to group pixels in a data-driven way by using the capabilities of deep architectures to process unstructured data such as images. Later, self-supervised learning bypassed the need for labels via pretext tasks, compelling deep architectures to learn more generic features capable of enhancing downstream tasks, including segmentation. The generalized representations produced by unsupervised models have propelled the recent progress in self-supervised, few- and zero-shot learning and even general-purpose foundational models in computer vision, yielding state-of-the-art results across diverse tasks and datasets. This paper provides an overview of unsupervised and generalizable approaches for image segmentation, introduces key concepts and terminology, and discusses the main aspects of state-of-the-art methods. Additionally, we highlight prominent applications in various domains such as remote sensing, medical imaging, and geology. Finally, we discuss trends and future directions for state-of-the-art unsupervised image segmentation.</p></div>","PeriodicalId":50628,"journal":{"name":"Computers & Graphics-Uk","volume":"123 ","pages":"Article 104014"},"PeriodicalIF":2.5,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141961155","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Shape Modeling International (SMI) 2024 awards interviews with SMI’2024 award winners 国际造型设计协会(SMI)2024 年奖项采访 SMI'2024 年获奖者
IF 2.5 4区 计算机科学 Q2 COMPUTER SCIENCE, SOFTWARE ENGINEERING Pub Date : 2024-07-29 DOI: 10.1016/j.cag.2024.104021
Bianca Falcidieno, Brian Wyvill, Ergun Akleman, Jorg Peters

The Shape Modeling International awards (SMI awards) were introduced to commemorate the passing of SMI founder, Professor Kunii. Since 2021, the SMI awards recognize exceptional contributors to Shape Modeling. Currently, there are three awards: the Tosiyasu Kunii Distinguished Researcher, the Young Investigator, and the Alexander Pasko Service Award. The 2024 Distinguished Researcher awardees are Gershon Elber and Stefanie Hahmann. The 2024 Young Investigators are Gianmarco Cherchi and Amal Dev Parakkat. The 2024 Service Awardee is Ergun Akleman. This article provides interviews with the five SMI 2024 award winners.

国际形状建模奖(SMI 奖)是为纪念 SMI 创始人 Kunii 教授的逝世而设立的。自 2021 年起,SMI 奖开始表彰对形状建模做出杰出贡献的人员。目前有三个奖项:Tosiyasu Kunii 杰出研究员奖、青年研究员奖和亚历山大-帕斯科服务奖。2024 年杰出研究员奖获得者是格申-埃尔伯(Gershon Elber)和斯蒂芬妮-哈曼(Stefanie Hahmann)。2024年青年研究员奖获得者是詹马尔科-切尔奇(Gianmarco Cherchi)和阿马尔-德夫-帕拉克卡特(Amal Dev Parakkat)。2024年度服务奖获得者是埃尔贡-阿克勒曼(Ergun Akleman)。本文对五位 SMI 2024 获奖者进行了采访。
{"title":"Shape Modeling International (SMI) 2024 awards interviews with SMI’2024 award winners","authors":"Bianca Falcidieno,&nbsp;Brian Wyvill,&nbsp;Ergun Akleman,&nbsp;Jorg Peters","doi":"10.1016/j.cag.2024.104021","DOIUrl":"10.1016/j.cag.2024.104021","url":null,"abstract":"<div><p>The Shape Modeling International awards (SMI awards) were introduced to commemorate the passing of SMI founder, Professor Kunii. Since 2021, the SMI awards recognize exceptional contributors to Shape Modeling. Currently, there are three awards: the Tosiyasu Kunii Distinguished Researcher, the Young Investigator, and the Alexander Pasko Service Award. The 2024 Distinguished Researcher awardees are Gershon Elber and Stefanie Hahmann. The 2024 Young Investigators are Gianmarco Cherchi and Amal Dev Parakkat. The 2024 Service Awardee is Ergun Akleman. This article provides interviews with the five SMI 2024 award winners.</p></div>","PeriodicalId":50628,"journal":{"name":"Computers & Graphics-Uk","volume":"123 ","pages":"Article 104021"},"PeriodicalIF":2.5,"publicationDate":"2024-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141952720","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Assessing the landscape of toolkits, frameworks, and authoring tools for urban visual analytics systems 评估城市可视化分析系统的工具包、框架和创作工具情况
IF 2.5 4区 计算机科学 Q2 COMPUTER SCIENCE, SOFTWARE ENGINEERING Pub Date : 2024-07-25 DOI: 10.1016/j.cag.2024.104013
Leonardo Ferreira , Gustavo Moreira , Maryam Hosseini , Marcos Lage , Nivan Ferreira , Fabio Miranda

Over the past decade, there has been a significant increase in the development of visual analytics systems dedicated to addressing urban issues. These systems distill intricate urban analysis workflows into intuitive, interactive visual representations and interfaces, enabling users to explore, understand, and derive insights from large and complex data, including street-level imagery, street networks, and building geometries. Developing urban visual analytics systems, however, is a challenging endeavor that requires considerable programming expertise and interaction between various multidisciplinary stakeholders. This situation often leads to monolithic and isolated prototypes that are hard to reproduce, combine, or extend. Concurrently, there has been an increase in the availability of general and urban-specific toolkits, frameworks, and authoring tools that are open source and abstract away the need to implement low-level visual analytics functionalities. This paper provides a hierarchical taxonomy of urban visual analytics systems to contextualize how they are usually designed, implemented, and evaluated. We develop this taxonomy across three distinct levels (i.e., dimensions, categories, and tags), juxtaposing visualization with analytics, data, and system dimensions. We then assess the extent to which current open-source toolkits, frameworks, and authoring tools can effectively support the development of components tailored to urban visual analytics, identifying their strengths and limitations in addressing the unique challenges posed by urban data. In doing so, we offer a roadmap that can guide the effective employment of existing resources and chart a pathway for developing and refining future systems.

在过去十年中,致力于解决城市问题的可视化分析系统的开发显著增加。这些系统将错综复杂的城市分析工作流程提炼为直观、交互式的可视化表示和界面,使用户能够探索、理解大量复杂数据,包括街道级图像、街道网络和建筑几何图形,并从中获得洞察力。然而,开发城市可视化分析系统是一项极具挑战性的工作,需要大量的编程专业知识和多学科利益相关者之间的互动。这种情况往往会导致难以复制、组合或扩展的单一和孤立的原型。与此同时,通用的和针对城市的工具包、框架和创作工具的可用性也在不断提高,这些工具包、框架和创作工具都是开源的,并且抽象出了实现底层可视化分析功能的需求。本文提供了城市可视化分析系统的层次分类法,以说明这些系统通常是如何设计、实施和评估的。我们将可视化与分析、数据和系统维度并列,在三个不同的层面(即维度、类别和标签)上发展了这一分类法。然后,我们评估了当前的开源工具包、框架和创作工具能在多大程度上有效支持城市可视化分析组件的开发,确定了它们在应对城市数据带来的独特挑战方面的优势和局限。在此过程中,我们提供了一个路线图,可以指导如何有效利用现有资源,并为开发和完善未来系统指明方向。
{"title":"Assessing the landscape of toolkits, frameworks, and authoring tools for urban visual analytics systems","authors":"Leonardo Ferreira ,&nbsp;Gustavo Moreira ,&nbsp;Maryam Hosseini ,&nbsp;Marcos Lage ,&nbsp;Nivan Ferreira ,&nbsp;Fabio Miranda","doi":"10.1016/j.cag.2024.104013","DOIUrl":"10.1016/j.cag.2024.104013","url":null,"abstract":"<div><p>Over the past decade, there has been a significant increase in the development of visual analytics systems dedicated to addressing urban issues. These systems distill intricate urban analysis workflows into intuitive, interactive visual representations and interfaces, enabling users to explore, understand, and derive insights from large and complex data, including street-level imagery, street networks, and building geometries. Developing urban visual analytics systems, however, is a challenging endeavor that requires considerable programming expertise and interaction between various multidisciplinary stakeholders. This situation often leads to monolithic and isolated prototypes that are hard to reproduce, combine, or extend. Concurrently, there has been an increase in the availability of general and urban-specific toolkits, frameworks, and authoring tools that are open source and abstract away the need to implement low-level visual analytics functionalities. This paper provides a hierarchical taxonomy of urban visual analytics systems to contextualize how they are usually designed, implemented, and evaluated. We develop this taxonomy across three distinct levels (<em>i.e.</em>, dimensions, categories, and tags), juxtaposing visualization with analytics, data, and system dimensions. We then assess the extent to which current open-source toolkits, frameworks, and authoring tools can effectively support the development of components tailored to urban visual analytics, identifying their strengths and limitations in addressing the unique challenges posed by urban data. In doing so, we offer a roadmap that can guide the effective employment of existing resources and chart a pathway for developing and refining future systems.</p></div>","PeriodicalId":50628,"journal":{"name":"Computers & Graphics-Uk","volume":"123 ","pages":"Article 104013"},"PeriodicalIF":2.5,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S0097849324001481/pdfft?md5=5e1b2ee787bdf31bc660006341515d9a&pid=1-s2.0-S0097849324001481-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141841726","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Arbitrary style transfer via multi-feature correlation 通过多特征相关性实现任意风格转移
IF 2.5 4区 计算机科学 Q2 COMPUTER SCIENCE, SOFTWARE ENGINEERING Pub Date : 2024-07-25 DOI: 10.1016/j.cag.2024.104018
Jin Xiang , Huihuang Zhao , Pengfei Li , Yue Deng , Weiliang Meng

Recent research in arbitrary style transfer has highlighted challenges in maintaining the balance between content structure and style patterns. Moreover, the improper application of style patterns onto the content image often results in suboptimal quality. In this paper, a novel style transfer network, called MCNet, is proposed. It is based on multi-feature correlations. To better explore the intrinsic relationship between the style image and the content image and to transfer the most suitable style onto the content image, a novel Global Style-Attentional Transfer Module, named GSATM, is introduced in this work. GSATM comprises two parts: Forward Adaptive Style Transformation (FAST) and Delayed Style Transformation (DST). The former analyzes the relationship between style and content features and fine-tunes the style features, whereas the latter transfers the content features based on the fine-tuned style features. Moreover, a new encoding and decoding structure is designed to effectively handle the output of GSATM. Extensive quantitative and qualitative experiments fully demonstrate the superiority of our algorithm. Project page: https://github.com/XiangJinCherry/MCNet.

最近在任意风格转换方面的研究凸显了在内容结构和风格模式之间保持平衡所面临的挑战。此外,将风格模式不恰当地应用到内容图像上往往会导致质量不佳。本文提出了一种名为 MCNet 的新型风格转换网络。它基于多特征相关性。为了更好地探索风格图像和内容图像之间的内在关系,并将最合适的风格转移到内容图像上,本文引入了一个新颖的全局风格-意向转移模块(Global Style-Attentional Transfer Module,简称 GSATM)。GSATM 包括两个部分:前向自适应风格转换(FAST)和延迟风格转换(DST)。前者分析风格特征和内容特征之间的关系并微调风格特征,后者则根据微调后的风格特征传输内容特征。此外,还设计了一种新的编码和解码结构,以有效处理 GSATM 的输出。广泛的定量和定性实验充分证明了我们算法的优越性。项目页面:https://github.com/XiangJinCherry/MCNet。
{"title":"Arbitrary style transfer via multi-feature correlation","authors":"Jin Xiang ,&nbsp;Huihuang Zhao ,&nbsp;Pengfei Li ,&nbsp;Yue Deng ,&nbsp;Weiliang Meng","doi":"10.1016/j.cag.2024.104018","DOIUrl":"10.1016/j.cag.2024.104018","url":null,"abstract":"<div><p>Recent research in arbitrary style transfer has highlighted challenges in maintaining the balance between content structure and style patterns. Moreover, the improper application of style patterns onto the content image often results in suboptimal quality. In this paper, a novel style transfer network, called MCNet, is proposed. It is based on multi-feature correlations. To better explore the intrinsic relationship between the style image and the content image and to transfer the most suitable style onto the content image, a novel Global Style-Attentional Transfer Module, named GSATM, is introduced in this work. GSATM comprises two parts: Forward Adaptive Style Transformation (FAST) and Delayed Style Transformation (DST). The former analyzes the relationship between style and content features and fine-tunes the style features, whereas the latter transfers the content features based on the fine-tuned style features. Moreover, a new encoding and decoding structure is designed to effectively handle the output of GSATM. Extensive quantitative and qualitative experiments fully demonstrate the superiority of our algorithm. Project page: <span><span>https://github.com/XiangJinCherry/MCNet</span><svg><path></path></svg></span>.</p></div>","PeriodicalId":50628,"journal":{"name":"Computers & Graphics-Uk","volume":"123 ","pages":"Article 104018"},"PeriodicalIF":2.5,"publicationDate":"2024-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141851209","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Towards diverse image-to-image translation via adaptive normalization layer and contrast learning 通过自适应归一化层和对比度学习实现图像到图像的多样化转换
IF 2.5 4区 计算机科学 Q2 COMPUTER SCIENCE, SOFTWARE ENGINEERING Pub Date : 2024-07-22 DOI: 10.1016/j.cag.2024.104017
Heng Zhang , Yuanyuan Pu , Zhengpeng Zhao , Yupan Li , Xin Li , Rencan Nie

A nice image-to-image translation framework is able to acquire an explicit and credible mapping relationship between the source domain and target domains while satisfying two requirements. One is simplicity, the other is extensibility over multiple translation tasks. To this end, we design a concise but versatile generative model for image-to-image translation. Our method includes three major ingredients. First, inspired by popular unconditional normalization layers, named Spatially Adaptive Normalization(SPADE). We introduce a novel Semantics-Appearance Spatially Adaptive Normalization (SA-SPADE), taking into account both semantic structure and style appearance. This enables semantic composition and style appearance information to be sufficiently captured and integrated by our normalization layers. Thanks to SA-SPADE, our model extends to multiple image-to-image translation tasks in an unsupervised or supervised way. Second, we carefully designed two symmetrical network branches to provide semantic and appearance information for our normalization layer, namely Semantic Branch (SB) and Appearance Branch(AB) respectively. Third, we propose novel Semantic-aware Contrastive Loss (SCL) and Appearance-aware Contrastive Loss (ACL)based on newly un-/self- supervised contrastive learning. That is, SCL guarantees domain-invariant (e.g., pose, structure) representations between the generated image and the input image, while ACL ensures domain-specific representations (e.g., color, texture) between the generated image and the reference image. As a result, we verify the effectiveness of our method by comparing it with various task-dependent image translation models in both qualitative and quantitative evaluations.

一个好的图像到图像翻译框架能够在源域和目标域之间获得明确可信的映射关系,同时满足两个要求。一个是简单性,另一个是在多个翻译任务中的可扩展性。为此,我们为图像到图像翻译设计了一个简洁但通用的生成模型。我们的方法包括三大要素。首先,受流行的无条件归一化层的启发,我们将其命名为空间自适应归一化(SPADE)。我们引入了新颖的语义-外观空间自适应归一化(SA-SPADE),同时考虑语义结构和风格外观。这样,我们的归一化层就能充分捕捉和整合语义构成和风格外观信息。得益于 SA-SPADE,我们的模型能够以无监督或有监督的方式扩展到多种图像到图像的翻译任务中。其次,我们精心设计了两个对称的网络分支,分别为归一化层提供语义和外观信息,即语义分支(SB)和外观分支(AB)。第三,我们基于新的非/自我监督对比学习,提出了新颖的语义感知对比损失(SCL)和外观感知对比损失(ACL)。也就是说,SCL 保证生成图像和输入图像之间的领域不变性(如姿势、结构)表示,而 ACL 则保证生成图像和参考图像之间的特定领域表示(如颜色、纹理)。因此,我们通过在定性和定量评估中将我们的方法与各种与任务相关的图像翻译模型进行比较,验证了我们方法的有效性。
{"title":"Towards diverse image-to-image translation via adaptive normalization layer and contrast learning","authors":"Heng Zhang ,&nbsp;Yuanyuan Pu ,&nbsp;Zhengpeng Zhao ,&nbsp;Yupan Li ,&nbsp;Xin Li ,&nbsp;Rencan Nie","doi":"10.1016/j.cag.2024.104017","DOIUrl":"10.1016/j.cag.2024.104017","url":null,"abstract":"<div><p>A nice image-to-image translation framework is able to acquire an explicit and credible mapping relationship between the source domain and target domains while satisfying two requirements. One is simplicity, the other is extensibility over multiple translation tasks. To this end, we design a concise but versatile generative model for image-to-image translation. Our method includes three major ingredients. First, inspired by popular unconditional normalization layers, named Spatially Adaptive Normalization(SPADE). We introduce a novel Semantics-Appearance Spatially Adaptive Normalization (SA-SPADE), taking into account both semantic structure and style appearance. This enables semantic composition and style appearance information to be sufficiently captured and integrated by our normalization layers. Thanks to SA-SPADE, our model extends to multiple image-to-image translation tasks in an unsupervised or supervised way. Second, we carefully designed two symmetrical network branches to provide semantic and appearance information for our normalization layer, namely Semantic Branch (SB) and Appearance Branch(AB) respectively. Third, we propose novel Semantic-aware Contrastive Loss (SCL) and Appearance-aware Contrastive Loss (ACL)based on newly un-/self- supervised contrastive learning. That is, SCL guarantees domain-invariant (e.g., pose, structure) representations between the generated image and the input image, while ACL ensures domain-specific representations (e.g., color, texture) between the generated image and the reference image. As a result, we verify the effectiveness of our method by comparing it with various task-dependent image translation models in both qualitative and quantitative evaluations.</p></div>","PeriodicalId":50628,"journal":{"name":"Computers & Graphics-Uk","volume":"123 ","pages":"Article 104017"},"PeriodicalIF":2.5,"publicationDate":"2024-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141852026","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Computers & Graphics-Uk
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1