首页 > 最新文献

Scientific Visualization最新文献

英文 中文
Integration of Physical Reality Objects with Their 3D Models Visualized in Virtual Environment Systems 将物理现实物体与虚拟环境系统中可视化的三维模型相结合
Q4 Computer Science Pub Date : 2024-05-01 DOI: 10.26583/sv.16.2.08
A.V. Maltsev
The paper describes methods and approaches for integrating, from the user's point of view, three-dimensional virtual models visible to them in a virtual reality headset, and their physical prototypes. This allows for the addition of some important elements of physical reality to the virtual environment, such as tactile and muscle-motor sensations. Developed solutions are based on the use of wireless HTC Vive trackers, which determine their position and orientation in space and have the ability to be attached to various objects in the real world. An original approach to building a tracking system from several controllers of such type with one anchor element selection is proposed, as well as new methods for real-time integration of physical reality objects with their virtual models by means of functional control schemes with blocks for the Vive trackers. Software modules were created based on developed methods and approaches. Approbation of them was carried out in virtual environment system VirSim and showed adequacy and effectiveness of proposed solutions when using in virtual environment systems and training complexes.
本文介绍了从用户的角度将虚拟现实头盔中可见的三维虚拟模型与其物理原型整合在一起的方法和途径。这样就可以在虚拟环境中增加一些重要的物理现实元素,如触觉和肌肉运动感觉。所开发的解决方案基于无线 HTC Vive 跟踪器的使用,该跟踪器可确定其在空间中的位置和方向,并能够连接到现实世界中的各种物体上。本文提出了一种新颖的方法,即通过选择一个锚元素,从多个此类控制器中构建一个跟踪系统,并通过 Vive 跟踪器的功能块控制方案,提出了将物理现实物体与其虚拟模型实时集成的新方法。根据开发的方法和途径创建了软件模块。在虚拟环境系统 VirSim 中对这些模块进行了验证,结果表明,在虚拟环境系统和培训综合设施中使用所提出的解决方案是适当和有效的。
{"title":"Integration of Physical Reality Objects with Their 3D Models Visualized in Virtual Environment Systems","authors":"A.V. Maltsev","doi":"10.26583/sv.16.2.08","DOIUrl":"https://doi.org/10.26583/sv.16.2.08","url":null,"abstract":"\u0000 The paper describes methods and approaches for integrating, from the user's point of view, three-dimensional virtual models visible to them in a virtual reality headset, and their physical prototypes. This allows for the addition of some important elements of physical reality to the virtual environment, such as tactile and muscle-motor sensations. Developed solutions are based on the use of wireless HTC Vive trackers, which determine their position and orientation in space and have the ability to be attached to various objects in the real world. An original approach to building a tracking system from several controllers of such type with one anchor element selection is proposed, as well as new methods for real-time integration of physical reality objects with their virtual models by means of functional control schemes with blocks for the Vive trackers. Software modules were created based on developed methods and approaches. Approbation of them was carried out in virtual environment system VirSim and showed adequacy and effectiveness of proposed solutions when using in virtual environment systems and training complexes.\u0000","PeriodicalId":38328,"journal":{"name":"Scientific Visualization","volume":"63 3","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141145605","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Interactive Geoinformation System for Dynamic Visualization of Auroral Oval Characteristics Based on Component-Oriented Programming Patterns 基于面向组件编程模式的极光椭圆特征动态可视化交互式地理信息系统
Q4 Computer Science Pub Date : 2024-05-01 DOI: 10.26583/sv.16.2.07
A. Vorobev, G. Vorobeva
The practical need for operational monitoring of the position dynamics of the auroral oval is due to the negative technospheric manifestations of space weather effects observed in this spatial region. However, the well-known software tools for modeling the auroral oval solve this problem inefficiently from the point of view of informativeness and ergonomics. The paper proposes an approach to dynamic visualization of the characteristics of the auroral oval, which is available at the program level in the form of a traditional web application with the ability to render visual elements in the browser, as well as in the format of a standalone service like RESTful-API. The developed solution provides visualization of the following parameters: the probability of observing the glow of the upper layers of the atmosphere with the naked eye, the electric and magnetic potentials of the field in the region of the northern auroral belt, as well as various types of auroral precipitation. It is assumed that the proposed approach will make it possible to significantly increase the efficiency of the study of parameters in the auroral oval region by specialists and scientists in the relevant fields. At the same time, the high internal and low external connectivity of the developed software modules allow them to be integrated into third-party applications of various profiles and purposes.
对极光椭圆的位置动态进行业务监测的实际需要是由于在这一空间区域观测到的空间天气效应在技术层的负面表现。然而,从信息量和人机工程学的角度来看,众所周知的极光椭圆建模软件工具解决这一问题的效率不高。本文提出了一种动态可视化极光椭圆形特征的方法,该方法在程序层面以传统网络应用程序的形式提供,能够在浏览器中渲染可视化元素,也可以 RESTful-API 等独立服务的形式提供。开发的解决方案提供以下参数的可视化:肉眼观测到大气上层辉光的概率、北部极光带区域的电场和磁场电位以及各种类型的极光降水。据推测,拟议的方法将有可能大大提高相关领域专家和科学家研究极光椭圆区域参数的效率。同时,所开发的软件模块内部连接性高,外部连接性低,因此可以将其集成到各种规模和用途的第三方应用程序中。
{"title":"Interactive Geoinformation System for Dynamic Visualization of Auroral Oval Characteristics Based on Component-Oriented Programming Patterns","authors":"A. Vorobev, G. Vorobeva","doi":"10.26583/sv.16.2.07","DOIUrl":"https://doi.org/10.26583/sv.16.2.07","url":null,"abstract":"\u0000 The practical need for operational monitoring of the position dynamics of the auroral oval is due to the negative technospheric manifestations of space weather effects observed in this spatial region. However, the well-known software tools for modeling the auroral oval solve this problem inefficiently from the point of view of informativeness and ergonomics. The paper proposes an approach to dynamic visualization of the characteristics of the auroral oval, which is available at the program level in the form of a traditional web application with the ability to render visual elements in the browser, as well as in the format of a standalone service like RESTful-API. The developed solution provides visualization of the following parameters: the probability of observing the glow of the upper layers of the atmosphere with the naked eye, the electric and magnetic potentials of the field in the region of the northern auroral belt, as well as various types of auroral precipitation. It is assumed that the proposed approach will make it possible to significantly increase the efficiency of the study of parameters in the auroral oval region by specialists and scientists in the relevant fields. At the same time, the high internal and low external connectivity of the developed software modules allow them to be integrated into third-party applications of various profiles and purposes.\u0000","PeriodicalId":38328,"journal":{"name":"Scientific Visualization","volume":"146 8‐12","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141139526","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dual-Pass Feature-Fused SSD Model for Detecting Multi-Scale Vehicles on the Construction Site 用于检测建筑工地上多尺度车辆的双通道特征融合 SSD 模型
Q4 Computer Science Pub Date : 2024-05-01 DOI: 10.26583/sv.16.2.11
M. Petrov, S. Zimina, D. Dyachenko, A. Dubodelov, S. Simakov
When detecting equipment on a construction site the objects of detection could have very different scale relative to the image on which they are located. For better detection and bounding box visualization of small objects, a Feature-Fused modification of the SSD detector can be used. Together with the use of overlapping image slicing on the inference, this model copes well with the detection of small objects. However, excessive manual adjustment of the slicing parameters for better detection of small objects can both generally worsen detection on scenes different from those on which the model was adjusted, and lead to significant losses in the detection of large objects and problems with their bound-ing box visualization. Therefore, to achieve the best quality, the image slicing parameters should be automatically selected by the model depending on the characteristic scales of objects in the image. The article presents a dual-pass version of Feature-Fused SSD for automatic determination of image slicing parameters. To determine the characteristic sizes of detected objects on the first pass, a fast truncated version of the detector is used. On the second pass the final object detection is carried out with slicing parameters selected after the first one. Depending on the complexity of the task being solved, the detector demonstrates a quality of 0.82 - 0.92 according to the mAP (mean Average Precision) metric.
在检测建筑工地上的设备时,检测对象相对于其所在图像的比例可能非常不同。为了更好地检测小型物体并使其边界框可视化,可以使用 SSD 检测器的特征融合模型。该模型与推理中使用的重叠图像切片一起,可以很好地应对小型物体的检测。但是,如果为了更好地检测小物体而过多地手动调整切片参数,则会导致在与模型调整对象不同的场景中检测效果普遍变差,同时也会导致在检测大物体时出现重大损失,并出现边界框可视化问题。因此,为了达到最佳质量,图像切片参数应由模型根据图像中物体的特征尺度自动选择。 本文介绍了自动确定图像切片参数的特征融合 SSD 双通道版本。为了在第一次检测中确定检测物体的特征尺寸,使用了快速截断检测器版本。在第二次检测中,使用第一次检测后选择的切片参数进行最终的物体检测。根据所解决任务的复杂程度,检测器的 mAP(平均精度)指标显示质量为 0.82 - 0.92。
{"title":"Dual-Pass Feature-Fused SSD Model for Detecting Multi-Scale Vehicles on the Construction Site","authors":"M. Petrov, S. Zimina, D. Dyachenko, A. Dubodelov, S. Simakov","doi":"10.26583/sv.16.2.11","DOIUrl":"https://doi.org/10.26583/sv.16.2.11","url":null,"abstract":"\u0000 When detecting equipment on a construction site the objects of detection could have very different scale relative to the image on which they are located. For better detection and bounding box visualization of small objects, a Feature-Fused modification of the SSD detector can be used. Together with the use of overlapping image slicing on the inference, this model copes well with the detection of small objects. However, excessive manual adjustment of the slicing parameters for better detection of small objects can both generally worsen detection on scenes different from those on which the model was adjusted, and lead to significant losses in the detection of large objects and problems with their bound-ing box visualization. Therefore, to achieve the best quality, the image slicing parameters should be automatically selected by the model depending on the characteristic scales of objects in the image.\u0000 \u0000 \u0000 The article presents a dual-pass version of Feature-Fused SSD for automatic determination of image slicing parameters. To determine the characteristic sizes of detected objects on the first pass, a fast truncated version of the detector is used. On the second pass the final object detection is carried out with slicing parameters selected after the first one. Depending on the complexity of the task being solved, the detector demonstrates a quality of 0.82 - 0.92 according to the mAP (mean Average Precision) metric.\u0000","PeriodicalId":38328,"journal":{"name":"Scientific Visualization","volume":"299 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141144271","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
BBMS: Investigation to Single Colour Image Visibility Improvement in Turbid Media through Biorthogonal Wavelet Based Depth-map Estimation BBMS:通过基于深度图估计的双谐波小波提高浊度介质中单色图像可见度的研究
Q4 Computer Science Pub Date : 2024-05-01 DOI: 10.26583/sv.16.2.03
Sangita Roy
Electronic imaging needs good quality, high resolution (HR) digital images for highlighting finer details of the image. Normally images captured by ordinary digital camera are post pro cessed with available software instead of high cost CMOS sensor phased camera. Problem commonly faced with these images may get degraded due to the scattering media which deteriorates contrast, shifts colour, and make overall image whitish. Information from the distant objects suffer from poor medium transmission as well as noise amplification. Biorthogonal wavelet denoising (BWD), compress sparsely in frequency -time space, removes noise from depth estimation and makes the transmission smooth. Moreover, single image recovery is a serious challenge and ill posed problem. The recovered image improves compare to degraded image significantly and dis cards possibility of false edge detection as well as prevent colour shift and low contrast. Good quality images are found with objective evaluation. Moreover, different wavelets, thresholds, and decomposition levels have been studied and compared. Time complexity is linear due to wavelet domain analysis which makes the technique fast, reliable, and visually pleasing.
电子成像需要高质量、高分辨率(HR)的数字图像来突出图像的细节。通常情况下,普通数码相机拍摄的图像会通过现有软件进行后期处理,而不是使用高成本的 CMOS 传感器相位相机。这些图像通常面临的问题是,散射介质会降低对比度,改变颜色,使整个图像发白。来自远处物体的信息会因介质传输不良和噪声放大而受到影响。双正交小波去噪(BWD)可在频率-时间空间中进行稀疏压缩,消除深度估计中的噪声,并使传输变得平滑。此外,单幅图像复原也是一个严峻的挑战和棘手的问题。恢复后的图像与退化图像相比有明显改善,消除了错误边缘检测的可能性,并防止了色彩偏移和低对比度。通过客观的评估,可以找到高质量的图像。此外,还对不同的小波、阈值和分解级别进行了研究和比较。由于采用了小波域分析,时间复杂度呈线性,这使得该技术快速、可靠、视觉效果好。
{"title":"BBMS: Investigation to Single Colour Image Visibility Improvement in Turbid Media through Biorthogonal Wavelet Based Depth-map Estimation","authors":"Sangita Roy","doi":"10.26583/sv.16.2.03","DOIUrl":"https://doi.org/10.26583/sv.16.2.03","url":null,"abstract":"\u0000 Electronic imaging needs good quality, high resolution (HR) digital images for highlighting finer details of the image. Normally images captured by ordinary digital camera are post pro cessed with available software instead of high cost CMOS sensor phased camera. Problem commonly faced with these images may get degraded due to the scattering media which deteriorates contrast, shifts colour, and make overall image whitish. Information from the distant objects suffer from poor medium transmission as well as noise amplification. Biorthogonal wavelet denoising (BWD), compress sparsely in frequency -time space, removes noise from depth estimation and makes the transmission smooth. Moreover, single image recovery is a serious challenge and ill posed problem. The recovered image improves compare to degraded image significantly and dis cards possibility of false edge detection as well as prevent colour shift and low contrast. Good quality images are found with objective evaluation. Moreover, different wavelets, thresholds, and decomposition levels have been studied and compared. Time complexity is linear due to wavelet domain analysis which makes the technique fast, reliable, and visually pleasing.\u0000","PeriodicalId":38328,"journal":{"name":"Scientific Visualization","volume":"93 5","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141135687","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Multiscale Analysis of High Resolution Digital Elevation Models Using the Wavelet Transform 利用小波变换对高分辨率数字高程模型进行多尺度分析
Q4 Computer Science Pub Date : 2024-05-01 DOI: 10.26583/sv.16.2.01
A.N. Zemtsov
A technique is proposed for choosing the optimal wavelet basis in terms of decorrelation of the spectral coefficients of the wavelet basis when solving the problem of representation of digital elevation models. In the course of the work, it was revealed that the selection of the spectral transform basis significantly affects the accuracy of the representation of the original model. The proposed method to the decomposition of digital elevation models based on the discrete wavelet transform does not require large computational costs. A technique is proposed for selection the optimal wavelet basis from the position of the minimum mean square error of the reconstructed signal, when quantizing the high-frequency expansion coefficients. Expressions are obtained for generating scaling and wavelet functions in space. The method developed to represent digital elevation models has good properties, which allows to significantly increase the resolution of digital elevation models in the implemented regional geoinformation system.
在解决数字高程模型的表示问题时,提出了一种根据小波基频谱系数的去相关性选择最佳小波基的技术。在工作过程中发现,谱变换基的选择会极大地影响原始模型的表示精度。所提出的基于离散小波变换的数字高程模型分解方法不需要很大的计算成本。在量化高频扩展系数时,提出了一种从重建信号最小均方误差位置选择最佳小波基的技术。获得了生成空间缩放和小波函数的表达式。为表示数字高程模型而开发的方法具有良好的特性,可以显著提高已实施的区域地理信息系统中数字高程模型的分辨率。
{"title":"Multiscale Analysis of High Resolution Digital Elevation Models Using the Wavelet Transform","authors":"A.N. Zemtsov","doi":"10.26583/sv.16.2.01","DOIUrl":"https://doi.org/10.26583/sv.16.2.01","url":null,"abstract":"\u0000 A technique is proposed for choosing the optimal wavelet basis in terms of decorrelation of the spectral coefficients of the wavelet basis when solving the problem of representation of digital elevation models. In the course of the work, it was revealed that the selection of the spectral transform basis significantly affects the accuracy of the representation of the original model. The proposed method to the decomposition of digital elevation models based on the discrete wavelet transform does not require large computational costs. A technique is proposed for selection the optimal wavelet basis from the position of the minimum mean square error of the reconstructed signal, when quantizing the high-frequency expansion coefficients. Expressions are obtained for generating scaling and wavelet functions in space. The method developed to represent digital elevation models has good properties, which allows to significantly increase the resolution of digital elevation models in the implemented regional geoinformation system.\u0000","PeriodicalId":38328,"journal":{"name":"Scientific Visualization","volume":" 30","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141130627","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Visualization and Classification of Human Movements Based on Skeletal Structure: A Neural Network Approach to Sport Exercise Analysis and Comparison of Methodologies 基于骨骼结构的人体运动可视化和分类:运动锻炼分析和方法比较的神经网络方法
Q4 Computer Science Pub Date : 2024-05-01 DOI: 10.26583/sv.16.2.06
V.O. Kuzevanov, D. V. Tikhomirova
The authors of the paper review and compare different existing approaches to Human Action Recognition (HAR), analyze the advantages and disadvantages of platforms for extracting human skeletal structure from video stream, and evaluate the importance of visual representation in the motion analysis process. This paper presents an example implementation of one of the approaches to HAR based on the use of interpretability and visual expressiveness inherent in skeletal structures. In this work, an ad hoc network with Long Short-Term Memory (LSTM) for human activity classification is designed and implemented, which has been trained and tested in the domain of sports exercises. LSTM incorporation of memory cells and gating mechanisms not only mitigates the vanishing gradient problem but also enables LSTMs to selectively retain and utilize relevant information over extended sequences, making them highly effective in tasks with complex temporal dependencies. The problem with a fading gradient is quite common in deep neural networks and is that if the error is back propagated during the training of the network, the gradient can decrease strongly as it travels through the layers of the network to the initial layers. This can lead to the fact that the weights in the initial layers are practically not updated, which makes training of these layers impossible or slows down its process. The resulting solution can be used to create a real-time virtual fitness assistant. The resulting solution can be used to create a real-time virtual fitness assistant. In addition, this approach will make it possible to create interactive training applications with visualization of human skeletal structure, motion analysis and monitoring systems in the field of medicine and rehabilitation, as well as for the development of security systems with access control based on the analysis of visual data on the movement of human body parts.
本文作者回顾并比较了现有的各种人体动作识别(HAR)方法,分析了从视频流中提取人体骨骼结构的平台的优缺点,并评估了视觉呈现在动作分析过程中的重要性。本文介绍了基于骨骼结构固有的可解释性和视觉表现力的 HAR 方法之一的实施实例。在这项工作中,设计并实施了一个用于人体活动分类的具有长短期记忆(LSTM)的特设网络,并在体育锻炼领域对其进行了训练和测试。LSTM 融合了记忆单元和门控机制,不仅能缓解梯度消失问题,还能使 LSTM 有选择性地保留和利用扩展序列中的相关信息,从而使其在具有复杂时间依赖性的任务中非常有效。梯度消失的问题在深度神经网络中非常常见,因为如果在网络训练过程中误差被反向传播,梯度就会在网络各层到达初始层时强烈下降。这可能导致初始层的权重实际上没有更新,从而使这些层的训练无法进行或减慢进程。由此产生的解决方案可用于创建实时虚拟健身助手。由此产生的解决方案可用于创建实时虚拟健身助手。此外,这种方法还可用于创建可视化人体骨骼结构的交互式培训应用程序、医学和康复领域的运动分析和监测系统,以及开发基于人体部位运动可视化数据分析的访问控制安全系统。
{"title":"Visualization and Classification of Human Movements Based on Skeletal Structure: A Neural Network Approach to Sport Exercise Analysis and Comparison of Methodologies","authors":"V.O. Kuzevanov, D. V. Tikhomirova","doi":"10.26583/sv.16.2.06","DOIUrl":"https://doi.org/10.26583/sv.16.2.06","url":null,"abstract":"\u0000 The authors of the paper review and compare different existing approaches to Human Action Recognition (HAR), analyze the advantages and disadvantages of platforms for extracting human skeletal structure from video stream, and evaluate the importance of visual representation in the motion analysis process. This paper presents an example implementation of one of the approaches to HAR based on the use of interpretability and visual expressiveness inherent in skeletal structures. In this work, an ad hoc network with Long Short-Term Memory (LSTM) for human activity classification is designed and implemented, which has been trained and tested in the domain of sports exercises. LSTM incorporation of memory cells and gating mechanisms not only mitigates the vanishing gradient problem but also enables LSTMs to selectively retain and utilize relevant information over extended sequences, making them highly effective in tasks with complex temporal dependencies. The problem with a fading gradient is quite common in deep neural networks and is that if the error is back propagated during the training of the network, the gradient can decrease strongly as it travels through the layers of the network to the initial layers. This can lead to the fact that the weights in the initial layers are practically not updated, which makes training of these layers impossible or slows down its process. The resulting solution can be used to create a real-time virtual fitness assistant. The resulting solution can be used to create a real-time virtual fitness assistant. In addition, this approach will make it possible to create interactive training applications with visualization of human skeletal structure, motion analysis and monitoring systems in the field of medicine and rehabilitation, as well as for the development of security systems with access control based on the analysis of visual data on the movement of human body parts.\u0000","PeriodicalId":38328,"journal":{"name":"Scientific Visualization","volume":"78 3","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141134890","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Shadow Detection and Elimination for Robot and Machine Vision Applications 机器人和机器视觉应用中的阴影检测与消除
Q4 Computer Science Pub Date : 2024-05-01 DOI: 10.26583/sv.16.2.02
L. I. Abdul-Kreem, Hussam k. Abdul-Ameer
Shadow removal is crucial for robot and machine vision as the accuracy of object detection is greatly influenced by the uncertainty and ambiguity of the visual scene. In this paper, we introduce a new algorithm for shadow detection and removal based on different shapes, orientations, and spatial extents of Gaussian equations. Here, the contrast information of the visual scene is utilized for shadow detection and removal through five consecutive processing stages. In the first stage, contrast filtering is performed to obtain the contrast information of the image. The second stage involves a normalization process that suppresses noise and generates a balanced intensity at a specific position compared to the neighboring intensities. In the third stage, the boundary of the target object is extracted, and in the fourth and fifth stages, respectively, the region of interest (ROI) is highlighted and reconstructed. Our model was tested and evaluated using realistic scenarios which include outdoor and indoor scenes. The results reflect the ability of our approach to detect and remove shadows and reconstruct a shadow free image with a small error of approximately 6%.
阴影去除对于机器人和机器视觉至关重要,因为物体检测的准确性在很大程度上受到视觉场景的不确定性和模糊性的影响。本文介绍了一种基于高斯方程的不同形状、方向和空间范围的阴影检测和去除新算法。在这里,通过五个连续的处理阶段,利用视觉场景的对比度信息进行阴影检测和去除。在第一阶段,通过对比度滤波获得图像的对比度信息。第二阶段是归一化处理,抑制噪声,并在特定位置生成与邻近强度相比的平衡强度。在第三阶段,提取目标物体的边界;在第四和第五阶段,分别突出并重建感兴趣区域(ROI)。我们使用现实场景(包括室外和室内场景)对模型进行了测试和评估。结果表明,我们的方法能够检测和移除阴影,并以约 6% 的微小误差重建无阴影图像。
{"title":"Shadow Detection and Elimination for Robot and Machine Vision Applications","authors":"L. I. Abdul-Kreem, Hussam k. Abdul-Ameer","doi":"10.26583/sv.16.2.02","DOIUrl":"https://doi.org/10.26583/sv.16.2.02","url":null,"abstract":"\u0000 Shadow removal is crucial for robot and machine vision as the accuracy of object detection is greatly influenced by the uncertainty and ambiguity of the visual scene. In this paper, we introduce a new algorithm for shadow detection and removal based on different shapes, orientations, and spatial extents of Gaussian equations. Here, the contrast information of the visual scene is utilized for shadow detection and removal through five consecutive processing stages. In the first stage, contrast filtering is performed to obtain the contrast information of the image. The second stage involves a normalization process that suppresses noise and generates a balanced intensity at a specific position compared to the neighboring intensities. In the third stage, the boundary of the target object is extracted, and in the fourth and fifth stages, respectively, the region of interest (ROI) is highlighted and reconstructed. Our model was tested and evaluated using realistic scenarios which include outdoor and indoor scenes. The results reflect the ability of our approach to detect and remove shadows and reconstruct a shadow free image with a small error of approximately 6%.\u0000","PeriodicalId":38328,"journal":{"name":"Scientific Visualization","volume":"64 3","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141139776","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Application of Modern Object Tracking Technologies to the Task of Aortography Key Point Detection in Transcatheter Aortic Valve Implantation 现代物体跟踪技术在经导管主动脉瓣植入术中主动脉造影关键点检测任务中的应用
Q4 Computer Science Pub Date : 2024-05-01 DOI: 10.26583/sv.16.2.09
V. Laptev, N. Kochergin
Object detection, as one of the most fundamental and challenging problems in computer vision, has attracted much attention in recent years. Over the past two decades, we have witnessed the rapid technological evolution of object detection and its profound impact on the whole field of computer vision. In this paper, aortography key point detection approaches for transcatheter aortic valve implantation based on machine learning tools are discussed. The paper provides a description and analytical comparison of such popular methods as "object detection", "pose estimation". As a result of this study, a visual assessment system is proposed to facilitate the performance of the intervention procedure. The final accuracy of the proposed system reaches 79.3% with an analysis speed of 12 ms per image.
物体检测是计算机视觉领域最基本、最具挑战性的问题之一,近年来备受关注。在过去的二十年里,我们见证了物体检测技术的飞速发展及其对整个计算机视觉领域的深远影响。本文讨论了基于机器学习工具的经导管主动脉瓣植入术主动脉造影关键点检测方法。本文对 "物体检测"、"姿态估计 "等流行方法进行了描述和分析比较。通过这项研究,提出了一种视觉评估系统,以促进介入手术的进行。拟议系统的最终准确率达到 79.3%,每幅图像的分析速度为 12 毫秒。
{"title":"Application of Modern Object Tracking Technologies to the Task of Aortography Key Point Detection in Transcatheter Aortic Valve Implantation","authors":"V. Laptev, N. Kochergin","doi":"10.26583/sv.16.2.09","DOIUrl":"https://doi.org/10.26583/sv.16.2.09","url":null,"abstract":"\u0000 Object detection, as one of the most fundamental and challenging problems in computer vision, has attracted much attention in recent years. Over the past two decades, we have witnessed the rapid technological evolution of object detection and its profound impact on the whole field of computer vision. In this paper, aortography key point detection approaches for transcatheter aortic valve implantation based on machine learning tools are discussed. The paper provides a description and analytical comparison of such popular methods as \"object detection\", \"pose estimation\". As a result of this study, a visual assessment system is proposed to facilitate the performance of the intervention procedure. The final accuracy of the proposed system reaches 79.3% with an analysis speed of 12 ms per image.\u0000","PeriodicalId":38328,"journal":{"name":"Scientific Visualization","volume":" 12","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141132009","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Visualization of Solar Radiation Using Three-Dimensional Computer Graphics Technologies 利用三维计算机制图技术实现太阳辐射可视化
Q4 Computer Science Pub Date : 2024-05-01 DOI: 10.26583/sv.16.2.04
F.A. Mager, A.V. Sokolova, O. I. Khristodulo
Currently, the prediction, calculation and rationing of solar radiation is a serious problem that has a wide impact on the spheres of human activity. Creating and maintaining a comfortable living environment, as well as solving the world's energy problems, are the fundamental criteria that determine its relevance. This article discusses the possibility of using three-dimensional graphics technologies to calculate insolation. The paper considers an algorithm for calculating the four main components of the visualization of global solar radiation: direct beam radiation, diffuse radiation, reflected beam radiation and reflected diffuse radiation. The freely distributed open source software Blender 3D is used as a tool for working with computer graphics. In the course of the study, calculations based on the principle of bidirectional path tracing, which is used in the visualization algorithms of the Cycles graphics engine, are presented. The use of the technology of transferring complex data to the raster image format allows you to create a separate texture map for each component of the simulated lighting. Based on the obtained texture maps, it is possible to calculate the global solar radiation for all created or imported 3D models in the three-dimensional space of Blender 3D.
目前,太阳辐射的预测、计算和配给是一个严重的问题,对人类活动领域有着广泛的影响。创造和维持舒适的生活环境以及解决世界能源问题是决定其相关性的基本标准。本文讨论了使用三维图形技术计算日照的可能性。本文考虑了计算全球太阳辐射可视化的四个主要组成部分:直接光束辐射、漫射辐射、反射光束辐射和反射漫射辐射的算法。免费发布的开放源码软件 Blender 3D 被用作计算机制图工具。在研究过程中,介绍了基于双向路径追踪原理的计算,该原理用于 Cycles 图形引擎的可视化算法。利用将复杂数据传输到光栅图像格式的技术,可以为模拟照明的每个组件创建单独的纹理贴图。根据获得的纹理贴图,可以在 Blender 3D 的三维空间中为所有创建或导入的 3D 模型计算全局太阳辐射。
{"title":"Visualization of Solar Radiation Using Three-Dimensional Computer Graphics Technologies","authors":"F.A. Mager, A.V. Sokolova, O. I. Khristodulo","doi":"10.26583/sv.16.2.04","DOIUrl":"https://doi.org/10.26583/sv.16.2.04","url":null,"abstract":"\u0000 Currently, the prediction, calculation and rationing of solar radiation is a serious problem that has a wide impact on the spheres of human activity. Creating and maintaining a comfortable living environment, as well as solving the world's energy problems, are the fundamental criteria that determine its relevance. This article discusses the possibility of using three-dimensional graphics technologies to calculate insolation. The paper considers an algorithm for calculating the four main components of the visualization of global solar radiation: direct beam radiation, diffuse radiation, reflected beam radiation and reflected diffuse radiation. The freely distributed open source software Blender 3D is used as a tool for working with computer graphics. In the course of the study, calculations based on the principle of bidirectional path tracing, which is used in the visualization algorithms of the Cycles graphics engine, are presented. The use of the technology of transferring complex data to the raster image format allows you to create a separate texture map for each component of the simulated lighting. Based on the obtained texture maps, it is possible to calculate the global solar radiation for all created or imported 3D models in the three-dimensional space of Blender 3D.\u0000","PeriodicalId":38328,"journal":{"name":"Scientific Visualization","volume":"106 s413","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141134428","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Information Environment а for Industrial and Scientific-Cognitive Tourism with Application of GIS 应用地理信息系统的工业和科学认知旅游信息环境
Q4 Computer Science Pub Date : 2024-05-01 DOI: 10.26583/sv.16.2.05
О.А. Ulchitsky, Е.К. Podobreeva, Y. Kocherzhinskaya, Е.К. Bulatova, O. Veremey
The subject of the stated research is conditioned by the need to develop modern methods and technologies of information support of the tourism industry of the regional profile taking into account its specifics and features. Awareness and comfortable conditions of tourist service are the key factors of successful promotion and sustainable development of this sphere. In the near future, domestic tourism has great prospects, it concerns many territories of the country, and the Southern Urals is no exception. The article is a continuation of research work related to the collection and analysis of geodata, as well as the visualization of the information environment. This study shows how to graphically visualize information on the basis of the development of an interactive scheme project with the possibility of overlaying it on a scalable satellite map in the field of industrial, scientific-cognitive tourism and architectural tourism on the example of a separate layer "Country of Cities" for the objects located in the South Urals. In the research on the basis of the program utility "Grid cartogram of reference archaeological objects" the design concept of the interface functionality of utility "KROT-1.0" ("Cartogram of reference objects of tourism. Version 1.0") is developed and tested as an interactive cartogram on Internet platforms. Methodology wise, the research process consists of 2 stages: pre-project or data collection with the formation of a database catalog and design and research, with the implementation of results, consisting in the development of the design concept of the utility and its integration with a web resource developed on the platform of non-commercial CMS; analysis and comparison of the results obtained on different platforms, publication or placement of the developed interactive schemes on internal servers and Internet platforms with further prospects for the development of mobile applications for the provision of information environment in different spheres of regional tourism.
上述研究课题的条件是,需要根据地区概况的具体情况和特点,开发现代方法和技术,为旅游业提供信息支持。旅游服务意识和舒适条件是成功促进和可持续发展这一领域的关键因素。在不久的将来,国内旅游业前景广阔,关系到国家的许多地区,南乌拉尔地区也不例外。 本文是地理数据收集和分析以及信息环境可视化相关研究工作的延续。本研究以位于南乌拉尔地区的 "城市之国 "独立图层为例,展示了如何在开发交互式计划项目的基础上实现信息的图形可视化,以及在工业、科学认知旅游和建筑旅游领域的可扩展卫星地图上叠加信息的可能性。 在 "考古参考对象网格制图 "程序工具的基础上,研究开发了 "KROT-1.0"("旅游参考对象制图。1.0 版")工具界面功能的设计理念,并作为互联网平台上的交互式制图进行了测试。 从方法上讲,研究过程包括两个阶段:项目前期或数据收集,形成数据库目录,设计和研究,以及结果的实施,包括开发实用程序的设计概念及其与在非商业内容管理系统平台上开发的网络资源的整合;分析和比较在不同平台上获得的结果,在内部服务器和互联网平台上发布或放置开发的交互式方案,为在地区旅游的不同领域提供信息环境开发移动应用程序提供进一步的前景。
{"title":"Information Environment а for Industrial and Scientific-Cognitive Tourism with Application of GIS","authors":"О.А. Ulchitsky, Е.К. Podobreeva, Y. Kocherzhinskaya, Е.К. Bulatova, O. Veremey","doi":"10.26583/sv.16.2.05","DOIUrl":"https://doi.org/10.26583/sv.16.2.05","url":null,"abstract":"\u0000 The subject of the stated research is conditioned by the need to develop modern methods and technologies of information support of the tourism industry of the regional profile taking into account its specifics and features. Awareness and comfortable conditions of tourist service are the key factors of successful promotion and sustainable development of this sphere. In the near future, domestic tourism has great prospects, it concerns many territories of the country, and the Southern Urals is no exception.\u0000 \u0000 \u0000 The article is a continuation of research work related to the collection and analysis of geodata, as well as the visualization of the information environment. This study shows how to graphically visualize information on the basis of the development of an interactive scheme project with the possibility of overlaying it on a scalable satellite map in the field of industrial, scientific-cognitive tourism and architectural tourism on the example of a separate layer \"Country of Cities\" for the objects located in the South Urals.\u0000 \u0000 \u0000 In the research on the basis of the program utility \"Grid cartogram of reference archaeological objects\" the design concept of the interface functionality of utility \"KROT-1.0\" (\"Cartogram of reference objects of tourism. Version 1.0\") is developed and tested as an interactive cartogram on Internet platforms.\u0000 \u0000 \u0000 Methodology wise, the research process consists of 2 stages: pre-project or data collection with the formation of a database catalog and design and research, with the implementation of results, consisting in the development of the design concept of the utility and its integration with a web resource developed on the platform of non-commercial CMS; analysis and comparison of the results obtained on different platforms, publication or placement of the developed interactive schemes on internal servers and Internet platforms with further prospects for the development of mobile applications for the provision of information environment in different spheres of regional tourism.\u0000","PeriodicalId":38328,"journal":{"name":"Scientific Visualization","volume":"13 s4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141133257","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Scientific Visualization
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1