首页 > 最新文献

IS&T International Symposium on Electronic Imaging最新文献

英文 中文
Practical OSINT investigation in Twitter utilizing AI-based aggressiveness analysis 利用基于人工智能的攻击性分析对Twitter进行实际OSINT调查
Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.3.mobmu-355
Artem Sklyar, Klaus Schwarz, Reiner Creutzburg
Open-source intelligence is gaining popularity due to the rapid development of social networks. There is more and more information in the public domain. One of the most popular social networks is Twitter. It was chosen to analyze the dependence of changes in the number of likes, reposts, quotes and retweets on the aggressiveness of the post text for a separate profile, as this information can be important not only for the owner of the channel in the social network, but also for other studies that in some way influence user accounts and their behavior in the social network. Furthermore, this work includes a detailed analysis and evaluation of the Tweety library capabilities and situations in which it can be effectively applied. Lastly, this work includes the creation and description of a compiled neural network whose purpose is to predict changes in the number of likes, reposts, quotes, and retweets from the aggressiveness of the post text for a separate profile.
由于社交网络的快速发展,开源智能越来越受欢迎。在公共领域有越来越多的信息。最受欢迎的社交网络之一是Twitter。选择它来分析喜欢,转发,引用和转发的数量变化对单独配置文件的帖子文本攻击性的依赖关系,因为这些信息不仅对社交网络中频道的所有者很重要,而且对其他研究也很重要,这些研究以某种方式影响用户帐户及其在社交网络中的行为。此外,这项工作还包括对Tweety库功能的详细分析和评估,以及它可以有效应用的情况。最后,这项工作包括创建和描述一个编译的神经网络,其目的是预测喜欢、转发、引用和转发数量的变化,从帖子文本的攻击性中获得一个单独的个人资料。
{"title":"Practical OSINT investigation in Twitter utilizing AI-based aggressiveness analysis","authors":"Artem Sklyar, Klaus Schwarz, Reiner Creutzburg","doi":"10.2352/ei.2023.35.3.mobmu-355","DOIUrl":"https://doi.org/10.2352/ei.2023.35.3.mobmu-355","url":null,"abstract":"Open-source intelligence is gaining popularity due to the rapid development of social networks. There is more and more information in the public domain. One of the most popular social networks is Twitter. It was chosen to analyze the dependence of changes in the number of likes, reposts, quotes and retweets on the aggressiveness of the post text for a separate profile, as this information can be important not only for the owner of the channel in the social network, but also for other studies that in some way influence user accounts and their behavior in the social network. Furthermore, this work includes a detailed analysis and evaluation of the Tweety library capabilities and situations in which it can be effectively applied. Lastly, this work includes the creation and description of a compiled neural network whose purpose is to predict changes in the number of likes, reposts, quotes, and retweets from the aggressiveness of the post text for a separate profile.","PeriodicalId":73514,"journal":{"name":"IS&T International Symposium on Electronic Imaging","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135695031","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
3D Imaging and Applications 2023 Conference Overview and Papers Program 3D成像与应用2023会议综述和论文计划
Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.17.3dia-a17
Abstract Scientific and technological advances during the last decade in the fields of image acquisition, data processing, telecommunications, and computer graphics have contributed to the emergence of new multimedia, especially 3D digital data. Modern 3D imaging technologies allow for the acquisition of 3D and 4D (3D video) data at higher speeds, resolutions, and accuracies. With the ability to capture increasingly complex 3D/4D information, advancements have also been made in the areas of 3D data processing (e.g., filtering, reconstruction, compression). As such, 3D/4D technologies are now being used in a large variety of applications, such as medicine, forensic science, cultural heritage, manufacturing, autonomous vehicles, security, and bioinformatics. Further, with mixed reality (AR, VR, XR), 3D/4D technologies may also change the ways we work, play, and communicate with each other every day.
近十年来,图像采集、数据处理、电信和计算机图形学等领域的科技进步促进了新型多媒体的出现,尤其是3D数字数据。现代3D成像技术允许以更高的速度、分辨率和精度获取3D和4D (3D视频)数据。随着捕获越来越复杂的3D/4D信息的能力,3D数据处理领域也取得了进步(例如,过滤、重建、压缩)。因此,3D/4D技术现在被广泛应用于医学、法医学、文化遗产、制造业、自动驾驶汽车、安全和生物信息学等领域。此外,随着混合现实(AR, VR, XR), 3D/4D技术也可能改变我们每天工作,娱乐和彼此交流的方式。
{"title":"3D Imaging and Applications 2023 Conference Overview and Papers Program","authors":"","doi":"10.2352/ei.2023.35.17.3dia-a17","DOIUrl":"https://doi.org/10.2352/ei.2023.35.17.3dia-a17","url":null,"abstract":"Abstract Scientific and technological advances during the last decade in the fields of image acquisition, data processing, telecommunications, and computer graphics have contributed to the emergence of new multimedia, especially 3D digital data. Modern 3D imaging technologies allow for the acquisition of 3D and 4D (3D video) data at higher speeds, resolutions, and accuracies. With the ability to capture increasingly complex 3D/4D information, advancements have also been made in the areas of 3D data processing (e.g., filtering, reconstruction, compression). As such, 3D/4D technologies are now being used in a large variety of applications, such as medicine, forensic science, cultural heritage, manufacturing, autonomous vehicles, security, and bioinformatics. Further, with mixed reality (AR, VR, XR), 3D/4D technologies may also change the ways we work, play, and communicate with each other every day.","PeriodicalId":73514,"journal":{"name":"IS&T International Symposium on Electronic Imaging","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135695213","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Computer Vision and Image Analysis of Art 2023 Conference Overview and Papers Program 计算机视觉与图像分析艺术2023会议综述和论文计划
Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.13.cvaa-a13
Abstract This conference on computer image analysis in the study of art presents leading research in the application of image analysis, computer vision, and pattern recognition to problems of interest to art historians, curators and conservators. A number of recent questions and controversies have highlighted the value of rigorous image analysis in the service of the analysis of art, particularly painting. Consider these examples: the fractal image analysis for the authentication of drip paintings possibly by Jackson Pollock; sophisticated perspective, shading and form analysis to address claims that early Renaissance masters such as Jan van Eyck or Baroque masters such as Georges de la Tour traced optically projected images; automatic multi-scale analysis of brushstrokes for the attribution of portraits within a painting by Perugino; and multi-spectral, x-ray and infra-red scanning and image analysis of the Mona Lisa to reveal the painting techniques of Leonardo. The value of image analysis to these and other questions strongly suggests that current and future computer methods will play an ever larger role in the scholarship of visual arts.
本次关于计算机图像分析在艺术研究中的应用的会议将介绍图像分析、计算机视觉和模式识别在艺术史学家、策展人和保护人员感兴趣的问题中的应用。最近的一些问题和争议突出了严格的图像分析在艺术分析中的价值,特别是绘画。考虑这些例子:分形图像分析鉴定可能是杰克逊·波洛克的水滴画;复杂的透视,阴影和形式分析,以解决早期文艺复兴大师如扬·凡·艾克或巴洛克大师如乔治·德·拉图尔追踪光学投影图像的说法;佩鲁吉诺(Perugino)画作中肖像归属的笔触自动多尺度分析;以及对《蒙娜丽莎》进行多光谱、x射线和红外扫描和图像分析,揭示达·芬奇的绘画技巧。图像分析对这些问题和其他问题的价值强烈表明,当前和未来的计算机方法将在视觉艺术的学术研究中发挥越来越大的作用。
{"title":"Computer Vision and Image Analysis of Art 2023 Conference Overview and Papers Program","authors":"","doi":"10.2352/ei.2023.35.13.cvaa-a13","DOIUrl":"https://doi.org/10.2352/ei.2023.35.13.cvaa-a13","url":null,"abstract":"Abstract This conference on computer image analysis in the study of art presents leading research in the application of image analysis, computer vision, and pattern recognition to problems of interest to art historians, curators and conservators. A number of recent questions and controversies have highlighted the value of rigorous image analysis in the service of the analysis of art, particularly painting. Consider these examples: the fractal image analysis for the authentication of drip paintings possibly by Jackson Pollock; sophisticated perspective, shading and form analysis to address claims that early Renaissance masters such as Jan van Eyck or Baroque masters such as Georges de la Tour traced optically projected images; automatic multi-scale analysis of brushstrokes for the attribution of portraits within a painting by Perugino; and multi-spectral, x-ray and infra-red scanning and image analysis of the Mona Lisa to reveal the painting techniques of Leonardo. The value of image analysis to these and other questions strongly suggests that current and future computer methods will play an ever larger role in the scholarship of visual arts.","PeriodicalId":73514,"journal":{"name":"IS&T International Symposium on Electronic Imaging","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135695216","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Using simulation to quantify the performance of automotive perception systems 用仿真方法量化汽车感知系统的性能
Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.16.avm-118
Zhenyi Liu, Devesh Shah, Alireza Rahimpour, Devesh Upadhyay, Joyce Farrell, Brian Wandell
The design and evaluation of complex systems can benefit from a software simulation - sometimes called a digital twin. The simulation can be used to characterize system performance or to test its performance under conditions that are difficult to measure (e.g., nighttime for automotive perception systems). We describe the image system simulation software tools that we use to evaluate the performance of image systems for object (automobile) detection. We describe experiments with 13 different cameras with a variety of optics and pixel sizes. To measure the impact of camera spatial resolution, we designed a collection of driving scenes that had cars at many different distances. We quantified system performance by measuring average precision and we report a trend relating system resolution and object detection performance. We also quantified the large performance degradation under nighttime conditions, compared to daytime, for all cameras and a COCO pre-trained network.
复杂系统的设计和评估可以受益于软件模拟-有时被称为数字孪生。模拟可用于表征系统性能或测试其在难以测量的条件下的性能(例如,汽车感知系统的夜间)。我们描述了我们用来评估物体(汽车)检测图像系统性能的图像系统仿真软件工具。我们描述了用13种不同的光学和像素大小的相机进行的实验。为了测量相机空间分辨率的影响,我们设计了一组驾驶场景,其中有许多不同距离的汽车。我们通过测量平均精度来量化系统性能,并报告了与系统分辨率和目标检测性能相关的趋势。我们还量化了所有摄像机和COCO预训练网络在夜间条件下与白天相比的较大性能下降。
{"title":"Using simulation to quantify the performance of automotive perception systems","authors":"Zhenyi Liu, Devesh Shah, Alireza Rahimpour, Devesh Upadhyay, Joyce Farrell, Brian Wandell","doi":"10.2352/ei.2023.35.16.avm-118","DOIUrl":"https://doi.org/10.2352/ei.2023.35.16.avm-118","url":null,"abstract":"The design and evaluation of complex systems can benefit from a software simulation - sometimes called a digital twin. The simulation can be used to characterize system performance or to test its performance under conditions that are difficult to measure (e.g., nighttime for automotive perception systems). We describe the image system simulation software tools that we use to evaluate the performance of image systems for object (automobile) detection. We describe experiments with 13 different cameras with a variety of optics and pixel sizes. To measure the impact of camera spatial resolution, we designed a collection of driving scenes that had cars at many different distances. We quantified system performance by measuring average precision and we report a trend relating system resolution and object detection performance. We also quantified the large performance degradation under nighttime conditions, compared to daytime, for all cameras and a COCO pre-trained network.","PeriodicalId":73514,"journal":{"name":"IS&T International Symposium on Electronic Imaging","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135693975","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Practical phase retrieval using double deep image priors 基于双深度图像先验的实际相位检索
Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.14.coimg-153
Zhong Zhuang, David Yang, Felix Hofmann, David Barmherzig, Ju Sun
Phase retrieval (PR) consists of recovering complex-valued objects from their oversampled Fourier magnitudes and takes a central place in scientific imaging. A critical issue around PR is the typical nonconvexity in natural formulations and the associated bad local minimizers. The issue is exacerbated when the support of the object is not precisely known and hence must be overspecified in practice. Practical methods for PR hence involve convolved algorithms, e.g., multiple cycles of hybrid input-output (HIO) + error reduction (ER), to avoid the bad local minimizers and attain reasonable speed, and heuristics to refine the support of the object, e.g., the famous shrinkwrap trick. Overall, the convolved algorithms and the support-refinement heuristics induce multiple algorithm hyperparameters, to which the recovery quality is often sensitive. In this work, we propose a novel PR method by parameterizing the object as the output of a learnable neural network, i.e., deep image prior (DIP). For complex-valued objects in PR, we can flexibly parametrize the magnitude and phase, or the real and imaginary parts separately by two DIPs. We show that this simple idea, free from multi-hyperparameter tuning and support-refinement heuristics, can obtain superior performance than gold-standard PR methods. For the session: Computational Imaging using Fourier Ptychography and Phase Retrieval.
相位恢复(PR)包括从过采样的傅立叶幅度中恢复复值物体,在科学成像中占有中心地位。关于PR的一个关键问题是自然公式中的典型非凸性和相关的坏局部最小值。当对象的支持不是精确已知的,因此在实践中必须过度指定时,问题就会加剧。因此,PR的实用方法包括卷积算法,例如,混合输入输出(HIO) +误差减少(ER)的多循环,以避免不良的局部最小化并获得合理的速度,以及启发式算法,以改进对象的支持,例如著名的shrinkwrap技巧。总的来说,卷积算法和支持改进启发式算法会产生多个算法超参数,这些超参数对恢复质量往往很敏感。在这项工作中,我们提出了一种新的PR方法,通过参数化对象作为可学习神经网络的输出,即深度图像先验(DIP)。对于PR中的复值对象,我们可以通过两个dip分别灵活地参数化幅度和相位,或实部和虚部。我们证明了这个简单的想法,没有多超参数调优和支持改进启发式,可以获得比金标准PR方法更好的性能。会议:计算成像使用傅里叶平面摄影和相位检索。
{"title":"Practical phase retrieval using double deep image priors","authors":"Zhong Zhuang, David Yang, Felix Hofmann, David Barmherzig, Ju Sun","doi":"10.2352/ei.2023.35.14.coimg-153","DOIUrl":"https://doi.org/10.2352/ei.2023.35.14.coimg-153","url":null,"abstract":"Phase retrieval (PR) consists of recovering complex-valued objects from their oversampled Fourier magnitudes and takes a central place in scientific imaging. A critical issue around PR is the typical nonconvexity in natural formulations and the associated bad local minimizers. The issue is exacerbated when the support of the object is not precisely known and hence must be overspecified in practice. Practical methods for PR hence involve convolved algorithms, e.g., multiple cycles of hybrid input-output (HIO) + error reduction (ER), to avoid the bad local minimizers and attain reasonable speed, and heuristics to refine the support of the object, e.g., the famous shrinkwrap trick. Overall, the convolved algorithms and the support-refinement heuristics induce multiple algorithm hyperparameters, to which the recovery quality is often sensitive. In this work, we propose a novel PR method by parameterizing the object as the output of a learnable neural network, i.e., deep image prior (DIP). For complex-valued objects in PR, we can flexibly parametrize the magnitude and phase, or the real and imaginary parts separately by two DIPs. We show that this simple idea, free from multi-hyperparameter tuning and support-refinement heuristics, can obtain superior performance than gold-standard PR methods. For the session: Computational Imaging using Fourier Ptychography and Phase Retrieval.","PeriodicalId":73514,"journal":{"name":"IS&T International Symposium on Electronic Imaging","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135694169","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Generative adversarial networks (GANs) and object tracking (OT) for vehicle accident detection 生成对抗网络(GANs)和目标跟踪(OT)在车辆事故检测中的应用
Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.3.mobmu-364
Taraka Rama Krishna Kanth Kannuri, Kirsnaragavan Arudpiragasam, Klaus Schwarz, Michael Hartmann, Reiner Creutzburg
Accident detection is one of the biggest challenges as there are various anomalies, occlusions, and objects in the image at different times. Therefore, this paper focuses on detecting traffic accidents through a combination of Object Tracking (OT) and image generation using GAN with variants such as skip connection, residual, and attention connection. The background removal techniques will be applied to reduce the background variation in the frame. Later, YOLO-R is used to detect objects, followed by DeepSort tracking of objects in the frame. Finally, the distance error metric and the adversarial error are determined using the Kalman filter and the GAN approach and help to decide accidents in videos.
事故检测是最大的挑战之一,因为在不同的时间图像中存在各种异常、遮挡和物体。因此,本文的重点是通过结合目标跟踪(OT)和使用GAN的图像生成来检测交通事故,其中包含跳跃连接、残差和注意连接等变体。背景去除技术将被用于减少背景变化的框架。然后使用YOLO-R对目标进行检测,然后对帧内的目标进行深度排序跟踪。最后,利用卡尔曼滤波和GAN方法确定距离误差度量和对抗误差,以帮助确定视频中的事故。
{"title":"Generative adversarial networks (GANs) and object tracking (OT) for vehicle accident detection","authors":"Taraka Rama Krishna Kanth Kannuri, Kirsnaragavan Arudpiragasam, Klaus Schwarz, Michael Hartmann, Reiner Creutzburg","doi":"10.2352/ei.2023.35.3.mobmu-364","DOIUrl":"https://doi.org/10.2352/ei.2023.35.3.mobmu-364","url":null,"abstract":"Accident detection is one of the biggest challenges as there are various anomalies, occlusions, and objects in the image at different times. Therefore, this paper focuses on detecting traffic accidents through a combination of Object Tracking (OT) and image generation using GAN with variants such as skip connection, residual, and attention connection. The background removal techniques will be applied to reduce the background variation in the frame. Later, YOLO-R is used to detect objects, followed by DeepSort tracking of objects in the frame. Finally, the distance error metric and the adversarial error are determined using the Kalman filter and the GAN approach and help to decide accidents in videos.","PeriodicalId":73514,"journal":{"name":"IS&T International Symposium on Electronic Imaging","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135694714","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Optical flow for autonomous driving: Applications, challenges and improvements 自动驾驶的光流:应用、挑战和改进
Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.16.avm-128
Shihao Shen, Louis Kerofsky, Senthil Yogamani
Estimating optical flow presents unique challenges in AV applications: large translational motion, wide variations in depth of important objects, strong lens distortion in commonly used fisheye cameras and rolling shutter artefacts in dynamic scenes. Even simple translational motion can produce complicated optical flow fields. Lack of ground truth data also creates a challenge. We evaluate recent optical flow methods on fisheye imagery found in AV applications. We explore various training techniques in challenging scenarios and domain adaptation for transferring models trained on synthetic data where ground truth is available to real-world data. We propose novel strategies that facilitate learning robust representations efficiently to address low-light degeneracies. Finally, we discuss the main challenges and open problems in this problem domain.
估计光流在AV应用中提出了独特的挑战:大的平移运动,重要物体深度的广泛变化,常用鱼眼相机的强烈镜头畸变以及动态场景中的滚动快门伪影。即使是简单的平移运动也会产生复杂的光流场。地面真实数据的缺乏也带来了挑战。我们评估了最近在AV应用中发现的鱼眼图像的光流方法。我们在具有挑战性的场景和领域适应中探索各种训练技术,以转移在合成数据上训练的模型,其中地面真相可用于真实世界数据。我们提出了新的策略,促进学习鲁棒表示有效地解决弱光退化。最后,讨论了该问题领域的主要挑战和有待解决的问题。
{"title":"Optical flow for autonomous driving: Applications, challenges and improvements","authors":"Shihao Shen, Louis Kerofsky, Senthil Yogamani","doi":"10.2352/ei.2023.35.16.avm-128","DOIUrl":"https://doi.org/10.2352/ei.2023.35.16.avm-128","url":null,"abstract":"Estimating optical flow presents unique challenges in AV applications: large translational motion, wide variations in depth of important objects, strong lens distortion in commonly used fisheye cameras and rolling shutter artefacts in dynamic scenes. Even simple translational motion can produce complicated optical flow fields. Lack of ground truth data also creates a challenge. We evaluate recent optical flow methods on fisheye imagery found in AV applications. We explore various training techniques in challenging scenarios and domain adaptation for transferring models trained on synthetic data where ground truth is available to real-world data. We propose novel strategies that facilitate learning robust representations efficiently to address low-light degeneracies. Finally, we discuss the main challenges and open problems in this problem domain.","PeriodicalId":73514,"journal":{"name":"IS&T International Symposium on Electronic Imaging","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135644696","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
FastPoints: A state-of-the-art point cloud renderer for Unity FastPoints:最先进的Unity点云渲染器
Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.1.vda-394
Elias Neuman-Donihue, Michael Jarvis, Yuhao Zhu
In this paper, we introduce FastPoints, a state-of-the-art point cloud renderer for the Unity game development platform. Our program supports standard unprocessed point cloud formats with non-programmatic, drag-and-drop support, and creates an out-of-core data structure for large clouds without requiring an explicit preprocessing step; instead, the software renders a decimated point cloud immediately and constructs a shallow octree online, during which time the Unity editor remains fully interactive.
在本文中,我们将介绍用于Unity游戏开发平台的最先进的点云渲染器FastPoints。我们的程序支持标准的未处理的点云格式与非编程,拖放支持,并创建大型云的核心外数据结构,而不需要明确的预处理步骤;相反,软件会立即渲染一个毁坏的点云,并在线构建一个浅八叉树,在此期间,Unity编辑器保持完全交互。
{"title":"FastPoints: A state-of-the-art point cloud renderer for Unity","authors":"Elias Neuman-Donihue, Michael Jarvis, Yuhao Zhu","doi":"10.2352/ei.2023.35.1.vda-394","DOIUrl":"https://doi.org/10.2352/ei.2023.35.1.vda-394","url":null,"abstract":"In this paper, we introduce FastPoints, a state-of-the-art point cloud renderer for the Unity game development platform. Our program supports standard unprocessed point cloud formats with non-programmatic, drag-and-drop support, and creates an out-of-core data structure for large clouds without requiring an explicit preprocessing step; instead, the software renders a decimated point cloud immediately and constructs a shallow octree online, during which time the Unity editor remains fully interactive.","PeriodicalId":73514,"journal":{"name":"IS&T International Symposium on Electronic Imaging","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135694179","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Practical OSINT investigation - Similarity calculation using Reddit user profile data 实用OSINT调查-相似度计算使用Reddit用户资料数据
Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.3.mobmu-356
Valeria Vishnevskaya, Klaus Schwarz, Reiner Creutzburg
This paper presents a practical Open Source Intelligence (OSINT) use case for user similarity measurements with the use of open profile data from the Reddit social network. This PoC work combines the open data from Reddit and the part of the state-of-the-art BERT model. Using the PRAW Python library, the project fetches comments and posts of users. Then these texts are converted into a feature vector - representation of all user posts and comments. The main idea here is to create a comparable user's pair similarity score based on their comments and posts. For example, if we fix one user and calculate scores of all mutual pairs with other users, we will produce a total order on the set of all mutual pairs with that user. This total order can be described as a degree of written similarity with this chosen user. A set of "similar" users for one particular user can be used to recommend to the user interesting for him people. The similarity score also has a "transitive property": if $user_1$ is "similar" to $user_2$ and $user_2$ is similar to $user_3$ then inner properties of our model guarantees that $user_1$ and $user_3$ are pretty "similar" too. In this way, this score can be used to cluster a set of users into sets of "similar" users. It could be used in some recommendation algorithms or tune already existing algorithms to consider a cluster's peculiarities. Also, we can extend our model and calculate feature vectors for subreddits. In that way, we can find similar to the user's subreddits and recommend them to him.
本文提出了一个实用的开源智能(OSINT)用例,用于使用来自Reddit社交网络的开放个人资料数据进行用户相似性测量。这项PoC工作结合了Reddit的开放数据和最先进的BERT模型的一部分。该项目使用PRAW Python库获取用户的评论和帖子。然后将这些文本转换成一个特征向量-所有用户帖子和评论的表示。这里的主要思想是根据用户的评论和帖子创建一个可比较的用户配对相似度评分。例如,如果我们固定一个用户并计算与其他用户的所有互对的分数,我们将在与该用户的所有互对的集合上生成一个总排序。这个总顺序可以用与所选用户的书写相似度来描述。一个特定用户的一组“相似”用户可以用来向用户推荐他感兴趣的人。相似度得分也有一个“传递属性”:如果$user_1$与$user_2$“相似”,$user_2$与$user_3$相似,那么我们模型的内部属性保证$user_1$和$user_3$也非常“相似”。这样,这个分数就可以用来将一组用户聚类为“相似”用户集。它可以用在一些推荐算法中,或者调优已经存在的算法来考虑集群的特性。此外,我们可以扩展我们的模型并计算子reddit的特征向量。这样,我们就可以找到与用户相似的subreddits并推荐给他。
{"title":"Practical OSINT investigation - Similarity calculation using Reddit user profile data","authors":"Valeria Vishnevskaya, Klaus Schwarz, Reiner Creutzburg","doi":"10.2352/ei.2023.35.3.mobmu-356","DOIUrl":"https://doi.org/10.2352/ei.2023.35.3.mobmu-356","url":null,"abstract":"This paper presents a practical Open Source Intelligence (OSINT) use case for user similarity measurements with the use of open profile data from the Reddit social network. This PoC work combines the open data from Reddit and the part of the state-of-the-art BERT model. Using the PRAW Python library, the project fetches comments and posts of users. Then these texts are converted into a feature vector - representation of all user posts and comments. The main idea here is to create a comparable user's pair similarity score based on their comments and posts. For example, if we fix one user and calculate scores of all mutual pairs with other users, we will produce a total order on the set of all mutual pairs with that user. This total order can be described as a degree of written similarity with this chosen user. A set of \"similar\" users for one particular user can be used to recommend to the user interesting for him people. The similarity score also has a \"transitive property\": if $user_1$ is \"similar\" to $user_2$ and $user_2$ is similar to $user_3$ then inner properties of our model guarantees that $user_1$ and $user_3$ are pretty \"similar\" too. In this way, this score can be used to cluster a set of users into sets of \"similar\" users. It could be used in some recommendation algorithms or tune already existing algorithms to consider a cluster's peculiarities. Also, we can extend our model and calculate feature vectors for subreddits. In that way, we can find similar to the user's subreddits and recommend them to him.","PeriodicalId":73514,"journal":{"name":"IS&T International Symposium on Electronic Imaging","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135694712","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
A qualitative study of LiDAR technologies and their application areas 激光雷达技术及其应用领域的定性研究
Pub Date : 2023-01-16 DOI: 10.2352/ei.2023.35.3.mobmu-368
Daniel Jaster, Reiner Creutzburg, Eberhard Hasche
In this work, the most relevant 3D LiDAR technologies and their applications in 2022 were investigated. For this purpose, applications of LiDAR systems were classified into the typical application areas "3D modeling", "smart city", "robotics", "smart automotive" and "consumer goods". The investigation has shown that neither "mechanical" LiDAR technologies, nor so-called solid-state LiDAR technologies, nor "hybrid" LiDAR technologies can be evaluated as optimal for the typical application areas. In none of the application areas could all of the elaborated requirements be met. However, the "hybrid" LiDAR technologies such as sequential MEMS LiDAR technology and sequential flash LiDAR technology proved to be among the most suitable for most typical application areas. However, other technologies also tended to be suitable for individual typical application areas. Finally, it was found that several of the LiDAR technologies investigated are currently equally suitable for some typical application areas. To evaluate the suitability, concrete LiDAR systems - of different technologies and properties - were compared with the specific requirements of exemplary applications of an application area. The results of the investigation provide an orientation as to which LiDAR technology is promising for which application area.
本文对2022年最相关的3D激光雷达技术及其应用进行了研究。为此,将激光雷达系统的应用分为“3D建模”、“智慧城市”、“机器人”、“智能汽车”和“消费品”等典型应用领域。调查表明,无论是“机械”激光雷达技术,还是所谓的固态激光雷达技术,还是“混合”激光雷达技术,都不能被评估为典型应用领域的最佳技术。在任何一个应用领域中,都不可能满足所有详细阐述的需求。然而,“混合”激光雷达技术,如顺序MEMS激光雷达技术和顺序闪存激光雷达技术被证明是最适合大多数典型应用领域的技术。然而,其他技术也倾向于适合个别典型的应用领域。最后,研究发现,目前所研究的几种激光雷达技术同样适用于一些典型的应用领域。为了评估其适用性,将不同技术和特性的具体激光雷达系统与应用领域示例应用的具体要求进行了比较。研究结果为激光雷达技术在哪些应用领域有前景提供了方向。
{"title":"A qualitative study of LiDAR technologies and their application areas","authors":"Daniel Jaster, Reiner Creutzburg, Eberhard Hasche","doi":"10.2352/ei.2023.35.3.mobmu-368","DOIUrl":"https://doi.org/10.2352/ei.2023.35.3.mobmu-368","url":null,"abstract":"In this work, the most relevant 3D LiDAR technologies and their applications in 2022 were investigated. For this purpose, applications of LiDAR systems were classified into the typical application areas \"3D modeling\", \"smart city\", \"robotics\", \"smart automotive\" and \"consumer goods\". The investigation has shown that neither \"mechanical\" LiDAR technologies, nor so-called solid-state LiDAR technologies, nor \"hybrid\" LiDAR technologies can be evaluated as optimal for the typical application areas. In none of the application areas could all of the elaborated requirements be met. However, the \"hybrid\" LiDAR technologies such as sequential MEMS LiDAR technology and sequential flash LiDAR technology proved to be among the most suitable for most typical application areas. However, other technologies also tended to be suitable for individual typical application areas. Finally, it was found that several of the LiDAR technologies investigated are currently equally suitable for some typical application areas. To evaluate the suitability, concrete LiDAR systems - of different technologies and properties - were compared with the specific requirements of exemplary applications of an application area. The results of the investigation provide an orientation as to which LiDAR technology is promising for which application area.","PeriodicalId":73514,"journal":{"name":"IS&T International Symposium on Electronic Imaging","volume":null,"pages":null},"PeriodicalIF":0.0,"publicationDate":"2023-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135694715","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
IS&T International Symposium on Electronic Imaging
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1