首页 > 最新文献

2010 IEEE International Symposium on Mixed and Augmented Reality最新文献

英文 中文
Haptic simulation of breast cancer palpation: A case study of haptic augmented reality 乳腺癌触诊的触觉模拟:触觉增强现实的案例研究
Pub Date : 2010-11-22 DOI: 10.1109/ISMAR.2010.5643585
Seokhee Jeon, B. Knoerlein, M. Harders, Seungmoon Choi
Haptic augmented reality (AR) allows to modulate the haptic properties of a real object by providing virtual haptic feedback. We previously developed a haptic AR system wherein the stiffness of a real object can be augmented with the aid of a haptic interface. To demonstrate its potential, this paper presents a case study for medical training of breast cancer palpation. A real breast model made of soft silicone is augmented with a virtual tumor rendered inside. Haptic stimuli for the virtual tumor are generated based on a contact dynamics model identified via real measurements, without the need of geometric information on the breast. A subjective evaluation confirmed the realism and fidelity of our palpation system.
触觉增强现实(AR)允许通过提供虚拟触觉反馈来调节真实物体的触觉特性。我们之前开发了一种触觉增强现实系统,其中真实物体的刚度可以通过触觉界面来增强。为了证明它的潜力,本文提出了一个乳腺癌触诊医学培训的案例研究。一个真实的乳房模型由柔软的硅胶制成,里面有一个虚拟的肿瘤。虚拟肿瘤的触觉刺激是基于通过实际测量确定的接触动力学模型产生的,不需要乳房上的几何信息。主观评价证实了我们的触诊系统的真实感和保真度。
{"title":"Haptic simulation of breast cancer palpation: A case study of haptic augmented reality","authors":"Seokhee Jeon, B. Knoerlein, M. Harders, Seungmoon Choi","doi":"10.1109/ISMAR.2010.5643585","DOIUrl":"https://doi.org/10.1109/ISMAR.2010.5643585","url":null,"abstract":"Haptic augmented reality (AR) allows to modulate the haptic properties of a real object by providing virtual haptic feedback. We previously developed a haptic AR system wherein the stiffness of a real object can be augmented with the aid of a haptic interface. To demonstrate its potential, this paper presents a case study for medical training of breast cancer palpation. A real breast model made of soft silicone is augmented with a virtual tumor rendered inside. Haptic stimuli for the virtual tumor are generated based on a contact dynamics model identified via real measurements, without the need of geometric information on the breast. A subjective evaluation confirmed the realism and fidelity of our palpation system.","PeriodicalId":250608,"journal":{"name":"2010 IEEE International Symposium on Mixed and Augmented Reality","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"126443264","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 25
AR-based visibility evaluation for preserving landscapes of historical buildings 基于ar的历史建筑景观保护可视性评价
Pub Date : 2010-11-22 DOI: 10.1109/ISMAR.2010.5643607
N. Yabuki, Kyoko Miyashita, T. Fukuda
Building tall structures behind an aesthetic and historical building tends to destroy the good landscape. To avoid such situations, public agencies must regulate height of buildings and other structures near the landscape target. In order to check the visibility of portions of high, future structures, in this research, a new method using Augmented Reality (AR) was proposed. In this method, a number of virtual rectangular objects with a scale are located on the grid of 3D geographical model. And then, the virtual rulers are shown in an overlapping manner with the actual landscape from multiple viewpoints using the AR technology. The user measures the maximum skyline-preserving height for each rectangular object at a grid point. Using the measured data, the government or public agencies can establish appropriate height regulations for all surrounding areas of the target structures. To verify the proposed method, a system was developed deploying AR Toolkit and was applied to a scenic building. The performance of the system was checked and then, the errors of the obtained data were evaluated. In conclusion, the proposed method was evaluated feasible and effective.
在美学和历史建筑后面建造高层建筑往往会破坏良好的景观。为了避免这种情况,公共机构必须规范景观目标附近的建筑物和其他结构的高度。为了检验未来高层结构部分的可见性,本研究提出了一种使用增强现实(AR)的新方法。该方法在三维地理模型的网格上定位若干具有一定比例的虚拟矩形物体。然后,使用AR技术,虚拟尺子以与实际景观重叠的方式从多个视点显示。用户测量网格点上每个矩形对象的最大天际线保持高度。利用测量数据,政府或公共机构可以为目标结构的所有周围区域制定适当的高度规定。为了验证所提出的方法,利用AR Toolkit开发了一个系统,并将其应用于一个风景名胜建筑。对系统的性能进行了检验,并对所得数据的误差进行了评价。综上所述,该方法是可行和有效的。
{"title":"AR-based visibility evaluation for preserving landscapes of historical buildings","authors":"N. Yabuki, Kyoko Miyashita, T. Fukuda","doi":"10.1109/ISMAR.2010.5643607","DOIUrl":"https://doi.org/10.1109/ISMAR.2010.5643607","url":null,"abstract":"Building tall structures behind an aesthetic and historical building tends to destroy the good landscape. To avoid such situations, public agencies must regulate height of buildings and other structures near the landscape target. In order to check the visibility of portions of high, future structures, in this research, a new method using Augmented Reality (AR) was proposed. In this method, a number of virtual rectangular objects with a scale are located on the grid of 3D geographical model. And then, the virtual rulers are shown in an overlapping manner with the actual landscape from multiple viewpoints using the AR technology. The user measures the maximum skyline-preserving height for each rectangular object at a grid point. Using the measured data, the government or public agencies can establish appropriate height regulations for all surrounding areas of the target structures. To verify the proposed method, a system was developed deploying AR Toolkit and was applied to a scenic building. The performance of the system was checked and then, the errors of the obtained data were evaluated. In conclusion, the proposed method was evaluated feasible and effective.","PeriodicalId":250608,"journal":{"name":"2010 IEEE International Symposium on Mixed and Augmented Reality","volume":"60 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131227464","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
3DOF tracking accuracy improvement for outdoor Augmented Reality 户外增强现实3DOF跟踪精度的提高
Pub Date : 2010-11-22 DOI: 10.1109/ISMAR.2010.5643598
Joonsuk Park, Jun Park
Outdoor Augmented Reality (AR) gained popularity recently due to its potential for location based mobile services. However, most commercially available Global Positioning Systems (GPS), except for the expensive high-end models, do not provide accurate location information that is enough to be used for displaying practically meaningful location based information. In this paper, we present a computer vision based method for improving user's two dimensional location and one-dimensional orientation, the initial values of which are obtained from a GPS and a digital compass. Our method utilizes corner positions of buildings in the map and the vertical edges of the buildings in the captured images. We applied anisotropic diffusion in order to filter noise and preserve edges, and dual vertical edge filters on gray and saturation images. Our method is suitable for mobile services in urban environments where tall buildings degrade GPS signals. In average, our method improved 15.0 meters in position and 2.2 degrees in orientation.
户外增强现实(AR)最近因其基于位置的移动服务的潜力而受到欢迎。然而,大多数商用全球定位系统(GPS),除了昂贵的高端型号,不能提供准确的位置信息,不足以显示实际有意义的基于位置的信息。本文提出了一种基于计算机视觉的改进用户二维定位和一维方位的方法,其初始值由GPS和数字罗盘获得。我们的方法利用地图中建筑物的角落位置和捕获图像中建筑物的垂直边缘。我们采用各向异性扩散来过滤噪声和保留边缘,并对灰度和饱和图像进行双垂直边缘滤波。我们的方法适用于城市环境下的移动业务,因为高楼大厦会降低GPS信号。我们的方法平均提高了15.0米的位置和2.2度的方向。
{"title":"3DOF tracking accuracy improvement for outdoor Augmented Reality","authors":"Joonsuk Park, Jun Park","doi":"10.1109/ISMAR.2010.5643598","DOIUrl":"https://doi.org/10.1109/ISMAR.2010.5643598","url":null,"abstract":"Outdoor Augmented Reality (AR) gained popularity recently due to its potential for location based mobile services. However, most commercially available Global Positioning Systems (GPS), except for the expensive high-end models, do not provide accurate location information that is enough to be used for displaying practically meaningful location based information. In this paper, we present a computer vision based method for improving user's two dimensional location and one-dimensional orientation, the initial values of which are obtained from a GPS and a digital compass. Our method utilizes corner positions of buildings in the map and the vertical edges of the buildings in the captured images. We applied anisotropic diffusion in order to filter noise and preserve edges, and dual vertical edge filters on gray and saturation images. Our method is suitable for mobile services in urban environments where tall buildings degrade GPS signals. In average, our method improved 15.0 meters in position and 2.2 degrees in orientation.","PeriodicalId":250608,"journal":{"name":"2010 IEEE International Symposium on Mixed and Augmented Reality","volume":"38 8","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"114022667","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 10
The City of Sights: Design, construction, and measurement of an Augmented Reality stage set 城市的景观:设计,建设和测量增强现实舞台设置
Pub Date : 2010-11-22 DOI: 10.1109/ISMAR.2010.5643564
Lukas Gruber, Steffen Gauglitz, Jonathan Ventura, S. Zollmann, Manuel J. Huber, M. Schlegel, G. Klinker, D. Schmalstieg, Tobias Höllerer
We describe the design and implementation of a physical and virtual model of an imaginary urban scene—the “City of Sights”— that can serve as a backdrop or “stage” for a variety of Augmented Reality (AR) research. We argue that the AR research community would benefit from such a standard model dataset which can be used for evaluation of such AR topics as tracking systems, modeling, spatial AR, rendering tests, collaborative AR and user interface design. By openly sharing the digital blueprints and assembly instructions for our models, we allow the proposed set to be physically replicable by anyone and permit customization and experimental changes to the stage design which enable comprehensive exploration of algorithms and methods. Furthermore we provide an accompanying rich dataset consisting of video sequences under varying conditions with ground truth camera pose. We employed three different ground truth acquisition methods to support a broad range of use cases. The goal of our design is to enable and improve the replicability and evaluation of future augmented reality research.
我们描述了一个虚拟城市场景的物理和虚拟模型的设计和实现——“城市景观”——它可以作为各种增强现实(AR)研究的背景或“舞台”。我们认为,AR研究界将受益于这样一个标准模型数据集,该数据集可用于评估诸如跟踪系统、建模、空间AR、渲染测试、协作AR和用户界面设计等AR主题。通过公开分享我们模型的数字蓝图和组装说明,我们允许任何人都可以物理复制提议的集合,并允许对舞台设计进行定制和实验更改,从而能够全面探索算法和方法。此外,我们还提供了一个随附的丰富数据集,该数据集由不同条件下的视频序列组成,具有地面真实摄像机姿态。我们采用了三种不同的ground truth获取方法来支持广泛的用例。我们设计的目标是实现和提高未来增强现实研究的可复制性和评估。
{"title":"The City of Sights: Design, construction, and measurement of an Augmented Reality stage set","authors":"Lukas Gruber, Steffen Gauglitz, Jonathan Ventura, S. Zollmann, Manuel J. Huber, M. Schlegel, G. Klinker, D. Schmalstieg, Tobias Höllerer","doi":"10.1109/ISMAR.2010.5643564","DOIUrl":"https://doi.org/10.1109/ISMAR.2010.5643564","url":null,"abstract":"We describe the design and implementation of a physical and virtual model of an imaginary urban scene—the “City of Sights”— that can serve as a backdrop or “stage” for a variety of Augmented Reality (AR) research. We argue that the AR research community would benefit from such a standard model dataset which can be used for evaluation of such AR topics as tracking systems, modeling, spatial AR, rendering tests, collaborative AR and user interface design. By openly sharing the digital blueprints and assembly instructions for our models, we allow the proposed set to be physically replicable by anyone and permit customization and experimental changes to the stage design which enable comprehensive exploration of algorithms and methods. Furthermore we provide an accompanying rich dataset consisting of video sequences under varying conditions with ground truth camera pose. We employed three different ground truth acquisition methods to support a broad range of use cases. The goal of our design is to enable and improve the replicability and evaluation of future augmented reality research.","PeriodicalId":250608,"journal":{"name":"2010 IEEE International Symposium on Mixed and Augmented Reality","volume":"10 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132674603","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 39
Foreground and shadow occlusion handling for outdoor augmented reality 户外增强现实的前景和阴影遮挡处理
Pub Date : 2010-11-22 DOI: 10.1109/ISMAR.2010.5643558
B. Lu, Tetsuya Kakuta, Rei Kawakami, Takeshi Oishi, K. Ikeuchi
Occlusion handling in augmented reality (AR) applications is challenging in synthesizing virtual objects correctly into the real scene with respect to existing foregrounds and shadows. Furthermore, outdoor environment makes the task more difficult due to the unpredictable illumination changes. This paper proposes novel outdoor illumination constraints for resolving the foreground occlusion problem in outdoor environment. The constraints can be also integrated into a probabilistic model of multiple cues for a better segmentation of the foreground. In addition, we introduce an effective method to resolve the shadow occlusion problem by using shadow detection and recasting with a spherical vision camera. We have applied the system in our digital cultural heritage project named Virtual Asuka (VA) and verified the effectiveness of the system.
增强现实(AR)应用中的遮挡处理在将虚拟物体正确地合成到真实场景中具有挑战性,相对于现有的前景和阴影。此外,室外环境由于不可预测的光照变化,使得任务更加困难。本文提出了一种新的室外光照约束来解决室外环境下的前景遮挡问题。约束也可以集成到多个线索的概率模型中,以便更好地分割前景。此外,我们还介绍了一种有效的解决阴影遮挡问题的方法,即利用球面视觉相机进行阴影检测和重投影。我们将该系统应用于我们的数字文化遗产项目Virtual Asuka (VA)中,并验证了该系统的有效性。
{"title":"Foreground and shadow occlusion handling for outdoor augmented reality","authors":"B. Lu, Tetsuya Kakuta, Rei Kawakami, Takeshi Oishi, K. Ikeuchi","doi":"10.1109/ISMAR.2010.5643558","DOIUrl":"https://doi.org/10.1109/ISMAR.2010.5643558","url":null,"abstract":"Occlusion handling in augmented reality (AR) applications is challenging in synthesizing virtual objects correctly into the real scene with respect to existing foregrounds and shadows. Furthermore, outdoor environment makes the task more difficult due to the unpredictable illumination changes. This paper proposes novel outdoor illumination constraints for resolving the foreground occlusion problem in outdoor environment. The constraints can be also integrated into a probabilistic model of multiple cues for a better segmentation of the foreground. In addition, we introduce an effective method to resolve the shadow occlusion problem by using shadow detection and recasting with a spherical vision camera. We have applied the system in our digital cultural heritage project named Virtual Asuka (VA) and verified the effectiveness of the system.","PeriodicalId":250608,"journal":{"name":"2010 IEEE International Symposium on Mixed and Augmented Reality","volume":"61 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"128975529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 26
Video stabilization to a global 3D frame of reference by fusing orientation sensor and image alignment data 通过融合方向传感器和图像对准数据实现视频稳定到全局三维参考框架
Pub Date : 2010-11-22 DOI: 10.1109/ISMAR.2010.5643595
Oscar Nestares, Yoram Gat, H. Haussecker, I. Kozintsev
Estimating the 3D orientation of the camera in a video sequence within a global frame of reference is useful for video stabilization when displaying the video in a virtual 3D environment, as well as for accurate navigation and other applications. This task requires the input of orientation sensors attached to the camera to provide absolute 3D orientation in a geographical frame of reference. However, high-frequency noise in the sensor readings makes it impossible to achieve accurate orientation estimates required for visually stable presentation of video sequences that were acquired with a camera subject to jitter, such as a handheld camera or a vehicle mounted camera. On the other hand, image alignment has proven successful for image stabilization, providing accurate frame-to-frame orientation estimates but drifting over time due to error and bias accumulation and lacking absolute orientation. In this paper we propose a practical method for generating high accuracy estimates of the 3D orientation of the camera within a global frame of reference by fusing orientation estimates from an efficient image-based alignment method, and the estimates from an orientation sensor, overcoming the limitations of the component methods.
在全局参考框架内估计视频序列中摄像机的3D方向对于在虚拟3D环境中显示视频时的视频稳定以及精确导航和其他应用非常有用。这项任务需要连接在相机上的方向传感器的输入,以提供地理参照系中的绝对3D方向。然而,传感器读数中的高频噪声使其无法实现准确的方向估计,而这些方向估计是由受抖动影响的摄像机(如手持摄像机或车载摄像机)获得的视频序列的视觉稳定呈现所必需的。另一方面,图像对准已被证明是成功的图像稳定,提供准确的帧对帧方向估计,但由于误差和偏差积累以及缺乏绝对方向而随着时间的推移而漂移。在本文中,我们提出了一种实用的方法,通过融合来自有效的基于图像的对准方法的方向估计和来自方向传感器的估计,在全局参考框架内生成高精度的相机三维方向估计,克服了组件方法的局限性。
{"title":"Video stabilization to a global 3D frame of reference by fusing orientation sensor and image alignment data","authors":"Oscar Nestares, Yoram Gat, H. Haussecker, I. Kozintsev","doi":"10.1109/ISMAR.2010.5643595","DOIUrl":"https://doi.org/10.1109/ISMAR.2010.5643595","url":null,"abstract":"Estimating the 3D orientation of the camera in a video sequence within a global frame of reference is useful for video stabilization when displaying the video in a virtual 3D environment, as well as for accurate navigation and other applications. This task requires the input of orientation sensors attached to the camera to provide absolute 3D orientation in a geographical frame of reference. However, high-frequency noise in the sensor readings makes it impossible to achieve accurate orientation estimates required for visually stable presentation of video sequences that were acquired with a camera subject to jitter, such as a handheld camera or a vehicle mounted camera. On the other hand, image alignment has proven successful for image stabilization, providing accurate frame-to-frame orientation estimates but drifting over time due to error and bias accumulation and lacking absolute orientation. In this paper we propose a practical method for generating high accuracy estimates of the 3D orientation of the camera within a global frame of reference by fusing orientation estimates from an efficient image-based alignment method, and the estimates from an orientation sensor, overcoming the limitations of the component methods.","PeriodicalId":250608,"journal":{"name":"2010 IEEE International Symposium on Mixed and Augmented Reality","volume":"34 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"130270431","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 9
Designing and comparing two-handed gestures to confirm links between user controlled objects 设计和比较双手手势,以确认用户控制的对象之间的联系
Pub Date : 2010-11-22 DOI: 10.1109/ISMAR.2010.5643592
P. Maier, M. Tönnis, G. Klinker
Systems using two-handed spatial manipulation techniques also require strategies to enable system control tasks. These strategies make it possible to interact with the system comfortably while controlling two hand-held objects simultaneously.
使用双手空间操纵技术的系统也需要策略来实现系统控制任务。这些策略使得在同时控制两个手持对象的同时与系统进行舒适的交互成为可能。
{"title":"Designing and comparing two-handed gestures to confirm links between user controlled objects","authors":"P. Maier, M. Tönnis, G. Klinker","doi":"10.1109/ISMAR.2010.5643592","DOIUrl":"https://doi.org/10.1109/ISMAR.2010.5643592","url":null,"abstract":"Systems using two-handed spatial manipulation techniques also require strategies to enable system control tasks. These strategies make it possible to interact with the system comfortably while controlling two hand-held objects simultaneously.","PeriodicalId":250608,"journal":{"name":"2010 IEEE International Symposium on Mixed and Augmented Reality","volume":"117 16","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"131913863","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 4
Interactive modelling for AR applications AR应用的交互式建模
Pub Date : 2010-11-22 DOI: 10.1109/ISMAR.2010.5643570
J. Bastian, Ben Ward, R. Hill, A. Hengel, A. Dick
We present a method for estimating the 3D shape of an object from a sequence of images captured by a hand-held device. The method is well suited to augmented reality applications in that minimal user interaction is required, and the models generated are of an appropriate form. The method proceeds by segmenting the object in every image as it is captured and using the calculated silhouette to update the current shape estimate. In contrast to previous silhouettebased modelling approaches, however, the segmentation process is informed by a 3D prior based on the previous shape estimate. A voting scheme is also introduced in order to compensate for the inevitable noise in the camera position estimates. The combination of the voting scheme with the closed-loop segmentation process provides a robust and flexible shape estimation method. We demonstrate the approach on a number of scenes where segmentation without a 3D prior would be challenging.
我们提出了一种方法来估计一个对象的三维形状从一个手持设备捕获的图像序列。该方法非常适合于增强现实应用程序,因为它需要最少的用户交互,并且生成的模型具有适当的形式。该方法首先对捕获的每个图像中的物体进行分割,并使用计算出的轮廓更新当前形状估计。然而,与先前基于轮廓的建模方法相反,分割过程是由基于先前形状估计的3D先验通知的。为了补偿摄像机位置估计中不可避免的噪声,还引入了一种投票方案。将投票方案与闭环分割过程相结合,提供了一种鲁棒灵活的形状估计方法。我们在许多场景中展示了这种方法,在这些场景中,没有3D先验的分割将是具有挑战性的。
{"title":"Interactive modelling for AR applications","authors":"J. Bastian, Ben Ward, R. Hill, A. Hengel, A. Dick","doi":"10.1109/ISMAR.2010.5643570","DOIUrl":"https://doi.org/10.1109/ISMAR.2010.5643570","url":null,"abstract":"We present a method for estimating the 3D shape of an object from a sequence of images captured by a hand-held device. The method is well suited to augmented reality applications in that minimal user interaction is required, and the models generated are of an appropriate form. The method proceeds by segmenting the object in every image as it is captured and using the calculated silhouette to update the current shape estimate. In contrast to previous silhouettebased modelling approaches, however, the segmentation process is informed by a 3D prior based on the previous shape estimate. A voting scheme is also introduced in order to compensate for the inevitable noise in the camera position estimates. The combination of the voting scheme with the closed-loop segmentation process provides a robust and flexible shape estimation method. We demonstrate the approach on a number of scenes where segmentation without a 3D prior would be challenging.","PeriodicalId":250608,"journal":{"name":"2010 IEEE International Symposium on Mixed and Augmented Reality","volume":"12 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133470841","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 29
Camera pose navigation using Augmented Reality 相机姿态导航使用增强现实
Pub Date : 2010-11-22 DOI: 10.1109/ISMAR.2010.5643602
Jun Shingu, E. Rieffel, Don Kimber, Jim Vaughan, Pernilla Qvarfordt, K. Tuite
We propose an Augmented Reality (AR) system that helps users take a picture from a designated pose, such as the position and camera angle of an earlier photo. Repeat photography is frequently used to observe and document changes in an object. Our system uses AR technology to estimate camera poses in real time. When a user takes a photo, the camera pose is saved as a “view bookmark”. To support a user in taking a repeat photo, two simple graphics are rendered in an AR viewer on the camera's screen to guide the user to this bookmarked view. The system then uses image adjustment techniques to create an image based on the user's repeat photo that is even closer to the original.
我们提出了一种增强现实(AR)系统,可以帮助用户从指定的姿势拍照,例如先前照片的位置和相机角度。重复摄影经常被用来观察和记录物体的变化。我们的系统使用AR技术来实时估计相机的姿势。当用户拍照时,相机姿势会被保存为“查看书签”。为了支持用户重复拍摄照片,在相机屏幕上的AR查看器中呈现了两个简单的图形,以引导用户进入这个书签视图。然后,系统使用图像调整技术根据用户的重复照片创建更接近原始照片的图像。
{"title":"Camera pose navigation using Augmented Reality","authors":"Jun Shingu, E. Rieffel, Don Kimber, Jim Vaughan, Pernilla Qvarfordt, K. Tuite","doi":"10.1109/ISMAR.2010.5643602","DOIUrl":"https://doi.org/10.1109/ISMAR.2010.5643602","url":null,"abstract":"We propose an Augmented Reality (AR) system that helps users take a picture from a designated pose, such as the position and camera angle of an earlier photo. Repeat photography is frequently used to observe and document changes in an object. Our system uses AR technology to estimate camera poses in real time. When a user takes a photo, the camera pose is saved as a “view bookmark”. To support a user in taking a repeat photo, two simple graphics are rendered in an AR viewer on the camera's screen to guide the user to this bookmarked view. The system then uses image adjustment techniques to create an image based on the user's repeat photo that is even closer to the original.","PeriodicalId":250608,"journal":{"name":"2010 IEEE International Symposium on Mixed and Augmented Reality","volume":"17 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"133676346","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 11
The importance of eye-contact for collaboration in AR systems 在AR系统中,目光接触对于协作的重要性
Pub Date : 2010-11-22 DOI: 10.1109/ISMAR.2010.5643559
E. Prytz, Susanna Nilsson, Arne Jönsson
Eye contact is believed to be an important factor in normal human communication and as a result of this a head mounted display (HMD) is often seen as something intrusive and limiting. This can be especially problematic when AR is used in a collaborative setting. The study presented in this paper aims to investigate the effects an HMD-based AR system can have on eye contact behaviour between participants in a collaborative task and thus, in extension, the effects of the HMD on collaboration itself. The focus of the study is on task-oriented collaboration between professionals. The participants worked through three different scenarios alternating between HMDs and regular paper maps with the purpose of managing the crisis response to a simulated major forest fire. Correlations between eye contact between participants and questionnaire items concerning team- and taskwork were analysed, indicating that, for the paper map condition, a high amount of eye contact is associated with low confidence and trust in the artefacts used (i.e. paper map and symbols). The amount of eye-contact in both conditions was very low. It was significantly higher for conditions without HMDs. However, the confidence and trust in the artefacts was generally rated significantly higher with HMDs than without. In conclusion, the decrease in eye contact with HMDs does not seem to have a direct effect on the collaboration in a professional, task-oriented context. This is contrary to popular assumptions and the results are relevant for future design choices for AR systems using HMDs.
目光接触被认为是正常人类交流的一个重要因素,因此,头戴式显示器(HMD)经常被视为侵入性和限制性的东西。当AR在协作环境中使用时,这尤其成问题。本文提出的研究旨在调查基于HMD的AR系统对协作任务中参与者之间眼神接触行为的影响,从而延伸到HMD对协作本身的影响。本研究的重点是专业人员之间的任务导向协作。参与者通过三种不同的场景,在hmd和常规纸质地图之间交替进行,目的是管理对模拟森林大火的危机反应。参与者之间的目光接触与问卷中关于团队和任务的项目之间的相关性进行了分析,表明,在纸质地图条件下,大量的目光接触与对所使用的人工制品(即纸质地图和符号)的低信心和信任有关。在这两种情况下,眼神接触的次数都很低。在没有hmd的情况下,这一比例明显更高。然而,对人工制品的信心和信任通常被认为比没有hmd的人高得多。总之,在专业的、以任务为导向的环境中,与头戴式显示器眼神接触的减少似乎对合作没有直接影响。这与流行的假设相反,结果与使用头显的AR系统的未来设计选择相关。
{"title":"The importance of eye-contact for collaboration in AR systems","authors":"E. Prytz, Susanna Nilsson, Arne Jönsson","doi":"10.1109/ISMAR.2010.5643559","DOIUrl":"https://doi.org/10.1109/ISMAR.2010.5643559","url":null,"abstract":"Eye contact is believed to be an important factor in normal human communication and as a result of this a head mounted display (HMD) is often seen as something intrusive and limiting. This can be especially problematic when AR is used in a collaborative setting. The study presented in this paper aims to investigate the effects an HMD-based AR system can have on eye contact behaviour between participants in a collaborative task and thus, in extension, the effects of the HMD on collaboration itself. The focus of the study is on task-oriented collaboration between professionals. The participants worked through three different scenarios alternating between HMDs and regular paper maps with the purpose of managing the crisis response to a simulated major forest fire. Correlations between eye contact between participants and questionnaire items concerning team- and taskwork were analysed, indicating that, for the paper map condition, a high amount of eye contact is associated with low confidence and trust in the artefacts used (i.e. paper map and symbols). The amount of eye-contact in both conditions was very low. It was significantly higher for conditions without HMDs. However, the confidence and trust in the artefacts was generally rated significantly higher with HMDs than without. In conclusion, the decrease in eye contact with HMDs does not seem to have a direct effect on the collaboration in a professional, task-oriented context. This is contrary to popular assumptions and the results are relevant for future design choices for AR systems using HMDs.","PeriodicalId":250608,"journal":{"name":"2010 IEEE International Symposium on Mixed and Augmented Reality","volume":"358 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"122811610","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 13
期刊
2010 IEEE International Symposium on Mixed and Augmented Reality
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1