Current trends in digital display technology show a marked interest towards 3D displays, which allow three dimensional images to be conveyed to viewers. Among various 3D display techniques, auto stereoscopic display appears to be promising due to the use of optical trickery at the display, allowing glass-free viewing. However, the cost of generating and transmitting the auto stereoscopic images is usually quite high due to the huge amount of data. Hence, it is challenging to acquire artifact-free 3D images in real-time. This paper presents a system to generate and display high-resolution auto stereoscopic images at full HD resolution, i.e., 1920*1080*24. We show that the video-plus-depth data representation enables a scalable system architecture and efficient data transition. The proposed GPU accelerated depth image-based rendering (DIBR) algorithm and multiplexing algorithm are able to synthesize auto stereoscopic images in real-time. The synthesized images are then displayed on the auto stereoscopic screen that is mounted on a conventional LCD monitor. We demonstrate our system to both indoor activities and natural scenes.
{"title":"A System for Capturing, Rendering and Multiplexing Images on Multi-view Autostereoscopic Display","authors":"H. S. Tan, Jiazhi Xia, Ying He, Y. Guan","doi":"10.1109/CW.2010.27","DOIUrl":"https://doi.org/10.1109/CW.2010.27","url":null,"abstract":"Current trends in digital display technology show a marked interest towards 3D displays, which allow three dimensional images to be conveyed to viewers. Among various 3D display techniques, auto stereoscopic display appears to be promising due to the use of optical trickery at the display, allowing glass-free viewing. However, the cost of generating and transmitting the auto stereoscopic images is usually quite high due to the huge amount of data. Hence, it is challenging to acquire artifact-free 3D images in real-time. This paper presents a system to generate and display high-resolution auto stereoscopic images at full HD resolution, i.e., 1920*1080*24. We show that the video-plus-depth data representation enables a scalable system architecture and efficient data transition. The proposed GPU accelerated depth image-based rendering (DIBR) algorithm and multiplexing algorithm are able to synthesize auto stereoscopic images in real-time. The synthesized images are then displayed on the auto stereoscopic screen that is mounted on a conventional LCD monitor. We demonstrate our system to both indoor activities and natural scenes.","PeriodicalId":410870,"journal":{"name":"2010 International Conference on Cyberworlds","volume":"30 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"132980189","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The generalized cross-correlation using the phase transform prefilter remains popular for the estimation of time-differences-of-arrival. However it is not robust to noise and as a consequence, the performance of direction-of-arrival algorithms is often degraded under low signal-to-noise condition. We propose to address this problem through the use of a wavelet-based speech enhancement technique since the wavelet transform can achieve good denoising performance. The over complete rational-dilation wavelet transform is then exploited to effectively process speech signals due to its higher frequency resolution. In addition, we exploit the joint distribution of the speech in the wavelet domain and develop a novel local noise variance estimator based on the bivariate shrinkage function. As will be shown, our proposed algorithm achieves good direction-of-arrival performance in the presence of noise.
{"title":"Improvement of Speech Source Localization in Noisy Environment Using Overcomplete Rational-Dilation Wavelet Transforms","authors":"Di Liu, Andy W. H. Khong","doi":"10.1109/CW.2010.69","DOIUrl":"https://doi.org/10.1109/CW.2010.69","url":null,"abstract":"The generalized cross-correlation using the phase transform prefilter remains popular for the estimation of time-differences-of-arrival. However it is not robust to noise and as a consequence, the performance of direction-of-arrival algorithms is often degraded under low signal-to-noise condition. We propose to address this problem through the use of a wavelet-based speech enhancement technique since the wavelet transform can achieve good denoising performance. The over complete rational-dilation wavelet transform is then exploited to effectively process speech signals due to its higher frequency resolution. In addition, we exploit the joint distribution of the speech in the wavelet domain and develop a novel local noise variance estimator based on the bivariate shrinkage function. As will be shown, our proposed algorithm achieves good direction-of-arrival performance in the presence of noise.","PeriodicalId":410870,"journal":{"name":"2010 International Conference on Cyberworlds","volume":"59 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123549350","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The rapid development of World Wide Web and the dominance of networked computers for information transfer and communication have enabled the rise of virtual worlds (e.g. Second Life™). This paper introduces our virtual campus-Virtual CUHK (VCUHK) project which builds a 3D virtual campus of the Chinese University of Hong Kong (CUHK) in networked virtual worlds. VCUHK is a 3D shared networked virtual world of the real campus of CUHK built with Open Simulator platform, an open source virtual world server project that has an adaptation of the basic server functionality of the Second Life™ servers. The real CUHK campus occupies approximately the area of 2 square km with hilly terrain and diverse and unique landscape, and has a great number of buildings with very sophisticated architecture. By using Second Life™ viewer (an open source 3D virtual world viewer) or other compatible viewers, users can access VCUHK from any Internet-connected personal computer running MS windows or Linux. Users can immerse in VCUHK being anything with the form of 3D modeling avatar and experience virtual education and other diverse campus activities.
{"title":"VCUHK: Integrating the Real into a 3D Campus in Networked Virtual Worlds","authors":"Bin Chen, F. Huang, Hui Lin, Mingyuan Hu","doi":"10.1109/CW.2010.25","DOIUrl":"https://doi.org/10.1109/CW.2010.25","url":null,"abstract":"The rapid development of World Wide Web and the dominance of networked computers for information transfer and communication have enabled the rise of virtual worlds (e.g. Second Life™). This paper introduces our virtual campus-Virtual CUHK (VCUHK) project which builds a 3D virtual campus of the Chinese University of Hong Kong (CUHK) in networked virtual worlds. VCUHK is a 3D shared networked virtual world of the real campus of CUHK built with Open Simulator platform, an open source virtual world server project that has an adaptation of the basic server functionality of the Second Life™ servers. The real CUHK campus occupies approximately the area of 2 square km with hilly terrain and diverse and unique landscape, and has a great number of buildings with very sophisticated architecture. By using Second Life™ viewer (an open source 3D virtual world viewer) or other compatible viewers, users can access VCUHK from any Internet-connected personal computer running MS windows or Linux. Users can immerse in VCUHK being anything with the form of 3D modeling avatar and experience virtual education and other diverse campus activities.","PeriodicalId":410870,"journal":{"name":"2010 International Conference on Cyberworlds","volume":"49 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"120913407","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Zin-Yan Chua, Yilin Kang, Xing Jiang, Kah-Hoe Pang, Andrew C. Gregory, C. Tan, Wai-Lun Wong, A. Tan, Y. Ong, C. Miao
We have designed and implemented a 3D virtual world based on the Co-Space concept encompasses the Youth Olympic Village (YOV) and several sports competition venues. It is a massively multiplayer online (MMO) virtual world built according to the actual, physical locations of the YOV and sports competition venues. On top of that, the Co-Space is being populated with human-like avatars, which are created according to the actual human size and appearance, they perform their activities and interact with the users in real-world context. In addition, autonomous intelligent agents are integrated into the Co-Space to provide context-aware and personalized services to the users. These agents, which are in the form of human-like avatars, act as the users’ personal tour guides, they interact with the users and gradually learn the users’ preferences. Then, the agents are able to suggest suitable locations for the users to visit. The intention of deploying these agents is to enrich the Co-Space with a variety of interactions tailored to each user’s preferences instead of the same contents for everyone. Besides, our Co-Space also provides an avenue for people from different locations throughout the world to explore the YOV and experience the atmosphere of the sports events in Singapore.
{"title":"Youth Olympic Village Co-space","authors":"Zin-Yan Chua, Yilin Kang, Xing Jiang, Kah-Hoe Pang, Andrew C. Gregory, C. Tan, Wai-Lun Wong, A. Tan, Y. Ong, C. Miao","doi":"10.1109/CW.2010.67","DOIUrl":"https://doi.org/10.1109/CW.2010.67","url":null,"abstract":"We have designed and implemented a 3D virtual world based on the Co-Space concept encompasses the Youth Olympic Village (YOV) and several sports competition venues. It is a massively multiplayer online (MMO) virtual world built according to the actual, physical locations of the YOV and sports competition venues. On top of that, the Co-Space is being populated with human-like avatars, which are created according to the actual human size and appearance, they perform their activities and interact with the users in real-world context. In addition, autonomous intelligent agents are integrated into the Co-Space to provide context-aware and personalized services to the users. These agents, which are in the form of human-like avatars, act as the users’ personal tour guides, they interact with the users and gradually learn the users’ preferences. Then, the agents are able to suggest suitable locations for the users to visit. The intention of deploying these agents is to enrich the Co-Space with a variety of interactions tailored to each user’s preferences instead of the same contents for everyone. Besides, our Co-Space also provides an avenue for people from different locations throughout the world to explore the YOV and experience the atmosphere of the sports events in Singapore.","PeriodicalId":410870,"journal":{"name":"2010 International Conference on Cyberworlds","volume":"22 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2010-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"123838391","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
京公网安备 11010802042870号
京ICP备2023020795号-1
扫码关注我们
求助内容：
应助结果提醒方式：