首页 > 最新文献

Journal of the Society for Information Display最新文献

英文 中文
A varifocal augmented reality head-up display using Alvarez freeform lenses 使用阿尔瓦雷斯自由曲面透镜的变焦增强现实平视显示器
IF 2.3 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-04-24 DOI: 10.1002/jsid.1286
Yi Liu, Yuqing Qiu, Jiaqi Dong, Bo-Ru Yang, Zong Qin

A crucial requirement of augmented reality head-up displays (AR-HUDs) is continuously adjustable virtual image distance (VID), which allows adaptation to various depths in road environments and thereby avoids visual fatigue. However, usual varifocal components for near-eye displays are unavailable because AR-HUDs require the varifocal component's aperture to be larger than 10 cm. This study considers the Alvarez lenses, which change the optical power by in-plane sliding two freeform lenses. Under the paraxial assumption, classic Alvarez lenses can create a quadratic wavefront profile, but the large aperture and extensive diopter variation range required by AR-HUDs lead to significant aberrations. Thus, the classic paraxial Alvarez lens design is extended by co-optimizing Alvarez lenses with high-order surface profiles and a primary freeform mirror. Therefore, a novel varifocal AR-HUD containing Alvarez lenses with apertures larger than 15 cm is proposed. The AR-HUD generates a varifocal plane whose VID can be continuously adjusted between 2.5 and 7.5 m, and another focal plane with a fixed VID at 7.5 m. In addition, merely one display panel is used for compactness. Finally, an AR-HUD prototype with a reduced volume of 9.8 L was built. The expected varifocal performance and qualified imaging quality were experimentally verified through the field of view, VID, and image sharpness.

增强现实平视显示器(AR-HUD)的一个关键要求是可连续调节虚拟图像距离(VID),以便适应道路环境中的各种深度,从而避免视觉疲劳。然而,由于 AR-HUD 要求变焦组件的孔径大于 10 厘米,因此无法使用用于近眼显示器的普通变焦组件。本研究考虑了阿尔瓦雷斯透镜,它通过平面内滑动两个自由曲面透镜来改变光学功率。在准轴假设下,经典的阿尔瓦雷斯透镜可以产生二次波面轮廓,但 AR-HUD 所需的大光圈和广泛的屈光度变化范围会导致显著的像差。因此,通过对具有高阶表面轮廓的阿尔瓦雷斯透镜和主自由曲面镜进行共同优化,扩展了经典的准轴向阿尔瓦雷斯透镜设计。因此,我们提出了一种新颖的变焦 AR-HUD,其中包含孔径大于 15 厘米的阿尔瓦雷斯透镜。该 AR-HUD 可产生一个变焦平面,其 VID 可在 2.5 至 7.5 米之间连续调节,另一个焦平面的 VID 固定在 7.5 米处。最后,我们制作了一个体积缩小到 9.8 升的 AR-HUD 原型。实验通过视场角、VID 和图像清晰度验证了预期的变焦性能和合格的成像质量。
{"title":"A varifocal augmented reality head-up display using Alvarez freeform lenses","authors":"Yi Liu,&nbsp;Yuqing Qiu,&nbsp;Jiaqi Dong,&nbsp;Bo-Ru Yang,&nbsp;Zong Qin","doi":"10.1002/jsid.1286","DOIUrl":"10.1002/jsid.1286","url":null,"abstract":"<p>A crucial requirement of augmented reality head-up displays (AR-HUDs) is continuously adjustable virtual image distance (VID), which allows adaptation to various depths in road environments and thereby avoids visual fatigue. However, usual varifocal components for near-eye displays are unavailable because AR-HUDs require the varifocal component's aperture to be larger than 10 cm. This study considers the Alvarez lenses, which change the optical power by in-plane sliding two freeform lenses. Under the paraxial assumption, classic Alvarez lenses can create a quadratic wavefront profile, but the large aperture and extensive diopter variation range required by AR-HUDs lead to significant aberrations. Thus, the classic paraxial Alvarez lens design is extended by co-optimizing Alvarez lenses with high-order surface profiles and a primary freeform mirror. Therefore, a novel varifocal AR-HUD containing Alvarez lenses with apertures larger than 15 cm is proposed. The AR-HUD generates a varifocal plane whose VID can be continuously adjusted between 2.5 and 7.5 m, and another focal plane with a fixed VID at 7.5 m. In addition, merely one display panel is used for compactness. Finally, an AR-HUD prototype with a reduced volume of 9.8 L was built. The expected varifocal performance and qualified imaging quality were experimentally verified through the field of view, VID, and image sharpness.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":"32 5","pages":"226-236"},"PeriodicalIF":2.3,"publicationDate":"2024-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140662638","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Next generation personalized display systems employing adaptive dynamic-range compression techniques to address diversity in individual circadian visual features 下一代个性化显示系统采用自适应动态范围压缩技术,解决个体昼夜节律视觉特征的多样性问题
IF 2.3 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-04-17 DOI: 10.1002/jsid.1277
Sakuichi Ohtsuka, Saki Iwaida, Yuichiro Orita, Shoko Hira, Masayuki Kashima

Perceptually natural standard-dynamic-range (SDR) images reproduced under normal viewing conditions should retain enough information for the human observer to estimate the time at which the actual high-dynamic-range (HDR) scene was captured without recourse to artificial information. Currently, both global- and local-tone mapping operators (TMOs) seem to have comparable levels of performance. Therefore, we first consider the constraints created in the actual human visual system by eye movement, and buttress a hypothesis with a demonstration. We briefly review the imperceptible illuminance effects yielded by the personal circadian clock suggested by chronophysiological research and other related effects, because our previous study suggested that the characteristics of the human visual system dynamically varies depending on the individual's circadian pattern. Finally, we conduct two psychophysical experiments based on the hypothesis that the human visual system employs several global TMOs at the first stage for information compression that depend on individual-circadian-visual-features (ICVF). The results suggest that (1) no participant can perceive actual-capture-time (ACT) and (2) sensitive observers can discriminate reproduced images based on virtual-shooting-time (VST) effects induced by different types of global TMOs. We also discover that the VST-based discrimination differs widely among people, but most are unaware of this effect as evidenced by daily conversations.

在正常观看条件下重现的感知自然的标准动态范围(SDR)图像应保留足够的信息,以便人类观察者在不借助人工信息的情况下估计实际高动态范围(HDR)场景的拍摄时间。目前,全局色调映射算子(TMO)和局部色调映射算子(TMO)的性能水平似乎相当。因此,我们首先考虑了眼球运动在实际人类视觉系统中造成的限制,并通过演示来支持假设。我们简要回顾了时间生理学研究中提出的个人昼夜节律所产生的不易察觉的照度效应以及其他相关效应,因为我们之前的研究表明,人类视觉系统的特性会随着个人昼夜节律模式的不同而动态变化。最后,我们基于人类视觉系统在第一阶段采用多个全局 TMO 进行信息压缩的假设,进行了两个心理物理实验,这些全局 TMO 取决于个体昼夜节律视觉特征(ICVF)。实验结果表明:(1) 没有人能够感知实际捕捉时间(ACT);(2) 敏感的观察者可以根据不同类型的全局 TMO 引起的虚拟射击时间(VST)效应来分辨再现的图像。我们还发现,基于 VST 的辨别能力在人与人之间差别很大,但大多数人都没有意识到这种效应,这一点可以从日常对话中得到证明。
{"title":"Next generation personalized display systems employing adaptive dynamic-range compression techniques to address diversity in individual circadian visual features","authors":"Sakuichi Ohtsuka,&nbsp;Saki Iwaida,&nbsp;Yuichiro Orita,&nbsp;Shoko Hira,&nbsp;Masayuki Kashima","doi":"10.1002/jsid.1277","DOIUrl":"10.1002/jsid.1277","url":null,"abstract":"<p>Perceptually natural standard-dynamic-range (SDR) images reproduced under normal viewing conditions should retain enough information for the human observer to estimate the time at which the actual high-dynamic-range (HDR) scene was captured without recourse to artificial information. Currently, both global- and local-tone mapping operators (TMOs) seem to have comparable levels of performance. Therefore, we first consider the constraints created in the actual human visual system by eye movement, and buttress a hypothesis with a demonstration. We briefly review the imperceptible illuminance effects yielded by the personal circadian clock suggested by chronophysiological research and other related effects, because our previous study suggested that the characteristics of the human visual system dynamically varies depending on the individual's circadian pattern. Finally, we conduct two psychophysical experiments based on the hypothesis that the human visual system employs several global TMOs at the first stage for information compression that depend on individual-circadian-visual-features (ICVF). The results suggest that (1) no participant can perceive actual-capture-time (ACT) and (2) sensitive observers can discriminate reproduced images based on virtual-shooting-time (VST) effects induced by different types of global TMOs. We also discover that the VST-based discrimination differs widely among people, but most are unaware of this effect as evidenced by daily conversations.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":"32 6","pages":"462-483"},"PeriodicalIF":2.3,"publicationDate":"2024-04-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/jsid.1277","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140694508","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Halo effect measurement for mini-light-emitting diode backlight liquid crystal displays 测量微型发光二极管背光液晶显示器的光晕效应
IF 2.3 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-04-11 DOI: 10.1002/jsid.1278
Wang Xinyu, Lu Zhiyong, Kuang Guofeng, Tang Guofu, Liu Chao, Zhang Qinquan, Lian Qiaozhen, Huang Xuerun

We develop a measurement and evaluation system to quantify the halo effect of mini-light-emitting diode (LED) backlight liquid crystal displays (mLCDs). The validity and reliability of our halo measurement system was investigated through a human visual perception experiment. The results indicate that our halo measurement system can effectively distinguish the halo differences among different displays, with matching rate of 93.3% between our measurement and the human visual system.

我们开发了一套测量和评估系统,用于量化微型发光二极管(LED)背光液晶显示器(mLCD)的光晕效应。我们通过人类视觉感知实验研究了光晕测量系统的有效性和可靠性。结果表明,我们的光晕测量系统能有效区分不同显示器之间的光晕差异,测量结果与人类视觉系统的匹配率高达 93.3%。
{"title":"Halo effect measurement for mini-light-emitting diode backlight liquid crystal displays","authors":"Wang Xinyu,&nbsp;Lu Zhiyong,&nbsp;Kuang Guofeng,&nbsp;Tang Guofu,&nbsp;Liu Chao,&nbsp;Zhang Qinquan,&nbsp;Lian Qiaozhen,&nbsp;Huang Xuerun","doi":"10.1002/jsid.1278","DOIUrl":"https://doi.org/10.1002/jsid.1278","url":null,"abstract":"<p>We develop a measurement and evaluation system to quantify the halo effect of mini-light-emitting diode (LED) backlight liquid crystal displays (mLCDs). The validity and reliability of our halo measurement system was investigated through a human visual perception experiment. The results indicate that our halo measurement system can effectively distinguish the halo differences among different displays, with matching rate of 93.3% between our measurement and the human visual system.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":"32 4","pages":"136-148"},"PeriodicalIF":2.3,"publicationDate":"2024-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140559588","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
In-panel ambient light eliminating differential circuit applied to active pixel fingerprint sensor 应用于有源像素指纹传感器的面板内环境光消除差分电路
IF 2.3 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-04-05 DOI: 10.1002/jsid.1279
Ya-Hsiang Tai, Yi-Cheng Yuan, Chih-Yang Chen, Te-Yu Lee

In this paper, we present a novel approach to counter the influence of ambient light on photodetectors used in applications like biometric recognition and environmental sensing. The proposed solution introduces a circuit-based technique that utilizes signal differencing to subtract ambient light signals before they reach the integrated circuit (IC). The process involves row and column differential signals, akin to analog circuit differential amplifiers. Simulations validate the circuit's functionality, showing its effectiveness in reducing ambient light impact. However, image reconstruction after differencing introduces blurriness due to the accumulation of noise. An alternative bidirectional fusion method is suggested, resulting in a clearer representation of features without noise accumulation. This innovative approach promises to enhance photodetector performance in challenging lighting conditions for various applications.

在本文中,我们提出了一种新方法来消除环境光对生物识别和环境传感等应用中使用的光电探测器的影响。所提出的解决方案引入了一种基于电路的技术,利用信号差分技术在环境光信号到达集成电路(IC)之前将其减去。这一过程涉及行列差分信号,类似于模拟电路差分放大器。模拟验证了电路的功能,显示出其在减少环境光影响方面的有效性。然而,差分后的图像重建会因噪声的积累而导致模糊。我们提出了另一种双向融合方法,可以更清晰地显示特征,而不会产生噪声积累。这种创新方法有望提高光电探测器在各种应用的挑战性照明条件下的性能。
{"title":"In-panel ambient light eliminating differential circuit applied to active pixel fingerprint sensor","authors":"Ya-Hsiang Tai,&nbsp;Yi-Cheng Yuan,&nbsp;Chih-Yang Chen,&nbsp;Te-Yu Lee","doi":"10.1002/jsid.1279","DOIUrl":"https://doi.org/10.1002/jsid.1279","url":null,"abstract":"<p>In this paper, we present a novel approach to counter the influence of ambient light on photodetectors used in applications like biometric recognition and environmental sensing. The proposed solution introduces a circuit-based technique that utilizes signal differencing to subtract ambient light signals before they reach the integrated circuit (IC). The process involves row and column differential signals, akin to analog circuit differential amplifiers. Simulations validate the circuit's functionality, showing its effectiveness in reducing ambient light impact. However, image reconstruction after differencing introduces blurriness due to the accumulation of noise. An alternative bidirectional fusion method is suggested, resulting in a clearer representation of features without noise accumulation. This innovative approach promises to enhance photodetector performance in challenging lighting conditions for various applications.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":"32 4","pages":"149-158"},"PeriodicalIF":2.3,"publicationDate":"2024-04-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140559517","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Innovations in thin-film electronics for the new generation of displays 用于新一代显示器的创新薄膜电子技术
IF 2.3 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-03-25 DOI: 10.1002/jsid.1274
Andre Zeumault, Jose E. Mendez, John Brewer

Today's display industry faces transistor-level challenges similar to those of complementary metal-oxide semiconductor (CMOS) metal-oxide semiconductor field-effect transistors (MOSFETs) in the mid-1990s. Learnings from MOSFETs inform the display industry's response to the limitations of silicon-based thin-film transistors (TFTs). Improvements sustaining Moore's Law drove the need to rethink MOSFET materials and structures. The display industry needs fundamental innovation at the device level. New thin-film devices enable an inflection point in the use of displays, just as fin field-effect transistor (FinFET) defined the inflection point in CMOS in the 2000s. This paper outlines two innovations in thin-film device technology that offers improvement in image quality and power consumption of flat panel displays: amorphous metal gate TFTs (AMeTFTs) and amorphous metal nonlinear resistors (AMNRs). Linked through a single core material set based on mass-producible, thin-film amorphous metals, these two innovations create near- and long-term roadmaps simplifying the production of high-image quality, low-power consumption displays on glass (now) and plastic (future). In particular, the field-effect mobility of indium gallium zinc oxide (IGZO) AMeTFTs (55–72 cm2/Vs) exceeds that of IGZO TFTs developed by existing display manufacturers without the need for atomic layer deposition or vertical stacking of heterostructure semiconductor films, making AMeTFTs a natural choice for the new G8.5–G8.7 fabs targeting IGZO backplanes.

当今显示器行业面临的晶体管级挑战与 20 世纪 90 年代中期互补金属氧化物半导体(CMOS)金属氧化物半导体场效应晶体管(MOSFET)面临的挑战类似。从 MOSFET 中汲取的经验为显示器行业应对硅基薄膜晶体管 (TFT) 的局限性提供了借鉴。摩尔定律的持续改进促使人们需要重新思考 MOSFET 的材料和结构。显示器行业需要在器件层面进行根本性创新。新型薄膜器件使显示器的应用出现拐点,正如鳍式场效应晶体管 (FinFET) 在 2000 年代确定了 CMOS 的拐点一样。本文概述了薄膜器件技术的两项创新,它们改善了平板显示器的图像质量和功耗:非晶金属栅极 TFT(AMeTFT)和非晶金属非线性电阻器(AMNR)。这两项创新通过以可大规模生产的薄膜非晶金属为基础的单一核心材料集相互连接,创建了简化玻璃(现在)和塑料(未来)上高图像质量、低功耗显示器生产的近期和长期路线图。特别是,氧化铟镓锌 (IGZO) AMeTFT 的场效应迁移率(55-72 cm2/Vs)超过了现有显示器制造商开发的 IGZO TFT,而无需原子层沉积或垂直堆叠异质结构半导体薄膜,这使得 AMeTFT 成为针对 IGZO 背板的新型 G8.5-G8.7 晶圆厂的自然选择。
{"title":"Innovations in thin-film electronics for the new generation of displays","authors":"Andre Zeumault,&nbsp;Jose E. Mendez,&nbsp;John Brewer","doi":"10.1002/jsid.1274","DOIUrl":"10.1002/jsid.1274","url":null,"abstract":"<p>Today's display industry faces transistor-level challenges similar to those of complementary metal-oxide semiconductor (CMOS) metal-oxide semiconductor field-effect transistors (MOSFETs) in the mid-1990s. Learnings from MOSFETs inform the display industry's response to the limitations of silicon-based thin-film transistors (TFTs). Improvements sustaining Moore's Law drove the need to rethink MOSFET materials and structures. The display industry needs fundamental innovation at the device level. New thin-film devices enable an inflection point in the use of displays, just as fin field-effect transistor (FinFET) defined the inflection point in CMOS in the 2000s. This paper outlines two innovations in thin-film device technology that offers improvement in image quality and power consumption of flat panel displays: amorphous metal gate TFTs (AMeTFTs) and amorphous metal nonlinear resistors (AMNRs). Linked through a single core material set based on mass-producible, thin-film amorphous metals, these two innovations create near- and long-term roadmaps simplifying the production of high-image quality, low-power consumption displays on glass (now) and plastic (future). In particular, the field-effect mobility of indium gallium zinc oxide (IGZO) AMeTFTs (55–72 cm<sup>2</sup>/Vs) exceeds that of IGZO TFTs developed by existing display manufacturers without the need for atomic layer deposition or vertical stacking of heterostructure semiconductor films, making AMeTFTs a natural choice for the new G8.5–G8.7 fabs targeting IGZO backplanes.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":"32 4","pages":"121-135"},"PeriodicalIF":2.3,"publicationDate":"2024-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/jsid.1274","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140382078","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Aerial display that reconstructs face orientation by use of spatial blending of two face images 利用两张人脸图像的空间混合重建人脸方向的航空显示器
IF 2.3 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-03-14 DOI: 10.1002/jsid.1273
Kohei Kishinami, Keigo Sato, Masaki Yasugi, Shiro Suyama, Hirotsugu Yamamoto

This paper proposes a novel aerial display system that reconstructs face orientation. The proposed system forms two face images floating in mid-air. Viewers observe a spatially blended image of the two face images, where the spatial blending ratio depends on the viewing position. Thus, the spatially blended aerial face image is perceived to look in a fixed orientation even if the viewing position is changed within a certain viewing range. We analyze the spatial blending system optical design and show results from our prototype display.

本文提出了一种可重建人脸方向的新型空中显示系统。该系统可形成两幅漂浮在半空中的人脸图像。观众观察到的是两幅人脸图像的空间混合图像,其中空间混合比例取决于观看位置。因此,即使在一定的观看范围内改变观看位置,空间混合的空中人脸图像也会被认为是固定方向的。我们分析了空间混合系统的光学设计,并展示了原型显示屏的效果。
{"title":"Aerial display that reconstructs face orientation by use of spatial blending of two face images","authors":"Kohei Kishinami,&nbsp;Keigo Sato,&nbsp;Masaki Yasugi,&nbsp;Shiro Suyama,&nbsp;Hirotsugu Yamamoto","doi":"10.1002/jsid.1273","DOIUrl":"https://doi.org/10.1002/jsid.1273","url":null,"abstract":"<p>This paper proposes a novel aerial display system that reconstructs face orientation. The proposed system forms two face images floating in mid-air. Viewers observe a spatially blended image of the two face images, where the spatial blending ratio depends on the viewing position. Thus, the spatially blended aerial face image is perceived to look in a fixed orientation even if the viewing position is changed within a certain viewing range. We analyze the spatial blending system optical design and show results from our prototype display.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":"32 3","pages":"101-111"},"PeriodicalIF":2.3,"publicationDate":"2024-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140188501","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Impact of visual enhancement and color conversion algorithms on remote sound recovery from silent videos 视觉增强和色彩转换算法对无声视频远程声音恢复的影响
IF 2.3 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-03-12 DOI: 10.1002/jsid.1275
Ren-Jun Choong, Wun-She Yap, Yan Chai Hum, Khin Wee Lai, Lloyd Ling, Anthony Vodacek, Yee Kai Tee

The visual microphone is a technique for remote sound recovery that extracts sound information from tiny pixel-scale vibrations in a video. Despite having demonstrated success in sound recovery, the impact of various visual enhancement and color conversion algorithms applied on the video before the sound recovery process has not been explored. Thus, it is important to investigate these effects have on the recovered sound quality, as the vibrations are so small the effects play an important role. This work experimented with different color to grayscale conversions and visual enhancement algorithms on 576 videos, and found that the recovered sound quality is indeed greatly affected by the choice of algorithms. The best conversion algorithms were found to be the average of the red, green and blue color channels and the perceptual lightness in the CIELAB color space, improving the recovered sound quality by up to 23.22%. Furthermore, visual enhancement techniques such as gamma correction have been found to corrupt vibration information, leading to a 22.47% drop in recovered sound quality in one of the tested videos. Therefore, it is advisable to avoid or minimize the use of visual enhancement techniques for remote sound recovery to prevent the elimination of useful subtle vibrations.

视觉麦克风是一种远程声音恢复技术,可从视频中微小的像素级振动中提取声音信息。尽管在声音恢复方面取得了成功,但在声音恢复过程之前对视频应用的各种视觉增强和色彩转换算法的影响尚未得到探讨。因此,研究这些算法对声音恢复质量的影响非常重要,因为振动是如此微小,这些影响起着重要作用。这项工作在 576 个视频上试验了不同的彩色到灰度转换和视觉增强算法,发现声音恢复质量确实受到算法选择的很大影响。最佳转换算法是 CIELAB 色彩空间中红、绿、蓝色彩通道和感知亮度的平均值,可将恢复的音质提高 23.22%。此外,人们还发现伽玛校正等视觉增强技术会破坏振动信息,导致其中一个测试视频的恢复音质下降了 22.47%。因此,最好避免或尽量减少在远程声音恢复中使用视觉增强技术,以防止有用的细微振动被消除。
{"title":"Impact of visual enhancement and color conversion algorithms on remote sound recovery from silent videos","authors":"Ren-Jun Choong,&nbsp;Wun-She Yap,&nbsp;Yan Chai Hum,&nbsp;Khin Wee Lai,&nbsp;Lloyd Ling,&nbsp;Anthony Vodacek,&nbsp;Yee Kai Tee","doi":"10.1002/jsid.1275","DOIUrl":"https://doi.org/10.1002/jsid.1275","url":null,"abstract":"<p>The visual microphone is a technique for remote sound recovery that extracts sound information from tiny pixel-scale vibrations in a video. Despite having demonstrated success in sound recovery, the impact of various visual enhancement and color conversion algorithms applied on the video before the sound recovery process has not been explored. Thus, it is important to investigate these effects have on the recovered sound quality, as the vibrations are so small the effects play an important role. This work experimented with different color to grayscale conversions and visual enhancement algorithms on 576 videos, and found that the recovered sound quality is indeed greatly affected by the choice of algorithms. The best conversion algorithms were found to be the average of the red, green and blue color channels and the perceptual lightness in the CIELAB color space, improving the recovered sound quality by up to 23.22%. Furthermore, visual enhancement techniques such as gamma correction have been found to corrupt vibration information, leading to a 22.47% drop in recovered sound quality in one of the tested videos. Therefore, it is advisable to avoid or minimize the use of visual enhancement techniques for remote sound recovery to prevent the elimination of useful subtle vibrations.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":"32 3","pages":"112-125"},"PeriodicalIF":2.3,"publicationDate":"2024-03-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140188493","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Fusion information refresh rate improvement based on adaptive visual tracking in vehicle augmented reality sightseeing interactive system 基于自适应视觉跟踪的融合信息刷新率在车载增强现实观光互动系统中的改进
IF 1.7 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-03-10 DOI: 10.1002/jsid.1276
Yu-Hsiang Tsai, Hong-Ming Dai, Yung-Jhe Yan, Mang Ou-Yang

This paper proposes a dynamic information fusion interactive system with a transparent display applied in the vehicle. The dynamic information fusion interactive system integrates three leading technologies: relative position acquisition, fusion information mapping, and visual field tracking adaptive information generation. For visual field tracking adaptive information generation, the position of fusion information changes as the observer's field of view varies to help observers use this system more comfortably and intuitively. The frame rate of the dynamic virtual information display can be increased from 10 to 20 Hz without increasing the AI computing power and providing observers with a better observer experience. Integrating those technologies could achieve an AR-based interactive system on a direct-view transparent display. Such a system can provide passengers with location-based interactive virtual and real integration information in the mobile field.

本文提出了一种应用于车载透明显示屏的动态信息融合交互系统。该动态信息融合交互系统集成了三项领先技术:相对位置采集、融合信息映射和视场跟踪自适应信息生成。在视场跟踪自适应信息生成方面,融合信息的位置会随着观察者视野的变化而变化,以帮助观察者更舒适、更直观地使用该系统。在不增加人工智能计算能力的情况下,动态虚拟信息显示的帧速率可从 10 Hz 提高到 20 Hz,从而为观察者提供更好的观察体验。整合这些技术可以在直视透明显示屏上实现基于 AR 的交互系统。这样的系统可以在移动领域为乘客提供基于位置的交互式虚拟和真实集成信息。
{"title":"Fusion information refresh rate improvement based on adaptive visual tracking in vehicle augmented reality sightseeing interactive system","authors":"Yu-Hsiang Tsai,&nbsp;Hong-Ming Dai,&nbsp;Yung-Jhe Yan,&nbsp;Mang Ou-Yang","doi":"10.1002/jsid.1276","DOIUrl":"10.1002/jsid.1276","url":null,"abstract":"<p>This paper proposes a dynamic information fusion interactive system with a transparent display applied in the vehicle. The dynamic information fusion interactive system integrates three leading technologies: relative position acquisition, fusion information mapping, and visual field tracking adaptive information generation. For visual field tracking adaptive information generation, the position of fusion information changes as the observer's field of view varies to help observers use this system more comfortably and intuitively. The frame rate of the dynamic virtual information display can be increased from 10 to 20 Hz without increasing the AI computing power and providing observers with a better observer experience. Integrating those technologies could achieve an AR-based interactive system on a direct-view transparent display. Such a system can provide passengers with location-based interactive virtual and real integration information in the mobile field.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":"32 8","pages":"545-554"},"PeriodicalIF":1.7,"publicationDate":"2024-03-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140255075","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Two-view autostereoscopic display independent of differences of interocular distance and viewing condition 不受眼间距离和观看条件差异影响的双视角自动立体显示技术
IF 2.3 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-03-03 DOI: 10.1002/jsid.1272
Takumi Hori, Kayo Yoshimoto, Goro Hamagishi, Hideya Takahashi

We have previously proposed the parallax barrier autostereoscopic display with eye tracking control. This display realized a wide viewing area. However, the previous method simplifies the process by using the average interocular distance and composing images corresponding to the center position of both eyes. As a result, crosstalk caused by individual differences in interocular distance and changes in viewing condition, such as facial tilt and rotation, was occurred. The crosstalk caused by individual differences in interocular distance is an important factor that must be eliminated. Therefore, we propose the method to compose a parallax image by using positions of both eyes to expand the viewing zone. We use the black images to the crosstalk subpixels, which can be determined from the positions of each eye and achieves more comfortable stereoscopic viewing. To verify the effectiveness of the proposed method, we constructed the prototype 3D display using the parallax barrier with 50% aperture ratio and confirmed the wide viewing area with the crosstalk ratio of less than 5%. We can achieve an autostereoscopic display that has bright and high-quality stereoscopic image and independent of individual differences in interocular distance and changes in viewing condition.

我们曾提出过带有眼球跟踪控制功能的视差屏障自动立体显示器。这种显示器实现了宽广的可视区域。但是,以前的方法通过使用平均眼间距和合成与双眼中心位置相对应的图像来简化过程。因此,由于个体眼间距的差异和观看条件的变化(如面部倾斜和旋转)而导致的串扰时有发生。眼间距离的个体差异造成的串扰是必须消除的一个重要因素。因此,我们提出了利用双眼位置来扩大观察区域,从而合成视差图像的方法。我们将黑色图像用于串扰子像素,这可以根据每只眼睛的位置来确定,并实现更舒适的立体观看。为了验证所提方法的有效性,我们利用视差屏障构建了光圈比为 50%的 3D 显示器原型,并确认了串扰比小于 5%的宽广可视区域。我们可以实现自动立体显示,它具有明亮、高质量的立体图像,并且不受个体眼间距差异和观看条件变化的影响。
{"title":"Two-view autostereoscopic display independent of differences of interocular distance and viewing condition","authors":"Takumi Hori,&nbsp;Kayo Yoshimoto,&nbsp;Goro Hamagishi,&nbsp;Hideya Takahashi","doi":"10.1002/jsid.1272","DOIUrl":"https://doi.org/10.1002/jsid.1272","url":null,"abstract":"<p>We have previously proposed the parallax barrier autostereoscopic display with eye tracking control. This display realized a wide viewing area. However, the previous method simplifies the process by using the average interocular distance and composing images corresponding to the center position of both eyes. As a result, crosstalk caused by individual differences in interocular distance and changes in viewing condition, such as facial tilt and rotation, was occurred. The crosstalk caused by individual differences in interocular distance is an important factor that must be eliminated. Therefore, we propose the method to compose a parallax image by using positions of both eyes to expand the viewing zone. We use the black images to the crosstalk subpixels, which can be determined from the positions of each eye and achieves more comfortable stereoscopic viewing. To verify the effectiveness of the proposed method, we constructed the prototype 3D display using the parallax barrier with 50% aperture ratio and confirmed the wide viewing area with the crosstalk ratio of less than 5%. We can achieve an autostereoscopic display that has bright and high-quality stereoscopic image and independent of individual differences in interocular distance and changes in viewing condition.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":"32 3","pages":"89-100"},"PeriodicalIF":2.3,"publicationDate":"2024-03-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140188536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Charge balance in OLEDs: Optimization of hole injection layer using novel p-dopants 有机发光二极管中的电荷平衡:使用新型 p 掺杂剂优化空穴注入层
IF 2.3 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-02-23 DOI: 10.1002/jsid.1271
Menglan Xie, Huiqing Pang, Jing Wang, Zhihao Cui, Hualong Ding, Renjie Zheng, Ray Kwong, Sean Xia

Charge balance is one of the most important factors for realizing high performance organic light emitting devices (OLEDs). In this work, we provide a novel strategy to improve the charge balance in OLEDs by optimizing the hole injection layer (HIL) as well as the electron transporting layer (ETL) and thereby controlling the charge carrier supplies in the device. First, we develop a p-dopant material (PD02), with a lowest unoccupied molecular orbit (LUMO) of −4.63 eV, much shallower than that of the commercial material (PD01) of which the LUMO is −5.04 eV. Nevertheless, this enables us to modulate the supply of holes to the emissive layer through tuning doping concentration. We demonstrate that device performances are significantly improved by employing such a scheme. With a 23% molar doping of PD02, a bottom emission red OLED achieves an external quantum efficiency (EQE) of over 30%, an operating voltage of 3.4 V and a LT95 ~15,000 h at 10 mA/cm2, with a Digital Cinema Initiative P3 (DCI-P3) chromaticity of CIE (X, Y) = (0.68, 0.32). Moreover, the efficiency roll-off is suppressed up till ~3500 cd/m2, a desirable feature in display applications. The lateral conductivity of by using such HIL is also found to be much lower than that of PD01, resulting in reduced crosstalk among RGB pixels. Next, a new electron transporting material (ETM-02) with a deep LUMO of −2.86 eV is also introduced to further optimize the charge balance. Although devices with ETM-02 shows lower voltage and higher EQE, lifetime is compromised. In order to improve lifetime, additional fine tuning of the charge balance is essential. Finally, a second p-dopant PD03 with a LUMO of −4.91 eV is added to the HIL to further extend the modulation flexibility in the hole injection. A double-layer HIL consisting of 8 nm of HTM:16% PD02 and 2 nm of HTM:3% PD03, where the former is in contact with anode, is adopted in the device structure. The bottom emission deep red device achieve EQE over 30%, an operating voltage of 3.2 V and an improved LT95 ~13,000 h at 10 mA/cm2 with a BT.2020 range chromaticity of CIE (X, Y) = (0.701, 0.299). In the double HIL configuration, the introduction of PD03 provides one more parameter for tuning and therefore improves the overall device performances.

电荷平衡是实现高性能有机发光器件(OLED)的最重要因素之一。在这项工作中,我们提供了一种新策略,通过优化空穴注入层(HIL)和电子传输层(ETL)来改善有机发光二极管的电荷平衡,从而控制器件中的电荷载流子供应。首先,我们开发了一种 p 掺杂材料(PD02),其最低未占分子轨道(LUMO)为 -4.63 eV,比商用材料(PD01)的 LUMO 低得多,后者的 LUMO 为 -5.04 eV。不过,这使我们能够通过调整掺杂浓度来调节发射层的空穴供应。我们证明,采用这种方案可以显著提高器件性能。在 PD02 的摩尔掺杂浓度为 23% 的情况下,底部发射的红色有机发光二极管的外部量子效率 (EQE) 超过了 30%,工作电压为 3.4 V,在 10 mA/cm2 的条件下,LT95 ~15,000 h,数字电影计划 P3 (DCI-P3) 色度为 CIE (X, Y) = (0.68, 0.32)。此外,效率衰减被抑制到 ~3500 cd/m2,这是显示应用中的一个理想特性。使用这种 HIL 的横向导电率也比 PD01 低得多,从而减少了 RGB 像素之间的串扰。接下来,为了进一步优化电荷平衡,我们还引入了一种新的电子传输材料(ETM-02),其 LUMO 值为 -2.86 eV。虽然使用 ETM-02 的器件具有更低的电压和更高的 EQE,但寿命却受到了影响。为了提高寿命,必须对电荷平衡进行额外的微调。最后,在 HIL 中加入了第二种 LUMO 为 -4.91 eV 的 p 掺杂剂 PD03,以进一步扩展空穴注入的调制灵活性。器件结构中采用了由 8 nm HTM:16% PD02 和 2 nm HTM:3% PD03 组成的双层 HIL,其中前者与阳极接触。底部发射深红色器件的 EQE 超过 30%,工作电压为 3.2 V,在 10 mA/cm2 条件下的 LT95 为 13,000 h,色度范围为 CIE (X, Y) = (0.701, 0.299) 的 BT.2020。在双 HIL 配置中,PD03 的引入增加了一个可调参数,从而提高了器件的整体性能。
{"title":"Charge balance in OLEDs: Optimization of hole injection layer using novel p-dopants","authors":"Menglan Xie,&nbsp;Huiqing Pang,&nbsp;Jing Wang,&nbsp;Zhihao Cui,&nbsp;Hualong Ding,&nbsp;Renjie Zheng,&nbsp;Ray Kwong,&nbsp;Sean Xia","doi":"10.1002/jsid.1271","DOIUrl":"https://doi.org/10.1002/jsid.1271","url":null,"abstract":"<p>Charge balance is one of the most important factors for realizing high performance organic light emitting devices (OLEDs). In this work, we provide a novel strategy to improve the charge balance in OLEDs by optimizing the hole injection layer (HIL) as well as the electron transporting layer (ETL) and thereby controlling the charge carrier supplies in the device. First, we develop a p-dopant material (PD02), with a lowest unoccupied molecular orbit (LUMO) of −4.63 eV, much shallower than that of the commercial material (PD01) of which the LUMO is −5.04 eV. Nevertheless, this enables us to modulate the supply of holes to the emissive layer through tuning doping concentration. We demonstrate that device performances are significantly improved by employing such a scheme. With a 23% molar doping of PD02, a bottom emission red OLED achieves an external quantum efficiency (EQE) of over 30%, an operating voltage of 3.4 V and a LT95 ~15,000 h at 10 mA/cm<sup>2</sup>, with a Digital Cinema Initiative P3 (DCI-P3) chromaticity of CIE (X, Y) = (0.68, 0.32). Moreover, the efficiency roll-off is suppressed up till ~3500 cd/m<sup>2</sup>, a desirable feature in display applications. The lateral conductivity of by using such HIL is also found to be much lower than that of PD01, resulting in reduced crosstalk among RGB pixels. Next, a new electron transporting material (ETM-02) with a deep LUMO of −2.86 eV is also introduced to further optimize the charge balance. Although devices with ETM-02 shows lower voltage and higher EQE, lifetime is compromised. In order to improve lifetime, additional fine tuning of the charge balance is essential. Finally, a second p-dopant PD03 with a LUMO of −4.91 eV is added to the HIL to further extend the modulation flexibility in the hole injection. A double-layer HIL consisting of 8 nm of HTM:16% PD02 and 2 nm of HTM:3% PD03, where the former is in contact with anode, is adopted in the device structure. The bottom emission deep red device achieve EQE over 30%, an operating voltage of 3.2 V and an improved LT<sub>95</sub> ~13,000 h at 10 mA/cm<sup>2</sup> with a BT.2020 range chromaticity of CIE (X, Y) = (0.701, 0.299). In the double HIL configuration, the introduction of PD03 provides one more parameter for tuning and therefore improves the overall device performances.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":"32 2","pages":"71-81"},"PeriodicalIF":2.3,"publicationDate":"2024-02-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139976553","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of the Society for Information Display
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1