首页 > 最新文献

Journal of the Society for Information Display最新文献

英文 中文
Impact of visual enhancement and color conversion algorithms on remote sound recovery from silent videos 视觉增强和色彩转换算法对无声视频远程声音恢复的影响
IF 2.3 4区 工程技术 Q2 Engineering Pub Date : 2024-03-12 DOI: 10.1002/jsid.1275
Ren-Jun Choong, Wun-She Yap, Yan Chai Hum, Khin Wee Lai, Lloyd Ling, Anthony Vodacek, Yee Kai Tee

The visual microphone is a technique for remote sound recovery that extracts sound information from tiny pixel-scale vibrations in a video. Despite having demonstrated success in sound recovery, the impact of various visual enhancement and color conversion algorithms applied on the video before the sound recovery process has not been explored. Thus, it is important to investigate these effects have on the recovered sound quality, as the vibrations are so small the effects play an important role. This work experimented with different color to grayscale conversions and visual enhancement algorithms on 576 videos, and found that the recovered sound quality is indeed greatly affected by the choice of algorithms. The best conversion algorithms were found to be the average of the red, green and blue color channels and the perceptual lightness in the CIELAB color space, improving the recovered sound quality by up to 23.22%. Furthermore, visual enhancement techniques such as gamma correction have been found to corrupt vibration information, leading to a 22.47% drop in recovered sound quality in one of the tested videos. Therefore, it is advisable to avoid or minimize the use of visual enhancement techniques for remote sound recovery to prevent the elimination of useful subtle vibrations.

视觉麦克风是一种远程声音恢复技术,可从视频中微小的像素级振动中提取声音信息。尽管在声音恢复方面取得了成功,但在声音恢复过程之前对视频应用的各种视觉增强和色彩转换算法的影响尚未得到探讨。因此,研究这些算法对声音恢复质量的影响非常重要,因为振动是如此微小,这些影响起着重要作用。这项工作在 576 个视频上试验了不同的彩色到灰度转换和视觉增强算法,发现声音恢复质量确实受到算法选择的很大影响。最佳转换算法是 CIELAB 色彩空间中红、绿、蓝色彩通道和感知亮度的平均值,可将恢复的音质提高 23.22%。此外,人们还发现伽玛校正等视觉增强技术会破坏振动信息,导致其中一个测试视频的恢复音质下降了 22.47%。因此,最好避免或尽量减少在远程声音恢复中使用视觉增强技术,以防止有用的细微振动被消除。
{"title":"Impact of visual enhancement and color conversion algorithms on remote sound recovery from silent videos","authors":"Ren-Jun Choong,&nbsp;Wun-She Yap,&nbsp;Yan Chai Hum,&nbsp;Khin Wee Lai,&nbsp;Lloyd Ling,&nbsp;Anthony Vodacek,&nbsp;Yee Kai Tee","doi":"10.1002/jsid.1275","DOIUrl":"https://doi.org/10.1002/jsid.1275","url":null,"abstract":"<p>The visual microphone is a technique for remote sound recovery that extracts sound information from tiny pixel-scale vibrations in a video. Despite having demonstrated success in sound recovery, the impact of various visual enhancement and color conversion algorithms applied on the video before the sound recovery process has not been explored. Thus, it is important to investigate these effects have on the recovered sound quality, as the vibrations are so small the effects play an important role. This work experimented with different color to grayscale conversions and visual enhancement algorithms on 576 videos, and found that the recovered sound quality is indeed greatly affected by the choice of algorithms. The best conversion algorithms were found to be the average of the red, green and blue color channels and the perceptual lightness in the CIELAB color space, improving the recovered sound quality by up to 23.22%. Furthermore, visual enhancement techniques such as gamma correction have been found to corrupt vibration information, leading to a 22.47% drop in recovered sound quality in one of the tested videos. Therefore, it is advisable to avoid or minimize the use of visual enhancement techniques for remote sound recovery to prevent the elimination of useful subtle vibrations.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":null,"pages":null},"PeriodicalIF":2.3,"publicationDate":"2024-03-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140188493","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Fusion information refresh rate improvement based on adaptive visual tracking in vehicle augmented reality sightseeing interactive system 基于自适应视觉跟踪的融合信息刷新率在车载增强现实观光互动系统中的改进
IF 1.7 4区 工程技术 Q3 ENGINEERING, ELECTRICAL & ELECTRONIC Pub Date : 2024-03-10 DOI: 10.1002/jsid.1276
Yu-Hsiang Tsai, Hong-Ming Dai, Yung-Jhe Yan, Mang Ou-Yang

This paper proposes a dynamic information fusion interactive system with a transparent display applied in the vehicle. The dynamic information fusion interactive system integrates three leading technologies: relative position acquisition, fusion information mapping, and visual field tracking adaptive information generation. For visual field tracking adaptive information generation, the position of fusion information changes as the observer's field of view varies to help observers use this system more comfortably and intuitively. The frame rate of the dynamic virtual information display can be increased from 10 to 20 Hz without increasing the AI computing power and providing observers with a better observer experience. Integrating those technologies could achieve an AR-based interactive system on a direct-view transparent display. Such a system can provide passengers with location-based interactive virtual and real integration information in the mobile field.

本文提出了一种应用于车载透明显示屏的动态信息融合交互系统。该动态信息融合交互系统集成了三项领先技术:相对位置采集、融合信息映射和视场跟踪自适应信息生成。在视场跟踪自适应信息生成方面,融合信息的位置会随着观察者视野的变化而变化,以帮助观察者更舒适、更直观地使用该系统。在不增加人工智能计算能力的情况下,动态虚拟信息显示的帧速率可从 10 Hz 提高到 20 Hz,从而为观察者提供更好的观察体验。整合这些技术可以在直视透明显示屏上实现基于 AR 的交互系统。这样的系统可以在移动领域为乘客提供基于位置的交互式虚拟和真实集成信息。
{"title":"Fusion information refresh rate improvement based on adaptive visual tracking in vehicle augmented reality sightseeing interactive system","authors":"Yu-Hsiang Tsai,&nbsp;Hong-Ming Dai,&nbsp;Yung-Jhe Yan,&nbsp;Mang Ou-Yang","doi":"10.1002/jsid.1276","DOIUrl":"10.1002/jsid.1276","url":null,"abstract":"<p>This paper proposes a dynamic information fusion interactive system with a transparent display applied in the vehicle. The dynamic information fusion interactive system integrates three leading technologies: relative position acquisition, fusion information mapping, and visual field tracking adaptive information generation. For visual field tracking adaptive information generation, the position of fusion information changes as the observer's field of view varies to help observers use this system more comfortably and intuitively. The frame rate of the dynamic virtual information display can be increased from 10 to 20 Hz without increasing the AI computing power and providing observers with a better observer experience. Integrating those technologies could achieve an AR-based interactive system on a direct-view transparent display. Such a system can provide passengers with location-based interactive virtual and real integration information in the mobile field.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":null,"pages":null},"PeriodicalIF":1.7,"publicationDate":"2024-03-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140255075","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Two-view autostereoscopic display independent of differences of interocular distance and viewing condition 不受眼间距离和观看条件差异影响的双视角自动立体显示技术
IF 2.3 4区 工程技术 Q2 Engineering Pub Date : 2024-03-03 DOI: 10.1002/jsid.1272
Takumi Hori, Kayo Yoshimoto, Goro Hamagishi, Hideya Takahashi

We have previously proposed the parallax barrier autostereoscopic display with eye tracking control. This display realized a wide viewing area. However, the previous method simplifies the process by using the average interocular distance and composing images corresponding to the center position of both eyes. As a result, crosstalk caused by individual differences in interocular distance and changes in viewing condition, such as facial tilt and rotation, was occurred. The crosstalk caused by individual differences in interocular distance is an important factor that must be eliminated. Therefore, we propose the method to compose a parallax image by using positions of both eyes to expand the viewing zone. We use the black images to the crosstalk subpixels, which can be determined from the positions of each eye and achieves more comfortable stereoscopic viewing. To verify the effectiveness of the proposed method, we constructed the prototype 3D display using the parallax barrier with 50% aperture ratio and confirmed the wide viewing area with the crosstalk ratio of less than 5%. We can achieve an autostereoscopic display that has bright and high-quality stereoscopic image and independent of individual differences in interocular distance and changes in viewing condition.

我们曾提出过带有眼球跟踪控制功能的视差屏障自动立体显示器。这种显示器实现了宽广的可视区域。但是,以前的方法通过使用平均眼间距和合成与双眼中心位置相对应的图像来简化过程。因此,由于个体眼间距的差异和观看条件的变化(如面部倾斜和旋转)而导致的串扰时有发生。眼间距离的个体差异造成的串扰是必须消除的一个重要因素。因此,我们提出了利用双眼位置来扩大观察区域,从而合成视差图像的方法。我们将黑色图像用于串扰子像素,这可以根据每只眼睛的位置来确定,并实现更舒适的立体观看。为了验证所提方法的有效性,我们利用视差屏障构建了光圈比为 50%的 3D 显示器原型,并确认了串扰比小于 5%的宽广可视区域。我们可以实现自动立体显示,它具有明亮、高质量的立体图像,并且不受个体眼间距差异和观看条件变化的影响。
{"title":"Two-view autostereoscopic display independent of differences of interocular distance and viewing condition","authors":"Takumi Hori,&nbsp;Kayo Yoshimoto,&nbsp;Goro Hamagishi,&nbsp;Hideya Takahashi","doi":"10.1002/jsid.1272","DOIUrl":"https://doi.org/10.1002/jsid.1272","url":null,"abstract":"<p>We have previously proposed the parallax barrier autostereoscopic display with eye tracking control. This display realized a wide viewing area. However, the previous method simplifies the process by using the average interocular distance and composing images corresponding to the center position of both eyes. As a result, crosstalk caused by individual differences in interocular distance and changes in viewing condition, such as facial tilt and rotation, was occurred. The crosstalk caused by individual differences in interocular distance is an important factor that must be eliminated. Therefore, we propose the method to compose a parallax image by using positions of both eyes to expand the viewing zone. We use the black images to the crosstalk subpixels, which can be determined from the positions of each eye and achieves more comfortable stereoscopic viewing. To verify the effectiveness of the proposed method, we constructed the prototype 3D display using the parallax barrier with 50% aperture ratio and confirmed the wide viewing area with the crosstalk ratio of less than 5%. We can achieve an autostereoscopic display that has bright and high-quality stereoscopic image and independent of individual differences in interocular distance and changes in viewing condition.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":null,"pages":null},"PeriodicalIF":2.3,"publicationDate":"2024-03-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140188536","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Charge balance in OLEDs: Optimization of hole injection layer using novel p-dopants 有机发光二极管中的电荷平衡:使用新型 p 掺杂剂优化空穴注入层
IF 2.3 4区 工程技术 Q2 Engineering Pub Date : 2024-02-23 DOI: 10.1002/jsid.1271
Menglan Xie, Huiqing Pang, Jing Wang, Zhihao Cui, Hualong Ding, Renjie Zheng, Ray Kwong, Sean Xia

Charge balance is one of the most important factors for realizing high performance organic light emitting devices (OLEDs). In this work, we provide a novel strategy to improve the charge balance in OLEDs by optimizing the hole injection layer (HIL) as well as the electron transporting layer (ETL) and thereby controlling the charge carrier supplies in the device. First, we develop a p-dopant material (PD02), with a lowest unoccupied molecular orbit (LUMO) of −4.63 eV, much shallower than that of the commercial material (PD01) of which the LUMO is −5.04 eV. Nevertheless, this enables us to modulate the supply of holes to the emissive layer through tuning doping concentration. We demonstrate that device performances are significantly improved by employing such a scheme. With a 23% molar doping of PD02, a bottom emission red OLED achieves an external quantum efficiency (EQE) of over 30%, an operating voltage of 3.4 V and a LT95 ~15,000 h at 10 mA/cm2, with a Digital Cinema Initiative P3 (DCI-P3) chromaticity of CIE (X, Y) = (0.68, 0.32). Moreover, the efficiency roll-off is suppressed up till ~3500 cd/m2, a desirable feature in display applications. The lateral conductivity of by using such HIL is also found to be much lower than that of PD01, resulting in reduced crosstalk among RGB pixels. Next, a new electron transporting material (ETM-02) with a deep LUMO of −2.86 eV is also introduced to further optimize the charge balance. Although devices with ETM-02 shows lower voltage and higher EQE, lifetime is compromised. In order to improve lifetime, additional fine tuning of the charge balance is essential. Finally, a second p-dopant PD03 with a LUMO of −4.91 eV is added to the HIL to further extend the modulation flexibility in the hole injection. A double-layer HIL consisting of 8 nm of HTM:16% PD02 and 2 nm of HTM:3% PD03, where the former is in contact with anode, is adopted in the device structure. The bottom emission deep red device achieve EQE over 30%, an operating voltage of 3.2 V and an improved LT95 ~13,000 h at 10 mA/cm2 with a BT.2020 range chromaticity of CIE (X, Y) = (0.701, 0.299). In the double HIL configuration, the introduction of PD03 provides one more parameter for tuning and therefore improves the overall device performances.

电荷平衡是实现高性能有机发光器件(OLED)的最重要因素之一。在这项工作中,我们提供了一种新策略,通过优化空穴注入层(HIL)和电子传输层(ETL)来改善有机发光二极管的电荷平衡,从而控制器件中的电荷载流子供应。首先,我们开发了一种 p 掺杂材料(PD02),其最低未占分子轨道(LUMO)为 -4.63 eV,比商用材料(PD01)的 LUMO 低得多,后者的 LUMO 为 -5.04 eV。不过,这使我们能够通过调整掺杂浓度来调节发射层的空穴供应。我们证明,采用这种方案可以显著提高器件性能。在 PD02 的摩尔掺杂浓度为 23% 的情况下,底部发射的红色有机发光二极管的外部量子效率 (EQE) 超过了 30%,工作电压为 3.4 V,在 10 mA/cm2 的条件下,LT95 ~15,000 h,数字电影计划 P3 (DCI-P3) 色度为 CIE (X, Y) = (0.68, 0.32)。此外,效率衰减被抑制到 ~3500 cd/m2,这是显示应用中的一个理想特性。使用这种 HIL 的横向导电率也比 PD01 低得多,从而减少了 RGB 像素之间的串扰。接下来,为了进一步优化电荷平衡,我们还引入了一种新的电子传输材料(ETM-02),其 LUMO 值为 -2.86 eV。虽然使用 ETM-02 的器件具有更低的电压和更高的 EQE,但寿命却受到了影响。为了提高寿命,必须对电荷平衡进行额外的微调。最后,在 HIL 中加入了第二种 LUMO 为 -4.91 eV 的 p 掺杂剂 PD03,以进一步扩展空穴注入的调制灵活性。器件结构中采用了由 8 nm HTM:16% PD02 和 2 nm HTM:3% PD03 组成的双层 HIL,其中前者与阳极接触。底部发射深红色器件的 EQE 超过 30%,工作电压为 3.2 V,在 10 mA/cm2 条件下的 LT95 为 13,000 h,色度范围为 CIE (X, Y) = (0.701, 0.299) 的 BT.2020。在双 HIL 配置中,PD03 的引入增加了一个可调参数,从而提高了器件的整体性能。
{"title":"Charge balance in OLEDs: Optimization of hole injection layer using novel p-dopants","authors":"Menglan Xie,&nbsp;Huiqing Pang,&nbsp;Jing Wang,&nbsp;Zhihao Cui,&nbsp;Hualong Ding,&nbsp;Renjie Zheng,&nbsp;Ray Kwong,&nbsp;Sean Xia","doi":"10.1002/jsid.1271","DOIUrl":"https://doi.org/10.1002/jsid.1271","url":null,"abstract":"<p>Charge balance is one of the most important factors for realizing high performance organic light emitting devices (OLEDs). In this work, we provide a novel strategy to improve the charge balance in OLEDs by optimizing the hole injection layer (HIL) as well as the electron transporting layer (ETL) and thereby controlling the charge carrier supplies in the device. First, we develop a p-dopant material (PD02), with a lowest unoccupied molecular orbit (LUMO) of −4.63 eV, much shallower than that of the commercial material (PD01) of which the LUMO is −5.04 eV. Nevertheless, this enables us to modulate the supply of holes to the emissive layer through tuning doping concentration. We demonstrate that device performances are significantly improved by employing such a scheme. With a 23% molar doping of PD02, a bottom emission red OLED achieves an external quantum efficiency (EQE) of over 30%, an operating voltage of 3.4 V and a LT95 ~15,000 h at 10 mA/cm<sup>2</sup>, with a Digital Cinema Initiative P3 (DCI-P3) chromaticity of CIE (X, Y) = (0.68, 0.32). Moreover, the efficiency roll-off is suppressed up till ~3500 cd/m<sup>2</sup>, a desirable feature in display applications. The lateral conductivity of by using such HIL is also found to be much lower than that of PD01, resulting in reduced crosstalk among RGB pixels. Next, a new electron transporting material (ETM-02) with a deep LUMO of −2.86 eV is also introduced to further optimize the charge balance. Although devices with ETM-02 shows lower voltage and higher EQE, lifetime is compromised. In order to improve lifetime, additional fine tuning of the charge balance is essential. Finally, a second p-dopant PD03 with a LUMO of −4.91 eV is added to the HIL to further extend the modulation flexibility in the hole injection. A double-layer HIL consisting of 8 nm of HTM:16% PD02 and 2 nm of HTM:3% PD03, where the former is in contact with anode, is adopted in the device structure. The bottom emission deep red device achieve EQE over 30%, an operating voltage of 3.2 V and an improved LT<sub>95</sub> ~13,000 h at 10 mA/cm<sup>2</sup> with a BT.2020 range chromaticity of CIE (X, Y) = (0.701, 0.299). In the double HIL configuration, the introduction of PD03 provides one more parameter for tuning and therefore improves the overall device performances.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":null,"pages":null},"PeriodicalIF":2.3,"publicationDate":"2024-02-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139976553","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Cumulative lifetime enhancement effect of deuteration in blue organic light-emitting diodes 蓝色有机发光二极管中的氘化累积寿命增强效应
IF 2.3 4区 工程技术 Q2 Engineering Pub Date : 2024-02-22 DOI: 10.1002/jsid.1270
Jingwen Yao, Ye-Xin Zhang, Ching W. Tang, Shou-Cheng Dong

This research investigates the impact of deuteration on the operational lifetime of blue organic light-emitting diodes (OLEDs). Our study focuses on the kinetic isotope effect (KIE) and how it enhances device lifetime. Specifically, we examine the effects of deuteration on OLEDs with emitters based on common polycyclic aromatic hydrocarbons by deuterating anthracene-based host materials. Our findings show that the deuterated analogues with incremental deuterium substitutions exhibit similar electroluminescence (EL) performances but progressively prolonged device lifetimes as a function of deuteration, indicating a cumulative enhancement effect. We observed a twofold increase in device lifetime with partial deuterium substitutions, while highly deuterated hosts realized up to a fourfold improvement. Furthermore, we found that device degradation is initiated from the interface of the hole transport layer (HTL) and emitting layer (ETL), and deuteration can mitigate the degraded reactions in the devices, thereby improving operational stability. These results provide insight into how deuteration can increase the operational lifetime of OLEDs, which has important implications for developing more efficient and durable OLED materials.

本研究调查了氘化对蓝色有机发光二极管(OLED)工作寿命的影响。我们的研究重点是动力学同位素效应(KIE)及其如何提高器件寿命。具体来说,我们通过氘化蒽基主材料,研究了氘化对基于常见多环芳烃的发光体的有机发光二极管的影响。我们的研究结果表明,随着氘取代量的增加,氘化类似物表现出相似的电致发光(EL)性能,但器件寿命随氘化量的增加而逐渐延长,这表明存在累积增强效应。我们观察到,部分氘置换使器件寿命延长了两倍,而高氘化宿主则实现了高达四倍的改善。此外,我们还发现,器件降解是从空穴传输层(HTL)和发射层(ETL)的界面开始的,而氘化可以缓解器件中的降解反应,从而提高运行稳定性。这些结果让我们深入了解了氘化如何延长有机发光二极管的工作寿命,这对开发更高效、更耐用的有机发光二极管材料具有重要意义。
{"title":"Cumulative lifetime enhancement effect of deuteration in blue organic light-emitting diodes","authors":"Jingwen Yao,&nbsp;Ye-Xin Zhang,&nbsp;Ching W. Tang,&nbsp;Shou-Cheng Dong","doi":"10.1002/jsid.1270","DOIUrl":"https://doi.org/10.1002/jsid.1270","url":null,"abstract":"<p>This research investigates the impact of deuteration on the operational lifetime of blue organic light-emitting diodes (OLEDs). Our study focuses on the kinetic isotope effect (KIE) and how it enhances device lifetime. Specifically, we examine the effects of deuteration on OLEDs with emitters based on common polycyclic aromatic hydrocarbons by deuterating anthracene-based host materials. Our findings show that the deuterated analogues with incremental deuterium substitutions exhibit similar electroluminescence (EL) performances but progressively prolonged device lifetimes as a function of deuteration, indicating a cumulative enhancement effect. We observed a twofold increase in device lifetime with partial deuterium substitutions, while highly deuterated hosts realized up to a fourfold improvement. Furthermore, we found that device degradation is initiated from the interface of the hole transport layer (HTL) and emitting layer (ETL), and deuteration can mitigate the degraded reactions in the devices, thereby improving operational stability. These results provide insight into how deuteration can increase the operational lifetime of OLEDs, which has important implications for developing more efficient and durable OLED materials.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":null,"pages":null},"PeriodicalIF":2.3,"publicationDate":"2024-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139976502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Toward physically realistic vision in teleoperation: A user study with light-field head mounted display and 6-DoF head motion 实现远程操作中的物理逼真视觉:使用光场头戴式显示器和 6-DoF 头部运动的用户研究
IF 2.3 4区 工程技术 Q2 Engineering Pub Date : 2023-11-05 DOI: 10.1002/jsid.1262
Nicolai Bechtel, Bernhard Weber, Pascal Severin, Jaime Sancho Aragon, Laurie Van Bogaert, Michael Panzirsch

Besides haptics, the visual channel provides the most essential feedback to the operator in teleoperation setups. For optimal performance, the view on the remote scene must provide 3D information, be sharp, and of high resolution. Head-mounted displays (HMD) are applied to improve the immersion of the operator into the remote environment. Still, so far, no near-eye display technology was available that provides a natural view on objects within the typical manipulation distance (up to 1.2 m). The main limitation is a mismatch of the 3D distance and the focal distance of the visualized objects (vergence-accommodation conflict) in displays with fixed focal distance. This conflict potentially leads to eye strain after extended use. Here, we apply a light-field HMD providing close-to-continuous depth information to the user, thus avoiding the vergence-accommodation conflict. Furthermore, we apply a time-of-flight sensor to generate a 2.5D environment model. The displayed content is processed with image-based rendering allowing a 6 degree-of-freedom head motion in the visualized scene. The main objective of the presented study is evaluating the effects of view perspective and light-field on performance and workload in a teleoperation setup. The reduction of visual effort for the user is confirmed in an abstract depth-matching task.

除触觉外,视觉通道还为远程操作设置中的操作员提供最基本的反馈。为了达到最佳性能,远程场景的视图必须提供三维信息、清晰度和高分辨率。头戴式显示器(HMD)的应用提高了操作员对远程环境的沉浸感。但迄今为止,还没有一种近眼显示技术能够在典型的操作距离(最远 1.2 米)内提供自然的物体视图。其主要局限性在于,在固定焦距的显示器中,三维距离与可视化对象的焦距不匹配(辐辏-适应冲突)。这种冲突可能导致长时间使用后眼睛疲劳。在这里,我们采用光场 HMD,为用户提供接近连续的深度信息,从而避免了辐辏-适应冲突。此外,我们还使用飞行时间传感器生成 2.5D 环境模型。显示的内容通过基于图像的渲染处理,允许头部在可视化场景中进行 6 自由度运动。本研究的主要目的是评估视角和光场对远程操作设置中的性能和工作量的影响。在一项抽象的深度匹配任务中,用户视觉工作量的减少得到了证实。
{"title":"Toward physically realistic vision in teleoperation: A user study with light-field head mounted display and 6-DoF head motion","authors":"Nicolai Bechtel,&nbsp;Bernhard Weber,&nbsp;Pascal Severin,&nbsp;Jaime Sancho Aragon,&nbsp;Laurie Van Bogaert,&nbsp;Michael Panzirsch","doi":"10.1002/jsid.1262","DOIUrl":"10.1002/jsid.1262","url":null,"abstract":"<p>Besides haptics, the visual channel provides the most essential feedback to the operator in teleoperation setups. For optimal performance, the view on the remote scene must provide 3D information, be sharp, and of high resolution. Head-mounted displays (HMD) are applied to improve the immersion of the operator into the remote environment. Still, so far, no near-eye display technology was available that provides a natural view on objects within the typical manipulation distance (up to 1.2 m). The main limitation is a mismatch of the 3D distance and the focal distance of the visualized objects (vergence-accommodation conflict) in displays with fixed focal distance. This conflict potentially leads to eye strain after extended use. Here, we apply a light-field HMD providing close-to-continuous depth information to the user, thus avoiding the vergence-accommodation conflict. Furthermore, we apply a time-of-flight sensor to generate a 2.5D environment model. The displayed content is processed with image-based rendering allowing a 6 degree-of-freedom head motion in the visualized scene. The main objective of the presented study is evaluating the effects of view perspective and light-field on performance and workload in a teleoperation setup. The reduction of visual effort for the user is confirmed in an abstract depth-matching task.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":null,"pages":null},"PeriodicalIF":2.3,"publicationDate":"2023-11-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sid.onlinelibrary.wiley.com/doi/epdf/10.1002/jsid.1262","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135725350","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Highly reliable a-Si:H gate driver on array with complementary double-sided noise-eliminating and dual voltage levels for TFT-LCD applications 高可靠的a-Si:H栅极驱动器阵列具有互补的双面消噪和双电压电平,适用于TFT-LCD应用
IF 2.3 4区 工程技术 Q2 Engineering Pub Date : 2023-11-03 DOI: 10.1002/jsid.1263
Guang-Ting Zheng, Po-Tsun Liu, Jo-Lin Chen, Cheng-Hao Li

In this work, we present a high-reliability gate driver on array (GOA) for a 10.7-in. HD (1,280 × RGB × 720) TFT-LCD panel, featuring an alternatively double-sided noise-eliminating function. The gate driver circuit is designed with 12-phase clock signals that exhibit 75% signal overlapping, threshold voltage recovering, and double-sided driving schemes. The double-sided driving scheme reduces the number of mental wires and TFTs in the gate driver circuit, resulting in a smaller layout area for GOA. By utilizing dual levels of voltage, we implemented a negative gate bias method to mitigate threshold voltage shifts for the noise-eliminating and driving TFTs. This prevents the noises from clock signals effectively. The reliability test of the proposed GOA with 720 stages passed a strict testing condition (90°C and −40°C) for simulation and exhibited good performance over 800 hours at 90°C for measurement.

在这项工作中,我们提出了一种高可靠性的阵列上栅极驱动器(GOA)。高清(1,280 × RGB × 720) TFT-LCD面板,具有可选的双面降噪功能。门驱动电路采用12相时钟信号设计,具有75%的信号重叠,阈值电压恢复和双面驱动方案。双面驱动方案减少了栅极驱动电路中的金属线和tft的数量,从而减小了GOA的布局面积。通过利用双电平电压,我们实现了一种负栅极偏置方法来减轻阈值电压漂移,以消除噪声并驱动TFTs。这有效地防止了时钟信号中的噪声。所提出的720级GOA可靠性测试通过了严格的模拟测试条件(90°C和- 40°C),并在90°C的测量条件下表现出800小时的良好性能。
{"title":"Highly reliable a-Si:H gate driver on array with complementary double-sided noise-eliminating and dual voltage levels for TFT-LCD applications","authors":"Guang-Ting Zheng,&nbsp;Po-Tsun Liu,&nbsp;Jo-Lin Chen,&nbsp;Cheng-Hao Li","doi":"10.1002/jsid.1263","DOIUrl":"https://doi.org/10.1002/jsid.1263","url":null,"abstract":"<p>In this work, we present a high-reliability gate driver on array (GOA) for a 10.7-in. HD (1,280 × RGB × 720) TFT-LCD panel, featuring an alternatively double-sided noise-eliminating function. The gate driver circuit is designed with 12-phase clock signals that exhibit 75% signal overlapping, threshold voltage recovering, and double-sided driving schemes. The double-sided driving scheme reduces the number of mental wires and TFTs in the gate driver circuit, resulting in a smaller layout area for GOA. By utilizing dual levels of voltage, we implemented a negative gate bias method to mitigate threshold voltage shifts for the noise-eliminating and driving TFTs. This prevents the noises from clock signals effectively. The reliability test of the proposed GOA with 720 stages passed a strict testing condition (90°C and −40°C) for simulation and exhibited good performance over 800 hours at 90°C for measurement.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":null,"pages":null},"PeriodicalIF":2.3,"publicationDate":"2023-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"134802280","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Deep and adaptive feature extraction attention network for single image super-resolution 用于单幅图像超分辨率的深度自适应特征提取注意力网络
IF 2.3 4区 工程技术 Q2 Engineering Pub Date : 2023-10-28 DOI: 10.1002/jsid.1269
Jianpu Lin, Lizhao Liao, Shanling Lin, Zhixian Lin, Tailiang Guo

Single image super-resolution (SISR) has been revolutionized by convolutional neural networks (CNN). However, existing SISR algorithms have feature extraction and adaptive adjustment limitations, leading to information duplication and unsatisfactory image reconstruction. In this paper, we propose a deep and adaptive feature extraction attention network (DAAN), which first fully extracts shallow features and then adaptively captures precise and fine-scale features by a deep feature extraction block (DFEB). It includes multi-dimensional feature extraction blocks (MFEBs) that combine large kernel and dynamic convolution layers to improve large-scale information utilization effectively. Finally, an enhanced spatial attention block (ESAB) to further selectively reinforce the transmission of details. A large number of experimental results show that our proposed model reconstruction performance is superior to existing classical methods.

卷积神经网络(CNN)给单图像超分辨率(SISR)带来了革命性的变化。然而,现有的 SISR 算法在特征提取和自适应调整方面存在局限性,导致信息重复和图像重建效果不理想。在本文中,我们提出了一种深度自适应特征提取注意力网络(DAAN),它首先完全提取浅层特征,然后通过深度特征提取块(DFEB)自适应地捕捉精确和精细的特征。它包括多维特征提取块(MFEB),结合大内核和动态卷积层,有效提高大规模信息的利用率。最后,增强空间注意力块(ESAB)可进一步有选择地加强细节的传输。大量实验结果表明,我们提出的模型重建性能优于现有的经典方法。
{"title":"Deep and adaptive feature extraction attention network for single image super-resolution","authors":"Jianpu Lin,&nbsp;Lizhao Liao,&nbsp;Shanling Lin,&nbsp;Zhixian Lin,&nbsp;Tailiang Guo","doi":"10.1002/jsid.1269","DOIUrl":"10.1002/jsid.1269","url":null,"abstract":"<p>Single image super-resolution (SISR) has been revolutionized by convolutional neural networks (CNN). However, existing SISR algorithms have feature extraction and adaptive adjustment limitations, leading to information duplication and unsatisfactory image reconstruction. In this paper, we propose a deep and adaptive feature extraction attention network (DAAN), which first fully extracts shallow features and then adaptively captures precise and fine-scale features by a deep feature extraction block (DFEB). It includes multi-dimensional feature extraction blocks (MFEBs) that combine large kernel and dynamic convolution layers to improve large-scale information utilization effectively. Finally, an enhanced spatial attention block (ESAB) to further selectively reinforce the transmission of details. A large number of experimental results show that our proposed model reconstruction performance is superior to existing classical methods.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":null,"pages":null},"PeriodicalIF":2.3,"publicationDate":"2023-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136159029","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Dual-view integral imaging display with adjustable optimal viewing distance 双视角整体成像显示屏,可调节最佳观察距离
IF 2.3 4区 工程技术 Q2 Engineering Pub Date : 2023-10-25 DOI: 10.1002/jsid.1267
Bai-Chuan Zhao, Yan Zhou, Fan Yang, Liang-Wei Chen, Yang Fu

We propose a dual-view integral imaging display that provides two three-dimensional scenes at the same time. An adjustable pinhole array is generated by using a liquid crystal panel. The horizontal pitch of pinhole is adjustable, while the vertical one is unadjustable. The center of each elemental image is deviation from that of the corresponding pinhole. The light rays emitted from two kinds of elemental images are propagated into the left and right viewing directions. The horizontal viewing ranges are unrelated to the horizontal pitch of pinhole and the optimal viewing distance. By changing the horizontal pitch of pinhole, the optimal viewing distance is easily adjusted without loss of viewing angle. We developed an experimental apparatus and verified the proposed hypothesis.

我们提出了一种可同时提供两个三维场景的双视角整体成像显示器。利用液晶面板生成可调针孔阵列。针孔的水平间距可调,垂直间距不可调。每个元素图像的中心与相应针孔的中心存在偏差。两种元素图像发出的光线分别向左、右两个观察方向传播。水平观察范围与针孔的水平间距和最佳观察距离无关。通过改变针孔的水平间距,可以在不损失视角的情况下轻松调整最佳观察距离。我们开发了一种实验装置,并验证了提出的假设。
{"title":"Dual-view integral imaging display with adjustable optimal viewing distance","authors":"Bai-Chuan Zhao,&nbsp;Yan Zhou,&nbsp;Fan Yang,&nbsp;Liang-Wei Chen,&nbsp;Yang Fu","doi":"10.1002/jsid.1267","DOIUrl":"10.1002/jsid.1267","url":null,"abstract":"<p>We propose a dual-view integral imaging display that provides two three-dimensional scenes at the same time. An adjustable pinhole array is generated by using a liquid crystal panel. The horizontal pitch of pinhole is adjustable, while the vertical one is unadjustable. The center of each elemental image is deviation from that of the corresponding pinhole. The light rays emitted from two kinds of elemental images are propagated into the left and right viewing directions. The horizontal viewing ranges are unrelated to the horizontal pitch of pinhole and the optimal viewing distance. By changing the horizontal pitch of pinhole, the optimal viewing distance is easily adjusted without loss of viewing angle. We developed an experimental apparatus and verified the proposed hypothesis.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":null,"pages":null},"PeriodicalIF":2.3,"publicationDate":"2023-10-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135166884","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
The effects of icon updating on user visual discrimination under different working memory load 不同工作记忆负荷下图标更新对用户视觉辨别能力的影响
IF 2.3 4区 工程技术 Q2 Engineering Pub Date : 2023-10-24 DOI: 10.1002/jsid.1268
Mo Chen, Jing Li, Yanfei Zhu

To lessen users' feelings of unease and stress after icons are updated, this study investigates icon recognition and discrimination in terms of icon color and location under different working memory (WM) loads. At low WM load, changing the color or position of the icons has little effect on icon recognition. The icon color update will affect the user's accuracy when less information is presented, but it will not affect participants' reaction time. As for position updates, it is better to update icons' positions within the same row rather than across rows. At high WM load, although subjects responded faster to color than location, subjects were more accurate with location than with color. It can be concluded that color updates are preferred for entertaining user interfaces that demand quick responses, while location updates are preferable for human–computer interfaces that focus on accuracy. From the results of high WM load, subjects are more sensitive to color brightness. The more drastic the color difference, especially if the change level was at levels of 20% or 40%, the subjects' responses would be more obvious.

为了减轻用户在图标更新后的不安和压力感,本研究调查了用户在不同工作记忆(WM)负荷下对图标颜色和位置的识别和分辨能力。在低工作记忆负荷下,改变图标的颜色或位置对图标识别几乎没有影响。当呈现的信息较少时,图标颜色的更新会影响用户的准确性,但不会影响参与者的反应时间。至于位置更新,最好是在同一行内更新图标的位置,而不是跨行更新。在高 WM 负荷下,虽然受试者对颜色的反应比对位置的反应更快,但受试者对位置的反应比对颜色的反应更准确。由此可以得出结论,对于要求快速反应的娱乐性用户界面来说,颜色更新更受欢迎,而对于注重准确性的人机界面来说,位置更新更受欢迎。从高 WM 负载的结果来看,受试者对颜色亮度更为敏感。颜色差异越大,尤其是变化水平达到 20% 或 40% 时,受试者的反应就越明显。
{"title":"The effects of icon updating on user visual discrimination under different working memory load","authors":"Mo Chen,&nbsp;Jing Li,&nbsp;Yanfei Zhu","doi":"10.1002/jsid.1268","DOIUrl":"10.1002/jsid.1268","url":null,"abstract":"<p>To lessen users' feelings of unease and stress after icons are updated, this study investigates icon recognition and discrimination in terms of icon color and location under different working memory (WM) loads. At low WM load, changing the color or position of the icons has little effect on icon recognition. The icon color update will affect the user's accuracy when less information is presented, but it will not affect participants' reaction time. As for position updates, it is better to update icons' positions within the same row rather than across rows. At high WM load, although subjects responded faster to color than location, subjects were more accurate with location than with color. It can be concluded that color updates are preferred for entertaining user interfaces that demand quick responses, while location updates are preferable for human–computer interfaces that focus on accuracy. From the results of high WM load, subjects are more sensitive to color brightness. The more drastic the color difference, especially if the change level was at levels of 20% or 40%, the subjects' responses would be more obvious.</p>","PeriodicalId":49979,"journal":{"name":"Journal of the Society for Information Display","volume":null,"pages":null},"PeriodicalIF":2.3,"publicationDate":"2023-10-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135267905","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Journal of the Society for Information Display
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1