Traditional image processing-based autofocusing techniques require the acquisition, storage, and processing of large amounts of image sequences, constraining focusing speed and cost. Here we propose an autofocusing technique, which directly and exactly acquires the geometric moments of the target object in real time at different locations by means of a proper image modulation and detection by a single-pixel detector. An autofocusing criterion is then formulated using the central moments, and the fast acquisition of the focal point is achieved by searching for the position that minimizes the criterion. Theoretical analysis and experimental validation of the method are performed and the results show that the method can achieve fast and accurate autofocusing. The proposed method requires only three single-pixel detections for each focusing position of the target object to evaluate the focusing criterion without imaging the target object. The method does not require any active object-to-camera distance measurement. Comparing to local differential methods such as contrast or gradient measurement, our method is more stable to noise and requires very little data compared with the traditional image processing methods. It may find a wide range of potential applications and prospects, particularly in low-light imaging and near-infra imaging, where the level of noise is typically high. Dongfeng Shi and colleagues design an autofocusing algorithm which required fewer sampling pixels. Their method performs well in low light high noise imaging.
{"title":"Fast autofocusing based on single-pixel moment detection","authors":"Huiling Chen, Dongfeng Shi, Zijun Guo, Runbo Jiang, Linbin Zha, Yingjian Wang, Jan Flusser","doi":"10.1038/s44172-024-00288-z","DOIUrl":"10.1038/s44172-024-00288-z","url":null,"abstract":"Traditional image processing-based autofocusing techniques require the acquisition, storage, and processing of large amounts of image sequences, constraining focusing speed and cost. Here we propose an autofocusing technique, which directly and exactly acquires the geometric moments of the target object in real time at different locations by means of a proper image modulation and detection by a single-pixel detector. An autofocusing criterion is then formulated using the central moments, and the fast acquisition of the focal point is achieved by searching for the position that minimizes the criterion. Theoretical analysis and experimental validation of the method are performed and the results show that the method can achieve fast and accurate autofocusing. The proposed method requires only three single-pixel detections for each focusing position of the target object to evaluate the focusing criterion without imaging the target object. The method does not require any active object-to-camera distance measurement. Comparing to local differential methods such as contrast or gradient measurement, our method is more stable to noise and requires very little data compared with the traditional image processing methods. It may find a wide range of potential applications and prospects, particularly in low-light imaging and near-infra imaging, where the level of noise is typically high. Dongfeng Shi and colleagues design an autofocusing algorithm which required fewer sampling pixels. Their method performs well in low light high noise imaging.","PeriodicalId":72644,"journal":{"name":"Communications engineering","volume":" ","pages":"1-15"},"PeriodicalIF":0.0,"publicationDate":"2024-10-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44172-024-00288-z.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142395705","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-10-05DOI: 10.1038/s44172-024-00284-3
Qilong Cheng, Sukumar Rajauria, Erhard Schreck, Robert Smith, Qing Dai, David B. Bogy
Laser-lubricant interaction has been a critical reliability issue in a thermo-tribological system named heat-assisted magnetic recording, one of the next generation hard disk drive solutions to increasing data storage. The lubricant response under laser irradiation and the subsequent lubricant recovery are crucial to the system’s reliability and longevity, however, they cannot be diagnosed locally and timely so far. Here, we propose a thermal scheme to in-situ characterize the mechanical laser-lubricant interaction. The nanometer-thick lubricant has a thermal barrier effect on the near-field thermal transport in the system, according to which the lubricant thickness can be determined. As demonstrations, this paper reports the first quantitative in-situ measurements of the laser-induced lubricant depletion and the subsequent reflow dynamics. The proposed scheme shows a sub-angstrom resolution (~0.2 Å) and a fast response time within seconds, rendering in-situ real-time lubricant diagnosis feasible in the practical hard disk drive products. Heat-Assisted Magnetic Recording hard disk drives offer a solution to increasing data storage. Cheng and colleagues demonstrate a near-field thermal transport-based scheme to in-situ measure the lubricant thickness during the lubricant depletion and reflow dynamics, a process crucial to the reliability and longevity of the system.
{"title":"In-situ sub-angstrom characterization of laser-lubricant interaction in a thermo-tribological system","authors":"Qilong Cheng, Sukumar Rajauria, Erhard Schreck, Robert Smith, Qing Dai, David B. Bogy","doi":"10.1038/s44172-024-00284-3","DOIUrl":"10.1038/s44172-024-00284-3","url":null,"abstract":"Laser-lubricant interaction has been a critical reliability issue in a thermo-tribological system named heat-assisted magnetic recording, one of the next generation hard disk drive solutions to increasing data storage. The lubricant response under laser irradiation and the subsequent lubricant recovery are crucial to the system’s reliability and longevity, however, they cannot be diagnosed locally and timely so far. Here, we propose a thermal scheme to in-situ characterize the mechanical laser-lubricant interaction. The nanometer-thick lubricant has a thermal barrier effect on the near-field thermal transport in the system, according to which the lubricant thickness can be determined. As demonstrations, this paper reports the first quantitative in-situ measurements of the laser-induced lubricant depletion and the subsequent reflow dynamics. The proposed scheme shows a sub-angstrom resolution (~0.2 Å) and a fast response time within seconds, rendering in-situ real-time lubricant diagnosis feasible in the practical hard disk drive products. Heat-Assisted Magnetic Recording hard disk drives offer a solution to increasing data storage. Cheng and colleagues demonstrate a near-field thermal transport-based scheme to in-situ measure the lubricant thickness during the lubricant depletion and reflow dynamics, a process crucial to the reliability and longevity of the system.","PeriodicalId":72644,"journal":{"name":"Communications engineering","volume":" ","pages":"1-7"},"PeriodicalIF":0.0,"publicationDate":"2024-10-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11457497/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142378658","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-23DOI: 10.1038/s44172-024-00282-5
Jesús Sánchez-Pastor, Petr Kadĕra, Masoud Sakaki, Rolf Jakoby, Jaroslav Lacik, Niels Benson, Alejandro Jiménez-Sáez
In addressing sensing in harsh and dynamic environments, there are no available millimeter-wave chipless and wireless sensors capable of continuous operation at extremely high temperatures. Here we present a fully dielectric wireless temperature sensor capable of operating beyond 1000 ∘C. The sensor uses high-Q cavities embedded within a three-dimensional photonic crystal resonating at 83.5 GHz and 85.5 GHz, and a flattened Luneburg lens enhances its readout range. The sensor is additively manufactured using Lithography-based Ceramic Manufacturing in Alumina (Al2O3). Despite the clutter, its frequency-coded response remains detectable from outside the furnace at 50 cm and at temperatures up to 1200 ∘C. It is observed that the resonance frequencies shift with temperature. This shift is linked to a change in the dielectric properties of Al2O3, which are estimated up to 1200 ∘C and show good agreement with literature values. The sensor is thus highly suitable for millimeter-wave applications in dynamic, cluttered, and high-temperature environments. Jesús Sánchez-Pastor and colleagues demonstrate a ceramic W-band wireless temperature sensor leveraging high-Q cavities within a three-dimensional photonic crystal. The sensor is additively manufactured in Alumina and can continuously operate at extreme temperatures above 1000 ∘C with potential applications in dynamic, cluttered, and high-temperature environments.
{"title":"A wireless W-band 3D-printed temperature sensor based on a three-dimensional photonic crystal operating beyond 1000 ∘C","authors":"Jesús Sánchez-Pastor, Petr Kadĕra, Masoud Sakaki, Rolf Jakoby, Jaroslav Lacik, Niels Benson, Alejandro Jiménez-Sáez","doi":"10.1038/s44172-024-00282-5","DOIUrl":"10.1038/s44172-024-00282-5","url":null,"abstract":"In addressing sensing in harsh and dynamic environments, there are no available millimeter-wave chipless and wireless sensors capable of continuous operation at extremely high temperatures. Here we present a fully dielectric wireless temperature sensor capable of operating beyond 1000 ∘C. The sensor uses high-Q cavities embedded within a three-dimensional photonic crystal resonating at 83.5 GHz and 85.5 GHz, and a flattened Luneburg lens enhances its readout range. The sensor is additively manufactured using Lithography-based Ceramic Manufacturing in Alumina (Al2O3). Despite the clutter, its frequency-coded response remains detectable from outside the furnace at 50 cm and at temperatures up to 1200 ∘C. It is observed that the resonance frequencies shift with temperature. This shift is linked to a change in the dielectric properties of Al2O3, which are estimated up to 1200 ∘C and show good agreement with literature values. The sensor is thus highly suitable for millimeter-wave applications in dynamic, cluttered, and high-temperature environments. Jesús Sánchez-Pastor and colleagues demonstrate a ceramic W-band wireless temperature sensor leveraging high-Q cavities within a three-dimensional photonic crystal. The sensor is additively manufactured in Alumina and can continuously operate at extreme temperatures above 1000 ∘C with potential applications in dynamic, cluttered, and high-temperature environments.","PeriodicalId":72644,"journal":{"name":"Communications engineering","volume":" ","pages":"1-9"},"PeriodicalIF":0.0,"publicationDate":"2024-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44172-024-00282-5.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142309251","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-23DOI: 10.1038/s44172-024-00283-4
Hutomo Suryo Wasisto, Sebastian Anzinger, Giovanni Acanfora, Aloysius Farrel, Valentina Sabatini, Elisa Grimoldi, Vasco Marelli, Nikita Ovsiannikov, Konstantin Tkachuk, Giordano Tosolini, Carmine Lucignano, Marco Mietta, Guangzhao Zhang, Marc Fueldner, Erwin Peiner
Microelectromechanical system-based microphones demand high ingress protection levels with regard to their use in harsh environment. Here, we develop environmental protective components comprising polyimide nanofibers combined onto polyether ether ketone fabric meshes and subsequently appraise their impact on the electroacoustic properties of high signal-to-noise-ratio microelectromechanical system-based microphones via industry-standard characterizations and theoretical simulations. Being placed directly on top of the microphone sound port, the nanofiber mesh die-cut parts with an inner diameter of 1.4 mm result in signal-to-noise-ratio and insertion losses of (2.05 ± 0.16) dB(A) and (0.30 ± 0.11) dBFS, respectively, in electroacoustic measurements. Hence, a high signal-to-noise-ratio value of (70.05 ± 0.17) dB(A) can be maintained by the mesh-protected microphone system. Due to their high temperature stability, acoustic performance, environmental robustness, and industry-scale batch production, these nanofibrous meshes reveal high potential to be practically implemented in high-market-volume applications of packaged microelectromechanical system-based microphones. Hutomo Suryo Wasisto and colleagues develop a nanofiber-based mesh for improving the ingress protection level of microelectromechanical system (MEMS)-based microphone. Their device demonstrates high acoustic performance and environmental robustness.
{"title":"Acoustically semitransparent nanofibrous meshes appraised by high signal-to-noise-ratio MEMS microphones","authors":"Hutomo Suryo Wasisto, Sebastian Anzinger, Giovanni Acanfora, Aloysius Farrel, Valentina Sabatini, Elisa Grimoldi, Vasco Marelli, Nikita Ovsiannikov, Konstantin Tkachuk, Giordano Tosolini, Carmine Lucignano, Marco Mietta, Guangzhao Zhang, Marc Fueldner, Erwin Peiner","doi":"10.1038/s44172-024-00283-4","DOIUrl":"10.1038/s44172-024-00283-4","url":null,"abstract":"Microelectromechanical system-based microphones demand high ingress protection levels with regard to their use in harsh environment. Here, we develop environmental protective components comprising polyimide nanofibers combined onto polyether ether ketone fabric meshes and subsequently appraise their impact on the electroacoustic properties of high signal-to-noise-ratio microelectromechanical system-based microphones via industry-standard characterizations and theoretical simulations. Being placed directly on top of the microphone sound port, the nanofiber mesh die-cut parts with an inner diameter of 1.4 mm result in signal-to-noise-ratio and insertion losses of (2.05 ± 0.16) dB(A) and (0.30 ± 0.11) dBFS, respectively, in electroacoustic measurements. Hence, a high signal-to-noise-ratio value of (70.05 ± 0.17) dB(A) can be maintained by the mesh-protected microphone system. Due to their high temperature stability, acoustic performance, environmental robustness, and industry-scale batch production, these nanofibrous meshes reveal high potential to be practically implemented in high-market-volume applications of packaged microelectromechanical system-based microphones. Hutomo Suryo Wasisto and colleagues develop a nanofiber-based mesh for improving the ingress protection level of microelectromechanical system (MEMS)-based microphone. Their device demonstrates high acoustic performance and environmental robustness.","PeriodicalId":72644,"journal":{"name":"Communications engineering","volume":" ","pages":"1-11"},"PeriodicalIF":0.0,"publicationDate":"2024-09-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44172-024-00283-4.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142309252","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-18DOI: 10.1038/s44172-024-00281-6
Alex Bocchieri, Edoardo Charbon, Andreas Velten
Position and time measurements of scintillation events encode information about the radiation source. Single photon avalanche diode (SPAD) arrays offer multiple-megapixel spatial resolution and tens of picoseconds temporal resolution for detecting single photons. Current lensless designs for measuring scintillation events use sensors that are lower in spatial resolution. Camera-based designs use sensors that are lower in temporal resolution or readout rate and cannot image individual interactions. Here we propose to image scintillation events in a thick, monolithic scintillator using a high-resolution SPAD camera. We demonstrate that a commercial SPAD camera is able to gather sufficient signal to image individual scintillation events and observe 3D shifts in their spatial distribution. Simulations show that a SPAD camera can localize individual scintillation events in 3D. We report direct imaging of gamma-ray interactions in a scintillator with a SPAD camera. The proposed design may allow to measure complex signatures of individual particles interacting in the scintillator. Alex Bocchieri and colleagues propose an imaging technique in a thick, monolithic scintillator using a high-resolution SPAD camera. They report a direct imaging of gamma-ray interactions in a scintillator.
{"title":"Scintillation event imaging with a single photon avalanche diode camera","authors":"Alex Bocchieri, Edoardo Charbon, Andreas Velten","doi":"10.1038/s44172-024-00281-6","DOIUrl":"10.1038/s44172-024-00281-6","url":null,"abstract":"Position and time measurements of scintillation events encode information about the radiation source. Single photon avalanche diode (SPAD) arrays offer multiple-megapixel spatial resolution and tens of picoseconds temporal resolution for detecting single photons. Current lensless designs for measuring scintillation events use sensors that are lower in spatial resolution. Camera-based designs use sensors that are lower in temporal resolution or readout rate and cannot image individual interactions. Here we propose to image scintillation events in a thick, monolithic scintillator using a high-resolution SPAD camera. We demonstrate that a commercial SPAD camera is able to gather sufficient signal to image individual scintillation events and observe 3D shifts in their spatial distribution. Simulations show that a SPAD camera can localize individual scintillation events in 3D. We report direct imaging of gamma-ray interactions in a scintillator with a SPAD camera. The proposed design may allow to measure complex signatures of individual particles interacting in the scintillator. Alex Bocchieri and colleagues propose an imaging technique in a thick, monolithic scintillator using a high-resolution SPAD camera. They report a direct imaging of gamma-ray interactions in a scintillator.","PeriodicalId":72644,"journal":{"name":"Communications engineering","volume":" ","pages":"1-16"},"PeriodicalIF":0.0,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44172-024-00281-6.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142273336","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Computer-aided diagnosis (CAD) has advanced medical image analysis, while large language models (LLMs) have shown potential in clinical applications. However, LLMs struggle to interpret medical images, which are critical for decision-making. Here we show a strategy integrating LLMs with CAD networks. The framework uses LLMs’ medical knowledge and reasoning to enhance CAD network outputs, such as diagnosis, lesion segmentation, and report generation, by summarizing information in natural language. The generated reports are of higher quality and can improve the performance of vision-based CAD models. In chest X-rays, an LLM using ChatGPT improved diagnosis performance by 16.42 percentage points compared to state-of-the-art models, while GPT-3 provided a 15.00 percentage point F1-score improvement. Our strategy allows accurate report generation and creates a patient-friendly interactive system, unlike conventional CAD systems only understood by professionals. This approach has the potential to revolutionize clinical decision-making and patient communication. Wang et al. developed a machine learning strategy for improving large language model to understand and analyse visual medical information. Their framework seamlessly integrates medical image computer-aided diagnosis networks with large language models, converting medical image inputs into a clear and concise textual summary of the patient’s condition.
{"title":"Interactive computer-aided diagnosis on medical image using large language models","authors":"Sheng Wang, Zihao Zhao, Xi Ouyang, Tianming Liu, Qian Wang, Dinggang Shen","doi":"10.1038/s44172-024-00271-8","DOIUrl":"10.1038/s44172-024-00271-8","url":null,"abstract":"Computer-aided diagnosis (CAD) has advanced medical image analysis, while large language models (LLMs) have shown potential in clinical applications. However, LLMs struggle to interpret medical images, which are critical for decision-making. Here we show a strategy integrating LLMs with CAD networks. The framework uses LLMs’ medical knowledge and reasoning to enhance CAD network outputs, such as diagnosis, lesion segmentation, and report generation, by summarizing information in natural language. The generated reports are of higher quality and can improve the performance of vision-based CAD models. In chest X-rays, an LLM using ChatGPT improved diagnosis performance by 16.42 percentage points compared to state-of-the-art models, while GPT-3 provided a 15.00 percentage point F1-score improvement. Our strategy allows accurate report generation and creates a patient-friendly interactive system, unlike conventional CAD systems only understood by professionals. This approach has the potential to revolutionize clinical decision-making and patient communication. Wang et al. developed a machine learning strategy for improving large language model to understand and analyse visual medical information. Their framework seamlessly integrates medical image computer-aided diagnosis networks with large language models, converting medical image inputs into a clear and concise textual summary of the patient’s condition.","PeriodicalId":72644,"journal":{"name":"Communications engineering","volume":" ","pages":"1-9"},"PeriodicalIF":0.0,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44172-024-00271-8.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142273367","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-17DOI: 10.1038/s44172-024-00273-6
Manashita Borah, Qiao Wang, Scott Moura, Dirk Uwe Sauer, Weihan Li
Improving battery health and safety motivates the synergy of a powerful duo: physics and machine learning. Through seamless integration of these disciplines, the efficacy of mathematical battery models can be significantly enhanced. This paper delves into the challenges and potentials of managing battery health and safety, highlighting the transformative impact of integrating physics and machine learning to address those challenges. Based on our systematic review in this context, we outline several future directions and perspectives, offering a comprehensive exploration of efficient and reliable approaches. Our analysis emphasizes that the integration of physics and machine learning stands as a disruptive innovation in the development of emerging battery health and safety management technologies. Lithium-ion batteries are integral to modern technologies but the sustainability of long-term battery health is a significant and persistent challenge. In this perspective Borah and colleagues discuss the integration of physics and machine learning to support developments in battery performance and safety.
{"title":"Synergizing physics and machine learning for advanced battery management","authors":"Manashita Borah, Qiao Wang, Scott Moura, Dirk Uwe Sauer, Weihan Li","doi":"10.1038/s44172-024-00273-6","DOIUrl":"10.1038/s44172-024-00273-6","url":null,"abstract":"Improving battery health and safety motivates the synergy of a powerful duo: physics and machine learning. Through seamless integration of these disciplines, the efficacy of mathematical battery models can be significantly enhanced. This paper delves into the challenges and potentials of managing battery health and safety, highlighting the transformative impact of integrating physics and machine learning to address those challenges. Based on our systematic review in this context, we outline several future directions and perspectives, offering a comprehensive exploration of efficient and reliable approaches. Our analysis emphasizes that the integration of physics and machine learning stands as a disruptive innovation in the development of emerging battery health and safety management technologies. Lithium-ion batteries are integral to modern technologies but the sustainability of long-term battery health is a significant and persistent challenge. In this perspective Borah and colleagues discuss the integration of physics and machine learning to support developments in battery performance and safety.","PeriodicalId":72644,"journal":{"name":"Communications engineering","volume":" ","pages":"1-9"},"PeriodicalIF":0.0,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44172-024-00273-6.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142273324","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-14DOI: 10.1038/s44172-024-00275-4
Hasan Uluşan, M. Berat Yüksel, Özlem Topçu, H. Andaç Yiğit, Akın M. Yılmaz, Mert Doğan, Nagihan Gülhan Yasar, İbrahim Kuyumcu, Aykan Batu, Nebil Göksu, M. Birol Uğur, Haluk Külah
Realizations of fully implantable cochlear implants (FICIs) for providing adequate solution to esthetic concerns and frequent battery replacement have lacked of addressing system level criteria as a complete device. Here, we present a full-custom FICI that considers design of both an implantable sensor for wide range sound sensing and a signal conditioning circuit for electrical stimulation of the auditory nerve. The microelectromechanical system (MEMS)-based acoustic sensor utilizes multiple cantilever beam structures to sense and filter the mechanical vibrations on the ossicular chain. The area optimized bilayer design of the piezoelectric sensor met with the volume limitation in the middle ear while achieving high signal-to-noise-ratio. The sensor outputs are processed by a current mode low-power signal conditioning circuit that stimulates the auditory neurons through intracochlear electrodes. The FICI is validated with an in vivo model where the electrical auditory brainstem response (eABR) of the animal was observed while applying sound excitation. The eABR results demonstrate that the system is able to evoke responses in the auditory nerves of a guinea pig for sound range of 45–100 dB SPL within the selected frequency bands. Dr Ulusan and colleagues design a fully implantable cochlear implant and demonstrate functionality using an in vivo model where sound vibrations within a range of 45–100 dB SPL can be detected and filtered. The design uses a MEMS-based acoustic sensor coupled with a low-power signal-conditioning circuit that will also ensure long operating times.
全植入式人工耳蜗(FICI)可充分解决美观问题和频繁更换电池的问题,但作为一个完整的设备,它缺乏系统级标准。在这里,我们介绍一种全定制 FICI,它既考虑了用于大范围声音感应的植入式传感器的设计,也考虑了用于电刺激听觉神经的信号调节电路的设计。基于微机电系统(MEMS)的声学传感器利用多个悬臂梁结构来感应和过滤听骨链上的机械振动。压电传感器的面积优化双层设计既能满足中耳的体积限制,又能实现高信噪比。传感器输出由电流模式低功耗信号调节电路处理,该电路通过耳蜗内电极刺激听觉神经元。FICI 通过活体模型进行了验证,在该模型中,在施加声音激励的同时观察了动物的听性脑干电反应(eABR)。电听觉脑干反应结果表明,该系统能够在选定频段内唤起豚鼠听觉神经对 45-100 dB SPL 范围内声音的反应。Ulusan 博士及其同事设计了一种完全可植入的人工耳蜗,并使用体内模型演示了其功能,在该模型中,可以检测和过滤 45-100 dB SPL 范围内的声音振动。该设计采用了基于 MEMS 的声学传感器和低功耗信号调节电路,可确保长时间工作。
{"title":"A full-custom fully implantable cochlear implant system validated in vivo with an animal model","authors":"Hasan Uluşan, M. Berat Yüksel, Özlem Topçu, H. Andaç Yiğit, Akın M. Yılmaz, Mert Doğan, Nagihan Gülhan Yasar, İbrahim Kuyumcu, Aykan Batu, Nebil Göksu, M. Birol Uğur, Haluk Külah","doi":"10.1038/s44172-024-00275-4","DOIUrl":"10.1038/s44172-024-00275-4","url":null,"abstract":"Realizations of fully implantable cochlear implants (FICIs) for providing adequate solution to esthetic concerns and frequent battery replacement have lacked of addressing system level criteria as a complete device. Here, we present a full-custom FICI that considers design of both an implantable sensor for wide range sound sensing and a signal conditioning circuit for electrical stimulation of the auditory nerve. The microelectromechanical system (MEMS)-based acoustic sensor utilizes multiple cantilever beam structures to sense and filter the mechanical vibrations on the ossicular chain. The area optimized bilayer design of the piezoelectric sensor met with the volume limitation in the middle ear while achieving high signal-to-noise-ratio. The sensor outputs are processed by a current mode low-power signal conditioning circuit that stimulates the auditory neurons through intracochlear electrodes. The FICI is validated with an in vivo model where the electrical auditory brainstem response (eABR) of the animal was observed while applying sound excitation. The eABR results demonstrate that the system is able to evoke responses in the auditory nerves of a guinea pig for sound range of 45–100 dB SPL within the selected frequency bands. Dr Ulusan and colleagues design a fully implantable cochlear implant and demonstrate functionality using an in vivo model where sound vibrations within a range of 45–100 dB SPL can be detected and filtered. The design uses a MEMS-based acoustic sensor coupled with a low-power signal-conditioning circuit that will also ensure long operating times.","PeriodicalId":72644,"journal":{"name":"Communications engineering","volume":" ","pages":"1-11"},"PeriodicalIF":0.0,"publicationDate":"2024-09-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44172-024-00275-4.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142234045","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Atomic Force Microscopy (AFM) is a widely employed tool for micro- and nanoscale topographic imaging. However, conventional AFM scanning struggles to reconstruct complex 3D micro- and nanostructures precisely due to limitations such as incomplete sample topography capturing and tip-sample convolution artifacts. Here, we propose a multi-view neural-network-based framework with AFM, named MVN-AFM, which accurately reconstructs surface models of intricate micro- and nanostructures. Unlike previous 3D-AFM approaches, MVN-AFM does not depend on any specially shaped probes or costly modifications to the AFM system. To achieve this, MVN-AFM employs an iterative method to align multi-view data and eliminate AFM artifacts simultaneously. Furthermore, we apply the neural implicit surface reconstruction technique in nanotechnology and achieve improved results. Additional extensive experiments show that MVN-AFM effectively eliminates artifacts present in raw AFM images and reconstructs various micro- and nanostructures, including complex geometrical microstructures printed via two-photon lithography and nanoparticles such as poly(methyl methacrylate) (PMMA) nanospheres and zeolitic imidazolate framework-67 (ZIF-67) nanocrystals. This work presents a cost-effective tool for micro- and nanoscale 3D analysis. Shuo Chen and colleagues present a cost-effective neural network-based method to deal with tip-sample convolution artifacts in atomic force microscopy. Their method merges multiview atomic force microscopy images into precise 3D models of complex micro- and nanostructures.
{"title":"Multi-view neural 3D reconstruction of micro- and nanostructures with atomic force microscopy","authors":"Shuo Chen, Mao Peng, Yijin Li, Bing-Feng Ju, Hujun Bao, Yuan-Liu Chen, Guofeng Zhang","doi":"10.1038/s44172-024-00270-9","DOIUrl":"10.1038/s44172-024-00270-9","url":null,"abstract":"Atomic Force Microscopy (AFM) is a widely employed tool for micro- and nanoscale topographic imaging. However, conventional AFM scanning struggles to reconstruct complex 3D micro- and nanostructures precisely due to limitations such as incomplete sample topography capturing and tip-sample convolution artifacts. Here, we propose a multi-view neural-network-based framework with AFM, named MVN-AFM, which accurately reconstructs surface models of intricate micro- and nanostructures. Unlike previous 3D-AFM approaches, MVN-AFM does not depend on any specially shaped probes or costly modifications to the AFM system. To achieve this, MVN-AFM employs an iterative method to align multi-view data and eliminate AFM artifacts simultaneously. Furthermore, we apply the neural implicit surface reconstruction technique in nanotechnology and achieve improved results. Additional extensive experiments show that MVN-AFM effectively eliminates artifacts present in raw AFM images and reconstructs various micro- and nanostructures, including complex geometrical microstructures printed via two-photon lithography and nanoparticles such as poly(methyl methacrylate) (PMMA) nanospheres and zeolitic imidazolate framework-67 (ZIF-67) nanocrystals. This work presents a cost-effective tool for micro- and nanoscale 3D analysis. Shuo Chen and colleagues present a cost-effective neural network-based method to deal with tip-sample convolution artifacts in atomic force microscopy. Their method merges multiview atomic force microscopy images into precise 3D models of complex micro- and nanostructures.","PeriodicalId":72644,"journal":{"name":"Communications engineering","volume":" ","pages":"1-12"},"PeriodicalIF":0.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44172-024-00270-9.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142234039","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-09-12DOI: 10.1038/s44172-024-00279-0
Taixia Shi, Yang Chen, Jianping Yao
To facilitate intelligent interconnection among people, machines, and things, the next generation of communication technology must incorporate various sensing functions besides high-speed wireless communications. Integration of radar, wireless communications, and spectrum sensing is being investigated for 6G with increased spectral efficiency, enhanced system integration, and reduced cost. Microwave photonics, a technique that combines microwave engineering and photonic technology is considered an effective solution for implementing the integration and breaking the bottleneck problems of electronic solutions. Here, we show a photonics-assisted joint radar, wireless communications, and spectrum sensing system that enables precise perception of the surrounding physical and electromagnetic environments while maintaining high-speed communication. Communication signals and frequency-sweep signals are merged optically using a shared system architecture and hardware to achieve signal level sharing, ultimately simultaneously achieving high-accuracy radar ranging and imaging with a measurement error within ± 4 cm and an imaging resolution of 25 × 24.7 mm, high-data-rate wireless communications at 2 Gbaud, and wideband spectrum sensing with a frequency measurement error within ±10 MHz in a 6 GHz bandwidth. Taixia Shi and colleagues demonstrate a microwave photonics system with integrated capabilities of radar, communication, and spectrum sensing for 6G technologies, simultaneously achieving high-accuracy radar ranging and imaging, high-data-rate wireless communications, and wideband spectrum sensing.
{"title":"Seamlessly merging radar ranging and imaging, wireless communications, and spectrum sensing for 6G empowered by microwave photonics","authors":"Taixia Shi, Yang Chen, Jianping Yao","doi":"10.1038/s44172-024-00279-0","DOIUrl":"10.1038/s44172-024-00279-0","url":null,"abstract":"To facilitate intelligent interconnection among people, machines, and things, the next generation of communication technology must incorporate various sensing functions besides high-speed wireless communications. Integration of radar, wireless communications, and spectrum sensing is being investigated for 6G with increased spectral efficiency, enhanced system integration, and reduced cost. Microwave photonics, a technique that combines microwave engineering and photonic technology is considered an effective solution for implementing the integration and breaking the bottleneck problems of electronic solutions. Here, we show a photonics-assisted joint radar, wireless communications, and spectrum sensing system that enables precise perception of the surrounding physical and electromagnetic environments while maintaining high-speed communication. Communication signals and frequency-sweep signals are merged optically using a shared system architecture and hardware to achieve signal level sharing, ultimately simultaneously achieving high-accuracy radar ranging and imaging with a measurement error within ± 4 cm and an imaging resolution of 25 × 24.7 mm, high-data-rate wireless communications at 2 Gbaud, and wideband spectrum sensing with a frequency measurement error within ±10 MHz in a 6 GHz bandwidth. Taixia Shi and colleagues demonstrate a microwave photonics system with integrated capabilities of radar, communication, and spectrum sensing for 6G technologies, simultaneously achieving high-accuracy radar ranging and imaging, high-data-rate wireless communications, and wideband spectrum sensing.","PeriodicalId":72644,"journal":{"name":"Communications engineering","volume":" ","pages":"1-12"},"PeriodicalIF":0.0,"publicationDate":"2024-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44172-024-00279-0.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142234032","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}