Jiawei Xi, Tsz Kit Yung, Hong Liang, Tan Li, Wing Yim Tam, Jensen Li
{"title":"采用深度学习方法对琼斯矩阵进行重合成像","authors":"Jiawei Xi, Tsz Kit Yung, Hong Liang, Tan Li, Wing Yim Tam, Jensen Li","doi":"10.1038/s44310-024-00002-z","DOIUrl":null,"url":null,"abstract":"Coincidence measurement has become an emerging technique for optical imaging. Based on measuring the second-order coherence g2, sample features such as reflection/transmission amplitude and phase delay can be extracted with developed algorithms pixel-by-pixel. However, an accurate measurement of g2 requires a substantial number of collected photons which becomes difficult under low-light conditions. Here, we propose a deep-learning approach for Jones matrix imaging using photon arrival data directly. A variational autoencoder (β-VAE) is trained using numerical data in an unsupervised manner to obtain a minimal data representation, which can be transformed into an image with little effort. We demonstrate as few as 88 photons collected per pixel on average to extract a Jones matrix image, with accuracy surpassing previous semi-analytic algorithms derived from g2. Our approach not only automates formulating imaging algorithms but can also assess the sufficiency of information from a designed experimental procedure, which can be useful in equipment or algorithm designs for a wide range of imaging applications.","PeriodicalId":501711,"journal":{"name":"npj Nanophotonics","volume":" ","pages":"1-8"},"PeriodicalIF":0.0000,"publicationDate":"2024-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.nature.com/articles/s44310-024-00002-z.pdf","citationCount":"0","resultStr":"{\"title\":\"Coincidence imaging for Jones matrix with a deep-learning approach\",\"authors\":\"Jiawei Xi, Tsz Kit Yung, Hong Liang, Tan Li, Wing Yim Tam, Jensen Li\",\"doi\":\"10.1038/s44310-024-00002-z\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Coincidence measurement has become an emerging technique for optical imaging. Based on measuring the second-order coherence g2, sample features such as reflection/transmission amplitude and phase delay can be extracted with developed algorithms pixel-by-pixel. However, an accurate measurement of g2 requires a substantial number of collected photons which becomes difficult under low-light conditions. Here, we propose a deep-learning approach for Jones matrix imaging using photon arrival data directly. A variational autoencoder (β-VAE) is trained using numerical data in an unsupervised manner to obtain a minimal data representation, which can be transformed into an image with little effort. We demonstrate as few as 88 photons collected per pixel on average to extract a Jones matrix image, with accuracy surpassing previous semi-analytic algorithms derived from g2. Our approach not only automates formulating imaging algorithms but can also assess the sufficiency of information from a designed experimental procedure, which can be useful in equipment or algorithm designs for a wide range of imaging applications.\",\"PeriodicalId\":501711,\"journal\":{\"name\":\"npj Nanophotonics\",\"volume\":\" \",\"pages\":\"1-8\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-03-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.nature.com/articles/s44310-024-00002-z.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"npj Nanophotonics\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.nature.com/articles/s44310-024-00002-z\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"npj Nanophotonics","FirstCategoryId":"1085","ListUrlMain":"https://www.nature.com/articles/s44310-024-00002-z","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Coincidence imaging for Jones matrix with a deep-learning approach
Coincidence measurement has become an emerging technique for optical imaging. Based on measuring the second-order coherence g2, sample features such as reflection/transmission amplitude and phase delay can be extracted with developed algorithms pixel-by-pixel. However, an accurate measurement of g2 requires a substantial number of collected photons which becomes difficult under low-light conditions. Here, we propose a deep-learning approach for Jones matrix imaging using photon arrival data directly. A variational autoencoder (β-VAE) is trained using numerical data in an unsupervised manner to obtain a minimal data representation, which can be transformed into an image with little effort. We demonstrate as few as 88 photons collected per pixel on average to extract a Jones matrix image, with accuracy surpassing previous semi-analytic algorithms derived from g2. Our approach not only automates formulating imaging algorithms but can also assess the sufficiency of information from a designed experimental procedure, which can be useful in equipment or algorithm designs for a wide range of imaging applications.