Pub Date : 2024-07-01Epub Date: 2024-07-12DOI: 10.1117/1.JBO.29.7.070901
Shunyao Zhang, Jingyi Miao, Lei S Li
Significance: Photoacoustic computed tomography (PACT), a hybrid imaging modality combining optical excitation with acoustic detection, has rapidly emerged as a prominent biomedical imaging technique.
Aim: We review the challenges and advances of PACT, including (1) limited view, (2) anisotropy resolution, (3) spatial aliasing, (4) acoustic heterogeneity (speed of sound mismatch), and (5) fluence correction of spectral unmixing.
Approach: We performed a comprehensive literature review to summarize the key challenges in PACT toward practical applications and discuss various solutions.
Results: There is a wide range of contributions from both industry and academic spaces. Various approaches, including emerging deep learning methods, are proposed to improve the performance of PACT further.
Conclusions: We outline contemporary technologies aimed at tackling the challenges in PACT applications.
{"title":"Challenges and advances in two-dimensional photoacoustic computed tomography: a review.","authors":"Shunyao Zhang, Jingyi Miao, Lei S Li","doi":"10.1117/1.JBO.29.7.070901","DOIUrl":"10.1117/1.JBO.29.7.070901","url":null,"abstract":"<p><strong>Significance: </strong>Photoacoustic computed tomography (PACT), a hybrid imaging modality combining optical excitation with acoustic detection, has rapidly emerged as a prominent biomedical imaging technique.</p><p><strong>Aim: </strong>We review the challenges and advances of PACT, including (1) limited view, (2) anisotropy resolution, (3) spatial aliasing, (4) acoustic heterogeneity (speed of sound mismatch), and (5) fluence correction of spectral unmixing.</p><p><strong>Approach: </strong>We performed a comprehensive literature review to summarize the key challenges in PACT toward practical applications and discuss various solutions.</p><p><strong>Results: </strong>There is a wide range of contributions from both industry and academic spaces. Various approaches, including emerging deep learning methods, are proposed to improve the performance of PACT further.</p><p><strong>Conclusions: </strong>We outline contemporary technologies aimed at tackling the challenges in PACT applications.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 7","pages":"070901"},"PeriodicalIF":3.0,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11245175/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141616531","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-07-01Epub Date: 2024-07-19DOI: 10.1117/1.JBO.29.7.076004
Robin Dale, Biao Zheng, Felipe Orihuela-Espina, Nicholas Ross, Thomas D O'Sullivan, Scott Howard, Hamid Dehghani
Significance: Frequency-domain diffuse optical tomography (FD-DOT) could enhance clinical breast tumor characterization. However, conventional diffuse optical tomography (DOT) image reconstruction algorithms require case-by-case expert tuning and are too computationally intensive to provide feedback during a scan. Deep learning (DL) algorithms front-load computational and tuning costs, enabling high-speed, high-fidelity FD-DOT.
Aim: We aim to demonstrate a simultaneous reconstruction of three-dimensional absorption and reduced scattering coefficients using DL-FD-DOT, with a view toward real-time imaging with a handheld probe.
Approach: A DL model was trained to solve the DOT inverse problem using a realistically simulated FD-DOT dataset emulating a handheld probe for human breast imaging and tested using both synthetic and experimental data.
Results: Over a test set of 300 simulated tissue phantoms for absorption and scattering reconstructions, the DL-DOT model reduced the root mean square error by and , increased the spatial similarity by and , increased the anomaly contrast accuracy by ( ), and reduced the crosstalk by and , respectively, compared with model-based tomography. The average reconstruction time was reduced from 3.8 min to 0.02 s for a single reconstruction. The model was successfully verified using two tumor-emulating optical phantoms.
Conclusions: There is clinical potential for real-time functional imaging of human breast tissue using DL and FD-DOT.
{"title":"Deep learning-enabled high-speed, multi-parameter diffuse optical tomography.","authors":"Robin Dale, Biao Zheng, Felipe Orihuela-Espina, Nicholas Ross, Thomas D O'Sullivan, Scott Howard, Hamid Dehghani","doi":"10.1117/1.JBO.29.7.076004","DOIUrl":"10.1117/1.JBO.29.7.076004","url":null,"abstract":"<p><strong>Significance: </strong>Frequency-domain diffuse optical tomography (FD-DOT) could enhance clinical breast tumor characterization. However, conventional diffuse optical tomography (DOT) image reconstruction algorithms require case-by-case expert tuning and are too computationally intensive to provide feedback during a scan. Deep learning (DL) algorithms front-load computational and tuning costs, enabling high-speed, high-fidelity FD-DOT.</p><p><strong>Aim: </strong>We aim to demonstrate a simultaneous reconstruction of three-dimensional absorption and reduced scattering coefficients using DL-FD-DOT, with a view toward real-time imaging with a handheld probe.</p><p><strong>Approach: </strong>A DL model was trained to solve the DOT inverse problem using a realistically simulated FD-DOT dataset emulating a handheld probe for human breast imaging and tested using both synthetic and experimental data.</p><p><strong>Results: </strong>Over a test set of 300 simulated tissue phantoms for absorption and scattering reconstructions, the DL-DOT model reduced the root mean square error by <math><mrow><mn>12</mn> <mo>%</mo> <mo>±</mo> <mn>40</mn> <mo>%</mo></mrow> </math> and <math><mrow><mn>23</mn> <mo>%</mo> <mo>±</mo> <mn>40</mn> <mo>%</mo></mrow> </math> , increased the spatial similarity by <math><mrow><mn>17</mn> <mo>%</mo> <mo>±</mo> <mn>17</mn> <mo>%</mo></mrow> </math> and <math><mrow><mn>9</mn> <mo>%</mo> <mo>±</mo> <mn>15</mn> <mo>%</mo></mrow> </math> , increased the anomaly contrast accuracy by <math><mrow><mn>9</mn> <mo>%</mo> <mo>±</mo> <mn>9</mn> <mo>%</mo></mrow> </math> ( <math> <mrow><msub><mi>μ</mi> <mi>a</mi></msub> </mrow> </math> ), and reduced the crosstalk by <math><mrow><mn>5</mn> <mo>%</mo> <mo>±</mo> <mn>18</mn> <mo>%</mo></mrow> </math> and <math><mrow><mn>7</mn> <mo>%</mo> <mo>±</mo> <mn>11</mn> <mo>%</mo></mrow> </math> , respectively, compared with model-based tomography. The average reconstruction time was reduced from 3.8 min to 0.02 s for a single reconstruction. The model was successfully verified using two tumor-emulating optical phantoms.</p><p><strong>Conclusions: </strong>There is clinical potential for real-time functional imaging of human breast tissue using DL and FD-DOT.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 7","pages":"076004"},"PeriodicalIF":3.0,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11259453/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141734165","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-01Epub Date: 2024-06-05DOI: 10.1117/1.JBO.29.S3.S33303
Janek Gröhl, Kylie Yeung, Kevin Gu, Thomas R Else, Monika Golinska, Ellie V Bunce, Lina Hacker, Sarah E Bohndiek
Significance: Photoacoustic imaging (PAI) promises to measure spatially resolved blood oxygen saturation but suffers from a lack of accurate and robust spectral unmixing methods to deliver on this promise. Accurate blood oxygenation estimation could have important clinical applications from cancer detection to quantifying inflammation.
Aim: We address the inflexibility of existing data-driven methods for estimating blood oxygenation in PAI by introducing a recurrent neural network architecture.
Approach: We created 25 simulated training dataset variations to assess neural network performance. We used a long short-term memory network to implement a wavelength-flexible network architecture and proposed the Jensen-Shannon divergence to predict the most suitable training dataset.
Results: The network architecture can flexibly handle the input wavelengths and outperforms linear unmixing and the previously proposed learned spectral decoloring method. Small changes in the training data significantly affect the accuracy of our method, but we find that the Jensen-Shannon divergence correlates with the estimation error and is thus suitable for predicting the most appropriate training datasets for any given application.
Conclusions: A flexible data-driven network architecture combined with the Jensen-Shannon divergence to predict the best training data set provides a promising direction that might enable robust data-driven photoacoustic oximetry for clinical use cases.
意义重大:光声成像(PAI)有望测量空间分辨率的血氧饱和度,但缺乏准确、稳健的光谱非混合方法来实现这一目标。准确的血氧饱和度估算可用于从癌症检测到炎症量化的重要临床应用。目的:我们通过引入循环神经网络架构,解决了现有数据驱动方法在 PAI 中估算血氧饱和度时缺乏灵活性的问题:方法:我们创建了 25 种模拟训练数据集变化来评估神经网络性能。我们使用长短期记忆网络实现了波长灵活的网络架构,并提出了詹森-香农发散法来预测最合适的训练数据集:结果:该网络架构可灵活处理输入波长,其性能优于线性解混法和之前提出的学习光谱解色法。训练数据的微小变化会显著影响我们方法的准确性,但我们发现詹森-香农发散与估计误差相关,因此适用于预测任何给定应用中最合适的训练数据集:灵活的数据驱动型网络架构与詹森-香农发散法相结合,为预测最佳训练数据集提供了一个很有前景的方向,该方向有可能为临床应用案例提供稳健的数据驱动型光声血氧仪。
{"title":"Distribution-informed and wavelength-flexible data-driven photoacoustic oximetry.","authors":"Janek Gröhl, Kylie Yeung, Kevin Gu, Thomas R Else, Monika Golinska, Ellie V Bunce, Lina Hacker, Sarah E Bohndiek","doi":"10.1117/1.JBO.29.S3.S33303","DOIUrl":"10.1117/1.JBO.29.S3.S33303","url":null,"abstract":"<p><strong>Significance: </strong>Photoacoustic imaging (PAI) promises to measure spatially resolved blood oxygen saturation but suffers from a lack of accurate and robust spectral unmixing methods to deliver on this promise. Accurate blood oxygenation estimation could have important clinical applications from cancer detection to quantifying inflammation.</p><p><strong>Aim: </strong>We address the inflexibility of existing data-driven methods for estimating blood oxygenation in PAI by introducing a recurrent neural network architecture.</p><p><strong>Approach: </strong>We created 25 simulated training dataset variations to assess neural network performance. We used a long short-term memory network to implement a wavelength-flexible network architecture and proposed the Jensen-Shannon divergence to predict the most suitable training dataset.</p><p><strong>Results: </strong>The network architecture can flexibly handle the input wavelengths and outperforms linear unmixing and the previously proposed learned spectral decoloring method. Small changes in the training data significantly affect the accuracy of our method, but we find that the Jensen-Shannon divergence correlates with the estimation error and is thus suitable for predicting the most appropriate training datasets for any given application.</p><p><strong>Conclusions: </strong>A flexible data-driven network architecture combined with the Jensen-Shannon divergence to predict the best training data set provides a promising direction that might enable robust data-driven photoacoustic oximetry for clinical use cases.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 Suppl 3","pages":"S33303"},"PeriodicalIF":3.5,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11151660/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141260266","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-01Epub Date: 2024-07-16DOI: 10.1117/1.JBO.29.S2.S22712
Sun Woong Hur, Minsung Kwon, Revathi Manoharaan, Melika Haji Mohammadi, Ashok Zachariah Samuel, Michael P Mulligan, Paul J Hergenrother, Rohit Bhargava
Significance: Label-free quantitative phase imaging can potentially measure cellular dynamics with minimal perturbation, motivating efforts to develop faster and more sensitive instrumentation. We characterize fast, single-shot quantitative phase gradient microscopy (ss-QPGM) that simultaneously acquires multiple polarization components required to reconstruct phase images. We integrate a computationally efficient least squares algorithm to provide real-time, video-rate imaging (up to ). The developed instrument was used to observe changes in cellular morphology and correlate these to molecular measures commonly obtained by staining.
Aim: We aim to characterize a fast approach to ss-QPGM and record morphological changes in single-cell phase images. We also correlate these with biochemical changes indicating cell death using concurrently acquired fluorescence images.
Approach: Here, we examine nutrient deprivation and anticancer drug-induced cell death in two different breast cell lines, viz., M2 and MCF7. Our approach involves in-line measurements of ss-QPGM and fluorescence imaging of the cells biochemically labeled for viability.
Results: We validate the accuracy of the phase measurement using a USAF1951 pattern phase target. The ss-QPGM system resolves , and our analysis scheme accurately retrieves the phase with a high correlation coefficient ( ), as measured by calibrated sample thicknesses. Analyzing the contrast in phase, we estimate the spatial resolution achievable to be for this microscope. ss-QPGM time-lapse live-cell imaging reveals multiple intracellular and morphological changes during biochemically induced cell death. Inferences from co-registered images of quantitative phase and fluorescence suggest the possibility of necrosis, which agrees with previous findings.
Conclusions: Label-free ss-QPGM with high-temporal resolution and high spatial fidelity is demonstrated. Its application for monitoring dynamic changes in live cells offers promising prospects.
{"title":"Capturing cell morphology dynamics with high temporal resolution using single-shot quantitative phase gradient imaging.","authors":"Sun Woong Hur, Minsung Kwon, Revathi Manoharaan, Melika Haji Mohammadi, Ashok Zachariah Samuel, Michael P Mulligan, Paul J Hergenrother, Rohit Bhargava","doi":"10.1117/1.JBO.29.S2.S22712","DOIUrl":"10.1117/1.JBO.29.S2.S22712","url":null,"abstract":"<p><strong>Significance: </strong>Label-free quantitative phase imaging can potentially measure cellular dynamics with minimal perturbation, motivating efforts to develop faster and more sensitive instrumentation. We characterize fast, single-shot quantitative phase gradient microscopy (ss-QPGM) that simultaneously acquires multiple polarization components required to reconstruct phase images. We integrate a computationally efficient least squares algorithm to provide real-time, video-rate imaging (up to <math><mrow><mn>75</mn> <mtext> frames</mtext> <mo>/</mo> <mi>s</mi></mrow> </math> ). The developed instrument was used to observe changes in cellular morphology and correlate these to molecular measures commonly obtained by staining.</p><p><strong>Aim: </strong>We aim to characterize a fast approach to ss-QPGM and record morphological changes in single-cell phase images. We also correlate these with biochemical changes indicating cell death using concurrently acquired fluorescence images.</p><p><strong>Approach: </strong>Here, we examine nutrient deprivation and anticancer drug-induced cell death in two different breast cell lines, <i>viz.</i>, M2 and MCF7. Our approach involves in-line measurements of ss-QPGM and fluorescence imaging of the cells biochemically labeled for viability.</p><p><strong>Results: </strong>We validate the accuracy of the phase measurement using a USAF1951 pattern phase target. The ss-QPGM system resolves <math><mrow><mn>912.3</mn> <mtext> </mtext> <mi>lp</mi> <mo>/</mo> <mi>mm</mi></mrow> </math> , and our analysis scheme accurately retrieves the phase with a high correlation coefficient ( <math><mrow><mo>∼</mo> <mn>0.99</mn></mrow> </math> ), as measured by calibrated sample thicknesses. Analyzing the contrast in phase, we estimate the spatial resolution achievable to be <math><mrow><mn>0.55</mn> <mtext> </mtext> <mi>μ</mi> <mi>m</mi></mrow> </math> for this microscope. ss-QPGM time-lapse live-cell imaging reveals multiple intracellular and morphological changes during biochemically induced cell death. Inferences from co-registered images of quantitative phase and fluorescence suggest the possibility of necrosis, which agrees with previous findings.</p><p><strong>Conclusions: </strong>Label-free ss-QPGM with high-temporal resolution and high spatial fidelity is demonstrated. Its application for monitoring dynamic changes in live cells offers promising prospects.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 Suppl 2","pages":"S22712"},"PeriodicalIF":3.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11249975/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141626852","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-01Epub Date: 2024-07-27DOI: 10.1117/1.JBO.29.S2.S22714
Neha Goswami, Mark A Anastasio, Gabriel Popescu
Significance: Quantitative phase imaging (QPI) is a non-invasive, label-free technique that provides intrinsic information about the sample under study. Such information includes the structure, function, and dynamics of the sample. QPI overcomes the limitations of conventional fluorescence microscopy in terms of phototoxicity to the sample and photobleaching of the fluorophore. As such, the application of QPI in estimating the three-dimensional (3D) structure and dynamics is well-suited for a range of samples from intracellular organelles to highly scattering multicellular samples while allowing for longer observation windows.
Aim: We aim to provide a comprehensive review of 3D QPI and related phase-based measurement techniques along with a discussion of methods for the estimation of sample dynamics.
Approach: We present information collected from 106 publications that cover the theoretical description of 3D light scattering and the implementation of related measurement techniques for the study of the structure and dynamics of the sample. We conclude with a discussion of the applications of the reviewed techniques in the biomedical field.
Results: QPI has been successfully applied to 3D sample imaging. The scattering-based contrast provides measurements of intrinsic quantities of the sample that are indicative of disease state, stage of growth, or overall dynamics.
Conclusions: We reviewed state-of-the-art QPI techniques for 3D imaging and dynamics estimation of biological samples. Both theoretical and experimental aspects of various techniques were discussed. We also presented the applications of the discussed techniques as applied to biomedicine and biology research.
{"title":"Quantitative phase imaging techniques for measuring scattering properties of cells and tissues: a review-part II.","authors":"Neha Goswami, Mark A Anastasio, Gabriel Popescu","doi":"10.1117/1.JBO.29.S2.S22714","DOIUrl":"10.1117/1.JBO.29.S2.S22714","url":null,"abstract":"<p><strong>Significance: </strong>Quantitative phase imaging (QPI) is a non-invasive, label-free technique that provides intrinsic information about the sample under study. Such information includes the structure, function, and dynamics of the sample. QPI overcomes the limitations of conventional fluorescence microscopy in terms of phototoxicity to the sample and photobleaching of the fluorophore. As such, the application of QPI in estimating the three-dimensional (3D) structure and dynamics is well-suited for a range of samples from intracellular organelles to highly scattering multicellular samples while allowing for longer observation windows.</p><p><strong>Aim: </strong>We aim to provide a comprehensive review of 3D QPI and related phase-based measurement techniques along with a discussion of methods for the estimation of sample dynamics.</p><p><strong>Approach: </strong>We present information collected from 106 publications that cover the theoretical description of 3D light scattering and the implementation of related measurement techniques for the study of the structure and dynamics of the sample. We conclude with a discussion of the applications of the reviewed techniques in the biomedical field.</p><p><strong>Results: </strong>QPI has been successfully applied to 3D sample imaging. The scattering-based contrast provides measurements of intrinsic quantities of the sample that are indicative of disease state, stage of growth, or overall dynamics.</p><p><strong>Conclusions: </strong>We reviewed state-of-the-art QPI techniques for 3D imaging and dynamics estimation of biological samples. Both theoretical and experimental aspects of various techniques were discussed. We also presented the applications of the discussed techniques as applied to biomedicine and biology research.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 Suppl 2","pages":"S22714"},"PeriodicalIF":3.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11283205/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141788059","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-01Epub Date: 2024-07-03DOI: 10.1117/1.JBO.29.S2.S22707
Karteek Kunala, Janet A H Tang, Keith Parkins, Jennifer J Hunter
Significance: Adaptive optics fluorescence lifetime ophthalmoscopy (AOFLIO) provides a label-free approach to observe functional and molecular changes at cellular scale in vivo. Adding multispectral capabilities improves interpretation of lifetime fluctuations due to individual fluorophores in the retinal pigment epithelium (RPE).
Aim: To quantify the cellular-scale changes in autofluorescence with age and eccentricity due to variations in lipofuscin, melanin, and melanolipofuscin in RPE using multispectral AOFLIO.
Approach: AOFLIO was performed on six subjects at seven eccentricities. Four imaging channels ( ) were used: 473/SSC, 473/LSC, 532/LSC, and 765/NIR. Cells were segmented and the timing signals of each pixel in a cell were combined into a single histogram, which were then used to compute the lifetime and phasor parameters. An ANOVA was performed to investigate eccentricity and spectral effects on each parameter.
Results: A repeatability analysis revealed change in lifetime parameters in repeat visits for 532/LSC. The 765/NIR and 532/LSC had eccentricity and age effects similar to previous reports. The 473/LSC had a change in eccentricity with mean lifetime and a phasor component. Both the 473/LSC and 473/SSC had changes in eccentricity in the short lifetime component and its relative contribution. The 473/SSC had no trend in eccentricity in phasor. The comparison across the four channels showed differences in lifetime and phasor parameters.
Conclusions: Multispectral AOFLIO can provide a more comprehensive picture of changes with age and eccentricity. These results indicate that cell segmentation has the potential to allow investigations in low-photon scenarios such as in older or diseased subjects with the co-capture of an NIR channel (such as 765/NIR) with the desired spectral channel. This work represents the first multispectral, cellular-scale fluorescence lifetime comparison in vivo in the human RPE and may be a useful method for tracking diseases.
{"title":"Multispectral label-free <i>in vivo</i> cellular imaging of human retinal pigment epithelium using adaptive optics fluorescence lifetime ophthalmoscopy improves feasibility for low emission analysis and increases sensitivity for detecting changes with age and eccentricity.","authors":"Karteek Kunala, Janet A H Tang, Keith Parkins, Jennifer J Hunter","doi":"10.1117/1.JBO.29.S2.S22707","DOIUrl":"10.1117/1.JBO.29.S2.S22707","url":null,"abstract":"<p><strong>Significance: </strong>Adaptive optics fluorescence lifetime ophthalmoscopy (AOFLIO) provides a label-free approach to observe functional and molecular changes at cellular scale <i>in vivo</i>. Adding multispectral capabilities improves interpretation of lifetime fluctuations due to individual fluorophores in the retinal pigment epithelium (RPE).</p><p><strong>Aim: </strong>To quantify the cellular-scale changes in autofluorescence with age and eccentricity due to variations in lipofuscin, melanin, and melanolipofuscin in RPE using multispectral AOFLIO.</p><p><strong>Approach: </strong>AOFLIO was performed on six subjects at seven eccentricities. Four imaging channels ( <math> <mrow> <msub><mrow><mi>λ</mi></mrow> <mrow><mi>ex</mi></mrow> </msub> <mo>/</mo> <msub><mrow><mi>λ</mi></mrow> <mrow><mi>em</mi></mrow> </msub> </mrow> </math> ) were used: 473/SSC, 473/LSC, 532/LSC, and 765/NIR. Cells were segmented and the timing signals of each pixel in a cell were combined into a single histogram, which were then used to compute the lifetime and phasor parameters. An ANOVA was performed to investigate eccentricity and spectral effects on each parameter.</p><p><strong>Results: </strong>A repeatability analysis revealed <math><mrow><mo><</mo> <mn>11.8</mn> <mo>%</mo></mrow> </math> change in lifetime parameters in repeat visits for 532/LSC. The 765/NIR and 532/LSC had eccentricity and age effects similar to previous reports. The 473/LSC had a change in eccentricity with mean lifetime and a phasor component. Both the 473/LSC and 473/SSC had changes in eccentricity in the short lifetime component and its relative contribution. The 473/SSC had no trend in eccentricity in phasor. The comparison across the four channels showed differences in lifetime and phasor parameters.</p><p><strong>Conclusions: </strong>Multispectral AOFLIO can provide a more comprehensive picture of changes with age and eccentricity. These results indicate that cell segmentation has the potential to allow investigations in low-photon scenarios such as in older or diseased subjects with the co-capture of an NIR channel (such as 765/NIR) with the desired spectral channel. This work represents the first multispectral, cellular-scale fluorescence lifetime comparison <i>in vivo</i> in the human RPE and may be a useful method for tracking diseases.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 Suppl 2","pages":"S22707"},"PeriodicalIF":3.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11221116/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141498156","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-01Epub Date: 2024-07-10DOI: 10.1117/1.JBO.29.S3.S33304
Marcus Larsson, Maria Ewerlöf, E Göran Salerud, Tomas Strömberg, Ingemar Fredriksson
Significance: Imaging blood oxygen saturation ( ) in the skin can be of clinical value when studying ischemic tissue. Emerging multispectral snapshot cameras enable real-time imaging but are limited by slow analysis when using inverse Monte Carlo (MC), the gold standard for analyzing multispectral data. Using artificial neural networks (ANNs) facilitates a significantly faster analysis but requires a large amount of high-quality training data from a wide range of tissue types for a precise estimation of .
Aim: We aim to develop a framework for training ANNs that estimates in real time from multispectral data with a precision comparable to inverse MC.
Approach: ANNs are trained using synthetic data from a model that includes MC simulations of light propagation in tissue and hardware characteristics. The model includes physiologically relevant variations in optical properties, unique sensor characteristics, variations in illumination spectrum, and detector noise. This approach enables a rapid way of generating high-quality training data that covers different tissue types and skin pigmentation.
Results: The ANN implementation analyzes an image in 0.11 s, which is at least 10,000 times faster than inverse MC. The hardware modeling is significantly improved by an in-house calibration of the sensor spectral response. An in-vivo example shows that inverse MC and ANN give almost identical values with a mean absolute deviation of 1.3%-units.
Conclusions: ANN can replace inverse MC and enable real-time imaging of microcirculatory in the skin if detailed and precise modeling of both tissue and hardware is used when generating training data.
意义重大:皮肤血氧饱和度(SO 2)成像在研究缺血组织时具有临床价值。新出现的多光谱快照照相机可实现实时成像,但受限于使用反蒙特卡罗(MC)这一分析多光谱数据的黄金标准时分析速度较慢。使用人工神经网络(ANN)可以大大加快分析速度,但需要大量来自各种组织类型的高质量训练数据,才能精确估计 SO 2:方法:使用一个模型中的合成数据训练 ANN,该模型包括对组织和硬件特征中光传播的 MC 模拟。该模型包括与生理相关的光学特性变化、独特的传感器特性、照明光谱变化和探测器噪声。这种方法可以快速生成高质量的训练数据,涵盖不同的组织类型和皮肤色素沉着:结果:ANN 实现在 0.11 秒内分析一幅图像,比反 MC 至少快 10,000 倍。通过对传感器光谱响应的内部校准,硬件建模得到了明显改善。一个体内实例显示,逆 MC 和 ANN 得出的 SO 2 值几乎完全相同,平均绝对偏差为 1.3%-单位:结论:如果在生成训练数据时对组织和硬件进行详细而精确的建模,则方差网络可取代逆 MC,实现皮肤微循环 SO 2 的实时成像。
{"title":"Artificial neural networks trained on simulated multispectral data for real-time imaging of skin microcirculatory blood oxygen saturation.","authors":"Marcus Larsson, Maria Ewerlöf, E Göran Salerud, Tomas Strömberg, Ingemar Fredriksson","doi":"10.1117/1.JBO.29.S3.S33304","DOIUrl":"10.1117/1.JBO.29.S3.S33304","url":null,"abstract":"<p><strong>Significance: </strong>Imaging blood oxygen saturation ( <math> <mrow> <msub><mrow><mi>SO</mi></mrow> <mrow><mn>2</mn></mrow> </msub> </mrow> </math> ) in the skin can be of clinical value when studying ischemic tissue. Emerging multispectral snapshot cameras enable real-time imaging but are limited by slow analysis when using inverse Monte Carlo (MC), the gold standard for analyzing multispectral data. Using artificial neural networks (ANNs) facilitates a significantly faster analysis but requires a large amount of high-quality training data from a wide range of tissue types for a precise estimation of <math> <mrow> <msub><mrow><mi>SO</mi></mrow> <mrow><mn>2</mn></mrow> </msub> </mrow> </math> .</p><p><strong>Aim: </strong>We aim to develop a framework for training ANNs that estimates <math> <mrow> <msub><mrow><mi>SO</mi></mrow> <mrow><mn>2</mn></mrow> </msub> </mrow> </math> in real time from multispectral data with a precision comparable to inverse MC.</p><p><strong>Approach: </strong>ANNs are trained using synthetic data from a model that includes MC simulations of light propagation in tissue and hardware characteristics. The model includes physiologically relevant variations in optical properties, unique sensor characteristics, variations in illumination spectrum, and detector noise. This approach enables a rapid way of generating high-quality training data that covers different tissue types and skin pigmentation.</p><p><strong>Results: </strong>The ANN implementation analyzes an image in 0.11 s, which is at least 10,000 times faster than inverse MC. The hardware modeling is significantly improved by an in-house calibration of the sensor spectral response. An <i>in-vivo</i> example shows that inverse MC and ANN give almost identical <math> <mrow> <msub><mrow><mi>SO</mi></mrow> <mrow><mn>2</mn></mrow> </msub> </mrow> </math> values with a mean absolute deviation of 1.3%-units.</p><p><strong>Conclusions: </strong>ANN can replace inverse MC and enable real-time imaging of microcirculatory <math> <mrow> <msub><mrow><mi>SO</mi></mrow> <mrow><mn>2</mn></mrow> </msub> </mrow> </math> in the skin if detailed and precise modeling of both tissue and hardware is used when generating training data.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 Suppl 3","pages":"S33304"},"PeriodicalIF":3.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11234456/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141579807","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-01Epub Date: 2024-09-06DOI: 10.1117/1.JBO.29.S3.S33306
Yue Tang, Shudong Jiang, Joseph S Sottosanti, Thomas Usherwood, Xu Cao, Logan M Bateman, Lillian A Fisher, Eric R Henderson, Ida Leah Gitajn, Jonathan Thomas Elliott
Significance: The arterial input function (AIF) plays a crucial role in correcting the time-dependent concentration of the contrast agent within the arterial system, accounting for variations in agent injection parameters (speed, timing, etc.) across patients. Understanding the significance of the AIF can enhance the accuracy of tissue vascular perfusion assessment through indocyanine green-based dynamic contrast-enhanced fluorescence imaging (DCE-FI).
Aim: We evaluate the impact of the AIF on perfusion assessment through DCE-FI.
Approach: A total of 144 AIFs were acquired from 110 patients using a pulse dye densitometer. Simulation and patient intraoperative imaging were conducted to validate the significance of AIF for perfusion assessment based on kinetic parameters extracted from fluorescence images before and after AIF correction. The kinetic model accuracy was evaluated by assessing the variability of kinetic parameters using individual AIF versus population-based AIF.
Results: Individual AIF can reduce the variability in kinetic parameters, and population-based AIF can potentially replace individual AIF for estimating wash-out rate ( ), maximum intensity ( ), ingress slope with lower differences compared with those in estimating blood flow, volume transfer constant ( ), and time to peak.
Conclusions: Individual AIF can provide the most accurate perfusion assessment compared with assessment without AIF or based on population-based AIF correction.
{"title":"Patient-specific arterial input function for accurate perfusion assessment in intraoperative fluorescence imaging.","authors":"Yue Tang, Shudong Jiang, Joseph S Sottosanti, Thomas Usherwood, Xu Cao, Logan M Bateman, Lillian A Fisher, Eric R Henderson, Ida Leah Gitajn, Jonathan Thomas Elliott","doi":"10.1117/1.JBO.29.S3.S33306","DOIUrl":"10.1117/1.JBO.29.S3.S33306","url":null,"abstract":"<p><strong>Significance: </strong>The arterial input function (AIF) plays a crucial role in correcting the time-dependent concentration of the contrast agent within the arterial system, accounting for variations in agent injection parameters (speed, timing, etc.) across patients. Understanding the significance of the AIF can enhance the accuracy of tissue vascular perfusion assessment through indocyanine green-based dynamic contrast-enhanced fluorescence imaging (DCE-FI).</p><p><strong>Aim: </strong>We evaluate the impact of the AIF on perfusion assessment through DCE-FI.</p><p><strong>Approach: </strong>A total of 144 AIFs were acquired from 110 patients using a pulse dye densitometer. Simulation and patient intraoperative imaging were conducted to validate the significance of AIF for perfusion assessment based on kinetic parameters extracted from fluorescence images before and after AIF correction. The kinetic model accuracy was evaluated by assessing the variability of kinetic parameters using individual AIF versus population-based AIF.</p><p><strong>Results: </strong>Individual AIF can reduce the variability in kinetic parameters, and population-based AIF can potentially replace individual AIF for estimating wash-out rate ( <math> <mrow> <msub><mrow><mi>k</mi></mrow> <mrow><mi>ep</mi></mrow> </msub> </mrow> </math> ), maximum intensity ( <math> <mrow> <msub><mrow><mi>I</mi></mrow> <mrow><mi>max</mi></mrow> </msub> </mrow> </math> ), ingress slope with lower differences compared with those in estimating blood flow, volume transfer constant ( <math> <mrow> <msup><mrow><mi>K</mi></mrow> <mrow><mi>trans</mi></mrow> </msup> </mrow> </math> ), and time to peak.</p><p><strong>Conclusions: </strong>Individual AIF can provide the most accurate perfusion assessment compared with assessment without AIF or based on population-based AIF correction.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 Suppl 3","pages":"S33306"},"PeriodicalIF":3.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11379448/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142154205","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-01Epub Date: 2024-05-29DOI: 10.1117/1.JBO.29.6.065002
Alina A Osychenko, Alexandr D Zalessky, Alexey V Bachurin, David Yu Martirosyan, Maria S Egorova, Viktor A Nadtochenko
Significance: Preparation of a recipient cytoplast by oocyte enucleation is an essential task for animal cloning and assisted reproductive technologies in humans. The femtosecond laser is a precise and low-invasive tool for oocyte enucleation, and it should be an appropriate alternative to traditional enucleation by a microneedle aspiration. However, until recently, the laser enucleation was performed only with applying a fluorescent dye.
Aim: This work is aimed to (1) achieve femtosecond laser oocyte enucleation without applying a fluorescent dye and (2) to study the effect of laser destruction of chromosomes on the structure and dynamics of the spindle.
Approach: We applied polarized light microscopy for spindle visualization and performed stain-free mouse and human oocyte enucleation with a 1033 nm femtosecond laser. Also, we studied transformation of a spindle after metaphase plate elimination by a confocal microscopy.
Results: We demonstrated a fundamental possibility of inactivating the metaphase plate in mouse and human oocytes by 1033 nm femtosecond laser radiation without applying a fluorescent dye. Irradiation of the spindle area, visualized by polarized light microscopy, resulted in partly or complete metaphase plate destruction but avoided the microtubules impairment. After the metaphase plate elimination, the spindle reorganized, however, it was not a complete depolymerization.
Conclusions: This method of recipient cytoplast preparation is expected to be useful for animal cloning and assisted reproductive technologies.
{"title":"Stain-free enucleation of mouse and human oocytes with a 1033 nm femtosecond laser.","authors":"Alina A Osychenko, Alexandr D Zalessky, Alexey V Bachurin, David Yu Martirosyan, Maria S Egorova, Viktor A Nadtochenko","doi":"10.1117/1.JBO.29.6.065002","DOIUrl":"10.1117/1.JBO.29.6.065002","url":null,"abstract":"<p><strong>Significance: </strong>Preparation of a recipient cytoplast by oocyte enucleation is an essential task for animal cloning and assisted reproductive technologies in humans. The femtosecond laser is a precise and low-invasive tool for oocyte enucleation, and it should be an appropriate alternative to traditional enucleation by a microneedle aspiration. However, until recently, the laser enucleation was performed only with applying a fluorescent dye.</p><p><strong>Aim: </strong>This work is aimed to (1) achieve femtosecond laser oocyte enucleation without applying a fluorescent dye and (2) to study the effect of laser destruction of chromosomes on the structure and dynamics of the spindle.</p><p><strong>Approach: </strong>We applied polarized light microscopy for spindle visualization and performed stain-free mouse and human oocyte enucleation with a 1033 nm femtosecond laser. Also, we studied transformation of a spindle after metaphase plate elimination by a confocal microscopy.</p><p><strong>Results: </strong>We demonstrated a fundamental possibility of inactivating the metaphase plate in mouse and human oocytes by 1033 nm femtosecond laser radiation without applying a fluorescent dye. Irradiation of the spindle area, visualized by polarized light microscopy, resulted in partly or complete metaphase plate destruction but avoided the microtubules impairment. After the metaphase plate elimination, the spindle reorganized, however, it was not a complete depolymerization.</p><p><strong>Conclusions: </strong>This method of recipient cytoplast preparation is expected to be useful for animal cloning and assisted reproductive technologies.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 6","pages":"065002"},"PeriodicalIF":3.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11133223/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141175865","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pub Date : 2024-06-01Epub Date: 2024-08-17DOI: 10.1117/1.JBO.29.S3.S33307
Valentina Quaresima, Marco Ferrari, Felix Scholkmann
Significance: This year, 2024, marks the 50th anniversary of the invention of pulse oximetry (PO), which was first presented by Takuo Aoyagi, an engineer from the Nihon Kohden Company, at the 13th Conference of the Japanese Society of Medical Electronics and Biological Engineering in Osaka in 1974. His discovery and the development of PO for the non-invasive measurement of peripheral arterial oxygenation represents one of the most significant chapters in the history of medical technology. It resulted from research and development efforts conducted by biochemists, engineers, physicists, physiologists, and physicians since the 1930s.
Aim: The objective of this work was to provide a narrative review of the history, current status, and future prospects of PO.
Approach: A comprehensive review of the literature on oximetry and PO was conducted.
Results and conclusions: Our historical review examines the development of oximetry in general and PO in particular, tracing the key stages of a long and fascinating story that has unfolded from the first half of the twentieth century to the present day-an exciting journey in which serendipity has intersected with the hard work of key pioneers. This work has been made possible by the contributions of numerous key pioneers, including Kurt Kramer, Karl Matthes, Glenn Millikan, Evgenii M. Kreps, Earl H. Wood, Robert F. Show, Scott A. Wilber, William New, and, above all, Takuo Aoyagi. PO has become an integral part of modern medical care and has proven to be an important tool for physiological monitoring. The COVID-19 pandemic not only highlighted the clinical utility of PO but also revealed some of the problems with the technology. Current research in biomedical optics should address these issues to make the technology even more reliable and accurate. We discuss the necessary innovations in PO and present our thoughts on what the next generation of PO might look like.
意义重大:今年,即 2024 年,是脉搏血氧仪(PO)发明 50 周年。1974 年,日本光电公司的工程师青柳孝夫在大阪举行的日本医疗电子和生物工程学会第 13 届会议上首次提出了脉搏血氧仪。他的发现和用于无创测量外周动脉血氧饱和度的 PO 的开发是医疗技术史上最重要的篇章之一。它是生物化学家、工程师、物理学家、生理学家和医生自 20 世纪 30 年代以来努力研发的成果:方法:对有关血氧仪和 PO 的文献进行了全面回顾:我们的历史回顾研究了血氧饱和度的总体发展情况,特别是 PO 的发展情况,追溯了从二十世纪上半叶到今天这个漫长而迷人的故事的关键阶段--在这个令人兴奋的旅程中,偶然性与主要先驱者的辛勤工作交织在一起。这项工作之所以能够完成,离不开众多重要先驱的贡献,其中包括库尔特-克雷默、卡尔-马特斯、格伦-米利肯、叶夫根尼-M-克雷普斯、厄尔-H-伍德、罗伯特-F-肖、斯科特-A-威尔伯、威廉-纽,以及最重要的青柳琢磨。PO 已成为现代医疗保健不可或缺的一部分,并被证明是生理监测的重要工具。COVID-19 大流行不仅凸显了 PO 的临床实用性,也揭示了该技术存在的一些问题。目前的生物医学光学研究应解决这些问题,使该技术更加可靠和准确。我们讨论了 PO 方面必要的创新,并提出了我们对下一代 PO 的看法。
{"title":"Ninety years of pulse oximetry: history, current status, and outlook.","authors":"Valentina Quaresima, Marco Ferrari, Felix Scholkmann","doi":"10.1117/1.JBO.29.S3.S33307","DOIUrl":"10.1117/1.JBO.29.S3.S33307","url":null,"abstract":"<p><strong>Significance: </strong>This year, 2024, marks the 50th anniversary of the invention of pulse oximetry (PO), which was first presented by Takuo Aoyagi, an engineer from the Nihon Kohden Company, at the 13th Conference of the Japanese Society of Medical Electronics and Biological Engineering in Osaka in 1974. His discovery and the development of PO for the non-invasive measurement of peripheral arterial oxygenation represents one of the most significant chapters in the history of medical technology. It resulted from research and development efforts conducted by biochemists, engineers, physicists, physiologists, and physicians since the 1930s.</p><p><strong>Aim: </strong>The objective of this work was to provide a narrative review of the history, current status, and future prospects of PO.</p><p><strong>Approach: </strong>A comprehensive review of the literature on oximetry and PO was conducted.</p><p><strong>Results and conclusions: </strong>Our historical review examines the development of oximetry in general and PO in particular, tracing the key stages of a long and fascinating story that has unfolded from the first half of the twentieth century to the present day-an exciting journey in which serendipity has intersected with the hard work of key pioneers. This work has been made possible by the contributions of numerous key pioneers, including Kurt Kramer, Karl Matthes, Glenn Millikan, Evgenii M. Kreps, Earl H. Wood, Robert F. Show, Scott A. Wilber, William New, and, above all, Takuo Aoyagi. PO has become an integral part of modern medical care and has proven to be an important tool for physiological monitoring. The COVID-19 pandemic not only highlighted the clinical utility of PO but also revealed some of the problems with the technology. Current research in biomedical optics should address these issues to make the technology even more reliable and accurate. We discuss the necessary innovations in PO and present our thoughts on what the next generation of PO might look like.</p>","PeriodicalId":15264,"journal":{"name":"Journal of Biomedical Optics","volume":"29 Suppl 3","pages":"S33307"},"PeriodicalIF":3.0,"publicationDate":"2024-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11330276/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142000056","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}