Mark3D - A semi-automated open-source toolbox for 3D head- surface reconstruction and electrode position registration using a smartphone camera video.

IF 2.6 4区 医学 Q2 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS Medical & Biological Engineering & Computing Pub Date : 2024-11-07 DOI:10.1007/s11517-024-03228-3
Suranjita Ganguly, Malaaika Mihir Chhaya, Ankita Jain, Aditya Koppula, Mohan Raghavan, Kousik Sarathy Sridharan
{"title":"Mark3D - A semi-automated open-source toolbox for 3D head- surface reconstruction and electrode position registration using a smartphone camera video.","authors":"Suranjita Ganguly, Malaaika Mihir Chhaya, Ankita Jain, Aditya Koppula, Mohan Raghavan, Kousik Sarathy Sridharan","doi":"10.1007/s11517-024-03228-3","DOIUrl":null,"url":null,"abstract":"<p><p>Source localization in EEG necessitates co-registering the EEG sensor locations with the subject's MRI, where EEG sensor locations are typically captured using electromagnetic tracking or 3D scanning of the subject's head with EEG cap, using commercially available 3D scanners. Both methods have drawbacks, where, electromagnetic tracking is slow and immobile, while 3D scanners are expensive. Photogrammetry offers a cost-effective alternative but requires multiple photos to sample the head, with good spatial sampling to adequately reconstruct the head surface. Post-reconstruction, the existing tools for electrode position labelling on the 3D head-surface have limited visual feedback and do not easily accommodate customized montages, which are typical in multi-modal measurements. We introduce Mark3D, an open-source, integrated tool for 3D head-surface reconstruction from phone camera video. It eliminates the need for keeping track of spatial sampling during image capture for video-based photogrammetry reconstruction. It also includes blur detection algorithms, a user-friendly interface for electrode and tracking, and integrates with popular toolboxes such as FieldTrip and MNE Python. The accuracy of the proposed method was benchmarked with the head-surface derived from a commercially available handheld 3D scanner Einscan-Pro + (Shining 3D Inc.,) which we treat as the \"ground truth\". We used reconstructed head-surfaces of ground truth (G1) and phone camera video (M<sub>1080</sub>) to mark the EEG electrode locations in 3D space using a dedicated UI provided in the tool. The electrode locations were then used to form pseudo-specific MRI templates for individual subjects to reconstruct source information. Somatosensory source activations in response to vibrotactile stimuli were estimated and compared between G1 and M<sub>1080</sub>. The mean positional errors of the EEG electrodes between G1 and M<sub>1080</sub> in 3D space were found to be 0.09 ± 0.01 mm across different cortical areas, with temporal and occipital areas registering a relatively higher error than other regions such as frontal, central or parietal areas. The error in source reconstruction was found to be 0.033 ± 0.016 mm and 0.037 ± 0.017 mm in the left and right cortical hemispheres respectively.</p>","PeriodicalId":49840,"journal":{"name":"Medical & Biological Engineering & Computing","volume":null,"pages":null},"PeriodicalIF":2.6000,"publicationDate":"2024-11-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Medical & Biological Engineering & Computing","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s11517-024-03228-3","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

Abstract

Source localization in EEG necessitates co-registering the EEG sensor locations with the subject's MRI, where EEG sensor locations are typically captured using electromagnetic tracking or 3D scanning of the subject's head with EEG cap, using commercially available 3D scanners. Both methods have drawbacks, where, electromagnetic tracking is slow and immobile, while 3D scanners are expensive. Photogrammetry offers a cost-effective alternative but requires multiple photos to sample the head, with good spatial sampling to adequately reconstruct the head surface. Post-reconstruction, the existing tools for electrode position labelling on the 3D head-surface have limited visual feedback and do not easily accommodate customized montages, which are typical in multi-modal measurements. We introduce Mark3D, an open-source, integrated tool for 3D head-surface reconstruction from phone camera video. It eliminates the need for keeping track of spatial sampling during image capture for video-based photogrammetry reconstruction. It also includes blur detection algorithms, a user-friendly interface for electrode and tracking, and integrates with popular toolboxes such as FieldTrip and MNE Python. The accuracy of the proposed method was benchmarked with the head-surface derived from a commercially available handheld 3D scanner Einscan-Pro + (Shining 3D Inc.,) which we treat as the "ground truth". We used reconstructed head-surfaces of ground truth (G1) and phone camera video (M1080) to mark the EEG electrode locations in 3D space using a dedicated UI provided in the tool. The electrode locations were then used to form pseudo-specific MRI templates for individual subjects to reconstruct source information. Somatosensory source activations in response to vibrotactile stimuli were estimated and compared between G1 and M1080. The mean positional errors of the EEG electrodes between G1 and M1080 in 3D space were found to be 0.09 ± 0.01 mm across different cortical areas, with temporal and occipital areas registering a relatively higher error than other regions such as frontal, central or parietal areas. The error in source reconstruction was found to be 0.033 ± 0.016 mm and 0.037 ± 0.017 mm in the left and right cortical hemispheres respectively.

查看原文
分享 分享
微信好友 朋友圈 QQ好友 复制链接
本刊更多论文
Mark3D - 利用智能手机摄像头视频进行三维头表面重建和电极位置注册的半自动化开源工具箱。
脑电图源定位需要将脑电图传感器位置与受试者的核磁共振成像共同注册,而脑电图传感器位置通常是通过电磁跟踪或使用市售三维扫描仪对受试者头部和脑电图帽进行三维扫描来捕捉的。这两种方法都有缺点,其中电磁追踪速度慢且无法移动,而三维扫描仪价格昂贵。摄影测量法提供了一种具有成本效益的替代方法,但需要多张照片对头部进行采样,并进行良好的空间采样,以充分重建头部表面。重建后,用于在三维头部表面标注电极位置的现有工具的视觉反馈有限,而且不容易适应多模态测量中常见的定制蒙太奇。我们介绍的 Mark3D 是一款开源的集成工具,用于根据手机摄像头视频重建三维头表面。在基于视频的摄影测量重建中,它无需在图像捕捉过程中跟踪空间采样。它还包括模糊检测算法、用于电极和跟踪的用户友好界面,以及与 FieldTrip 和 MNE Python 等流行工具箱的集成。我们将商用手持式三维扫描仪 Einscan-Pro +(Shining 3D Inc.我们利用地面实况(G1)和手机摄像头视频(M1080)重建的头部表面,使用工具中提供的专用用户界面在三维空间中标记脑电图电极位置。电极位置随后被用于为单个受试者形成伪特异性磁共振成像模板,以重建信号源信息。对 G1 和 M1080 对振动触觉刺激的躯体感觉源激活进行了估计和比较。结果发现,G1 和 M1080 的脑电图电极在三维空间中的平均位置误差为 0.09 ± 0.01 毫米,分布于不同的皮层区域,其中颞叶和枕叶区域的误差相对高于额叶、中央或顶叶等其他区域。在左侧和右侧皮质半球,声源重建误差分别为 0.033 ± 0.016 毫米和 0.037 ± 0.017 毫米。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 去求助
来源期刊
Medical & Biological Engineering & Computing
Medical & Biological Engineering & Computing 医学-工程:生物医学
CiteScore
6.00
自引率
3.10%
发文量
249
审稿时长
3.5 months
期刊介绍: Founded in 1963, Medical & Biological Engineering & Computing (MBEC) continues to serve the biomedical engineering community, covering the entire spectrum of biomedical and clinical engineering. The journal presents exciting and vital experimental and theoretical developments in biomedical science and technology, and reports on advances in computer-based methodologies in these multidisciplinary subjects. The journal also incorporates new and evolving technologies including cellular engineering and molecular imaging. MBEC publishes original research articles as well as reviews and technical notes. Its Rapid Communications category focuses on material of immediate value to the readership, while the Controversies section provides a forum to exchange views on selected issues, stimulating a vigorous and informed debate in this exciting and high profile field. MBEC is an official journal of the International Federation of Medical and Biological Engineering (IFMBE).
期刊最新文献
Numerical modeling and analysis of neck injury induced by parachute opening shock. Correction to: Evaluating and enhancing the robustness of vision transformers against adversarial attacks in medical imaging. Mark3D - A semi-automated open-source toolbox for 3D head- surface reconstruction and electrode position registration using a smartphone camera video. Load-bearing optimization for customized exoskeleton design based on kinematic gait reconstruction. Research on imaging biomarkers for chronic subdural hematoma recurrence.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
已复制链接
已复制链接
快去分享给好友吧!
我知道了
×
扫码分享
扫码分享
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1