Thomas J On, Yuan Xu, Jiuxu Chen, Nicolas I Gonzalez-Romo, Oscar Alcantar-Garibay, Jay Bhanushali, Wonhyoung Park, John E Wanebo, Andrew W Grande, Rokuya Tanikawa, Dilantha B Ellegala, Baoxin Li, Marco Santello, Michael T Lawton, Mark C Preul
{"title":"Deep learning detection of hand motion during microvascular anastomosis simulations performed by expert cerebrovascular neurosurgeons.","authors":"Thomas J On, Yuan Xu, Jiuxu Chen, Nicolas I Gonzalez-Romo, Oscar Alcantar-Garibay, Jay Bhanushali, Wonhyoung Park, John E Wanebo, Andrew W Grande, Rokuya Tanikawa, Dilantha B Ellegala, Baoxin Li, Marco Santello, Michael T Lawton, Mark C Preul","doi":"10.1016/j.wneu.2024.09.069","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>Deep learning enables precise hand tracking without the need for physical sensors, allowing for unsupervised quantitative evaluation of surgical motion and tasks. We quantitatively assessed the hand motions of experienced cerebrovascular neurosurgeons during simulated microvascular anastomosis using deep learning. We explored the extent to which surgical motion data differed among experts.</p><p><strong>Methods: </strong>A deep learning detection system tracked 21 landmarks corresponding to digit joints and the wrist on each hand of 5 expert cerebrovascular neurosurgeons. Tracking data for each surgeon was analyzed over long and short time intervals to examine gross movements and micromovements, respectively. Quantitative algorithms assessed the economy and flow of motion by calculating mean movement distances from the baseline median landmark coordinates and median times between sutures, respectively.</p><p><strong>Results: </strong>Tracking data correlated with specific surgical actions observed in microanastomosis video analysis. Economy of motion during suturing was calculated as 19, 26, 29, 27, and 28 pixels for surgeons 1, 2, 3, 4, and 5, respectively. Flow of motion during microanastomosis was 31.96, 29.40, 28.90, 7.37, and 47.21 secs for surgeons 1, 2, 3, 4, and 5, respectively.</p><p><strong>Conclusions: </strong>Hand tracking data showed similarities among experts, with low movements from baseline, minimal excess motion, and rhythmic suturing patterns. The data revealed unique patterns related to each expert's habits and techniques. The results showed that surgical motion can be correlated with hand motion and assessed using mathematical algorithms. We also demonstrated the feasibility and potential of deep learning-based motion detection to enhance surgical training.</p>","PeriodicalId":23906,"journal":{"name":"World neurosurgery","volume":null,"pages":null},"PeriodicalIF":1.9000,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"World neurosurgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.wneu.2024.09.069","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: Deep learning enables precise hand tracking without the need for physical sensors, allowing for unsupervised quantitative evaluation of surgical motion and tasks. We quantitatively assessed the hand motions of experienced cerebrovascular neurosurgeons during simulated microvascular anastomosis using deep learning. We explored the extent to which surgical motion data differed among experts.
Methods: A deep learning detection system tracked 21 landmarks corresponding to digit joints and the wrist on each hand of 5 expert cerebrovascular neurosurgeons. Tracking data for each surgeon was analyzed over long and short time intervals to examine gross movements and micromovements, respectively. Quantitative algorithms assessed the economy and flow of motion by calculating mean movement distances from the baseline median landmark coordinates and median times between sutures, respectively.
Results: Tracking data correlated with specific surgical actions observed in microanastomosis video analysis. Economy of motion during suturing was calculated as 19, 26, 29, 27, and 28 pixels for surgeons 1, 2, 3, 4, and 5, respectively. Flow of motion during microanastomosis was 31.96, 29.40, 28.90, 7.37, and 47.21 secs for surgeons 1, 2, 3, 4, and 5, respectively.
Conclusions: Hand tracking data showed similarities among experts, with low movements from baseline, minimal excess motion, and rhythmic suturing patterns. The data revealed unique patterns related to each expert's habits and techniques. The results showed that surgical motion can be correlated with hand motion and assessed using mathematical algorithms. We also demonstrated the feasibility and potential of deep learning-based motion detection to enhance surgical training.
期刊介绍:
World Neurosurgery has an open access mirror journal World Neurosurgery: X, sharing the same aims and scope, editorial team, submission system and rigorous peer review.
The journal''s mission is to:
-To provide a first-class international forum and a 2-way conduit for dialogue that is relevant to neurosurgeons and providers who care for neurosurgery patients. The categories of the exchanged information include clinical and basic science, as well as global information that provide social, political, educational, economic, cultural or societal insights and knowledge that are of significance and relevance to worldwide neurosurgery patient care.
-To act as a primary intellectual catalyst for the stimulation of creativity, the creation of new knowledge, and the enhancement of quality neurosurgical care worldwide.
-To provide a forum for communication that enriches the lives of all neurosurgeons and their colleagues; and, in so doing, enriches the lives of their patients.
Topics to be addressed in World Neurosurgery include: EDUCATION, ECONOMICS, RESEARCH, POLITICS, HISTORY, CULTURE, CLINICAL SCIENCE, LABORATORY SCIENCE, TECHNOLOGY, OPERATIVE TECHNIQUES, CLINICAL IMAGES, VIDEOS