Young-Tak Kim, Beom-Su Han, Jung Bin Kim, Jason K Sa, Je Hyeong Hong, Yunsik Son, Jae-Ho Han, Synho Do, Ji Seon Chae, Jung-Kwon Bae
{"title":"HKA-Net:临床适应性深度学习,用于自动测量下肢X光片上的髋关节-膝关节-踝关节角度,以评估膝关节骨关节炎。","authors":"Young-Tak Kim, Beom-Su Han, Jung Bin Kim, Jason K Sa, Je Hyeong Hong, Yunsik Son, Jae-Ho Han, Synho Do, Ji Seon Chae, Jung-Kwon Bae","doi":"10.1186/s13018-024-05265-y","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Accurate measurement of the hip-knee-ankle (HKA) angle is essential for informed clinical decision-making in the management of knee osteoarthritis (OA). Knee OA is commonly associated with varus deformity, where the alignment of the knee shifts medially, leading to increased stress and deterioration of the medial compartment. The HKA angle, which quantifies this alignment, is a critical indicator of the severity of varus deformity and helps guide treatment strategies, including corrective surgeries. Current manual methods are labor-intensive, time-consuming, and prone to inter-observer variability. Developing an automated model for HKA angle measurement is challenging due to the elaborate process of generating handcrafted anatomical landmarks, which is more labor-intensive than the actual measurement. This study aims to develop a ResNet-based deep learning model that predicts the HKA angle without requiring explicit anatomical landmark annotations and to assess its accuracy and efficiency compared to conventional manual methods.</p><p><strong>Methods: </strong>We developed a deep learning model based on the variants of the ResNet architecture to process lower limb radiographs and predict HKA angles without explicit landmark annotations. The classification performance for the four stages of varus deformity (stage I: 0°-10°, stage II: 10°-20°, stage III: > 20°, others: genu valgum or normal alignment) was also evaluated. The model was trained and validated using a retrospective cohort of 300 knee OA patients (Kellgren-Lawrence grade 3 or higher), with horizontal flip augmentation applied to double the dataset to 600 samples, followed by fivefold cross-validation. An extended temporal validation was conducted on a separate cohort of 50 knee OA patients. The model's accuracy was assessed by calculating the mean absolute error between predicted and actual HKA angles. Additionally, the classification of varus deformity stages was conducted to evaluate the model's ability to provide clinically relevant categorizations. Time efficiency was compared between the automated model and manual measurements performed by an experienced orthopedic surgeon.</p><p><strong>Results: </strong>The ResNet-50 model achieved a bias of - 0.025° with a standard deviation of 1.422° in the retrospective cohort and a bias of - 0.008° with a standard deviation of 1.677° in the temporal validation cohort. Using the ResNet-152 model, it accurately classified the four stages of varus deformity with weighted F1-score of 0.878 and 0.859 in the retrospective and temporal validation cohorts, respectively. The automated model was 126.7 times faster than manual measurements, reducing the total time from 49.8 min to 23.6 sec for the temporal validation cohort.</p><p><strong>Conclusions: </strong>The proposed ResNet-based model provides an efficient and accurate method for measuring HKA angles and classifying varus deformity stages without the need for extensive landmark annotations. Its high accuracy and significant improvement in time efficiency make it a valuable tool for clinical practice, potentially enhancing decision-making and workflow efficiency in the management of knee OA.</p>","PeriodicalId":16629,"journal":{"name":"Journal of Orthopaedic Surgery and Research","volume":"19 1","pages":"777"},"PeriodicalIF":2.8000,"publicationDate":"2024-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"HKA-Net: clinically-adapted deep learning for automated measurement of hip-knee-ankle angle on lower limb radiography for knee osteoarthritis assessment.\",\"authors\":\"Young-Tak Kim, Beom-Su Han, Jung Bin Kim, Jason K Sa, Je Hyeong Hong, Yunsik Son, Jae-Ho Han, Synho Do, Ji Seon Chae, Jung-Kwon Bae\",\"doi\":\"10.1186/s13018-024-05265-y\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Accurate measurement of the hip-knee-ankle (HKA) angle is essential for informed clinical decision-making in the management of knee osteoarthritis (OA). Knee OA is commonly associated with varus deformity, where the alignment of the knee shifts medially, leading to increased stress and deterioration of the medial compartment. The HKA angle, which quantifies this alignment, is a critical indicator of the severity of varus deformity and helps guide treatment strategies, including corrective surgeries. Current manual methods are labor-intensive, time-consuming, and prone to inter-observer variability. Developing an automated model for HKA angle measurement is challenging due to the elaborate process of generating handcrafted anatomical landmarks, which is more labor-intensive than the actual measurement. This study aims to develop a ResNet-based deep learning model that predicts the HKA angle without requiring explicit anatomical landmark annotations and to assess its accuracy and efficiency compared to conventional manual methods.</p><p><strong>Methods: </strong>We developed a deep learning model based on the variants of the ResNet architecture to process lower limb radiographs and predict HKA angles without explicit landmark annotations. The classification performance for the four stages of varus deformity (stage I: 0°-10°, stage II: 10°-20°, stage III: > 20°, others: genu valgum or normal alignment) was also evaluated. The model was trained and validated using a retrospective cohort of 300 knee OA patients (Kellgren-Lawrence grade 3 or higher), with horizontal flip augmentation applied to double the dataset to 600 samples, followed by fivefold cross-validation. An extended temporal validation was conducted on a separate cohort of 50 knee OA patients. The model's accuracy was assessed by calculating the mean absolute error between predicted and actual HKA angles. Additionally, the classification of varus deformity stages was conducted to evaluate the model's ability to provide clinically relevant categorizations. Time efficiency was compared between the automated model and manual measurements performed by an experienced orthopedic surgeon.</p><p><strong>Results: </strong>The ResNet-50 model achieved a bias of - 0.025° with a standard deviation of 1.422° in the retrospective cohort and a bias of - 0.008° with a standard deviation of 1.677° in the temporal validation cohort. Using the ResNet-152 model, it accurately classified the four stages of varus deformity with weighted F1-score of 0.878 and 0.859 in the retrospective and temporal validation cohorts, respectively. The automated model was 126.7 times faster than manual measurements, reducing the total time from 49.8 min to 23.6 sec for the temporal validation cohort.</p><p><strong>Conclusions: </strong>The proposed ResNet-based model provides an efficient and accurate method for measuring HKA angles and classifying varus deformity stages without the need for extensive landmark annotations. Its high accuracy and significant improvement in time efficiency make it a valuable tool for clinical practice, potentially enhancing decision-making and workflow efficiency in the management of knee OA.</p>\",\"PeriodicalId\":16629,\"journal\":{\"name\":\"Journal of Orthopaedic Surgery and Research\",\"volume\":\"19 1\",\"pages\":\"777\"},\"PeriodicalIF\":2.8000,\"publicationDate\":\"2024-11-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Orthopaedic Surgery and Research\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1186/s13018-024-05265-y\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ORTHOPEDICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Orthopaedic Surgery and Research","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s13018-024-05265-y","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0
摘要
背景:精确测量髋-膝-踝(HKA)角度对于膝关节骨性关节炎(OA)治疗的临床决策至关重要。膝关节 OA 通常伴有膝关节屈曲畸形,即膝关节向内侧移位,导致压力增加和内侧间室退化。HKA角度可量化这种对齐情况,是衡量膝关节屈曲畸形严重程度的关键指标,有助于指导治疗策略,包括矫正手术。目前的手动方法耗费大量人力和时间,而且容易造成观察者之间的差异。开发HKA角度自动测量模型具有挑战性,因为生成手工解剖地标的过程非常复杂,比实际测量更耗费人力。本研究旨在开发一种基于 ResNet 的深度学习模型,无需明确的解剖地标注释即可预测 HKA 角度,并评估其与传统人工方法相比的准确性和效率:我们开发了一种基于 ResNet 架构变体的深度学习模型,用于处理下肢 X 光片并预测 HKA 角度,而无需明确的地标注释。方法:我们开发了基于 ResNet 架构变体的深度学习模型,用于处理下肢 X 光片并预测 HKA 角度,无需明确的地标注释:此外,还对四个阶段(第一阶段:0°-10°;第二阶段:10°-20°;第三阶段:> 20°;其他阶段:膝外翻或正常对齐)的分类性能进行了评估。该模型使用 300 名膝关节 OA 患者(Kellgren-Lawrence 3 级或更高)的回顾性队列进行训练和验证,并应用水平翻转增强技术将数据集增加一倍至 600 个样本,然后进行五倍交叉验证。对另一批 50 名膝关节 OA 患者进行了扩展时间验证。通过计算预测和实际 HKA 角度之间的平均绝对误差来评估模型的准确性。此外,还对屈曲畸形分期进行了分类,以评估该模型提供临床相关分类的能力。比较了自动模型和经验丰富的矫形外科医生进行人工测量的时间效率:结果:ResNet-50 模型在回顾性队列中的偏差为 -0.025°,标准偏差为 1.422°;在时间验证队列中的偏差为 -0.008°,标准偏差为 1.677°。使用 ResNet-152 模型对四期曲度畸形进行了准确分类,在回顾性队列和时间验证队列中的加权 F1 分数分别为 0.878 和 0.859。自动模型比人工测量快 126.7 倍,将时间验证队列的总时间从 49.8 分钟减少到 23.6 秒:结论:所提出的基于 ResNet 的模型提供了一种高效、准确的方法来测量 HKA 角度并对屈曲畸形分期进行分类,而无需大量的地标注释。该模型的高准确性和时间效率的显著提高使其成为临床实践中的重要工具,有可能在膝关节 OA 的管理中提高决策和工作流程的效率。
HKA-Net: clinically-adapted deep learning for automated measurement of hip-knee-ankle angle on lower limb radiography for knee osteoarthritis assessment.
Background: Accurate measurement of the hip-knee-ankle (HKA) angle is essential for informed clinical decision-making in the management of knee osteoarthritis (OA). Knee OA is commonly associated with varus deformity, where the alignment of the knee shifts medially, leading to increased stress and deterioration of the medial compartment. The HKA angle, which quantifies this alignment, is a critical indicator of the severity of varus deformity and helps guide treatment strategies, including corrective surgeries. Current manual methods are labor-intensive, time-consuming, and prone to inter-observer variability. Developing an automated model for HKA angle measurement is challenging due to the elaborate process of generating handcrafted anatomical landmarks, which is more labor-intensive than the actual measurement. This study aims to develop a ResNet-based deep learning model that predicts the HKA angle without requiring explicit anatomical landmark annotations and to assess its accuracy and efficiency compared to conventional manual methods.
Methods: We developed a deep learning model based on the variants of the ResNet architecture to process lower limb radiographs and predict HKA angles without explicit landmark annotations. The classification performance for the four stages of varus deformity (stage I: 0°-10°, stage II: 10°-20°, stage III: > 20°, others: genu valgum or normal alignment) was also evaluated. The model was trained and validated using a retrospective cohort of 300 knee OA patients (Kellgren-Lawrence grade 3 or higher), with horizontal flip augmentation applied to double the dataset to 600 samples, followed by fivefold cross-validation. An extended temporal validation was conducted on a separate cohort of 50 knee OA patients. The model's accuracy was assessed by calculating the mean absolute error between predicted and actual HKA angles. Additionally, the classification of varus deformity stages was conducted to evaluate the model's ability to provide clinically relevant categorizations. Time efficiency was compared between the automated model and manual measurements performed by an experienced orthopedic surgeon.
Results: The ResNet-50 model achieved a bias of - 0.025° with a standard deviation of 1.422° in the retrospective cohort and a bias of - 0.008° with a standard deviation of 1.677° in the temporal validation cohort. Using the ResNet-152 model, it accurately classified the four stages of varus deformity with weighted F1-score of 0.878 and 0.859 in the retrospective and temporal validation cohorts, respectively. The automated model was 126.7 times faster than manual measurements, reducing the total time from 49.8 min to 23.6 sec for the temporal validation cohort.
Conclusions: The proposed ResNet-based model provides an efficient and accurate method for measuring HKA angles and classifying varus deformity stages without the need for extensive landmark annotations. Its high accuracy and significant improvement in time efficiency make it a valuable tool for clinical practice, potentially enhancing decision-making and workflow efficiency in the management of knee OA.
期刊介绍:
Journal of Orthopaedic Surgery and Research is an open access journal that encompasses all aspects of clinical and basic research studies related to musculoskeletal issues.
Orthopaedic research is conducted at clinical and basic science levels. With the advancement of new technologies and the increasing expectation and demand from doctors and patients, we are witnessing an enormous growth in clinical orthopaedic research, particularly in the fields of traumatology, spinal surgery, joint replacement, sports medicine, musculoskeletal tumour management, hand microsurgery, foot and ankle surgery, paediatric orthopaedic, and orthopaedic rehabilitation. The involvement of basic science ranges from molecular, cellular, structural and functional perspectives to tissue engineering, gait analysis, automation and robotic surgery. Implant and biomaterial designs are new disciplines that complement clinical applications.
JOSR encourages the publication of multidisciplinary research with collaboration amongst clinicians and scientists from different disciplines, which will be the trend in the coming decades.