Salih Turk , Ozkan Bingol , Ahmet Coskuncay , Tolga Aydin
{"title":"The impact of implementing backbone architectures on fracture segmentation in X-ray images","authors":"Salih Turk , Ozkan Bingol , Ahmet Coskuncay , Tolga Aydin","doi":"10.1016/j.jestch.2024.101883","DOIUrl":null,"url":null,"abstract":"<div><div>X-ray imaging is widely utilized for the detection of bone fractures due to its affordability, rapid processing capabilities, broad accessibility, and ease of use. Despite these advantages, the intricate analysis of X-ray images necessitates advanced computational techniques to fully exploit their rich informational content. Notably, accurate segmentation of these images plays a critical role in aiding medical professionals with precise diagnoses and effective treatment planning. This study examines the impact of integrating different backbone architectures for the task of fracture segmentation in X-ray images. Specifically, the research focuses on enhancing the widely-used DeepLabV3 model by incorporating pre-trained networks such as ResNet50, ResNet101, and MobileNetV3 into the encoder component to improve feature extraction and segmentation accuracy. The FracAtlas dataset, which presents unique challenges due to its small size and the diversity of fractures from various anatomical regions, was employed for model evaluation. Data augmentation techniques were implemented to expand the dataset, and an additional subset focusing on cropped images of fracture areas was developed. The models were trained over 50 epochs, and their performance was assessed using metrics such as Intersection over Union (IoU), loss values, and Dice scores. The results indicate that the DeepLabV3 model with ResNet-based backbones achieved IoU values exceeding 0.93 on the original dataset and demonstrated outstanding performance on the augmented and cropped datasets, with AUC values reaching up to 0.99. The study also highlights the computational complexity of the models, with ResNet101 exhibiting the highest time complexity, while MobileNetV3 was the most efficient in terms of processing time and memory consumption.</div></div>","PeriodicalId":48609,"journal":{"name":"Engineering Science and Technology-An International Journal-Jestech","volume":"59 ","pages":"Article 101883"},"PeriodicalIF":5.1000,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Science and Technology-An International Journal-Jestech","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2215098624002696","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
X-ray imaging is widely utilized for the detection of bone fractures due to its affordability, rapid processing capabilities, broad accessibility, and ease of use. Despite these advantages, the intricate analysis of X-ray images necessitates advanced computational techniques to fully exploit their rich informational content. Notably, accurate segmentation of these images plays a critical role in aiding medical professionals with precise diagnoses and effective treatment planning. This study examines the impact of integrating different backbone architectures for the task of fracture segmentation in X-ray images. Specifically, the research focuses on enhancing the widely-used DeepLabV3 model by incorporating pre-trained networks such as ResNet50, ResNet101, and MobileNetV3 into the encoder component to improve feature extraction and segmentation accuracy. The FracAtlas dataset, which presents unique challenges due to its small size and the diversity of fractures from various anatomical regions, was employed for model evaluation. Data augmentation techniques were implemented to expand the dataset, and an additional subset focusing on cropped images of fracture areas was developed. The models were trained over 50 epochs, and their performance was assessed using metrics such as Intersection over Union (IoU), loss values, and Dice scores. The results indicate that the DeepLabV3 model with ResNet-based backbones achieved IoU values exceeding 0.93 on the original dataset and demonstrated outstanding performance on the augmented and cropped datasets, with AUC values reaching up to 0.99. The study also highlights the computational complexity of the models, with ResNet101 exhibiting the highest time complexity, while MobileNetV3 was the most efficient in terms of processing time and memory consumption.
期刊介绍:
Engineering Science and Technology, an International Journal (JESTECH) (formerly Technology), a peer-reviewed quarterly engineering journal, publishes both theoretical and experimental high quality papers of permanent interest, not previously published in journals, in the field of engineering and applied science which aims to promote the theory and practice of technology and engineering. In addition to peer-reviewed original research papers, the Editorial Board welcomes original research reports, state-of-the-art reviews and communications in the broadly defined field of engineering science and technology.
The scope of JESTECH includes a wide spectrum of subjects including:
-Electrical/Electronics and Computer Engineering (Biomedical Engineering and Instrumentation; Coding, Cryptography, and Information Protection; Communications, Networks, Mobile Computing and Distributed Systems; Compilers and Operating Systems; Computer Architecture, Parallel Processing, and Dependability; Computer Vision and Robotics; Control Theory; Electromagnetic Waves, Microwave Techniques and Antennas; Embedded Systems; Integrated Circuits, VLSI Design, Testing, and CAD; Microelectromechanical Systems; Microelectronics, and Electronic Devices and Circuits; Power, Energy and Energy Conversion Systems; Signal, Image, and Speech Processing)
-Mechanical and Civil Engineering (Automotive Technologies; Biomechanics; Construction Materials; Design and Manufacturing; Dynamics and Control; Energy Generation, Utilization, Conversion, and Storage; Fluid Mechanics and Hydraulics; Heat and Mass Transfer; Micro-Nano Sciences; Renewable and Sustainable Energy Technologies; Robotics and Mechatronics; Solid Mechanics and Structure; Thermal Sciences)
-Metallurgical and Materials Engineering (Advanced Materials Science; Biomaterials; Ceramic and Inorgnanic Materials; Electronic-Magnetic Materials; Energy and Environment; Materials Characterizastion; Metallurgy; Polymers and Nanocomposites)