{"title":"基于多模态时空信息融合的增强型步态相位分割研究","authors":"Hao Zhang;Xiaofeng Liu;Jie Li;Jia Pan;Chu Kiong Loo;Angelo Cangelosi","doi":"10.1109/JIOT.2024.3502653","DOIUrl":null,"url":null,"abstract":"Gait phase segmentation, pivotal for understanding lower limb motion, finds applications in diverse fields like medicine and sports. While existing method often struggle with accuracy and adaptability in real-world settings, this study presents a novel methodology employing particle filters for precise lower limb motion capture (MoCap) utilizing inertial sensors, which can be used in more everyday environments and in a wider range of applications over a longer period of time. The innovative approach adeptly tracks walking movements, labeling six gait phases via skeleton reconstruction facilitated by the MoCap algorithm. Subsequently, we propose a neural network architecture amalgamating temporal convolutional network (TCN), graph convolutional network (GCN), and long short-term memory (LSTM). This architecture integrates raw data from inertial sensors with joint angles derived from reconstructed motion, achieving accurate segmentation of the six gait phases. Experimental validation compares the MoCap algorithm against an optical motion capture system, and the neural network’s performance against state-of-the-art methods. Results demonstrate our method’s superior accuracy of 96.94%, highlighting its efficacy in addressing gait phase segmentation challenges and propelling advancements in gait analysis.","PeriodicalId":54347,"journal":{"name":"IEEE Internet of Things Journal","volume":"12 7","pages":"8773-8788"},"PeriodicalIF":8.9000,"publicationDate":"2024-11-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Research on Enhanced Gait Phase Segmentation Based on Multimodal Spatiotemporal Information Fusion\",\"authors\":\"Hao Zhang;Xiaofeng Liu;Jie Li;Jia Pan;Chu Kiong Loo;Angelo Cangelosi\",\"doi\":\"10.1109/JIOT.2024.3502653\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Gait phase segmentation, pivotal for understanding lower limb motion, finds applications in diverse fields like medicine and sports. While existing method often struggle with accuracy and adaptability in real-world settings, this study presents a novel methodology employing particle filters for precise lower limb motion capture (MoCap) utilizing inertial sensors, which can be used in more everyday environments and in a wider range of applications over a longer period of time. The innovative approach adeptly tracks walking movements, labeling six gait phases via skeleton reconstruction facilitated by the MoCap algorithm. Subsequently, we propose a neural network architecture amalgamating temporal convolutional network (TCN), graph convolutional network (GCN), and long short-term memory (LSTM). This architecture integrates raw data from inertial sensors with joint angles derived from reconstructed motion, achieving accurate segmentation of the six gait phases. Experimental validation compares the MoCap algorithm against an optical motion capture system, and the neural network’s performance against state-of-the-art methods. Results demonstrate our method’s superior accuracy of 96.94%, highlighting its efficacy in addressing gait phase segmentation challenges and propelling advancements in gait analysis.\",\"PeriodicalId\":54347,\"journal\":{\"name\":\"IEEE Internet of Things Journal\",\"volume\":\"12 7\",\"pages\":\"8773-8788\"},\"PeriodicalIF\":8.9000,\"publicationDate\":\"2024-11-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Internet of Things Journal\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10758819/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Internet of Things Journal","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10758819/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
Research on Enhanced Gait Phase Segmentation Based on Multimodal Spatiotemporal Information Fusion
Gait phase segmentation, pivotal for understanding lower limb motion, finds applications in diverse fields like medicine and sports. While existing method often struggle with accuracy and adaptability in real-world settings, this study presents a novel methodology employing particle filters for precise lower limb motion capture (MoCap) utilizing inertial sensors, which can be used in more everyday environments and in a wider range of applications over a longer period of time. The innovative approach adeptly tracks walking movements, labeling six gait phases via skeleton reconstruction facilitated by the MoCap algorithm. Subsequently, we propose a neural network architecture amalgamating temporal convolutional network (TCN), graph convolutional network (GCN), and long short-term memory (LSTM). This architecture integrates raw data from inertial sensors with joint angles derived from reconstructed motion, achieving accurate segmentation of the six gait phases. Experimental validation compares the MoCap algorithm against an optical motion capture system, and the neural network’s performance against state-of-the-art methods. Results demonstrate our method’s superior accuracy of 96.94%, highlighting its efficacy in addressing gait phase segmentation challenges and propelling advancements in gait analysis.
期刊介绍:
The EEE Internet of Things (IoT) Journal publishes articles and review articles covering various aspects of IoT, including IoT system architecture, IoT enabling technologies, IoT communication and networking protocols such as network coding, and IoT services and applications. Topics encompass IoT's impacts on sensor technologies, big data management, and future internet design for applications like smart cities and smart homes. Fields of interest include IoT architecture such as things-centric, data-centric, service-oriented IoT architecture; IoT enabling technologies and systematic integration such as sensor technologies, big sensor data management, and future Internet design for IoT; IoT services, applications, and test-beds such as IoT service middleware, IoT application programming interface (API), IoT application design, and IoT trials/experiments; IoT standardization activities and technology development in different standard development organizations (SDO) such as IEEE, IETF, ITU, 3GPP, ETSI, etc.