Guannan Liu;Rende Xie;Shih-Hau Fang;Hsiao-Chun Wu;Kun Yan
{"title":"Novel Human-Posture Recognition System Based on Advanced Graph Convolutional Network Using Skeletal Data","authors":"Guannan Liu;Rende Xie;Shih-Hau Fang;Hsiao-Chun Wu;Kun Yan","doi":"10.1109/JSAS.2024.3475355","DOIUrl":null,"url":null,"abstract":"Automatic human-posture or human-activity recognition is a very important research problem nowadays. In this work, we propose a novel human-posture recognition approach using the 3-D skeletal data acquired by the Kinect V2 sensor. The acquired skeletal data are first segmented using our recently proposed automatic-segmentation technique and each segment can be labeled with a particular kind of human-posture. We propose four different types of node feature matrices extracted from the segmented skeletal data, which can serve as the input features to the advanced graph convolutional network for multiclassification. The realworld experimental results demonstrate that our proposed novel human-posture recognition system can reach a very high average classification-accuracy of 91.56%. In addition, the ablation study of the effect of skeletal-graph variations on the recognition performance is also presented. The average classification-accuracy further reaches up to 92.33% when four confusing joint-nodes are removed from the skeletal graph. Our proposed novel human-posture recognition approach can be very useful for practical applications, such as human-computer interface, intelligent healthcare, robotics, etc.","PeriodicalId":100622,"journal":{"name":"IEEE Journal of Selected Areas in Sensors","volume":"1 ","pages":"224-236"},"PeriodicalIF":0.0000,"publicationDate":"2024-10-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10706704","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Areas in Sensors","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10706704/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Automatic human-posture or human-activity recognition is a very important research problem nowadays. In this work, we propose a novel human-posture recognition approach using the 3-D skeletal data acquired by the Kinect V2 sensor. The acquired skeletal data are first segmented using our recently proposed automatic-segmentation technique and each segment can be labeled with a particular kind of human-posture. We propose four different types of node feature matrices extracted from the segmented skeletal data, which can serve as the input features to the advanced graph convolutional network for multiclassification. The realworld experimental results demonstrate that our proposed novel human-posture recognition system can reach a very high average classification-accuracy of 91.56%. In addition, the ablation study of the effect of skeletal-graph variations on the recognition performance is also presented. The average classification-accuracy further reaches up to 92.33% when four confusing joint-nodes are removed from the skeletal graph. Our proposed novel human-posture recognition approach can be very useful for practical applications, such as human-computer interface, intelligent healthcare, robotics, etc.