Shih-Wei Shen, Wan-Chia Huang, I. T. Anggraini, N. Funabiki, Chih-Peng Fan
{"title":"Exercise and Performance Learning Assistant System for Self-Practice Dynamic Yoga by OpenPose and Fuzzy Based Design","authors":"Shih-Wei Shen, Wan-Chia Huang, I. T. Anggraini, N. Funabiki, Chih-Peng Fan","doi":"10.1109/ICIET55102.2022.9778954","DOIUrl":null,"url":null,"abstract":"In this study, a learning assistant system based on OpenPose and fuzzy technologies is studied for self-practice dynamic Yoga at home. The skeleton information of the human body is extracted through OpenPose. In the pre-processing, the initial frame and key frames of the instructor are selected with Euclidean distance. In the system processing, the initial frame and key frames are used to determine the difference between the instructor and the user. The vector and the angle are calculated with the key points of the instructor and the user. The angle differences between them are used as the inputs of the scoring system based on fuzzy theory to calculate each score. This system synchronizes the time domain of the instructor and the user to effectively, and it correctly selects the user's corresponding frame, and then the system greatly reduces the amount of calculations without losing accuracy. The experimental results show that the proposed system can effectively detect and score the corresponding video frames between the user and the instructor.","PeriodicalId":371262,"journal":{"name":"2022 10th International Conference on Information and Education Technology (ICIET)","volume":"23 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 10th International Conference on Information and Education Technology (ICIET)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICIET55102.2022.9778954","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 3
Abstract
In this study, a learning assistant system based on OpenPose and fuzzy technologies is studied for self-practice dynamic Yoga at home. The skeleton information of the human body is extracted through OpenPose. In the pre-processing, the initial frame and key frames of the instructor are selected with Euclidean distance. In the system processing, the initial frame and key frames are used to determine the difference between the instructor and the user. The vector and the angle are calculated with the key points of the instructor and the user. The angle differences between them are used as the inputs of the scoring system based on fuzzy theory to calculate each score. This system synchronizes the time domain of the instructor and the user to effectively, and it correctly selects the user's corresponding frame, and then the system greatly reduces the amount of calculations without losing accuracy. The experimental results show that the proposed system can effectively detect and score the corresponding video frames between the user and the instructor.