首页 > 最新文献

Int. J. Autom. Technol.最新文献

英文 中文
Machine Learning Based Position Prediction of a Target Tracked by Multi-Aperture Positioning System 基于机器学习的多孔径定位系统跟踪目标位置预测
Pub Date : 2023-05-05 DOI: 10.20965/ijat.2023.p0305
Luis Garcia, U. Bielke, C. Neumann, Rainer Börret
This paper proposes a machine learning-based position prediction approach to determine the position of a light-emitting diode (LED) target using a new measuring system called the multi-aperture positioning system (MAPS). The measurement system is based on a photogrammetric approach using an aperture mask and a single camera sensor. To achieve high accuracy in position calculation, several complex algorithms with high computational complexity are used. The accuracy of the system is equal to or better than that of existing photogrammetric devices. We investigate whether a neural network (NN) can replace the algorithms currently used in the system software to increase the measurement frequency with similar accuracy. Simulated images are used to train the NN, while real images are used to measure performance. Previously, various algorithms were used to calculate the position of the target from the captured images. Our approach is to train an NN, using thousands of labeled images, to predict the position of the target from these images. We investigate whether systematic measurement errors can be avoided; not all factors affecting the measurement precision are yet known, can always be accurately determined, or change over time. When NNs are used, all information contained in the images is learned by the model, considering all influences present at the time of training. Results show that the trained NN can achieve similar performance to the previously used Gaussian algorithm in less time since no filters or other pre-processing of images are required. This factor directly affects the measurement frequency of the MAPS. The light spot center was detected with sub-pixel accuracy without systematic errors in contrast to some of the previously used algorithms. The simulation of the sensor images needs to be improved to investigate the full potential of the NN.
本文提出了一种基于机器学习的位置预测方法,利用一种称为多孔径定位系统(MAPS)的新型测量系统来确定发光二极管(LED)目标的位置。该测量系统基于使用光圈掩模和单个相机传感器的摄影测量方法。为了实现高精度的位置计算,采用了几种计算复杂度较高的复杂算法。该系统的精度等于或优于现有的摄影测量设备。我们研究了神经网络(NN)是否可以取代系统软件中目前使用的算法,以相似的精度提高测量频率。模拟图像用于训练神经网络,而真实图像用于测量性能。以前,使用各种算法从捕获的图像中计算目标的位置。我们的方法是训练一个神经网络,使用成千上万的标记图像,从这些图像中预测目标的位置。我们研究系统测量误差是否可以避免;并非所有影响测量精度的因素都是已知的,总是可以准确地确定,或随时间变化。当使用神经网络时,考虑到训练时存在的所有影响,模型学习图像中包含的所有信息。结果表明,由于不需要滤波器或其他图像预处理,训练后的神经网络可以在更短的时间内达到与之前使用的高斯算法相似的性能。这个因素直接影响map的测量频率。与以前使用的一些算法相比,该算法以亚像素精度检测光斑中心,没有系统误差。传感器图像的模拟需要改进,以研究神经网络的全部潜力。
{"title":"Machine Learning Based Position Prediction of a Target Tracked by Multi-Aperture Positioning System","authors":"Luis Garcia, U. Bielke, C. Neumann, Rainer Börret","doi":"10.20965/ijat.2023.p0305","DOIUrl":"https://doi.org/10.20965/ijat.2023.p0305","url":null,"abstract":"This paper proposes a machine learning-based position prediction approach to determine the position of a light-emitting diode (LED) target using a new measuring system called the multi-aperture positioning system (MAPS). The measurement system is based on a photogrammetric approach using an aperture mask and a single camera sensor. To achieve high accuracy in position calculation, several complex algorithms with high computational complexity are used. The accuracy of the system is equal to or better than that of existing photogrammetric devices. We investigate whether a neural network (NN) can replace the algorithms currently used in the system software to increase the measurement frequency with similar accuracy. Simulated images are used to train the NN, while real images are used to measure performance. Previously, various algorithms were used to calculate the position of the target from the captured images. Our approach is to train an NN, using thousands of labeled images, to predict the position of the target from these images. We investigate whether systematic measurement errors can be avoided; not all factors affecting the measurement precision are yet known, can always be accurately determined, or change over time. When NNs are used, all information contained in the images is learned by the model, considering all influences present at the time of training. Results show that the trained NN can achieve similar performance to the previously used Gaussian algorithm in less time since no filters or other pre-processing of images are required. This factor directly affects the measurement frequency of the MAPS. The light spot center was detected with sub-pixel accuracy without systematic errors in contrast to some of the previously used algorithms. The simulation of the sensor images needs to be improved to investigate the full potential of the NN.","PeriodicalId":13583,"journal":{"name":"Int. J. Autom. Technol.","volume":"2 1","pages":"305-313"},"PeriodicalIF":0.0,"publicationDate":"2023-05-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88232909","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Proposal of Simulation-Based Surgical Navigation and Development of Laparoscopic Surgical Simulator that Reflects Motion of Surgical Instruments in Real-World 基于仿真的手术导航方法的提出及反映手术器械运动的腹腔镜手术模拟器的研制
Pub Date : 2023-05-05 DOI: 10.20965/ijat.2023.p0262
Sayaka Shibuya, Noriyuki Shido, Ryosuke Shirai, Kazuya Sase, Koki Ebina, Xiaoshuai Chen, T. Tsujita, S. Komizunai, T. Senoo, A. Konno
This study proposes simulation-based surgical navigation concept and describes the development of a laparoscopic surgical simulator that reflects the motion of surgical instruments in the real world. In the proposed simulation-based surgical navigation, movements of the surgical instruments are captured by a motion capture system, and the movements of the real surgical instruments are reflected in the movements of the virtual instruments in the simulation in real time. Contact of the virtual surgical instruments with organ model is detected based on the signed distance field (SDF) made around the organ model. The deformations of organs caused by contacts are calculated using dynamic finite element method (FEM). Using a cubic elastic object made of urethane resin, the accuracy of the calculation of the deformation was verified. The average error in the deformation verification experiments was within 1 mm. Simulations using hepato-biliary-pancreatic finite element (FE) models were performed, and computational costs of the simulation were validated. The time for one loop simulation with a hepato-biliary-pancreatic FE model of 3,225 elements and 1,663 nodes was 50 ms. The developed simulator can be applied to a simulation-based navigation system to update the states of organs in real time.
本研究提出了基于仿真的手术导航概念,并描述了一种反映现实世界中手术器械运动的腹腔镜手术模拟器的开发。在基于仿真的手术导航中,通过运动捕捉系统捕捉手术器械的运动,真实手术器械的运动实时反映在仿真中虚拟器械的运动中。基于器官模型周围的符号距离场(SDF)检测虚拟手术器械与器官模型的接触。采用动态有限元法对接触引起的器官变形进行了计算。以一个由聚氨酯树脂制成的立方体弹性物体为例,验证了变形计算的准确性。变形验证实验的平均误差在1 mm以内。采用肝-胆-胰有限元模型进行了仿真,并验证了仿真的计算成本。一个包含3225个元素和1663个节点的肝胆胰FE模型的循环模拟时间为50 ms。所开发的仿真器可用于基于仿真的导航系统中,实时更新各器官的状态。
{"title":"Proposal of Simulation-Based Surgical Navigation and Development of Laparoscopic Surgical Simulator that Reflects Motion of Surgical Instruments in Real-World","authors":"Sayaka Shibuya, Noriyuki Shido, Ryosuke Shirai, Kazuya Sase, Koki Ebina, Xiaoshuai Chen, T. Tsujita, S. Komizunai, T. Senoo, A. Konno","doi":"10.20965/ijat.2023.p0262","DOIUrl":"https://doi.org/10.20965/ijat.2023.p0262","url":null,"abstract":"This study proposes simulation-based surgical navigation concept and describes the development of a laparoscopic surgical simulator that reflects the motion of surgical instruments in the real world. In the proposed simulation-based surgical navigation, movements of the surgical instruments are captured by a motion capture system, and the movements of the real surgical instruments are reflected in the movements of the virtual instruments in the simulation in real time. Contact of the virtual surgical instruments with organ model is detected based on the signed distance field (SDF) made around the organ model. The deformations of organs caused by contacts are calculated using dynamic finite element method (FEM). Using a cubic elastic object made of urethane resin, the accuracy of the calculation of the deformation was verified. The average error in the deformation verification experiments was within 1 mm. Simulations using hepato-biliary-pancreatic finite element (FE) models were performed, and computational costs of the simulation were validated. The time for one loop simulation with a hepato-biliary-pancreatic FE model of 3,225 elements and 1,663 nodes was 50 ms. The developed simulator can be applied to a simulation-based navigation system to update the states of organs in real time.","PeriodicalId":13583,"journal":{"name":"Int. J. Autom. Technol.","volume":"24 1","pages":"262-276"},"PeriodicalIF":0.0,"publicationDate":"2023-05-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"81602912","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Estimating Whole-Body Walking Motion from Inertial Measurement Units at Wrist and Heels Using Deep Learning 利用深度学习从手腕和脚跟的惯性测量单元估计全身行走运动
Pub Date : 2023-05-05 DOI: 10.20965/ijat.2023.p0217
Yuji Kumano, S. Kanoga, Masataka Yamamoto, H. Takemura, M. Tada
A recurrent-neural-network-based deep-learning model was developed to estimate the three-axis joint angles of an entire body with 17 bones during walking from three inertial measurement units (IMUs) — one each on the left wrist and heels. In this model, the acceleration and angular velocity of the previous 49 frames and current frame were considered as inputs. The architecture comprises two hidden layers (two long short-term memory layers) and a dense layer. The performance of the model was evaluated using the National Institute of Advanced Industrial Science and Technology (AIST) Gait Database 2019 public dataset. Consequently, the root mean squared error of each joint angle was less than 12.28°. A comparison of the estimation results of the same model with IMUs at the pelvis and shanks revealed that the proposed model is advantageous in terms of balanced measurement accuracy and ease of use in realizing whole-body motion capture. Although the accuracy of the model was better than those of previous models in estimating the general whole-body motion from six IMUs, it was worse than that of a previous model in estimating only the lower-limb motion from three IMUs attached to the pelvis and shanks during walking. In the proposed model, IMUs are attached to the left wrist and heels, and whole-body motion can be easily captured using a smartwatch and smart shoes.
研究人员开发了一种基于循环神经网络的深度学习模型,通过三个惯性测量单元(imu)——左手腕和脚跟各一个——来估计具有17块骨头的整个身体在行走过程中的三轴关节角度。在该模型中,将前49帧和当前帧的加速度和角速度作为输入。该体系结构包括两个隐藏层(两个长短期记忆层)和一个密集层。使用美国国家先进工业科学技术研究所(AIST)步态数据库2019年公共数据集对模型的性能进行了评估。因此,各关节角的均方根误差均小于12.28°。将同一模型与骨盆和小腿的imu的估计结果进行比较,表明该模型在平衡测量精度和易于实现全身运动捕获方面具有优势。虽然该模型在估计6个imu的全身运动时的准确性优于先前的模型,但在仅估计行走时骨盆和小腿连接的3个imu的下肢运动时,该模型的准确性比先前的模型差。在提出的模型中,imu连接在左手腕和脚跟上,可以通过智能手表和智能鞋轻松捕捉全身运动。
{"title":"Estimating Whole-Body Walking Motion from Inertial Measurement Units at Wrist and Heels Using Deep Learning","authors":"Yuji Kumano, S. Kanoga, Masataka Yamamoto, H. Takemura, M. Tada","doi":"10.20965/ijat.2023.p0217","DOIUrl":"https://doi.org/10.20965/ijat.2023.p0217","url":null,"abstract":"A recurrent-neural-network-based deep-learning model was developed to estimate the three-axis joint angles of an entire body with 17 bones during walking from three inertial measurement units (IMUs) — one each on the left wrist and heels. In this model, the acceleration and angular velocity of the previous 49 frames and current frame were considered as inputs. The architecture comprises two hidden layers (two long short-term memory layers) and a dense layer. The performance of the model was evaluated using the National Institute of Advanced Industrial Science and Technology (AIST) Gait Database 2019 public dataset. Consequently, the root mean squared error of each joint angle was less than 12.28°. A comparison of the estimation results of the same model with IMUs at the pelvis and shanks revealed that the proposed model is advantageous in terms of balanced measurement accuracy and ease of use in realizing whole-body motion capture. Although the accuracy of the model was better than those of previous models in estimating the general whole-body motion from six IMUs, it was worse than that of a previous model in estimating only the lower-limb motion from three IMUs attached to the pelvis and shanks during walking. In the proposed model, IMUs are attached to the left wrist and heels, and whole-body motion can be easily captured using a smartwatch and smart shoes.","PeriodicalId":13583,"journal":{"name":"Int. J. Autom. Technol.","volume":"81 1","pages":"217-225"},"PeriodicalIF":0.0,"publicationDate":"2023-05-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80075811","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Digital Twin of Experience for Human-Robot Collaboration Through Virtual Reality 基于虚拟现实的人机协作体验数字孪生
Pub Date : 2023-05-05 DOI: 10.20965/ijat.2023.p0284
T. Inamura
The keyword “human digital twin” has received considerable attention in recent years, and information technology has been developed in healthcare and sports training systems to guide human behavior to a better state. In contrast, from optimizing the production and maintenance processes of industrial products, which is the origin of the term “digital twin,” intelligent robot systems can be interpreted as a mainstream of digital twin. In other words, assistive robots that support humans in their daily lives and improve their life behavior require the integration of human digital twin and conventional object digital twin. However, integrating these two digital twins is not easy from the viewpoint of system integration. In addition, it is necessary to encourage humans to change their behavior to provide users with subjective and immersive experiences rather than simply displaying numerical information. This study reviews the current status and limitations of these digital twin technologies and proposes the concept of a virtual reality (VR) digital twin that integrates digital twins and VR toward assistive robotic systems. This will expand the experience of both humans and robots and open the way to the realization of robots that can better support our daily lives.
近年来,“人类数字双胞胎”这个关键词受到了相当大的关注,信息技术在医疗保健和体育训练系统中得到了发展,以引导人类的行为走向更好的状态。相反,从“数字孪生”一词的起源——工业产品的生产和维护过程的优化来看,智能机器人系统可以被理解为数字孪生的主流。换句话说,辅助机器人支持人类的日常生活,改善人类的生活行为,需要人的数字孪生和传统的物体数字孪生的融合。然而,从系统集成的角度来看,整合这两个数字孪生并不容易。此外,有必要鼓励人们改变自己的行为,为用户提供主观和身临其境的体验,而不是简单地显示数字信息。本研究回顾了这些数字孪生技术的现状和局限性,并提出了虚拟现实(VR)数字孪生的概念,该概念将数字孪生和VR集成到辅助机器人系统中。这将扩大人类和机器人的经验,并为实现更好地支持我们日常生活的机器人开辟道路。
{"title":"Digital Twin of Experience for Human-Robot Collaboration Through Virtual Reality","authors":"T. Inamura","doi":"10.20965/ijat.2023.p0284","DOIUrl":"https://doi.org/10.20965/ijat.2023.p0284","url":null,"abstract":"The keyword “human digital twin” has received considerable attention in recent years, and information technology has been developed in healthcare and sports training systems to guide human behavior to a better state. In contrast, from optimizing the production and maintenance processes of industrial products, which is the origin of the term “digital twin,” intelligent robot systems can be interpreted as a mainstream of digital twin. In other words, assistive robots that support humans in their daily lives and improve their life behavior require the integration of human digital twin and conventional object digital twin. However, integrating these two digital twins is not easy from the viewpoint of system integration. In addition, it is necessary to encourage humans to change their behavior to provide users with subjective and immersive experiences rather than simply displaying numerical information. This study reviews the current status and limitations of these digital twin technologies and proposes the concept of a virtual reality (VR) digital twin that integrates digital twins and VR toward assistive robotic systems. This will expand the experience of both humans and robots and open the way to the realization of robots that can better support our daily lives.","PeriodicalId":13583,"journal":{"name":"Int. J. Autom. Technol.","volume":"143 1","pages":"284-291"},"PeriodicalIF":0.0,"publicationDate":"2023-05-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"78197529","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 2
DhaibaWorks: A Software Platform for Human-Centered Cyber-Physical Systems DhaibaWorks:以人为中心的信息物理系统软件平台
Pub Date : 2023-05-05 DOI: 10.20965/ijat.2023.p0292
Y. Endo, Tsubasa Maruyama, M. Tada
In this paper, as a practical approach to building a human-centered cyber-physical system (CPS), we propose a software platform that integrates hardware and software materials to realize a human digital twin (HDT) including model construction, data acquisition, analysis, and intervention in terms of the physical load and physical capabilities of humans. Furthermore, as a case study of this platform in industrial applications, we introduce an example of a human-centered CPS in which humans and robots work together to realize better human workability and production line productivity within the system.
作为构建以人为中心的网络物理系统(CPS)的一种实践方法,我们提出了一个集成硬件和软件材料的软件平台,以实现人类数字孪生(HDT),包括模型构建、数据采集、分析以及对人类物理负荷和物理能力的干预。此外,作为该平台在工业应用中的案例研究,我们介绍了一个以人为中心的CPS示例,在该示例中,人类和机器人一起工作,以实现系统内更好的人类可操作性和生产线生产率。
{"title":"DhaibaWorks: A Software Platform for Human-Centered Cyber-Physical Systems","authors":"Y. Endo, Tsubasa Maruyama, M. Tada","doi":"10.20965/ijat.2023.p0292","DOIUrl":"https://doi.org/10.20965/ijat.2023.p0292","url":null,"abstract":"In this paper, as a practical approach to building a human-centered cyber-physical system (CPS), we propose a software platform that integrates hardware and software materials to realize a human digital twin (HDT) including model construction, data acquisition, analysis, and intervention in terms of the physical load and physical capabilities of humans. Furthermore, as a case study of this platform in industrial applications, we introduce an example of a human-centered CPS in which humans and robots work together to realize better human workability and production line productivity within the system.","PeriodicalId":13583,"journal":{"name":"Int. J. Autom. Technol.","volume":"36 1","pages":"292-304"},"PeriodicalIF":0.0,"publicationDate":"2023-05-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"76258610","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Inflatable Humanoid Cybernetic Avatar for Physical Human-Robot Interaction 用于人机物理交互的可充气人形控制化身
Pub Date : 2023-05-05 DOI: 10.20965/ijat.2023.p0277
Ryuma Niiyama, M. Ikeda, Young ah Seong
In a digital twin, a humanoid robot can be the counterpart of a simulated agent in the real world. In addition, a human, virtual avatar, and avatar robot might constitute digital triplets. We propose an inflatable cybernetic avatar (CA) with a humanoid upper body using an inflatable structure that can represent gestures. This inflatable CA is much lighter, safer, and cheaper than conventional humanoid robots and can be folded when deflated. These properties are ideal for physical human–robot interaction (pHRI) and allow real-time collection of human behavior through interaction. In the experiment, basic movements such as nodding and raising arms were measured using motion capture systems. This paper demonstrates the proposed inflatable CA in a hybrid event. We also conducted an experiment to measure the touch interactions using tactile sensors attached to the fabric of the inflatable part. A psychologically secure inflatable humanoid CA is a promising platform for physical interaction experiments.
在数字双胞胎中,人形机器人可以是现实世界中模拟代理的对应物。此外,人、虚拟化身和虚拟机器人可能构成数字三胞胎。我们提出了一个可充气的控制论化身(CA),具有人形的上半身,使用可充气的结构,可以表示手势。这种可充气的CA比传统的人形机器人更轻、更安全、更便宜,而且放气后可以折叠。这些特性是理想的物理人机交互(pHRI),并允许通过交互实时收集人类行为。在实验中,基本的动作,如点头和举起手臂是用动作捕捉系统测量的。本文对混合事件中提出的可膨胀CA进行了验证。我们还进行了一项实验,使用连接在充气部件织物上的触觉传感器来测量触摸交互。心理安全的充气类人CA是一个很有前途的物理交互实验平台。
{"title":"Inflatable Humanoid Cybernetic Avatar for Physical Human-Robot Interaction","authors":"Ryuma Niiyama, M. Ikeda, Young ah Seong","doi":"10.20965/ijat.2023.p0277","DOIUrl":"https://doi.org/10.20965/ijat.2023.p0277","url":null,"abstract":"In a digital twin, a humanoid robot can be the counterpart of a simulated agent in the real world. In addition, a human, virtual avatar, and avatar robot might constitute digital triplets. We propose an inflatable cybernetic avatar (CA) with a humanoid upper body using an inflatable structure that can represent gestures. This inflatable CA is much lighter, safer, and cheaper than conventional humanoid robots and can be folded when deflated. These properties are ideal for physical human–robot interaction (pHRI) and allow real-time collection of human behavior through interaction. In the experiment, basic movements such as nodding and raising arms were measured using motion capture systems. This paper demonstrates the proposed inflatable CA in a hybrid event. We also conducted an experiment to measure the touch interactions using tactile sensors attached to the fabric of the inflatable part. A psychologically secure inflatable humanoid CA is a promising platform for physical interaction experiments.","PeriodicalId":13583,"journal":{"name":"Int. J. Autom. Technol.","volume":"53 1","pages":"277-283"},"PeriodicalIF":0.0,"publicationDate":"2023-05-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79351434","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Effect of Perspective and Visuo-Tactile Feedback in Virtual Reality-Based Posture Learning 视角和视觉触觉反馈在基于虚拟现实的姿势学习中的作用
Pub Date : 2023-05-05 DOI: 10.20965/ijat.2023.p0248
Ryo Hanashima, Takumi Tokuda, M. Mochimaru, J. Ohyama
Posture learning is required in rehabilitation and in sports such as yoga and martial arts. Virtual reality (VR) systems are being used to learn posture by superimposing the postures of the learner and instructor in cyberspace using avatars. In this study, we examined whether the presented perspective of the avatar (first-person vs. third-person perspective) and visuo-tactile feedback (tactile correct feedback + visual feedback vs. tactile incorrect feedback + visual feedback vs. visual only feedback) are effective for the posture learning. The results of an experiment (N = 24) suggested that use of the third-person perspective may result in accurate learning of the head position as compared with first-person perspective. Visuo-tactile feedback was found to improve the subjective rating on the ease of learning, while the presentation method in which tactile feedback is given when body position is correct was found to be more effective than tactile feedback given when body position is incorrect. The sense of agency was maintained at a high level under all conditions for perspective and visuo-tactile feedback and may have improved the learning accuracy of posture. The findings of this study are expected to contribute to the design of effective perspective and tactile presentation in VR-based motor learning.
姿势学习在康复和瑜伽、武术等运动中是必需的。虚拟现实(VR)系统正被用于通过虚拟化身在网络空间中叠加学习者和讲师的姿势来学习姿势。在本研究中,我们考察了虚拟化身的呈现视角(第一人称视角vs第三人称视角)和视觉-触觉反馈(触觉正确反馈+视觉反馈vs触觉错误反馈+视觉反馈vs仅视觉反馈)对姿势学习是否有效。一项实验(N = 24)的结果表明,与第一人称视角相比,使用第三人称视角可以更准确地学习头部位置。视觉-触觉反馈提高了学生对学习难易程度的主观评价,而在身体姿势正确时给予触觉反馈的呈现方式比在身体姿势不正确时给予触觉反馈的呈现方式更有效。在视角和视觉触觉反馈的所有条件下,代理感都保持在较高的水平,这可能提高了姿势学习的准确性。本研究结果可望为虚拟现实运动学习中有效视角和触觉呈现的设计提供参考。
{"title":"Effect of Perspective and Visuo-Tactile Feedback in Virtual Reality-Based Posture Learning","authors":"Ryo Hanashima, Takumi Tokuda, M. Mochimaru, J. Ohyama","doi":"10.20965/ijat.2023.p0248","DOIUrl":"https://doi.org/10.20965/ijat.2023.p0248","url":null,"abstract":"Posture learning is required in rehabilitation and in sports such as yoga and martial arts. Virtual reality (VR) systems are being used to learn posture by superimposing the postures of the learner and instructor in cyberspace using avatars. In this study, we examined whether the presented perspective of the avatar (first-person vs. third-person perspective) and visuo-tactile feedback (tactile correct feedback + visual feedback vs. tactile incorrect feedback + visual feedback vs. visual only feedback) are effective for the posture learning. The results of an experiment (N = 24) suggested that use of the third-person perspective may result in accurate learning of the head position as compared with first-person perspective. Visuo-tactile feedback was found to improve the subjective rating on the ease of learning, while the presentation method in which tactile feedback is given when body position is correct was found to be more effective than tactile feedback given when body position is incorrect. The sense of agency was maintained at a high level under all conditions for perspective and visuo-tactile feedback and may have improved the learning accuracy of posture. The findings of this study are expected to contribute to the design of effective perspective and tactile presentation in VR-based motor learning.","PeriodicalId":13583,"journal":{"name":"Int. J. Autom. Technol.","volume":"144 1","pages":"248-261"},"PeriodicalIF":0.0,"publicationDate":"2023-05-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"75844114","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 1
Motion Measurement and Analysis for Functional Independence Measure 功能独立性测量的运动测量与分析
Pub Date : 2023-05-05 DOI: 10.20965/ijat.2023.p0237
Shino Matsuura, Kazuhiko Hirata, Hiroaki Kimura, Yoshitaka Iwamoto, Makoto Takahashi, Y. Endo, M. Tada, Tsubasa Maruyama, Y. Kurita
An appropriate physical functionality status assessment is necessary after rehabilitation to determine the level of assistance required by the patient and the efficacy of rehabilitation. The effectiveness of rehabilitation can be determined by computing a functional independence measure (FIM) score. The FIM score measurement process evaluates the amount of assistance associated with activities of daily living; however, it is influenced by evaluator subjectivity and can vary for the same patient assessed by different evaluators. Furthermore, it is time-consuming and laborious because of the large number of component items. Therefore, a new evaluation system that is easily implementable and based on objective criteria is needed. Several machine learning techniques have been suggested for evaluating the progress of rehabilitation in an objective manner, and their efficacy has been proven. However, the FIM score includes complex movement items, necessitating the evaluation of factors from multiple angles. In this study, a method for estimating FIM values using machine learning was investigated to evaluate the effectiveness of rehabilitation objectively. A simple exercise measurement experiment was conducted, and a musculoskeletal model was used to analyze the data to obtain movement and other mechanical indices, and these were subsequently used as features of machine learning. Based on the FIM values, an estimation experiment was conducted in three groups: independent, modified independent, and assisted groups. The statistical approaches of random forest and logistic regression were used in conjunction with a support vector machine for FIM estimation. The highest accuracy was estimated to be approximately 0.9. However, the accuracy varied with each method and item; the lowest accuracy was approximately 0.3. Statistical analysis showed clear differences in the indicators, with significant differences between the groups. These differences were considered to increase the accuracy of FIM estimation. Additionally, the accuracy of some items was improved by changing the feature values used. The best results were obtained when only the joint angle was used for two items, joint torque and muscle strength were used for seven items, and all indicators were used for two items. This suggests that a comprehensive evaluation, including that of joint torque and muscle strength, is effective for estimating FIM score.
康复后需要进行适当的身体功能状态评估,以确定患者所需的辅助水平和康复效果。康复的有效性可以通过计算功能独立测量(FIM)评分来确定。FIM评分测量过程评估与日常生活活动相关的援助量;然而,它受到评估者主观性的影响,不同的评估者对同一患者的评估可能会有所不同。此外,由于大量的组件项,它是耗时和费力的。因此,需要一种易于实施且以客观标准为基础的新的评价体系。几种机器学习技术已经被建议以客观的方式评估康复的进展,并且它们的功效已经被证明。然而,FIM分数包含复杂的运动项目,需要从多个角度评估因素。在这项研究中,研究了一种使用机器学习估计FIM值的方法,以客观地评估康复的有效性。通过简单的运动测量实验,利用肌肉骨骼模型对数据进行分析,得到运动等力学指标,并将这些指标作为机器学习的特征。根据FIM值进行独立组、修正独立组和辅助组的估计实验。随机森林和逻辑回归的统计方法与支持向量机相结合用于FIM估计。估计最高精度约为0.9。然而,每种方法和项目的准确性各不相同;最低精度约为0.3。统计分析显示,各指标差异明显,组间差异显著。这些差异被认为可以提高FIM估计的准确性。此外,通过改变所使用的特征值,某些项目的准确性得到了提高。2项仅使用关节角度,7项使用关节扭矩和肌力,2项使用所有指标时效果最好。这表明综合评估,包括关节扭矩和肌肉力量,是估计FIM评分的有效方法。
{"title":"Motion Measurement and Analysis for Functional Independence Measure","authors":"Shino Matsuura, Kazuhiko Hirata, Hiroaki Kimura, Yoshitaka Iwamoto, Makoto Takahashi, Y. Endo, M. Tada, Tsubasa Maruyama, Y. Kurita","doi":"10.20965/ijat.2023.p0237","DOIUrl":"https://doi.org/10.20965/ijat.2023.p0237","url":null,"abstract":"An appropriate physical functionality status assessment is necessary after rehabilitation to determine the level of assistance required by the patient and the efficacy of rehabilitation. The effectiveness of rehabilitation can be determined by computing a functional independence measure (FIM) score. The FIM score measurement process evaluates the amount of assistance associated with activities of daily living; however, it is influenced by evaluator subjectivity and can vary for the same patient assessed by different evaluators. Furthermore, it is time-consuming and laborious because of the large number of component items. Therefore, a new evaluation system that is easily implementable and based on objective criteria is needed. Several machine learning techniques have been suggested for evaluating the progress of rehabilitation in an objective manner, and their efficacy has been proven. However, the FIM score includes complex movement items, necessitating the evaluation of factors from multiple angles. In this study, a method for estimating FIM values using machine learning was investigated to evaluate the effectiveness of rehabilitation objectively. A simple exercise measurement experiment was conducted, and a musculoskeletal model was used to analyze the data to obtain movement and other mechanical indices, and these were subsequently used as features of machine learning. Based on the FIM values, an estimation experiment was conducted in three groups: independent, modified independent, and assisted groups. The statistical approaches of random forest and logistic regression were used in conjunction with a support vector machine for FIM estimation. The highest accuracy was estimated to be approximately 0.9. However, the accuracy varied with each method and item; the lowest accuracy was approximately 0.3. Statistical analysis showed clear differences in the indicators, with significant differences between the groups. These differences were considered to increase the accuracy of FIM estimation. Additionally, the accuracy of some items was improved by changing the feature values used. The best results were obtained when only the joint angle was used for two items, joint torque and muscle strength were used for seven items, and all indicators were used for two items. This suggests that a comprehensive evaluation, including that of joint torque and muscle strength, is effective for estimating FIM score.","PeriodicalId":13583,"journal":{"name":"Int. J. Autom. Technol.","volume":"48 1","pages":"237-247"},"PeriodicalIF":0.0,"publicationDate":"2023-05-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86564758","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Editorial: Human Digital Twin Technology 社论:人类数字孪生技术
Pub Date : 2023-05-05 DOI: 10.20965/ijat.2023.p0205
M. Tada, T. Inamura
With the advancement of information technologies such as the Internet of Things and artificial intelligence, cyber-physical systems are being introduced into society. At the core of these systems is the digital twin, a computer model (twin) of a physical entity built in cyberspace for simulation-based prediction. Currently, the digital twin mainly targets artificial objects, such as aircraft engines and factories. However, if it can be extended to humans, it could lead to the realization of human-machine cooperative systems and health promotion services, thereby solving social issues stemming from the aging of society. However, humans are the weakest link in the system, and many technical problems remain to be solved, such as realizing the measurement, modeling, and prediction of human behavior, if the human digital twin is to become reality. This special issue contains 9 papers on developing essential technologies for the human digital twin and constructing human-machine systems for specific applications. The topics covered include learning algorithms, motion measurement and analysis techniques, human perception, system development, and platform software for system development. These clearly show that cross-disciplinary efforts are essential to the realization of the human digital twin. We thank the authors of the papers submitted for this special issue. We are confident that the information provided by the authors is suggestive and informative for both specialists and non-specialists alike. We also sincerely appreciate the efforts of the reviewers. Their contributions helped to make this special issue possible. We hope that this special issue will catalyze sharing across the boundaries of research fields along the path to realizing a human digital twin.
随着物联网、人工智能等信息技术的发展,网络物理系统正在进入社会。这些系统的核心是数字孪生,即建立在网络空间中的物理实体的计算机模型(孪生),用于基于模拟的预测。目前,数字孪生主要针对人造物体,如飞机发动机和工厂。然而,如果它可以扩展到人类,它可以导致实现人机协作系统和健康促进服务,从而解决社会老龄化带来的社会问题。然而,人类是系统中最薄弱的环节,如果要实现人类数字孪生,还需要解决许多技术问题,例如实现对人类行为的测量、建模和预测。这期特刊包含了9篇关于开发人类数字孪生的关键技术和构建特定应用的人机系统的论文。涵盖的主题包括学习算法、运动测量和分析技术、人类感知、系统开发和系统开发的平台软件。这些都清楚地表明,跨学科的努力对于实现人类数字孪生至关重要。我们感谢为本期特刊提交论文的作者。我们相信,作者提供的信息对专家和非专业人士都具有启发性和信息性。我们也衷心感谢审稿人的努力。他们的贡献使本期特刊成为可能。我们希望这期特刊能够在实现人类数字孪生的道路上,促进跨研究领域的共享。
{"title":"Editorial: Human Digital Twin Technology","authors":"M. Tada, T. Inamura","doi":"10.20965/ijat.2023.p0205","DOIUrl":"https://doi.org/10.20965/ijat.2023.p0205","url":null,"abstract":"With the advancement of information technologies such as the Internet of Things and artificial intelligence, cyber-physical systems are being introduced into society. At the core of these systems is the digital twin, a computer model (twin) of a physical entity built in cyberspace for simulation-based prediction.\u0000 Currently, the digital twin mainly targets artificial objects, such as aircraft engines and factories. However, if it can be extended to humans, it could lead to the realization of human-machine cooperative systems and health promotion services, thereby solving social issues stemming from the aging of society. However, humans are the weakest link in the system, and many technical problems remain to be solved, such as realizing the measurement, modeling, and prediction of human behavior, if the human digital twin is to become reality.\u0000 This special issue contains 9 papers on developing essential technologies for the human digital twin and constructing human-machine systems for specific applications. The topics covered include learning algorithms, motion measurement and analysis techniques, human perception, system development, and platform software for system development. These clearly show that cross-disciplinary efforts are essential to the realization of the human digital twin.\u0000 We thank the authors of the papers submitted for this special issue. We are confident that the information provided by the authors is suggestive and informative for both specialists and non-specialists alike. We also sincerely appreciate the efforts of the reviewers. Their contributions helped to make this special issue possible. We hope that this special issue will catalyze sharing across the boundaries of research fields along the path to realizing a human digital twin.","PeriodicalId":13583,"journal":{"name":"Int. J. Autom. Technol.","volume":"2014 1","pages":"205"},"PeriodicalIF":0.0,"publicationDate":"2023-05-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82738642","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
Motion Analysis of the Torso and the Elbow During Picking and Placing Heavy Object on Shelf 在货架上取放重物时躯干和肘部的运动分析
Pub Date : 2023-05-05 DOI: 10.20965/ijat.2023.p0226
Kaito Hara, Satoki Tsuichihara, Yasutake Takahashi
In recent years, labor shortages and workforce aging have become problematic. One solution to this problem is introducing humanoid robots to perform human tasks. This research is aimed at analyzing the posture and preparation posture of the torso and elbow in human motions for improving the motion planning of humanoid robots utilizing the redundant part. We analyze the frontal tilt angle of the torso, time of backward bending the torso, and lateral tilt angle of the elbow when humans apply force. In the experiments, we focused on picking and placing heavy objects on the shelf, which requires maintaining balance and exerting force, and confirmed the differences in movements by changing the weight of the objects. An optical motion capture system and a six-axis load cell were used for measuring the motion. The subjects were asked to approach the shelf from a distance of 1 m and move a heavy object from the upper to the middle height of the shelf. As a result, the heavier the object, the earlier the preparation posture of a backward bending of the torso before grasping. The heavier the object, the larger the tilt angle of the torso forward. Significant differences were observed between the time of backward bending and picking the object, distances from the shoulder to wrist joint, and tilt angle of the torso. We identified the posture and time required to bend the torso for holding a heavier object in front of the shelf, considering the dynamic stability of the Zero-Moment Point.
近年来,劳动力短缺和劳动力老龄化已经成为问题。这个问题的一个解决方案是引入人形机器人来执行人类的任务。本研究旨在分析人体运动中躯干和肘部的姿势和准备姿势,以改进利用冗余部分的仿人机器人的运动规划。我们分析了人体施加力时躯干的正面倾斜角、躯干向后弯曲的时间以及肘部的侧向倾斜角。在实验中,我们将重点放在货架上的重物的拾取和放置,这需要保持平衡和施加力,并通过改变物体的重量来确认运动的差异。光学运动捕捉系统和六轴称重传感器用于测量运动。受试者被要求离架子1米远,并将一个重物从架子的上部移到中间高度。因此,物体越重,在抓取前躯干向后弯曲的准备姿势就越早。物体越重,躯干向前倾斜的角度越大。在向后弯曲和拾取物体的时间、肩关节到腕关节的距离和躯干倾斜角度之间存在显著差异。考虑到零力矩点的动态稳定性,我们确定了在架子前握住较重的物体时弯曲躯干所需的姿势和时间。
{"title":"Motion Analysis of the Torso and the Elbow During Picking and Placing Heavy Object on Shelf","authors":"Kaito Hara, Satoki Tsuichihara, Yasutake Takahashi","doi":"10.20965/ijat.2023.p0226","DOIUrl":"https://doi.org/10.20965/ijat.2023.p0226","url":null,"abstract":"In recent years, labor shortages and workforce aging have become problematic. One solution to this problem is introducing humanoid robots to perform human tasks. This research is aimed at analyzing the posture and preparation posture of the torso and elbow in human motions for improving the motion planning of humanoid robots utilizing the redundant part. We analyze the frontal tilt angle of the torso, time of backward bending the torso, and lateral tilt angle of the elbow when humans apply force. In the experiments, we focused on picking and placing heavy objects on the shelf, which requires maintaining balance and exerting force, and confirmed the differences in movements by changing the weight of the objects. An optical motion capture system and a six-axis load cell were used for measuring the motion. The subjects were asked to approach the shelf from a distance of 1 m and move a heavy object from the upper to the middle height of the shelf. As a result, the heavier the object, the earlier the preparation posture of a backward bending of the torso before grasping. The heavier the object, the larger the tilt angle of the torso forward. Significant differences were observed between the time of backward bending and picking the object, distances from the shoulder to wrist joint, and tilt angle of the torso. We identified the posture and time required to bend the torso for holding a heavier object in front of the shelf, considering the dynamic stability of the Zero-Moment Point.","PeriodicalId":13583,"journal":{"name":"Int. J. Autom. Technol.","volume":"26 1","pages":"226-236"},"PeriodicalIF":0.0,"publicationDate":"2023-05-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82809517","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
引用次数: 0
期刊
Int. J. Autom. Technol.
全部 Acc. Chem. Res. ACS Applied Bio Materials ACS Appl. Electron. Mater. ACS Appl. Energy Mater. ACS Appl. Mater. Interfaces ACS Appl. Nano Mater. ACS Appl. Polym. Mater. ACS BIOMATER-SCI ENG ACS Catal. ACS Cent. Sci. ACS Chem. Biol. ACS Chemical Health & Safety ACS Chem. Neurosci. ACS Comb. Sci. ACS Earth Space Chem. ACS Energy Lett. ACS Infect. Dis. ACS Macro Lett. ACS Mater. Lett. ACS Med. Chem. Lett. ACS Nano ACS Omega ACS Photonics ACS Sens. ACS Sustainable Chem. Eng. ACS Synth. Biol. Anal. Chem. BIOCHEMISTRY-US Bioconjugate Chem. BIOMACROMOLECULES Chem. Res. Toxicol. Chem. Rev. Chem. Mater. CRYST GROWTH DES ENERG FUEL Environ. Sci. Technol. Environ. Sci. Technol. Lett. Eur. J. Inorg. Chem. IND ENG CHEM RES Inorg. Chem. J. Agric. Food. Chem. J. Chem. Eng. Data J. Chem. Educ. J. Chem. Inf. Model. J. Chem. Theory Comput. J. Med. Chem. J. Nat. Prod. J PROTEOME RES J. Am. Chem. Soc. LANGMUIR MACROMOLECULES Mol. Pharmaceutics Nano Lett. Org. Lett. ORG PROCESS RES DEV ORGANOMETALLICS J. Org. Chem. J. Phys. Chem. J. Phys. Chem. A J. Phys. Chem. B J. Phys. Chem. C J. Phys. Chem. Lett. Analyst Anal. Methods Biomater. Sci. Catal. Sci. Technol. Chem. Commun. Chem. Soc. Rev. CHEM EDUC RES PRACT CRYSTENGCOMM Dalton Trans. Energy Environ. Sci. ENVIRON SCI-NANO ENVIRON SCI-PROC IMP ENVIRON SCI-WAT RES Faraday Discuss. Food Funct. Green Chem. Inorg. Chem. Front. Integr. Biol. J. Anal. At. Spectrom. J. Mater. Chem. A J. Mater. Chem. B J. Mater. Chem. C Lab Chip Mater. Chem. Front. Mater. Horiz. MEDCHEMCOMM Metallomics Mol. Biosyst. Mol. Syst. Des. Eng. Nanoscale Nanoscale Horiz. Nat. Prod. Rep. New J. Chem. Org. Biomol. Chem. Org. Chem. Front. PHOTOCH PHOTOBIO SCI PCCP Polym. Chem.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
0
微信
客服QQ
Book学术公众号 扫码关注我们
反馈
×
意见反馈
请填写您的意见或建议
请填写您的手机或邮箱
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
现在去查看 取消
×
提示
确定
Book学术官方微信
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术
文献互助 智能选刊 最新文献 互助须知 联系我们:info@booksci.cn
Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。
Copyright © 2023 Book学术 All rights reserved.
ghs 京公网安备 11010802042870号 京ICP备2023020795号-1