Pub Date : 2022-05-31eCollection Date: 2022-01-01DOI: 10.34133/2022/9806328
Qiyuan Cao, Rui Wang, Tiandong Zhang, Yu Wang, Shuo Wang
In this paper, the hydrodynamic modeling and parameter identification of the RobDact, a bionic underwater vehicle inspired by Dactylopteridae, are carried out based on computational fluid dynamics (CFD) and force measurement experiment. Firstly, the paper briefly describes the RobDact, then establishes the kinematics model and rigid body dynamics model of the RobDact according to the hydrodynamic force and moment equations. Through CFD simulations, the hydrodynamic force of the RobDact at different speeds is obtained, and then, the hydrodynamic model parameters are identified. Furthermore, the measurement platform is developed to obtain the relationship between the thrust generated by the RobDact and the input fluctuation parameters. Finally, by combining the rigid body dynamics model and the fin thrust mapping model, the hydrodynamic model of the RobDact at different motion states is constructed.
{"title":"Hydrodynamic Modeling and Parameter Identification of a Bionic Underwater Vehicle: RobDact.","authors":"Qiyuan Cao, Rui Wang, Tiandong Zhang, Yu Wang, Shuo Wang","doi":"10.34133/2022/9806328","DOIUrl":"10.34133/2022/9806328","url":null,"abstract":"<p><p>In this paper, the hydrodynamic modeling and parameter identification of the RobDact, a bionic underwater vehicle inspired by Dactylopteridae, are carried out based on computational fluid dynamics (CFD) and force measurement experiment. Firstly, the paper briefly describes the RobDact, then establishes the kinematics model and rigid body dynamics model of the RobDact according to the hydrodynamic force and moment equations. Through CFD simulations, the hydrodynamic force of the RobDact at different speeds is obtained, and then, the hydrodynamic model parameters are identified. Furthermore, the measurement platform is developed to obtain the relationship between the thrust generated by the RobDact and the input fluctuation parameters. Finally, by combining the rigid body dynamics model and the fin thrust mapping model, the hydrodynamic model of the RobDact at different motion states is constructed.</p>","PeriodicalId":72764,"journal":{"name":"Cyborg and bionic systems (Washington, D.C.)","volume":"2022 1","pages":"9806328"},"PeriodicalIF":10.5,"publicationDate":"2022-05-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9494701/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41800429","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
While engineers put lots of effort, resources, and time in building insect scale micro aerial vehicles (MAVs) that fly like insects, insects themselves are the real masters of flight. What if we would use living insect as platform for MAV instead? Here, we reported a flight control via electrical stimulation of a flight muscle of an insect-computer hybrid robot, which is the interface of a mountable wireless backpack controller and a living beetle. The beetle uses indirect flight muscles to drive wing flapping and three major direct flight muscles (basalar, subalar, and third axilliary (3Ax) muscles) to control the kinematics of the wings for flight maneuver. While turning control was already achieved by stimulating basalar and 3Ax muscles, electrical stimulation of subalar muscles resulted in braking and elevation control in flight. We also demonstrated around 20 degrees of contralateral yaw and roll by stimulating individual subalar muscle. Stimulating both subalar muscles lead to an increase of 20 degrees in pitch and decelerate the flight by 1.5 m/s2 as well as an induce in elevation of 2 m/s2.
{"title":"A Cyborg Insect Reveals a Function of a Muscle in Free Flight","authors":"T. Vo-Doan, V. T. Dung, Hirotaka Sato","doi":"10.34133/2022/9780504","DOIUrl":"https://doi.org/10.34133/2022/9780504","url":null,"abstract":"While engineers put lots of effort, resources, and time in building insect scale micro aerial vehicles (MAVs) that fly like insects, insects themselves are the real masters of flight. What if we would use living insect as platform for MAV instead? Here, we reported a flight control via electrical stimulation of a flight muscle of an insect-computer hybrid robot, which is the interface of a mountable wireless backpack controller and a living beetle. The beetle uses indirect flight muscles to drive wing flapping and three major direct flight muscles (basalar, subalar, and third axilliary (3Ax) muscles) to control the kinematics of the wings for flight maneuver. While turning control was already achieved by stimulating basalar and 3Ax muscles, electrical stimulation of subalar muscles resulted in braking and elevation control in flight. We also demonstrated around 20 degrees of contralateral yaw and roll by stimulating individual subalar muscle. Stimulating both subalar muscles lead to an increase of 20 degrees in pitch and decelerate the flight by 1.5 m/s2 as well as an induce in elevation of 2 m/s2.","PeriodicalId":72764,"journal":{"name":"Cyborg and bionic systems (Washington, D.C.)","volume":"49 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-05-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"90809305","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Hen-Wei Huang, Jack Chen, P. Chai, Claas Ehmke, Philipp Rupp, Farah Z. Dadabhoy, Annie Feng, Canchen Li, Akhil J Thomas, Marco da Silva, Edward W. Boyer, G. Traverso
The COVID-19 pandemic has accelerated methods to facilitate contactless evaluation of patients in hospital settings. By minimizing in-person contact with individuals who may have COVID-19, healthcare workers can prevent disease transmission and conserve personal protective equipment. Obtaining vital signs is a ubiquitous task that is commonly done in person by healthcare workers. To eliminate the need for in-person contact for vital sign measurement in the hospital setting, we developed Dr. Spot, a mobile quadruped robotic system. The system includes IR and RGB cameras for vital sign monitoring and a tablet computer for face-to-face medical interviewing. Dr. Spot is teleoperated by trained clinical staff to simultaneously measure the skin temperature, respiratory rate, and heart rate while maintaining social distancing from patients and without removing their mask. To enable accurate, contactless measurements on a mobile system without a static black body as reference, we propose novel methods for skin temperature compensation and respiratory rate measurement at various distances between the subject and the cameras, up to 5 m. Without compensation, the skin temperature MAE is 1.3°C. Using the proposed compensation method, the skin temperature MAE is reduced to 0.3°C. The respiratory rate method can provide continuous monitoring with a MAE of 1.6 BPM in 30 s or rapid screening with a MAE of 2.1 BPM in 10 s. For the heart rate estimation, our system is able to achieve a MAE less than 8 BPM in 10 s measured in arbitrary indoor light conditions at any distance below 2 m.
{"title":"Mobile Robotic Platform for Contactless Vital Sign Monitoring","authors":"Hen-Wei Huang, Jack Chen, P. Chai, Claas Ehmke, Philipp Rupp, Farah Z. Dadabhoy, Annie Feng, Canchen Li, Akhil J Thomas, Marco da Silva, Edward W. Boyer, G. Traverso","doi":"10.34133/2022/9780497","DOIUrl":"https://doi.org/10.34133/2022/9780497","url":null,"abstract":"The COVID-19 pandemic has accelerated methods to facilitate contactless evaluation of patients in hospital settings. By minimizing in-person contact with individuals who may have COVID-19, healthcare workers can prevent disease transmission and conserve personal protective equipment. Obtaining vital signs is a ubiquitous task that is commonly done in person by healthcare workers. To eliminate the need for in-person contact for vital sign measurement in the hospital setting, we developed Dr. Spot, a mobile quadruped robotic system. The system includes IR and RGB cameras for vital sign monitoring and a tablet computer for face-to-face medical interviewing. Dr. Spot is teleoperated by trained clinical staff to simultaneously measure the skin temperature, respiratory rate, and heart rate while maintaining social distancing from patients and without removing their mask. To enable accurate, contactless measurements on a mobile system without a static black body as reference, we propose novel methods for skin temperature compensation and respiratory rate measurement at various distances between the subject and the cameras, up to 5 m. Without compensation, the skin temperature MAE is 1.3°C. Using the proposed compensation method, the skin temperature MAE is reduced to 0.3°C. The respiratory rate method can provide continuous monitoring with a MAE of 1.6 BPM in 30 s or rapid screening with a MAE of 2.1 BPM in 10 s. For the heart rate estimation, our system is able to achieve a MAE less than 8 BPM in 10 s measured in arbitrary indoor light conditions at any distance below 2 m.","PeriodicalId":72764,"journal":{"name":"Cyborg and bionic systems (Washington, D.C.)","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-04-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48791330","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lei Wang, Libo Meng, Ru Kang, Botao Liu, Sai Gu, Zhi Zhang, Fei Meng, A. Ming
In this paper, a parallel quadrupedal robot was designed that is capable of versatile dynamic locomotion and perception-less terrain adaptation. Firstly, a quadrupedal robot with a symmetric legs and a powerful actuator was implemented for highly dynamic movement. Then, a fast and reliable method based on generalized least square was proposed for estimating the terrain parameters by fusing the body, leg, and contact information. On the basis of virtual model control (VMC) with the quadratic program (QP) method, the optimal foot force for terrain adaptation was achieved. Finally, the results obtained by simulation and indoor and outdoor experiments demonstrate that the robot can achieve a robust and versatile dynamic locomotion on uneven terrain, and the rejection of disturbances is reliable, which proves the effectiveness and robustness of this proposed method.
{"title":"Design and Dynamic Locomotion Control of Quadruped Robot with Perception-Less Terrain Adaptation","authors":"Lei Wang, Libo Meng, Ru Kang, Botao Liu, Sai Gu, Zhi Zhang, Fei Meng, A. Ming","doi":"10.34133/2022/9816495","DOIUrl":"https://doi.org/10.34133/2022/9816495","url":null,"abstract":"In this paper, a parallel quadrupedal robot was designed that is capable of versatile dynamic locomotion and perception-less terrain adaptation. Firstly, a quadrupedal robot with a symmetric legs and a powerful actuator was implemented for highly dynamic movement. Then, a fast and reliable method based on generalized least square was proposed for estimating the terrain parameters by fusing the body, leg, and contact information. On the basis of virtual model control (VMC) with the quadratic program (QP) method, the optimal foot force for terrain adaptation was achieved. Finally, the results obtained by simulation and indoor and outdoor experiments demonstrate that the robot can achieve a robust and versatile dynamic locomotion on uneven terrain, and the rejection of disturbances is reliable, which proves the effectiveness and robustness of this proposed method.","PeriodicalId":72764,"journal":{"name":"Cyborg and bionic systems (Washington, D.C.)","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-02-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"48092092","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Dan Liu, Xiaoming Liu, Zhuo Chen, Zhaofeng Zuo, Xiaoqing Tang, Qiang Huang, T. Arai
Remotely controlled soft continuum robots with active steering capability have broad prospects in medical applications. However, conventional continuum robots have the miniaturization challenge. This paper presents a microscale soft continuum microrobot with steering and locomotion capabilities based on magnetic field actuation. The magnetically driven soft continuum microrobot is made of NdFeB particles and polydimethylsiloxane (PDMS), and it can be as small as 200 μm in diameter. Moreover, a hydrogel layer is covered on the surface of the microrobot, which not only overcomes the adhesion force between the microobjects and the soft tip but also reduces the friction between the microrobot and substrate. The performance test indicates the soft continuum microrobot featured excellent control and steering capabilities. The experimental results demonstrate that the soft continuum microrobot can travel through the microfluidic channel by its own vibration and flexibly steer in a bifurcation environment. Moreover, the micromanipulation of microbeads in the microfluidic channels proves that the proposed microscale soft continuum microrobot has a great potential for intravascular manipulation.
{"title":"Magnetically Driven Soft Continuum Microrobot for Intravascular Operations in Microscale","authors":"Dan Liu, Xiaoming Liu, Zhuo Chen, Zhaofeng Zuo, Xiaoqing Tang, Qiang Huang, T. Arai","doi":"10.34133/2022/9850832","DOIUrl":"https://doi.org/10.34133/2022/9850832","url":null,"abstract":"Remotely controlled soft continuum robots with active steering capability have broad prospects in medical applications. However, conventional continuum robots have the miniaturization challenge. This paper presents a microscale soft continuum microrobot with steering and locomotion capabilities based on magnetic field actuation. The magnetically driven soft continuum microrobot is made of NdFeB particles and polydimethylsiloxane (PDMS), and it can be as small as 200 μm in diameter. Moreover, a hydrogel layer is covered on the surface of the microrobot, which not only overcomes the adhesion force between the microobjects and the soft tip but also reduces the friction between the microrobot and substrate. The performance test indicates the soft continuum microrobot featured excellent control and steering capabilities. The experimental results demonstrate that the soft continuum microrobot can travel through the microfluidic channel by its own vibration and flexibly steer in a bifurcation environment. Moreover, the micromanipulation of microbeads in the microfluidic channels proves that the proposed microscale soft continuum microrobot has a great potential for intravascular manipulation.","PeriodicalId":72764,"journal":{"name":"Cyborg and bionic systems (Washington, D.C.)","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"42340453","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Eduardo R. Perez-Guagnelli, Joanna Jones, Dana D. Damian
Technologies that provide mechanical assistance are required in the medical field, such as implants that regenerate tissue through elongation and stimulation. One of the challenges is to develop actuators that combine the benefits of high axial extension at low pressures, modularity, multifunction, and load-bearing capabilities into one design while maintaining their shape and softness. Overcoming such a challenge will provide implants with enhanced capacity for mechanical assistance to induce tissue regeneration. We introduce two novel actuators (M2H) built of stacked Hyperelastic Ballooning Membrane Actuators (HBMAs) that can be realized using helical and toroidal configurations. By restraining the HBMA expansion deterministically using a semisoft exoskeleton, the actuators are endowed with axial extension and radial expansion capabilities. These actuators are thus built of modules that can be configured to different therapeutical needs and multifunctionality, to provide anatomically congruent stimulation. We present the design, fabrication, testing, and numerical and experimental validation of the M2H-HBMAs. They can axially extend up to 41% and 32% in their helical and toroidal configurations at input pressures as low as 26 and 24 kPa, respectively. If the axial extension module is used separately, its extension capacity reaches >170%. The M2H-HBMAs can perform independent and simultaneous expansion and extension motions with negligible intraluminal deformation as well as stand at least 1 kg of axial force without collapsing. The M2H-HBMAs overcome the limitations of hyperexpanding machines that show low resistance to load. We envisage M2H-HBMAs as promising tools to perform tissue regeneration procedures.
{"title":"Hyperelastic Membrane Actuators: Analysis of Toroidal and Helical Multifunctional Configurations","authors":"Eduardo R. Perez-Guagnelli, Joanna Jones, Dana D. Damian","doi":"10.34133/2022/9786864","DOIUrl":"https://doi.org/10.34133/2022/9786864","url":null,"abstract":"Technologies that provide mechanical assistance are required in the medical field, such as implants that regenerate tissue through elongation and stimulation. One of the challenges is to develop actuators that combine the benefits of high axial extension at low pressures, modularity, multifunction, and load-bearing capabilities into one design while maintaining their shape and softness. Overcoming such a challenge will provide implants with enhanced capacity for mechanical assistance to induce tissue regeneration. We introduce two novel actuators (M2H) built of stacked Hyperelastic Ballooning Membrane Actuators (HBMAs) that can be realized using helical and toroidal configurations. By restraining the HBMA expansion deterministically using a semisoft exoskeleton, the actuators are endowed with axial extension and radial expansion capabilities. These actuators are thus built of modules that can be configured to different therapeutical needs and multifunctionality, to provide anatomically congruent stimulation. We present the design, fabrication, testing, and numerical and experimental validation of the M2H-HBMAs. They can axially extend up to 41% and 32% in their helical and toroidal configurations at input pressures as low as 26 and 24 kPa, respectively. If the axial extension module is used separately, its extension capacity reaches >170%. The M2H-HBMAs can perform independent and simultaneous expansion and extension motions with negligible intraluminal deformation as well as stand at least 1 kg of axial force without collapsing. The M2H-HBMAs overcome the limitations of hyperexpanding machines that show low resistance to load. We envisage M2H-HBMAs as promising tools to perform tissue regeneration procedures.","PeriodicalId":72764,"journal":{"name":"Cyborg and bionic systems (Washington, D.C.)","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-02-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"44922924","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Untethered microrobots have attracted extensive attention due to their potential for biomedical applications and micromanipulation at the small scale. Soft microrobots are of great research importance because of their highly deformable ability to achieve not only multiple locomotion mechanisms but also minimal invasion to the environment. However, the existing microrobots are still limited in their ability to locomote and cross obstacles in unstructured environments compared to conventional legged robots. Nature provides much inspiration for developing miniature robots. Here, we propose a bionic quadruped soft thin-film microrobot with a nonmagnetic soft body and 4 magnetic flexible legs. The quadruped soft microrobot can achieve multiple controllable locomotion modes in the external magnetic field. The experiment demonstrated the robot's excellent obstacle-crossing ability by walking on the surface with steps and moving in the bottom of a stomach model with gullies. In particular, by controlling the conical angle of the external conical magnetic field, microbeads gripping, transportation, and release of the microrobot were demonstrated. In the future, the quadruped microrobot with excellent obstacle-crossing and gripping capabilities will be relevant for biomedical applications and micromanipulation.
{"title":"Multimodal Locomotion and Cargo Transportation of Magnetically Actuated Quadruped Soft Microrobots.","authors":"Chenyang Huang, Zhengyu Lai, Xinyu Wu, Tiantian Xu","doi":"10.34133/cbsystems.0004","DOIUrl":"https://doi.org/10.34133/cbsystems.0004","url":null,"abstract":"<p><p>Untethered microrobots have attracted extensive attention due to their potential for biomedical applications and micromanipulation at the small scale. Soft microrobots are of great research importance because of their highly deformable ability to achieve not only multiple locomotion mechanisms but also minimal invasion to the environment. However, the existing microrobots are still limited in their ability to locomote and cross obstacles in unstructured environments compared to conventional legged robots. Nature provides much inspiration for developing miniature robots. Here, we propose a bionic quadruped soft thin-film microrobot with a nonmagnetic soft body and 4 magnetic flexible legs. The quadruped soft microrobot can achieve multiple controllable locomotion modes in the external magnetic field. The experiment demonstrated the robot's excellent obstacle-crossing ability by walking on the surface with steps and moving in the bottom of a stomach model with gullies. In particular, by controlling the conical angle of the external conical magnetic field, microbeads gripping, transportation, and release of the microrobot were demonstrated. In the future, the quadruped microrobot with excellent obstacle-crossing and gripping capabilities will be relevant for biomedical applications and micromanipulation.</p>","PeriodicalId":72764,"journal":{"name":"Cyborg and bionic systems (Washington, D.C.)","volume":"2022 ","pages":"0004"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10010670/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9180489","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Human action representation is derived from the description of human shape and motion. The traditional unsupervised 3-dimensional (3D) human action representation learning method uses a recurrent neural network (RNN)-based autoencoder to reconstruct the input pose sequence and then takes the midlevel feature of the autoencoder as representation. Although RNN can implicitly learn a certain amount of motion information, the extracted representation mainly describes the human shape and is insufficient to describe motion information. Therefore, we first present a handcrafted motion feature called pose flow to guide the reconstruction of the autoencoder, whose midlevel feature is expected to describe motion information. The performance is limited as we observe that actions can be distinctive in either motion direction or motion norm. For example, we can distinguish "sitting down" and "standing up" from motion direction yet distinguish "running" and "jogging" from motion norm. In these cases, it is difficult to learn distinctive features from pose flow where direction and norm are mixed. To this end, we present an explicit pose decoupled flow network (PDF-E) to learn from direction and norm in a multi-task learning framework, where 1 encoder is used to generate representation and 2 decoders are used to generating direction and norm, respectively. Further, we use reconstructing the input pose sequence as an additional constraint and present a generalized PDF network (PDF-G) to learn both motion and shape information, which achieves state-of-the-art performances on large-scale and challenging 3D action recognition datasets including the NTU RGB+D 60 dataset and NTU RGB+D 120 dataset.
{"title":"Generalized Pose Decoupled Network for Unsupervised 3D Skeleton Sequence-Based Action Representation Learning.","authors":"Mengyuan Liu, Fanyang Meng, Yongsheng Liang","doi":"10.34133/cbsystems.0002","DOIUrl":"https://doi.org/10.34133/cbsystems.0002","url":null,"abstract":"<p><p>Human action representation is derived from the description of human shape and motion. The traditional unsupervised 3-dimensional (3D) human action representation learning method uses a recurrent neural network (RNN)-based autoencoder to reconstruct the input pose sequence and then takes the midlevel feature of the autoencoder as representation. Although RNN can implicitly learn a certain amount of motion information, the extracted representation mainly describes the human shape and is insufficient to describe motion information. Therefore, we first present a handcrafted motion feature called pose flow to guide the reconstruction of the autoencoder, whose midlevel feature is expected to describe motion information. The performance is limited as we observe that actions can be distinctive in either motion direction or motion norm. For example, we can distinguish \"sitting down\" and \"standing up\" from motion direction yet distinguish \"running\" and \"jogging\" from motion norm. In these cases, it is difficult to learn distinctive features from pose flow where direction and norm are mixed. To this end, we present an explicit pose decoupled flow network (PDF-E) to learn from direction and norm in a multi-task learning framework, where 1 encoder is used to generate representation and 2 decoders are used to generating direction and norm, respectively. Further, we use reconstructing the input pose sequence as an additional constraint and present a generalized PDF network (PDF-G) to learn both motion and shape information, which achieves state-of-the-art performances on large-scale and challenging 3D action recognition datasets including the NTU RGB+D 60 dataset and NTU RGB+D 120 dataset.</p>","PeriodicalId":72764,"journal":{"name":"Cyborg and bionic systems (Washington, D.C.)","volume":"2022 ","pages":"0002"},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10076048/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9289631","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Liming Li, Vamiq M. Mustahsan, Guangyu He, F. Tavernier, Gurtej Singh, B. Boyce, F. Khan, I. Kao
Intraoperative confirmation of negative resection margins is an essential component of soft tissue sarcoma surgery. Frozen section examination of samples from the resection bed after excision of sarcomas is the gold standard for intraoperative assessment of margin status. However, it takes time to complete histologic examination of these samples, and the technique does not provide real-time diagnosis in the operating room (OR), which delays completion of the operation. This paper presents a study and development of sensing technology using Raman spectroscopy that could be used for detection and classification of the tumor after resection with negative sarcoma margins in real time. We acquired Raman spectra from samples of sarcoma and surrounding benign muscle, fat, and dermis during surgery and developed (i) a quantitative method (QM) and (ii) a machine learning method (MLM) to assess the spectral patterns and determine if they could accurately identify these tissue types when compared to findings in adjacent H&E-stained frozen sections. High classification accuracy (>85%) was achieved with both methods, indicating that these four types of tissue can be identified using the analytical methodology. A hand-held Raman probe could be employed to further develop the methodology to obtain spectra in the OR to provide real-time in vivo capability for the assessment of sarcoma resection margin status.
{"title":"Classification of Soft Tissue Sarcoma Specimens with Raman Spectroscopy as Smart Sensing Technology","authors":"Liming Li, Vamiq M. Mustahsan, Guangyu He, F. Tavernier, Gurtej Singh, B. Boyce, F. Khan, I. Kao","doi":"10.34133/2021/9816913","DOIUrl":"https://doi.org/10.34133/2021/9816913","url":null,"abstract":"Intraoperative confirmation of negative resection margins is an essential component of soft tissue sarcoma surgery. Frozen section examination of samples from the resection bed after excision of sarcomas is the gold standard for intraoperative assessment of margin status. However, it takes time to complete histologic examination of these samples, and the technique does not provide real-time diagnosis in the operating room (OR), which delays completion of the operation. This paper presents a study and development of sensing technology using Raman spectroscopy that could be used for detection and classification of the tumor after resection with negative sarcoma margins in real time. We acquired Raman spectra from samples of sarcoma and surrounding benign muscle, fat, and dermis during surgery and developed (i) a quantitative method (QM) and (ii) a machine learning method (MLM) to assess the spectral patterns and determine if they could accurately identify these tissue types when compared to findings in adjacent H&E-stained frozen sections. High classification accuracy (>85%) was achieved with both methods, indicating that these four types of tissue can be identified using the analytical methodology. A hand-held Raman probe could be employed to further develop the methodology to obtain spectra in the OR to provide real-time in vivo capability for the assessment of sarcoma resection margin status.","PeriodicalId":72764,"journal":{"name":"Cyborg and bionic systems (Washington, D.C.)","volume":"2021 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-12-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41401671","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
The deep learning gesture recognition based on surface electromyography plays an increasingly important role in human-computer interaction. In order to ensure the high accuracy of deep learning in multistate muscle action recognition and ensure that the training model can be applied in the embedded chip with small storage space, this paper presents a feature model construction and optimization method based on multichannel sEMG amplification unit. The feature model is established by using multidimensional sequential sEMG images by combining convolutional neural network and long-term memory network to solve the problem of multistate sEMG signal recognition. The experimental results show that under the same network structure, the sEMG signal with fast Fourier transform and root mean square as feature data processing has a good recognition rate, and the recognition accuracy of complex gestures is 91.40%, with the size of 1 MB. The model can still control the artificial hand accurately when the model is small and the precision is high.
{"title":"Application Research on Optimization Algorithm of sEMG Gesture Recognition Based on Light CNN+LSTM Model","authors":"Dianchun Bai, Tie Liu, Xinghua Han, Hongyu Yi","doi":"10.34133/2021/9794610","DOIUrl":"https://doi.org/10.34133/2021/9794610","url":null,"abstract":"The deep learning gesture recognition based on surface electromyography plays an increasingly important role in human-computer interaction. In order to ensure the high accuracy of deep learning in multistate muscle action recognition and ensure that the training model can be applied in the embedded chip with small storage space, this paper presents a feature model construction and optimization method based on multichannel sEMG amplification unit. The feature model is established by using multidimensional sequential sEMG images by combining convolutional neural network and long-term memory network to solve the problem of multistate sEMG signal recognition. The experimental results show that under the same network structure, the sEMG signal with fast Fourier transform and root mean square as feature data processing has a good recognition rate, and the recognition accuracy of complex gestures is 91.40%, with the size of 1 MB. The model can still control the artificial hand accurately when the model is small and the precision is high.","PeriodicalId":72764,"journal":{"name":"Cyborg and bionic systems (Washington, D.C.)","volume":" ","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-11-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41544326","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}