Reconstructing Soft Robotic Touch via In-Finger Vision

Abstract

Reconstructing Soft Robotic Touch via In-Finger Vision

The research by Fang Wan, Chaoyang Song, and co-workers (see article number 2400022) introduces a vision-based approach for learning proprioceptive interactions using Soft Robotic Metamaterials (SRMs). By reconstructing shape and touch during physical engagements, the authors achieve real-time, precise estimations of the soft finger mesh deformation in virtual environments. This innovation enhances the adaptability in 3D interactions and suggests promising applications in human–robot collaboration and touch-based digital twin interactions, bridging the gap between physical and virtual worlds via a multi-modal soft touch.