In-Sensor Tactile Fusion and Logic for Accurate Intention Recognition

Abstract

Touch control intention recognition is an important direction for the future development of human–machine interactions (HMIs). However, the implementation of parallel-sensing functional modules generally requires a combination of different logical blocks and control circuits, which results in regional redundancy, redundant data, and low efficiency. Here, a location-and-pressure intelligent tactile sensor (LPI tactile sensor) unprecedentedly combined with sensing, computing, and logic is proposed, enabling efficient and ultrahigh-resolution action–intention interaction. The LPI tactile sensor eliminates the need for data transfer among the functional units through the core integration design of the layered structure. It actuates in-sensor perception through feature transmission, fusion, and differentiation, thereby revolutionizing the traditional von Neumann architecture. While greatly simplifying the data dimensionality, the LPI tactile sensor achieves outstanding resolution sensing in both location (<400 µm) and pressure (75 Pa). Synchronous feature fusion and decoding support the high-fidelity recognition of action and combinatorial logic intentions. Benefiting from location and pressure synergy, the LPI tactile sensor demonstrates robust privacy as an encrypted password device and interaction intelligence through pressure enhancement. It can recognize continuous touch actions in real time, map real intentions to target events, and promote accurate and efficient intention-driven HMIs.