We regularly touch soft, compliant fruits and tissues. To help us discriminate them, we rely upon cues embedded in spatial and temporal deformation of finger pad skin. However, we do not yet understand, in touching objects of various compliance, how such patterns evolve over time, and drive perception. Using a 3-D stereo imaging technique in passive touch, we develop metrics for quantifying skin deformation, across compliance, displacement, and time. The metrics map 2-D estimates of terminal contact area to 3-D metrics that represent spatial and temporal changes in penetration depth, surface curvature, and force. To do this, clouds of thousands of 3-D points are reduced in dimensionality into stacks of ellipses, to be more readily comparable between participants and trials. To evaluate the robustness of the derived 3-D metrics, human subjects experiments are performed with stimulus pairs varying in compliance and discriminability. The results indicate that metrics such as penetration depth and surface curvature can distinguish compliances earlier, at less displacement. Observed also are distinct modes of skin deformation, for contact with stiffer objects, versus softer objects that approach the skin's compliance. These observations of the skin's deformation may guide the design and control of haptic actuation.
Our perception of compliance is informed by multi-dimensional tactile cues. Compared with stationary cues at terminal contact, time-dependent cues may afford optimal efficiency, speed, and fidelity. In this work, we investigate strategies by which temporal cues may encode compliances by modulating our exploration time. Two potential perceptual strategies are considered, inspired by memory representations within and between explorations. For either strategy, we introduce a unique computational approach. First, a curve similarity analysis, of accumulating touch force between sequentially explored compliances, generates a minimum time for discrimination. Second, a Kalman filtering approach derives a recognition time from progressive integration of stiffness estimates over time within a single exploration. Human-subjects experiments are conducted for both single finger touch and pinch grasp. The results indicate that for either strategy, by employing a more natural pinch grasp, time-dependent cues afford greater efficiency by reducing the exploration time, especially for harder objects. Moreover, compared to single finger touch, pinch grasp improves discrimination rates in judging plum ripeness. The time-dependent strategies as defined here appear promising, and may tie with the time-scales over which we make perceptual judgments.
We need to understand the physics of how the skin of the finger pad deforms, and their tie to perception, to accurately reproduce a sense of compliance, or 'softness,' in tactile displays. Contact interactions with compliant materials are distinct from those with rigid surfaces where the skin flattens completely. To capture unique patterns in skin deformation over a range of compliances, we developed a stereo imaging technique to visualize the skin through optically clear stimuli. Accompanying algorithms serve to locate and track points marked with ink on the skin, correct for light refraction through stimuli, and estimate aspects of contact between skin and stimulus surfaces. The method achieves a 3-D spatial resolution of 60-120 microns and temporal resolution of 30 frames per second. With human subjects, we measured the skin's deformation over a range of compliances (61-266 kPa), displacements (0-4 mm), and velocities (1- 15 mm/s). The results indicate that the method can differentiate patterns of skin deformation between compliances, as defined by metrics including surface penetration depth, retention of geometric shape, and force per gross contact area. Observations of biomechanical cues of this sort are key to understanding the perceptual encoding of compliance.
Distinguishing an object's compliance, into percepts of "softness" and "hardness," is crucial to our ability to grasp and manipulate it. Biomechanical cues at the skin's surface such as contact area and force rate have been thought to help encode compliance. However, no one has directly measured contact area with compliant materials, and few studies have considered compliances softer than the fingerpad. Herein, we developed a novel method to precisely measure the area in contact between compliant stimuli and the fingerpad, at given levels of force and displacement. To determine the method's robustness, we conducted psychophysical and biomechanical experiments with human subjects. The results indicate that cues including contact area at stimulus peak force of 3 Newtons, force rate over stimulus movement and at peak force, displacement and/or time to reach peak force may help in discriminating compliances while the directional spread of contact area is less important. Between softer and harder compliances, some cues were slightly more evident, though not yet definitively. Based upon the method's utility, the next step is to conduct broader experiments to distill the mixture of cues that encode compliance. The importance of such work lies in building haptic displays, for example, to render virtual tissues.