An interface for virtual 3D sculpting via physical proxy

We explore the design space of using direct finger input in conjunction with a deformable physical prop for the creation and manipulation of conceptual 3D geometric models. The user sculpts virtual models by manipulating the space on, into, and around the physical prop, in an extension of the types of manipulations one would perform on traditional modeling media such as clay or foam. The prop acts as a proxy to the virtual model and hence as a frame of reference to the user's fingers. A prototype implementation uses camera-based motion tracking technology to track passive markers on the fingers and prop. The interface supports a variety of clay-like sculpting operations including deforming, smoothing, pasting, and extruding. All operations are performed using the unconstrained fingers, with command input enabled by a small set of finger gestures coupled with on-screen widgets.