Morphing & Tracking & Stacking: 3D Interaction


May 9, 2012 @ 16:30, Room: Ballroom E

Chair: Celine Latulipe, University of North Carolina at Charlotte, USA
KidCAD: Digitally Remixing Toys Through Tangible Tools - Paper
Community: design
Contribution & Benefit: We bring physical interaction to digital modeling, allowing children to use existing physical objects as tangible building blocks for new designs. We introduce KidCAD a digital clay interface for remixing toys.
Abstract » Children have great facility in the physical world, and can skillfully model in clay and draw expressive illustrations. Traditional digital modeling tools have focused on mouse, keyboard and stylus input. These tools may be complicated and difficult for young users to easily and quickly create exciting designs. We seek to bring physical interaction to digital modeling, to allow users to use existing physical objects as tangible building blocks for new designs. We introduce KidCAD a digital clay interface for children to remix toys. KidCAD allows children to imprint 2.5D shapes from physical objects into their digital models by deforming a malleable gel input device, deForm. Users can mashup existing objects, edit and sculpt or draw new designs on a 2.5D canvas using physical objects, hands and tools as well as 2D touch gestures. We report on a preliminary user study with 13 children, ages 7 to 10, which provides feedback for our design and helps guide future work in tangible modeling for children.
ClayVision: The (Elastic) Image of the City - Paper
Community: design
Contribution & Benefit: Describes an augmented reality city guide that communicates through real-time 3D transformations of buildings. Can spearhead critical reassessments and revisions of design metaphors for augmented reality applications.
Abstract » In this paper we describe ClayVision, a new quasi-immersive urban navigation system that rethinks the design conventions of existing Augmented Reality (AR) applications, by aggressively incorporating knowledge from non-Computer Science fields---namely Information Design and Urban Planning. Instead of the prevailing approach of pasting ``information bubbles'' onto the existing urban scenery, ClayVision communicates through real-time 3D transformations of city elements. In other words, the system dynamically probes and reassembles the city into a better-designed copy of the original, that is both easier to navigate and tailored to suit the user's needs and preferences. We provide extensive discussions that cover the technical details of the system, the types of city-morphing operations that can be effectively applied, and what people's experiences will be in the newly ``elastic'' city.
HoloDesk: Direct 3D Interactions with a Situated See-Through Display - Paper
Community: user experience
Contribution & Benefit: HoloDesk is an interactive system combining an optical see-through display and Kinect; enabling direct manipulation of 3D content. A new technique to model input from raw Kinect data is introduced.
Abstract » HoloDesk is an interactive system combining an optical see through display and Kinect camera to create the illusion that users are directly interacting with 3D graphics. A virtual image of a 3D scene is rendered through a half silvered mirror and spatially aligned with the real-world for the viewer. Users easily reach into an interaction volume displaying the virtual image. This allows the user to literally get their hands into the virtual display and to directly interact with an spatially aligned 3D virtual world, without the need for any specialized head-worn hardware or input device. We introduce a new technique for interpreting raw Kinect data to approximate and track rigid (e.g., books, cups) and non-rigid (e.g., hands, paper) physical objects and support a variety of physics-inspired interactions between virtual and real. In particular the algorithm models natural human grasping of virtual objects with more fidelity than previously demonstrated. A qualitative study highlights rich emergent 3D interactions, using hands and real-world objects. The implementation of HoloDesk is described in full, and example application scenarios explored. Finally, HoloDesk is quantitatively evaluated in a 3D target acquisition task, comparing the system with indirect and glasses-based variants.
DisplayStacks: Interaction Techniques for Stacks of Flexible Thin-Film Displays - Paper
Contribution & Benefit: Presents DisplayStacks, a paper computer that allows physical stacking of digital documents via piles of thin-film flexible E Ink displays, with associated interaction techniques.
Abstract » Stacking physical documents is one of the main forms of spatio-temporal organization of information. We present DisplayStacks, a system that enables physical stacking of digital documents via piles of flexible E Ink displays. With a conductive dot pattern sensor attached to the flexible display, we dynamically track the position and orientation of these displays in relation to one another. We introduce mechanisms for interacting with these physical stacks for access and manipulation of information using asymmetric bi-manual interactions, such as providing contextual overviews. Initial user experiences indicate a preference for linear overlaps as a stacking configuration.