May 9, 2012 @ 14:30, Room: Ballroom G
Chair: Ken Hinckley, Microsoft Research, USA
iRotate: Automatic Screen Rotation based on Face Orientation - Paper
Contribution & Benefit: Our paper makes two contributions: 1) a new approach to automatic screen rotation based on users' face orientation instead of device orientation, 2) quantified the feasibility of using front-camera based approach.
Abstract » We present iRotate, an approach to automatically rotate screens on mobile devices to match users' face orientation. Current approaches to automatic screen rotation are based on gravity and device orientation. Our survey of 513 users shows that 42% currently experience auto-rotation that leads to incorrect viewing orientation several times a week or more, and 24% find the problem to be very serious to extremely serious. iRotate augments gravity-based approach, and uses front cameras on mobile devices to detect users' faces and rotates screens accordingly. It requires no explicit user input and supports different user postures and device orientations. We have implemented a iRotate that works in real-time on iPhone and iPad, and we assess the accuracy and limitations of iRotate through a 20- participant feasibility study.
ACMLooking At You: Fused Gyro and Face Tracking for Viewing Large Imagery on Mobile Devices - Paper
Contribution & Benefit: Describes a touch-free interface for viewing large imagery on mobile devices, using a sensor fusion methodology that combines face tracking with gyroscope data.
Abstract » We present a touch-free interface for viewing large imagery
on mobile devices. In particular, we focus on viewing paradigms
for 360 degree panoramas, parallax image sequences, and
long multi-perspective panoramas. We describe a sensor fusion
methodology that combines face tracking using a frontfacing
camera with gyroscope data to produce a robust signal
that defines the viewer's 3D position relative to the display.
The gyroscopic data provides both low-latency feedback and
allows extrapolation of the face position beyond the the fieldof-
view of the front-facing camera. We also demonstrate a
hybrid position and rate control that uses the viewer�s 3D position
to drive exploration of very large image spaces. We
report on the efficacy of the hybrid control vs. position only
control through a user study.
ACMon mobile devices. In particular, we focus on viewing paradigms
for 360 degree panoramas, parallax image sequences, and
long multi-perspective panoramas. We describe a sensor fusion
methodology that combines face tracking using a frontfacing
camera with gyroscope data to produce a robust signal
that defines the viewer's 3D position relative to the display.
The gyroscopic data provides both low-latency feedback and
allows extrapolation of the face position beyond the the fieldof-
view of the front-facing camera. We also demonstrate a
hybrid position and rate control that uses the viewer�s 3D position
to drive exploration of very large image spaces. We
report on the efficacy of the hybrid control vs. position only
control through a user study.
User Learning and Performance with Bezel Menus - Paper
Contribution & Benefit: Describes the performance of different bezel menu layouts. Using the results, presents a bezel-based text entry technique for eyes-free interaction with the phone. Concludes with design implications for bezel menus.
Abstract » Touchscreen phones tend to require constant visual attention, thus not allowing eyes-free interaction. For users with visual impairment, or when occupied with another task that requires a user's visual attention, these phones can be difficult to use. Recently, marks initiating from the bezel, the physical touch-insensitive frame surrounding a touchscreen display, have been proposed as a method for eyes-free interaction. Due to the physical form factor of the mobile device, it is possible to access different parts of the bezel eyes-free. In this paper, we first studied the performance of different bezel menu layouts. Based on the results, we designed a bezel-based text entry application to gain insights into how bezel menus perform in a real-world application. From a longitudinal study, we found that the participants achieved 9.2 words per minute in situations requiring minimal visual attention to the screen. After only one hour of practice, the participants transitioned from novice to expert users. This shows that bezel menus can be adopted for realistic applications.
ACMDetermining the Orientation of Proximate Mobile Devices using their Back Facing Camera - Note
Contribution & Benefit: Novel method to determine the relative orientation or proximate mobile device using only their backside camera. We implemented this method as a service to provide orientation information to mobile applications.
Abstract » Proximate mobile devices that are aware of their orientation relative to one another can support novel and natural forms of interaction. In this paper, we present a method to determine the relative orientation of proximate mobile devices using only the backside camera. We implemented this method as a service called Orienteer, which provides mobile device with the orientation of other proximate mobile devices. We demonstrate that orientation information can be used to enable novel and natural interactions by developing two applications that allow the user to push content in the direction of another device to share it and point the device toward another to filter content based on the device’s owner. An informal evaluation revealed that interactions built upon orientation information can be natural and compelling to users, but developers and designers need to carefully consider how orientation should be applied effectively.
ACMPhone as a Pixel: Enabling Ad-Hoc, Large-Scale Displays Using Mobile Devices - Note
Contribution & Benefit: We present system for creating large displays from a collection of smaller devices, opening opportunities for creating large displays using individuals mobile phones at events such as conferences and concerts.
Abstract » We present Phone as a Pixel: a scalable, synchronization-free, platform-independent system for creating large, ad-hoc displays from a collection of smaller devices. In contrast to most tiled-display systems, the only requirement for participation is for devices to have an internet connection and a web browser. Thus, most smartphones, tablets, laptops and similar devices can be used. Phone as a Pixel uses a color-transition encoding scheme to identify and locate displays. This approach has several advantages: devices can be arbitrarily arranged (i.e., not in a grid) and infrastructure consists of a single conventional camera. Further, additional devices can join at any time without re-calibration. These are desirable properties to enable collective displays in contexts like sporting events, concerts and political rallies. In this paper we describe our system, show results from proof-of-concept setups, and quantify the performance of our approach on hundreds of displays.
ACM