SideBySide

Disney Research, Pittsburgh

SideBySide is a novel interactive system that allows multiple people to play and work together using handheld projectors at anytime and anyplace. The system is immediate and simple: users simply project onto a surface and their projection becomes aware and responsive to other projections nearby. Interaction can range from projector-based games, such as boxing with projected characters, to everyday tasks such as exchanging contact information by ‘dragging and dropping’ onto another user’s projection.

Importantly, SideBySide does not require any fixed sensing in the environment and can be used anywhere: at home, at the office, or even inside the car during long road trips. The system consists of a hybrid mobile projector that outputs both visible and invisible projections at the same time. The invisible projection contains tracking data that can be recognized by the device camera, allowing accurate location tracking of multiple projections and lightweight communication between devices.

Research Paper

SideBySide: Ad-hoc Multi-user Interaction with Handheld Projectors

Willis, K. D.D., Poupyrev, I., Hudson, S. E., and Mahler, M. SideBySide: Ad-hoc Multi-user Interaction with Handheld Projectors. In Proc. ACM UIST (2011).
Paper [PDF, 2.2MB]

Awards


Best Paper Award at UIST 2011
Best Demo Award at UIST 2011

Team and Credits

The SideBySide project has been developed at Disney Research Pittsburgh and the Computational Design Lab / DevLabCarnegie Mellon University by Karl D.D. Willis, Ivan Poupyrev, Scott Hudson, and Moshe Mahler.

Contact

Email: drinfo [at] disneyresearch [dot] com

Gallery

SideBySide Mobile Projector Boxing

A two-player boxing game using the SideBySide system. Projected characters from each device are aware and responsive to each other.

SideBySide Concept

The SideBySide concept – a self-contained, full color, handheld projection device allowing multi-user interaction in almost any space.

SideBySide Prototype

The SideBySide prototype device.

SideBySide Applications

Example applications created with the SideBySide system.

SideBySide Prototype

Projecting visible and IR images in a single stream. The characters are visible to the user, and the markers are visible to the IR camera.

SideBySide System Overview

The SideBySide system overview.

SideBySide Projection Engine

The SideBySide projection engine.

Copyright Notice

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.