Project Members

Karl D. D. Willis (Disney Research Pittsburgh)
Takaaki Shiratori (Disney Research Pittsburgh)
Moshe Mahler (Disney Research Pittsburgh)

How can projected imagery traverse the digital-physical divide to interact with physical objects and surfaces in the environment? HideOut explores how mobile projectors can enable new forms of interaction with digital content projected on everyday objects such as books, walls, game boards, tables, and many others.

We enable seamless interaction between the digital and physical world using specially formulated infrared-absorbing markers – hidden from the human eye, but visible to a camera embedded in a compact mobile projection device. Digital imagery directly augments and responds to the physical objects it is projected on, such as an animated character interacting with printed graphics in a storybook.

HideOut further extends our work towards a new ‘game projector’ paradigm where the real world becomes a digital playground.


HideOut Interactive Book

Story books are enhanced with interactive content in a lightweight and exploratory way.

HideOut Board Game

Board game pieces are brought to life with interactive projected imagery.

HideOut Device

Our prototype device consists of a mobile projector, a camera, an infrared illumination source, and a button.

HideOut Shooting Game

Hidden markers in the environment are used as targets in a shooting game.

HideOut Photo Viewer

Scrolling through photos that are dynamically aligned to the environment.

HideOut Interactive Book Markers

Hidden markers embedded in an interactive storybook.

HideOut Board Game Markers

Hidden markers are tracked in the infrared spectrum to identify board pieces.

HideOut Board Game Interaction

A projected character responds to board game pieces to teleport over a wall that stands in its way.

HideOut Riding

Projected characters can be registered so they appear to ‘pop up’ from the environment.

HideOut Markers

Markers printed with infrared-absorbing ink are hidden to the eye and can be overprinted with graphics.

Copyright Notice

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.