Inferring Artistic Intention in Comic Art through Viewer Gaze

Project Members

Jessica Hodgins (Disney Research Los Angeles, Disney Research Pittsburgh)
Yaser Sheikh (Carnegie Mellon University)
Eakta Jain (Carnegie Mellon University)


Comics are a compelling, though complex, visual storytelling medium. Researchers are interested in the process of comic art creation to be able to automatically tell new stories, and also, summarize videos and catalog large collections of photographs for example. A primary organizing principle used by artists to lay out the components of comic art (panels, word bubbles, objects inside each panel) is to lead the viewer’s attention along a deliberate visual route that reveals the narrative. If artists are successful in leading viewer attention, then their intended visual route would be accessible through recorded viewer attention, i.e., eyetracking data. In this project, we conduct an experiment to establish if artists are successful in their goal of leading viewer gaze. We eyetrack viewers on images taken from comic books, as well as photographs taken by experts, amateur photographers and a robot. Our data analyses show that there is increased consistency in viewer gaze for comic pictures versus photographs taken by a robot and by amateur photographers, thus confirming that comic artists do indeed direct the flow of viewer attention.


Using Gaze Data to Predict Camera Moves on Stills for Sequential Art-Thumbnail

Using Gaze Data to Predict Camera Moves on Stills for Sequential Art
August 3, 2012
ACM Symposium on Applied Perception in Graphics and Visualization (ACM APGV) 2012
Paper File [pdf, 20.27 MB]

Copyright Notice

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.