Learning to Select and Order Vacation Photographs

Authors

Fereshteh Sadeghi (Disney Research Pittsburgh)
J.Rafael Tena (Disney Research Pittsburgh)
Ali Farhadi (University of Washington)
Leonid Sigal (Disney Research Pittsburgh)

IEEE Workshop on the Applications of Computer Vision (WACV) 2015

January 6, 2015

Learning to Select and Order Vacation Photographs-Image

We propose the problem of automated photo album creation from an unordered image collection. The problem is difficult as it involves a number of complex perceptual tasks that facilitate selection and ordering of photos to create a compelling visual narrative. To help solve this problem, we collect (and will make available) a new benchmark dataset based on Flickr images. Flickr Album Dataset and provides a variety of annotations useful for the task, including manually created albums of various lengths. We analyze the problem and provide experimental evidence, through user studies, that both selection and ordering of photos within an album is important for human observers. To capture and learn rules of album composition, we propose a discriminative structured model capable of encoding simple preferences for contextual layout of the scene (e.g., spatial layout of faces, global scene context, and presence/absence of attributes) and ordering between photos (e.g., exclusion principles or correlations). The parameters of the model are learned using a structured SVM framework. Once learned, the model allows automatic composition of photo albums from unordered and untagged collections of images. We quantitatively evaluate the results obtained using our model against manually created albums and baselines on a dataset of 63 personal photo collections from 5 different topics.

Download Vacation Photographs Dataset

The data set contains five different collections which include, beach vacations, Disney trips, London, Paris, and Washington DC. The set consists of a collection of five locations that include text files that contain links to Flickr images, album annotations and time ordering. There are no actual images on the set.

Download File "Learning to Select and Order Vacation Photographs-Paper"
[pdf, 4.24 MB]

Additional files

Download additional file "Learning to Select and Order Vacation Photographs-Supp Material"
[pdf, 7.15 MB]

Copyright Notice

The documents contained in these directories are included by the contributing authors as a means to ensure timely dissemination of scholarly and technical work on a non-commercial basis. Copyright and all rights therein are maintained by the authors or by other copyright holders, notwithstanding that they have offered their works here electronically. It is understood that all persons copying this information will adhere to the terms and constraints invoked by each author's copyright. These works may not be reposted without the explicit permission of the copyright holder.