Factorized Variational Autoencoders for Modeling Audience Reactions to Movies
Zhiwei Deng (Simon Fraser University)
Rajitha Navarantha (Disney Research Pittsburgh)
Peter Carr (Disney Research Pittsburgh)
Stephan Mandt (Disney Research Pittsburgh)
Yisong Yue (Caltech)
Iain Matthews (Disney Research Pittsburgh)
Greg Mori (Simon Fraser University)
IEEE Conference on Computer Vision and Pattern Recognition (CVPR) 2017
July 21, 2017
Matrix and tensor factorization methods are often used for finding underlying low-dimensional patterns from noisy data. In this paper, we study non-linear tensor factorization methods based on deep variational autoencoders. Our approach is well-suited for settings where the relationship between the latent representation to be learned and the raw data representation is highly complex. We apply our approach to a large dataset of facial expressions of movie-watching audiences (over 16 million faces). Our experiments show that compared to conventional linear factorization methods, our method achieves better reconstruction of the data, and further discovers interpretable latent factors.
Download File "Factorized Variational Autoencoders for Modeling Audience Reactions to Movies-Paper"
[pdf, 6.92 MB]
Download additional file "Supplemental-Material – Factorized Variational Autoencoders for Modeling Audience Reactions to Movies"
[pdf, 1.00 MB]