A dataset to evaluate the representations learned by video prediction models

Ryan Szeto, Simon Stent, German Ros, Jason J. Corso

Research output: Contribution to conferencePaperpeer-review

1 Scopus citations

Abstract

We present a parameterized synthetic dataset called Moving Symbols to support the objective study of video prediction networks. Using several instantiations of the dataset in which variation is explicitly controlled, we highlight issues in an existing state-of-the-art approach and propose the use of a performance metric with greater semantic meaning to improve experimental interpretability. Our dataset provides canonical test cases that will help the community better understand, and eventually improve, the representations learned by such networks in the future. Code is available at https://github.com/rszeto/moving-symbols.

Original languageEnglish
StatePublished - 2018
Event6th International Conference on Learning Representations, ICLR 2018 - Vancouver, Canada
Duration: 30 Apr 20183 May 2018

Conference

Conference6th International Conference on Learning Representations, ICLR 2018
Country/TerritoryCanada
CityVancouver
Period30/04/183/05/18

Fingerprint

Dive into the research topics of 'A dataset to evaluate the representations learned by video prediction models'. Together they form a unique fingerprint.

Cite this