Skip to main navigation Skip to search Skip to main content

Alternating back-propagation for generator network

  • Tian Han
  • , Yang Lu
  • , Song Chun Zhu
  • , Ying Nian Wu
    • University of California at Los Angeles

    Research output: Contribution to conference › Paper › peer-review

    104 Scopus citations

    Abstract

    This paper proposes an alternating back-propagation algorithm for learning the generator network model. The model is a nonlinear generalization of factor analysis. In this model, the mapping from the continuous latent factors to the observed signal is parametrized by a convolutional neural network. The alternating back-propagation algorithm iterates the following two steps: (1) Inferential back-propagation, which infers the latent factors by Langevin dynamics or gradient descent. (2) Learning back-propagation, which updates the parameters given the inferred latent factors by gradient descent. The gradient computations in both steps are powered by back-propagation, and they share most of their code in common. We show that the alternating back-propagation algorithm can learn realistic generator models of natural images, video sequences, and sounds. Moreover, it can also be used to learn from incomplete or indirect training data.

    Original languageEnglish
    Pages1976-1984
    Number of pages9
    StatePublished - 2017
    Event31st AAAI Conference on Artificial Intelligence, AAAI 2017 - San Francisco, United States
    Duration: 4 Feb 2017 → 10 Feb 2017

    Conference

    Conference31st AAAI Conference on Artificial Intelligence, AAAI 2017
    Country/TerritoryUnited States
    CitySan Francisco
    Period4/02/17 → 10/02/17

    Fingerprint

    Dive into the research topics of 'Alternating back-propagation for generator network'. Together they form a unique fingerprint.

    Cite this