A characteristic function approach to deep implicit generative modeling, Abdul Fatir Ansari★, Jonathan Scarlett, and Harold Soh★, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020
Links: Paper | Github

Implicit Generative Models (IGMs) such as GANs have emerged as effective data-driven models for generating samples, particularly images.

In this paper, we formulate the problem of learning an IGM as minimizing the expected distance between characteristic functions. Specifically, we minimize the distance between characteristic functions of the real and generated data distributions under a suitably-chosen weighting distribution. This distance metric, which we term as the characteristic function distance (CFD), can be (approximately) computed with linear time-complexity in the number of samples, in contrast with the quadratic-time Maximum Mean Discrepancy (MMD). By replacing the discrepancy measure in the critic of a GAN with the CFD, we obtain a model that is simple to implement and stable to train.

The proposed metric enjoys desirable theoretical properties including continuity and differentiability with respect to generator parameters, and continuity in the weak topology. We further propose a variation of the CFD in which the weighting distribution parameters are also optimized during training; this obviates the need for manual tuning, and leads to an improvement in test power relative to CFD.

We demonstrate experimentally that our proposed method outperforms WGAN and MMD-GAN variants on a variety of unsupervised image generation benchmarks.

Example on Celeb faces

Resources

You can find our paper here. Check out our repository here on github.

Citation

Please consider citing our paper if you build upon our results and ideas.

Abdul Fatir Ansari★, Jonathan Scarlett, and Harold Soh★, “A characteristic function approach to deep implicit generative modeling”, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020

@inproceedings{ansari2020characteristic,
title={A characteristic function approach to deep implicit generative modeling},
author={Ansari, Abdul Fatir and Scarlett, Jonathan and Soh, Harold},
booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
pages={7478--7487},
year={2020} } 

Contact

If you have questions or comments, please contact Fatir or Harold.


Acknowledgements


Written by

Abdul Fatir Ansari

I love Machine Learning!