NotesByLex

Generative Adversarial Network

A Generative Adversarial Network (GAN) is a type of Generative Model made up of two neural networks trained against each other: a generator, which turns random noise into fake samples, and a discriminator, which tries to tell real samples from generated ones.

The generator is trained to fool the discriminator, while the discriminator is trained to catch it out, so over time the generated samples get more realistic. GANs were introduced by Ian Goodfellow and colleagues in 2014, and were the leading approach for image generation until Diffusion Models caught up with them. The adversarial idea is still widely used as a training loss in other models, like VQ-GAN and HiFi-GAN.