Generative Model

1 An Introduction to Generative Models

#Self-supervised Learning #Generative Model #Basics

Discriminative model: The conditional probability of class label on data (posterior) $p(C_k\mid x)$ …

2 Generative Model: Autoregressive Model

#Self-supervised Learning #Generative Model #Autoregressive Model #Basics

An autoregressive (AR) model is autoregressive, $$ \begin{equation} \log p_\theta (x) = \sum_{t=1}^T …

3 Generative Model: Normalizing Flow

#Self-supervised Learning #Generative Model #Normalizing Flow #Basics

Normalizing flow is a method to convert a complicated distribution $p(x)$ to a simpler distribution …

4 Generative Model: Auto-Encoder

#Self-supervised Learning #Generative Model #Auto-Encoder #Basics

Autoencoders (AE) are machines that encodes inputs into a compact latent space. The simplest …

5 Variational Auto-Encoder

#Self-supervised Learning #Generative Model #VAE #Basics

In an inference problem, $p(z\vert x)$, which is used to infer $z$ from $x$. $$ p(z\vert x) = …