cards/information/mutual-information.md

1 Contrastive Model

#Self-supervised Learning #Contrastive Model #Basics

Contrastive models learn to compare1. Contrastive use special objective functions such as [[NCE]] …

2 Contrastive Model: Context-Instance

#Self-supervised Learning #Contrastive Model #Mutual Information #Basics

In contrastive methods, we can manipulate the data to create data entries and infer the changes …

3 infoGAN

#Self-supervised Learning #Adversarial Model #GAN #Basics

In GAN, the latent space input is usually random noise, e.g., Gaussian noise. The objective of …

4 Deep Infomax

#Self-supervised Learning #Contrastive Model #Mutual Information #Deep Infomax #Basics

Max Global Mutual Information Why not just use the global mutual information of the input and …