Contrastive Model

1 Contrastive Model

#Self-supervised Learning #Contrastive Model #Basics

Contrastive models learn to compare1. Contrastive use special objective functions such as [[NCE]] …

2 Contrastive Model: Context-Instance

#Self-supervised Learning #Contrastive Model #Mutual Information #Basics

In contrastive methods, we can manipulate the data to create data entries and infer the changes …

3 Contrastive Model: Instance-Instance

#Self-supervised Learning #Contrastive Model #Basics

It was discovered that the success of [[mutual information based contrastive learning]] Contrastive …

4 Contrastive Predictive Coding

#Self-supervised Learning #Contrastive Model #Mutual Information #Contrastive #Predictive Coding #Basics

Contrastive Predictive Coding, aka CPC, is an autoregressive model combined with InfoNCE loss1. …

4 Deep Infomax

#Self-supervised Learning #Contrastive Model #Mutual Information #Deep Infomax #Basics

Max Global Mutual Information Why not just use the global mutual information of the input and …