wiki/machine-learning/contrastive-models/context-instance.md

4 Contrastive Predictive Coding

#Self-supervised Learning #Contrastive Model #Mutual Information #Contrastive #Predictive Coding #Basics

Contrastive Predictive Coding, aka CPC, is an autoregressive model combined with InfoNCE loss1. …

4 Deep Infomax

#Self-supervised Learning #Contrastive Model #Mutual Information #Deep Infomax #Basics

Max Global Mutual Information Why not just use the global mutual information of the input and …