Predictive Coding

4 Contrastive Predictive Coding

#Self-supervised Learning #Contrastive Model #Mutual Information #Contrastive #Predictive Coding #Basics

Contrastive Predictive Coding, aka CPC, is an autoregressive model combined with InfoNCE loss1. …