Machine Learning::Embedding

Alignment and Uniformity

#Representation #Machine Learning #Contrastive Representation Learning

A good representation should be able to separate different instances and cluster similar instances.

CBOW: Continuous Bag of Words

#Word2vec

Use the context to predict the center word

Negative Sampling

#Word2vec

negative sampling makes the calculations faster

skipgram: Continuous skip-gram

#Word2vec

Use the center word to predict the context