Alignment and Uniformity
cards/machine-learning/embedding/alignment-and-uniformity.md Current Note ID: The unique ID of this note.
A good representation should be able to
- separate different instances, and
- cluster similar instances.
Wang et al proposed two concepts that matches the above two ideas, alignment and uniformity, on a hypersphere1.
Wang T, Isola P. Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere. arXiv [cs.LG]. 2020. Available: http://arxiv.org/abs/2005.10242 ↩︎
Planted: by L Ma;
L Ma (2021). 'Alignment and Uniformity', Datumorphism, 09 April. Available at: https://datumorphism.leima.is/cards/machine-learning/embedding/alignment-and-uniformity/.