Alignment and Uniformity

A good representation should be able to

  • separate different instances, and
  • cluster similar instances.

Wang et al proposed two concepts that matches the above two ideas, alignment and uniformity, on a hypersphere1.

From Wang et al

From Wang et al

  1. Wang T, Isola P. Understanding Contrastive Representation Learning through Alignment and Uniformity on the Hypersphere. arXiv [cs.LG]. 2020. Available: ↩︎

Planted: by ;

L Ma (2021). 'Alignment and Uniformity', Datumorphism, 09 April. Available at: