Discriminative self-supervised algorithms

The article discusses the theoretical understanding of self-supervised learning (SSL) methods like SimCLR, CLIP, and VicREG. The authors propose a generative latent variable model to explain the principle behind these…