OpenAI unveils CLIP, a zero-shot image classifier

OpenAI released CLIP on 5 January 2021, a model trained on 400 million image and text pairs to place both in a shared representation. It could sort images into categories it had never been trained on by matching them against written descriptions of the candidate labels.

Why it mattered Text-image matching became a standard part of guiding and scoring image generators, including the diffusion models released after 2021.