Self-supervised learning: The dark matter of intelligence
In recent years, the AI field has made tremendous progress in developing AI systems that can learn from massive amounts of carefully labeled data. This paradigm of supervised learning has a proven track record for training specialist models that perform extremely well on the task they were trained to do. Unfortunately, there’s a limit to how far the field of AI can go with supervised learning alone.
Source: Self-supervised learning: The dark matter of intelligence, an article by Yann LeCun and Ishan Misra.