Data2vec 2.0: Highly efficient self-supervised learning for vision, speech and text
We created data2vec 2.0, a general self-supervised AI algorithm for speech, vision, and text that can train models 16x faster than the most popular existing algorithm for images while achieving the same accuracy.