In Pursuit of Pixel Supervision for Visual Pre-training
IntermediateLihe Yang, Shang-Wen Li et al.Dec 17arXiv
Pixels are the raw stuff of images, and this paper shows you can learn great vision skills by predicting pixels directly, not by comparing fancy hidden features.
#pixel supervision#masked autoencoders#MAE redesign