MAE: Mask Most of the Image, Reconstruct Pixels, Get a Strong ViT Encoder
He et al. mask a large fraction of patches, encode the visible few, and decode pixels with a light decoder. Why 75% masking is the point, and how MAE pretraining changed vision self-supervision.
3 min read