Idea
Standard MAE masking treats every patch equally. For faces, identity lives in a few regions. This study asks whether steering the masking policy toward those regions produces better face representations — without touching the encoder–decoder.
Controlled comparison
- Random, block-wise and face-aware (landmark-guided) masking under one CelebA setup (90/10 split).
- Evaluated with validation loss, localized reconstruction error, ablations, linear probing and zero-shot evaluation.
Result
Face-aware masking reduced identity-critical reconstruction error by 17.5% against block-wise masking while adding zero model parameters — only the masking policy changed.