Computer VisionPaper

Face-Aware MAE

Identity-aware masked autoencoding: instead of masking random blocks, point MAE pre-training at the eyes, nose, mouth and central facial structure — and change nothing else.

identity-critical reconstruction error
−17.5%
added parameters
0
masking strategies compared
3
CelebA split
90/10

Idea

Standard MAE masking treats every patch equally. For faces, identity lives in a few regions. This study asks whether steering the masking policy toward those regions produces better face representations — without touching the encoder–decoder.

Controlled comparison

  • Random, block-wise and face-aware (landmark-guided) masking under one CelebA setup (90/10 split).
  • Evaluated with validation loss, localized reconstruction error, ablations, linear probing and zero-shot evaluation.

Result

Face-aware masking reduced identity-critical reconstruction error by 17.5% against block-wise masking while adding zero model parameters — only the masking policy changed.