masked-autoencoder

[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

ssl deep-learning convnet cnn pytorch convolutional-neural-networks object-detection bert iclr mae instance-segmentation mask-rcnn sparse-convolution self-supervised-learning pre-trained-model pretrain pretraining masked-autoencoder masked-image-modeling iclr2023

Updated Jan 23, 2024
Python

EdisonLeeeee / Awesome-Masked-Autoencoders

Star 856

A collection of literature after or concurrent with Masked Autoencoder (MAE) (Kaiming He el al.).

mae self-supervised-learning masked-autoencoder

Updated Jul 10, 2024

Lupin1998 / Awesome-MIM

Star 345

[Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)

computer-vision deep-learning awesome-list gpt representation-learning bert mae generative-models self-supervised-learning pre-training masked-autoencoder vision-transformer masked-image-modeling awesome-mim masked-modeling

Updated Apr 23, 2025
Python

uncbiag / SimpleClick

Star 245

SimpleClick: Interactive Image Segmentation with Simple Vision Transformers (ICCV 2023)

pytorch interactive-segmentation masked-autoencoder vision-transformers

Updated Aug 5, 2025
Python

implus / UM-MAE

Star 244

Official Codes for "Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality"

coco mae ade20k self-supervised-learning masked-autoencoder imagenet-classification pyramid-vision-transformer swin-transformer masked-image-modeling hierarchical-vision-transformer

Updated Dec 3, 2022
Jupyter Notebook

implus / mae_segmentation

Star 168

reproduction of semantic segmentation using masked autoencoder (mae)

vit semantic-segmentation mae self-supervised-learning masked-autoencoder vision-transformer

Updated Feb 3, 2022
Python

xyzforever / BEVT

Star 164

PyTorch implementation of BEVT (CVPR 2022) https://arxiv.org/abs/2112.01529

deep-learning pytorch bert action-recognition video-understanding video-representation-learning self-supervised-learning masked-autoencoder foundation-models

Updated Jul 19, 2022
Python

ruiwang2021 / mvd

Star 133

[CVPR2023] Masked Video Distillation: Rethinking Masked Feature Modeling for Self-supervised Video Representation Learning (https://arxiv.org/abs/2212.04500)

action-recognition video-understanding video-representation-learning self-supervised-learning masked-autoencoder vision-transformer cvpr2023

Updated May 21, 2023
Python

TonyLianLong / CrossMAE

Star 121

Official Implementation of the CrossMAE paper: Rethinking Patch Dependence for Masked Autoencoders

computer-vision deep-learning mae self-supervised-learning masked-autoencoder

Updated Apr 10, 2025
Python

nttcslab / m2d

Star 119

Masked Modeling Duo: Towards a Universal Audio Pre-training Framework

audio self-supervised-learning masked-autoencoder masked-modeling-duo

Updated Sep 23, 2025
Jupyter Notebook

NeRF-MAE

zubair-irshad / NeRF-MAE

Star 103

[ECCV 2024] Pytorch code for our ECCV'24 paper NeRF-MAE: Masked AutoEncoders for Self-Supervised 3D Representation Learning for Neural Radiance Fields