masked-image-modeling

[ICLR'23 Spotlight🔥] The first successful BERT/MAE-style pretraining on any convolutional network; Pytorch impl. of "Designing BERT for Convolutional Networks: Sparse and Hierarchical Masked Modeling"

ssl deep-learning convnet cnn pytorch convolutional-neural-networks object-detection bert iclr mae instance-segmentation mask-rcnn sparse-convolution self-supervised-learning pre-trained-model pretrain pretraining masked-autoencoder masked-image-modeling iclr2023

UpdatedJan 23, 2024
Python

microsoft /SimMIM

Star983

This is an official implementation for "SimMIM: A Simple Framework for Masked Image Modeling".

image-classification self-supervised-learning swin-transformer masked-image-modeling

UpdatedSep 29, 2022
Python

Westlake-AI /openmixup

Star651

CAIRI Supervised, Semi- and Self-Supervised Visual Representation Learning Toolbox and Benchmark

benchmark machine-learning deep-learning pytorch data-generation semi-supervised-learning imagenet awesome-list data-augmentation mixup self-supervised-learning image-classifcation automix contrastive-learning vision-transformer masked-image-modeling awesome-mixup awesome-mim

UpdatedApr 9, 2025
Python

Alpha-VL /ConvMAE

Star508

ConvMAE: Masked Convolution Meets Masked Autoencoders

computer-vision backbone object-detection semantic-segmentation mae masked-image-modeling

UpdatedMar 14, 2023
Python

hustvl /MIMDet

Star342

[ICCV 2023] You Only Look at One Partial Sequence

computer-vision transformer object-detection mae instance-segmentation vision-transformer masked-image-modeling

UpdatedOct 21, 2023
Python

Lupin1998 /Awesome-MIM

Star336

[Survey] Masked Modeling for Self-supervised Representation Learning on Vision and Beyond (https://arxiv.org/abs/2401.00897)

computer-vision deep-learning awesome-list gpt representation-learning bert mae generative-models self-supervised-learning pre-training masked-autoencoder vision-transformer masked-image-modeling awesome-mim masked-modeling

UpdatedApr 23, 2025
Python

implus /UM-MAE

Star242

Official Codes for "Uniform Masking: Enabling MAE Pre-training for Pyramid-based Vision Transformers with Locality"

coco mae ade20k self-supervised-learning masked-autoencoder imagenet-classification pyramid-vision-transformer swin-transformer masked-image-modeling hierarchical-vision-transformer

UpdatedDec 3, 2022
Jupyter Notebook

lxtGH /CAE

Star198

This is a PyTorch implementation of “Context AutoEncoder for Self-Supervised Representation Learning"

self-supervised-learning masked-image-modeling context-autoencoder

UpdatedJan 11, 2023
Python

LayneH /GreenMIM

Star173

[NeurIPS2022] Official implementation of the paper 'Green Hierarchical Vision Transformer for Masked Image Modeling'.

pytorch self-supervised-learning efficient-deep-learning vision-transformer masked-image-modeling

UpdatedJan 16, 2023
Python

Sense-X /MixMIM

Star143

MixMIM: Mixed and Masked Image Modeling for Efficient Visual Representation Learning

transformer masked-image-modeling

UpdatedJul 2, 2023
Python

dvlab-research /MOOD

Star134

Official PyTorch implementation of MOOD series: (1) MOODv1: Rethinking Out-of-distributionDetection: Masked Image Modeling Is All You Need. (2) MOODv2: Masked Image Modeling for Out-of-Distribution Detection.

pytorch outlier-detection ood-detection masked-image-modeling cvpr2023