awesome-MIM

Reading list for research topics in Masked Image Modeling(MIM).

We list the most popular methods for MIM, if I missed something, please submit a request. (Note: We show the date of the first version of Arxiv here. But the link of paper may be not the early version.)

Self-supervied Vision Transformers as backbone models.

Date	Method	Conference	Title	Code
2021-06-14	BeiT	ICLR 2022(Oral)	BEiT: BERT Pre-Training of Image Transformers	BeiT
2021-11-11	MAE	Arxiv 2021	Masked Autoencoders Are Scalable Vision Learners	MAE
2021-11-15	iBoT	Arxiv 2021	iBOT: Image BERT Pre-Training with Online Tokenizer	iBoT
2021-11-18	SimMIM	Arxiv 2021	SimMIM: A Simple Framework for Masked Image Modeling	SimMIM
2021-12-16	MaskFeat	Arxiv 2021	Masked Feature Prediction for Self-Supervised Visual Pre-Training	None
2021-12-20	SplitMask	Arxiv 2021	Are Large-scale Datasets Necessary for Self-Supervised Pre-training?	None
2022-01-31	ADIOS	Arxiv 2022	Adversarial Masking for Self-Supervised Learning	None
2022-02-07	CAE	Arxiv 2022	Context Autoencoder for Self-Supervised Representation Learning	None
2022-02-07	CIM	Arxiv 2022	Corrupted Image Modeling for Self-Supervised Visual Pre-Training	None

Reading list for research topics in Masked Image Modeling

Related tags

Overview

awesome-MIM

Self-supervied Vision Transformers as backbone models.

Owner

ligang

PyMove is a Python library to simplify queries and visualization of trajectories and other spatial-temporal data

Meta Representation Transformation for Low-resource Cross-lingual Learning

This repository contains the scripts for downloading and validating scripts for the documents

Deep Anomaly Detection with Outlier Exposure (ICLR 2019)

Open source person re-identification library in python

Reverse engineering recurrent neural networks with Jacobian switching linear dynamical systems

Unified Instance and Knowledge Alignment Pretraining for Aspect-based Sentiment Analysis

Deep learning toolbox based on PyTorch for hyperspectral data classification.

Feup-csr - Repository holding my group's submission to the CSR project competition

HGCN: Harmonic Gated Compensation Network For Speech Enhancement

Lite-HRNet: A Lightweight High-Resolution Network

Tandem Mass Spectrum Prediction with Graph Transformers

This project demonstrates the use of neural networks and computer vision to create a classifier that interprets the Brazilian Sign Language.

Semantic Segmentation in Pytorch

Hierarchical Attentive Recurrent Tracking

Linear algebra python - Number of operations and problems in Linear Algebra and Numerical Linear Algebra

[ICCV 2021] FaPN: Feature-aligned Pyramid Network for Dense Image Prediction

modelvshuman is a Python library to benchmark the gap between human and machine vision

A Next Generation ConvNet by FaceBookResearch Implementation in PyTorch(Original) and TensorFlow.

Simultaneous NMT/MMT framework in PyTorch