This is the official implementation of the paper "Object Propagation via Inter-Frame Attentions for Temporally Stable Video Instance Segmentation".

Last update: May 03, 2022

Related tags

Deep Learning ObjProp

Overview

ObjProp

Introduction

This is the official implementation of the paper "Object Propagation via Inter-Frame Attentions for Temporally Stable Video Instance Segmentation".

Installation

This repo is built using mmdetection. To install the dependencies, first clone the repository locally:

git clone https://github.com/anirudh-chakravarthy/objprop.git

Then, install PyTorch 1.1.0, torchvision 0.3.0, mmcv 0.2.12:

conda install pytorch==1.1.0 torchvision==0.3.0 -c pytorch
pip install mmcv==0.2.12

Then, install the CocoAPI for YouTube-VIS

conda install cython scipy
pip install git+https://github.com/youtubevos/cocoapi.git#"egg=pycocotools&subdirectory=PythonAPI"

Training

First, download and prepare the YouTube-VIS dataset using the following instructions.

To train ObjProp, run the following command:

python3 tools/train.py configs/masktrack_rcnn_r50_fpn_1x_youtubevos_objprop.py

In order to change the arguments such as dataset directory, learning rate, number of GPUs, etc, refer to the following configuration file configs/masktrack_rcnn_r50_fpn_1x_youtubevos_objprop.py.

Inference

To perform inference using ObjProp, run the following command:

python3 tools/test_video.py configs/masktrack_rcnn_r50_fpn_1x_youtubevos_objprop.py [MODEL_PATH] --out [OUTPUT_PATH.json] --eval segm

A JSON file with the inference results will be saved at OUTPUT_PATH.json. To evaluate the performance, submit the result file to the evaluation server.

License

ObjProp is released under the Apache 2.0 license.

Citation

@article{Chakravarthy2021ObjProp,
  author = {Anirudh S Chakravarthy and Won-Dong Jang and Zudi Lin and Donglai Wei and Song Bai and Hanspeter Pfister},  
  title = {Object Propagation via Inter-Frame Attentions for Temporally Stable Video Instance Segmentation},
  journal = {CoRR},
  volume = {abs/2111.07529},
  year = {2021},
  url = {https://arxiv.org/abs/2111.07529}
}

This is the official implementation of the paper "Object Propagation via Inter-Frame Attentions for Temporally Stable Video Instance Segmentation".

Related tags

Overview

ObjProp

Introduction

Installation

Training

Inference

License

Citation

Owner

Anirudh S Chakravarthy

Towards Flexible Blind JPEG Artifacts Removal (FBCNN, ICCV 2021)

Public implementation of "Learning from Suboptimal Demonstration via Self-Supervised Reward Regression" from CoRL'21

Udacity Suse Cloud Native Foundations Scholarship Course Walkthrough

KakaoBrain KoGPT (Korean Generative Pre-trained Transformer)

Resilience from Diversity: Population-based approach to harden models against adversarial attacks

A spatial genome aligner for analyzing multiplexed DNA-FISH imaging data.

Multilingual Image Captioning

Implementation of CVPR 2020 Dual Super-Resolution Learning for Semantic Segmentation

Code and real data for the paper "Counterfactual Temporal Point Processes", available at arXiv.

Toward Spatially Unbiased Generative Models (ICCV 2021)

Neural Module Network for VQA in Pytorch

A MatConvNet-based implementation of the Fully-Convolutional Networks for image segmentation

Implementation of ECCV20 paper: the devil is in classification: a simple framework for long-tail object detection and instance segmentation

AdamW optimizer and cosine learning rate annealing with restarts

[NeurIPS'20] Multiscale Deep Equilibrium Models

PyTorch deep learning projects made easy.

NumPy로 구현한 딥러닝 라이브러리입니다. (자동 미분 지원)

This repo is about to create the Streamlit application for given ML model.

Code Repo for the ACL21 paper "Common Sense Beyond English: Evaluating and Improving Multilingual LMs for Commonsense Reasoning"

Architecture Patterns with Python (TDD, DDD, EDM)