OrienMask
This repository implements the framework OrienMask for real-time instance segmentation.
It achieves 34.8 mask AP on COCO test-dev at the speed of 42.7 FPS evaluated with a single RTX 2080Ti. (log)
Paper: Real-time Instance Segmentation with Discriminative Orientation Maps
Installation
Please see INSTALL.md to prepare the environment and dataset.
Usage
Place the pre-trained backbone (link) and trained model (link) as follows for convenience (otherwise update the corresponding path in configurations):
├── checkpoints
│ ├── pretrained
│ │ ├──pretrained_darknet53.pth
│ ├── OrienMaskAnchor4FPNPlus
│ │ ├──orienmask_yolo.pth
train
Three items should be noticed when deploying different number of GPUs: n_gpu, batch_size, accumulate. Keep in mind that the approximate batch size equals to n_gpu * batch_size * accumulate.
# multi-gpu train (n_gpu=2, batch_size=8, accumulate=1)
# if necessary, set MASTER_PORT to avoid port conflict
# if permission error, run `chmod +x dist_train.sh`
CUDA_VISIBLE_DEVICES=0,1 ./dist_train.sh \
-c orienmask_yolo_coco_544_anchor4_fpn_plus
# single-gpu train (n_gpu=1, batch_size=8, accumulate=2)
CUDA_VISIBLE_DEVICES=0 ./dist_train.sh \
-c orienmask_yolo_coco_544_anchor4_fpn_plus
# or
CUDA_VISIBLE_DEVICES=0 python train.py \
-c orienmask_yolo_coco_544_anchor4_fpn_plus
test
Run the following command to obtain AP and AR metrics on val2017 split:
CUDA_VISIBLE_DEVICES=0 python test.py \
-c orienmask_yolo_coco_544_anchor4_fpn_plus_test \
-w checkpoints/OrienMaskAnchor4FPNPlus/orienmask_yolo.pth
infer
Please run python infer.py -h for more usages.
# infer on an image and save the visualized result
CUDA_VISIBLE_DEVICES=0 python infer.py \
-c orienmask_yolo_coco_544_anchor4_fpn_plus_infer \
-w checkpoints/OrienMaskAnchor4FPNPlus/orienmask_yolo.pth \
-i assets/000000163126.jpg -v -o outputs
# infer on a list of images and save the visualized results
CUDA_VISIBLE_DEVICES=0 python infer.py \
-c orienmask_yolo_coco_544_anchor4_fpn_plus_infer \
-w checkpoints/OrienMaskAnchor4FPNPlus/orienmask_yolo.pth \
-d coco/test2017 -l assets/test_dev_selected.txt -v -o outputs
logs
We provide two types of logs for monitoring the training process. The first is updated on the terminal which is also stored in a train.log file in the checkpoint directory. The other is the tensorboard whose statistics are kept in the checkpoint directory.
Citation
@article{du2021realtime,
title={Real-time Instance Segmentation with Discriminative Orientation Maps},
author={Du, Wentao and Xiang, Zhiyu and Chen, Shuya and Qiao, Chengyu and Chen, Yiman and Bai, Tingming},
journal={arXiv preprint arXiv:2106.12204},
year={2021}
}
363 Dec 28, 2022
16 Dec 02, 2022
5 Oct 20, 2022
14 Oct 21, 2022
6 Nov 04, 2022
28 Nov 29, 2022
82 Dec 15, 2022
448 Jan 02, 2023
97 Dec 23, 2022
6 Aug 03, 2022
15 Nov 20, 2022
185 Jan 07, 2023
217 Dec 05, 2022
145 Jan 05, 2023
1 Aug 24, 2022
6 Dec 14, 2022
40 Jul 25, 2022
69 Dec 23, 2022
188 Dec 25, 2022
7.2k Dec 29, 2022