STAR

Official implementation of Sparse Transformer-based Action Recognition

Dataset

download NTU RGB+D 60 action recognition of 2D/3D skeleton from http://rose1.ntu.edu.sg/datasets/actionRecognition.asp

or use google drive

NTU60 NTU120

uzip data as the following file structure: $(project_folder)/raw/.\*skeleton or $(project_folder)/dataset/raw/.\*skeleton (create "raw" folder under $(project_folder) or $(project_folder)/dataset then put raw skeleton files under "raw" folder)

run the code below to generate dataset:

python datagen.py

Training

git fetch and checkout to "distributed" branch

python train_dist.py -#distributed training

Configuration

parser.set_defaults(gpu=True,
                    batch_size=128,
                    dataset_name='NTU',
                    dataset_root=osp.join(os.getcwd()),  # or dataset_root=osp.join(os.getcwd(), 'dataset')
                    load_model=False,
                    in_channels=9,
                    num_enc_layers=5,
                    num_conv_layers=2,
                    weight_decay=4e-5,
                    drop_rate=[0.4, 0.4, 0.4, 0.4],  # linear_attention, sparse_attention, add_norm, ffn
                    hid_channels=64,
                    out_channels=64,
                    heads=8,
                    data_parallel=False,
                    cross_k=5,
                    mlp_head_hidden=128)

parser.set_defaults(gpu=True,
                    batch_size=128,
                    dataset_name='NTU',
                    dataset_root=osp.join(os.getcwd()),
                    load_model=False,
                    in_channels=9,
                    num_enc_layers=5,
                    num_conv_layers=2,
                    weight_decay=4e-5,
                    drop_rate=[0.4, 0.4, 0.4, 0.4],  # linear_attention, sparse_attention, add_norm, ffn
                    hid_channels=128,
                    out_channels=128,
                    heads=8,
                    data_parallel=False,
                    cross_k=5,
                    mlp_head_hidden=128)

Official implementation of Sparse Transformer-based Action Recognition

Related tags

Overview

STAR

Dataset

Training

Configuration

Owner

Chonghan_Lee

Pytorch implementation for Patient Knowledge Distillation for BERT Model Compression

Accelerated Multi-Modal MR Imaging with Transformers

FastyAPI is a Stack boilerplate optimised for heavy loads.

Framework to build and train RL algorithms

Official codes: Self-Supervised Learning by Estimating Twin Class Distribution

Transfer Learning for Pose Estimation of Illustrated Characters

JstDoS - HTTP Protocol Stack Remote Code Execution Vulnerability

Learning Correspondence from the Cycle-consistency of Time (CVPR 2019)

A light-weight image labelling tool for Python designed for creating segmentation data sets.

Code of paper Interact, Embed, and EnlargE (IEEE): Boosting Modality-specific Representations for Multi-Modal Person Re-identification.

PyTorch 1.0 inference in C++ on Windows10 platforms

PyTorch implementations of the beta divergence loss.

Code for the paper "Reinforced Active Learning for Image Segmentation"

PyTorch implementation of Advantage Actor Critic (A2C), Proximal Policy Optimization (PPO), Scalable trust-region method for deep reinforcement learning using Kronecker-factored approximation (ACKTR) and Generative Adversarial Imitation Learning (GAIL).

“Robust Lightweight Facial Expression Recognition Network with Label Distribution Training”, AAAI 2021.

PyTorch module to use OpenFace's nn4.small2.v1.t7 model

Predicts an answer in yes or no.

Code for CVPR2021 paper "Robust Reflection Removal with Reflection-free Flash-only Cues"

An official implementation of the paper Exploring Sequence Feature Alignment for Domain Adaptive Detection Transformers

Implementation for paper LadderNet: Multi-path networks based on U-Net for medical image segmentation