Monocular 3D pose estimation. OpenVINO. CPU inference or iGPU (OpenCL) inference.

Last update: Oct 03, 2022

Overview

human-pose-estimation-3d-python-cpp

RealSenseD435 (RGB) 480x640 + CPU Corei9 45 FPS (Depth is not used)

1. Run

1-1. RealSenseD435 (RGB) 480x640 + CPU Corei9 45 FPS (Depth is not used)

$ xhost +local: && \
docker run -it --rm \
-v `pwd`:/home/user/workdir \
-v /tmp/.X11-unix/:/tmp/.X11-unix:rw \
--device /dev/video0:/dev/video0:mwr \
--device /dev/video1:/dev/video1:mwr \
--device /dev/video2:/dev/video2:mwr \
--device /dev/video3:/dev/video3:mwr \
--device /dev/video4:/dev/video4:mwr \
--device /dev/video5:/dev/video5:mwr \
--net=host \
-e XDG_RUNTIME_DIR=$XDG_RUNTIME_DIR \
-e DISPLAY=$DISPLAY \
--privileged \
ghcr.io/pinto0309/openvino2tensorflow:latest

$ python3 human_pose_estimation_3d_demo.py \
--model models/openvino/FP16/human-pose-estimation-3d-0001_bgr_480x640.xml \
--device CPU \
--input 4

1-2. RealSenseD435 (RGB) 480x640 + iGPU (OpenCL)

$ xhost +local: && \
docker run -it --rm \
-v `pwd`:/home/user/workdir \
-v /tmp/.X11-unix/:/tmp/.X11-unix:rw \
--device /dev/video0:/dev/video0:mwr \
--device /dev/video1:/dev/video1:mwr \
--device /dev/video2:/dev/video2:mwr \
--device /dev/video3:/dev/video3:mwr \
--device /dev/video4:/dev/video4:mwr \
--device /dev/video5:/dev/video5:mwr \
--net=host \
-e LIBVA_DRIVER_NAME=iHD \
-e XDG_RUNTIME_DIR=$XDG_RUNTIME_DIR \
-e DISPLAY=$DISPLAY \
--privileged \
ghcr.io/pinto0309/openvino2tensorflow:latest

$ python3 human_pose_estimation_3d_demo.py \
--model models/openvino/FP16/human-pose-estimation-3d-0001_bgr_480x640.xml \
--device GPU \
--input 4

1-3. General USB Camera 480x640 + CPU

$ xhost +local: && \
docker run -it --rm \
-v `pwd`:/home/user/workdir \
-v /tmp/.X11-unix/:/tmp/.X11-unix:rw \
--device /dev/video0:/dev/video0:mwr \
--net=host \
-e XDG_RUNTIME_DIR=$XDG_RUNTIME_DIR \
-e DISPLAY=$DISPLAY \
--privileged \
ghcr.io/pinto0309/openvino2tensorflow:latest

$ python3 human_pose_estimation_3d_demo.py \
--model models/openvino/FP16/human-pose-estimation-3d-0001_bgr_480x640.xml \
--device CPU \
--input 0

2. Build

$ PYTHON_PREFIX=$(python3 -c "import sys; print(sys.prefix)") \
&& PYTHON_VERSION=$(python3 -c "import sys; print(f'{sys.version_info.major}.{sys.version_info.minor}')") \
&& PYTHON_INCLUDE_DIRS=${PYTHON_PREFIX}/include/python${PYTHON_VERSION}

$ NUMPY_INCLUDE_DIR=$(python3 -c "import numpy; print(numpy.get_include())")

$ mkdir -p pose_extractor/build && cd pose_extractor/build

$ cmake \
-DPYTHON_INCLUDE_DIRS=${PYTHON_INCLUDE_DIRS} \
-DNUMPY_INCLUDE_DIR=${NUMPY_INCLUDE_DIR} ..

$ make && cp pose_extractor.so ../.. && cd ../..

Monocular 3D pose estimation. OpenVINO. CPU inference or iGPU (OpenCL) inference.

Related tags

Overview

human-pose-estimation-3d-python-cpp

1. Run

1-1. RealSenseD435 (RGB) 480x640 + CPU Corei9 45 FPS (Depth is not used)

1-2. RealSenseD435 (RGB) 480x640 + iGPU (OpenCL)

1-3. General USB Camera 480x640 + CPU

2. Build

3. Reference

Owner

Katsuya Hyodo

Deep Learning and Reinforcement Learning Library for Scientists and Engineers 🔥

Reinforcement learning models in ViZDoom environment

This is the official source code of "BiCAT: Bi-Chronological Augmentation of Transformer for Sequential Recommendation".

NLP From Scratch Without Large-Scale Pretraining: A Simple and Efficient Framework

Regularized Frank-Wolfe for Dense CRFs: Generalizing Mean Field and Beyond

Disagreement-Regularized Imitation Learning

Greedy Gaussian Segmentation

Unsupervised Image to Image Translation with Generative Adversarial Networks

Code of Periodic Activation Functions Induce Stationarity

Beancount-mercury - Beancount importer for Mercury Startup Checking

Official source code of paper 'IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereo'

Spatial Transformer Nets in TensorFlow/ TensorLayer

Based on Stockfish neural network(similar to LcZero)

An addon uses SMPL's poses and global translation to drive cartoon character in Blender.

The official PyTorch implementation of Curriculum by Smoothing (NeurIPS 2020, Spotlight).

The World of an Octopus: How Reporting Bias Influences a Language Model's Perception of Color

OpenVINO黑客松比赛项目

SegNet including indices pooling for Semantic Segmentation with tensorflow and keras

A FAIR dataset of TCV experimental results for validating edge/divertor turbulence models.

Code base for NeurIPS 2021 publication titled Kernel Functional Optimisation (KFO)