DeepMind Robotics

Libraries, tools and tasks created and used at DeepMind Robotics.

Package overview

Package	Summary
Transformations	Rigid body transformations
Geometry	Scene and Robot geometry primitives
Vision	Visual blob detection and tracking
AgentFlow	Reinforcement Learning agent composition library
Manipulation	"RGB" object meshes for manipulation tasks
MoMa	Manipulation environment definition library, for simulated and real robots
Controllers	QP-optimization based cartesian controller
Controller Bindings	Python bindings for the controller
Least Squares QP	QP task definition and solver

Installation

These libraries are distributed on PyPI, the packages are:

dm_robotics-transformations
dm_robotics-geometry
dm_robotics-vision
dm_robotics-agentflow
dm_robotics-manipulation
dm_robotics-moma
dm_robotics-controllers

Dependencies

MoMa, Manipulation and Controllers depend on MuJoCo, the other packages do not. See the individual packages for more information on their dependencies.

Building

To build and test the libraries, run build.sh. This script assumes:

MuJoCo is installed and licensed.
dm_control is installed.
cmake version >= 3.20.2 is installed.
Python 3.6 ,3.7 or 3.8 and system headers are installed.
GCC version 9 or later is installed.
numpy is installed.

The Python libraries are tested with tox, the C++ code is built and tested with cmake.

Tox's distshare mechanism is used to share the built source distribution packages between the packages.

Libraries, tools and tasks created and used at DeepMind Robotics.

Related tags

Overview

DeepMind Robotics

Package overview

Installation

Dependencies

Building

Owner

DeepMind

Realtime Face Anti Spoofing with Face Detector based on Deep Learning using Tensorflow/Keras and OpenCV

Attempt at implementation of a simple GAN using Keras

Empower Sequence Labeling with Task-Aware Language Model

Compact Bilinear Pooling for PyTorch

Implementation for "Manga Filling Style Conversion with Screentone Variational Autoencoder" (SIGGRAPH ASIA 2020 issue)

Running Google MoveNet Multipose Tracking models on OpenVINO.

Official PyTorch implementation of MX-Font (Multiple Heads are Better than One: Few-shot Font Generation with Multiple Localized Experts)

Multi-task yolov5 with detection and segmentation based on yolov5

Official PyTorch implementation of "VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalization" (CVPR 2021)

BridgeGAN - Tensorflow implementation of Bridging the Gap between Label- and Reference-based Synthesis in Multi-attribute Image-to-Image Translation.

Paper: De-rendering Stylized Texts

Inferring Lexicographically-Ordered Rewards from Preferences

ResNEsts and DenseNEsts: Block-based DNN Models with Improved Representation Guarantees

Set of methods to ensemble boxes from different object detection models, including implementation of "Weighted boxes fusion (WBF)" method.

Code and models for ICCV2021 paper "Robust Object Detection via Instance-Level Temporal Cycle Confusion".

To propose and implement a multi-class classification approach to disaster assessment from the given data set of post-earthquake satellite imagery.

A Data Annotation Tool for Semantic Segmentation, Object Detection and Lane Line Detection.(In Development Stage)

Official public repository of paper "Intention Adaptive Graph Neural Network for Category-Aware Session-Based Recommendation"

Random Erasing Data Augmentation. Experiments on CIFAR10, CIFAR100 and Fashion-MNIST

SAFL: A Self-Attention Scene Text Recognizer with Focal Loss