This repo implements a Topological SLAM: Deep Visual Odometry with Long Term Place Recognition (Loop Closure Detection)

Last update: Jun 23, 2022

Related tags

Overview

Introduction

This repo implements a topological SLAM system. Deep Visual Odometry (DF-VO) and Visual Place Recognition are combined to form the topological SLAM system.

Publications

@INPROCEEDINGS{zhan2019dfvo,
  author={H. {Zhan} and C. S. {Weerasekera} and J. -W. {Bian} and I. {Reid}},
  booktitle={2020 IEEE International Conference on Robotics and Automation (ICRA)}, 
  title={Visual Odometry Revisited: What Should Be Learnt?}, 
  year={2020},
  volume={},
  number={},
  pages={4203-4210},
  doi={10.1109/ICRA40945.2020.9197374}}

@misc{zhan2021dfvo,
      title={DF-VO: What Should Be Learnt for Visual Odometry?}, 
      author={Huangying Zhan and Chamara Saroj Weerasekera and Jia-Wang Bian and Ravi Garg and Ian Reid},
      year={2021},
      eprint={2103.00933},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

@inproceedings{doan2019scalable,
  title={Scalable place recognition under appearance change for autonomous driving},
  author={Doan, Anh-Dzung and Latif, Yasir and Chin, Tat-Jun and Liu, Yu and Do, Thanh-Toan and Reid, Ian},
  booktitle={Proceedings of the IEEE/CVF International Conference on Computer Vision},
  pages={9319--9328},
  year={2019}
}

Part 1. Requirements

This code was tested with Python 3.6, CUDA 10.0, Ubuntu 16.04, and PyTorch-1.0.

We suggest use Anaconda for installing the prerequisites.

cd envs
conda env create -f min_requirements.yml -p {ANACONDA_DIR/envs/topo_slam} # install prerequisites
conda activate topo_slam  # activate the environment [topo_slam]

Part 2. Download dataset and models

The main dataset used in this project is KITTI Driving Dataset. After downloaing the dataset, create a softlink in the current repo.

ln -s KITTI_ODOMETRY/sequences dataset/kitti_odom/odom_data

For our trained models, please visit here to download the models and save the models into the directory model_zoo/.

Part 3. Run example

# run default kitti setup
python main.py -d options/examples/default.yml  -r data/kitti_odom

More configuration examples can be found in configuration examples.

The result (trajectory pose file) is saved in result_dir defined in the configuration file. Please check Configuration Documentation for reference.

Part 4. Result evaluation

Please check here for evaluating the result.

License

Please check License file.

Acknowledgement

Some of the codes were borrowed from the excellent works of monodepth2, LiteFlowNet and pytorch-liteflownet. The borrowed files are licensed under their original license respectively.

This repo implements a Topological SLAM: Deep Visual Odometry with Long Term Place Recognition (Loop Closure Detection)

Related tags

Overview

Introduction

Publications

Demo:

Contents

Part 1. Requirements

Part 2. Download dataset and models

Part 3. Run example

Part 4. Result evaluation

License

Acknowledgement

Owner

Best of Australian Centre for Robotic Vision (ACRV)

A statistical library designed to fill the void in Python's time series analysis capabilities, including the equivalent of R's auto.arima function.

Automated Machine Learning Pipeline with Feature Engineering and Hyper-Parameters Tuning

The Ultimate FREE Machine Learning Study Plan

QuickAI is a Python library that makes it extremely easy to experiment with state-of-the-art Machine Learning models.

Stacked Generalization (Ensemble Learning)

healthy and lesion models for learning based on the joint estimation of stochasticity and volatility

easyNeuron is a simple way to create powerful machine learning models, analyze data and research cutting-edge AI.

Learning --> Numpy January 2022 - winter'22

Predicting Baseball Metric Clusters: Clustering Application in Python Using scikit-learn

Library of Stan Models for Survival Analysis

Azure MLOps (v2) solution accelerators.

A Software Framework for Neuromorphic Computing

PyNNDescent is a Python nearest neighbor descent for approximate nearest neighbors.

Open MLOps - A Production-focused Open-Source Machine Learning Framework

Open-Source CI/CD platform for ML teams. Deliver ML products, better & faster. ⚡️🧑‍🔧

CinnaMon is a Python library which offers a number of tools to detect, explain, and correct data drift in a machine learning system

Uses WiFi signals :signal_strength: and machine learning to predict where you are

Adaptive: parallel active learning of mathematical functions

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

Code base of KU AIRS: SPARK Autonomous Vehicle Team