Omnidirectional camera calibration in python

Last update: Nov 22, 2022

Related tags

Deep Learning py-omnicalib

Overview

Omnidirectional Camera Calibration

Key features

pure python
initial solution based on A Toolbox for Easily Calibrating Omnidirectional Cameras (Davide Scaramuzza, Agostino Martinelli, Roland Siegwart)
Optimized solution via Levenberg–Marquardt algorithm on reprojection error
Lie algebra based extrinsics optimization

(undistort example)

Usage

Corner detection (see python -m omnicalib.detect --help for detailed argument description)

python -m omnical.detect --chessboard <rows> <columns> <square-size> --max-dim <max-dim> --threads <threads> <image-folder>

The file detections.pickle is written, which contains a pickled dictionary with the following format

{
    'detections': {
        <image_path_0>: {'image_points': <image_points>, 'object_points': <object_points>},
        ...
}

Image paths (pathlib.Path) are absolute
image_points are torch.Tensor with shape N x 2 and dtype torch.float64
object_points are torch.Tensor with shape N x 3 and dtype torch.float64 and third colum, the z coordinate, all zeros

If an external corner detection method is used, this file can simply be written manually.

Calibration (see python -m omnicalib --help for detailed argument description)

python -m omnical --degree <degree> detections.pickle

Result

A calibration.yml file (see example_calibration.yml) containing

extrinsics as list of 3 x 4 matrices
poly_incident_angle_to_radius, a polynom that converts incident angle to image radius
poly_radius_to_z, a polynom that converts radius to z component of view vector
principal_point in pixel

Method

For a detailed description see method.md.

Simulation

Play with the calibration on simulated data with the provided jupyter lab notebook. It generates randomized data for the following ideal projection models

equidistant
stereographic
orthographic
equisolid

, see Large Area 3D Human Pose Detection Via Stereo Reconstruction in Panoramic Cameras for a detailed description.

Example

Jupyter lab notebook, example results

You might also like...

Improving Calibration for Long-Tailed Recognition (CVPR2021)

19 Apr 28, 2021

Pytorch Implementation of Spiking Neural Networks Calibration, ICML 2021

SNN_Calibration Pytorch Implementation of Spiking Neural Networks Calibration, ICML 2021 Feature Comparison of SNN calibration: Features SNN Direct Tr

60 Dec 27, 2022

S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)

S2-BNN (Self-supervised Binary Neural Networks Using Distillation Loss) This is the official pytorch implementation of our paper: "S2-BNN: Bridging th

52 Dec 24, 2022

[CVPR 2022] Official code for the paper: "A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibration"

MDCA Calibration This is the official PyTorch implementation for the paper: "A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved

21 Dec 22, 2022

Omnidirectional camera calibration in python

Related tags

Overview

Omnidirectional Camera Calibration

Key features

Usage

Result

Method

Simulation

Example

You might also like...

Improving Calibration for Long-Tailed Recognition (CVPR2021)

Pytorch Implementation of Spiking Neural Networks Calibration, ICML 2021

S2-BNN: Bridging the Gap Between Self-Supervised Real and 1-bit Neural Networks via Guided Distribution Calibration (CVPR 2021)

the code for paper "Energy-Based Open-World Uncertainty Modeling for Confidence Calibration"

We utilize deep reinforcement learning to obtain favorable trajectories for visual-inertial system calibration.

Improving Calibration for Long-Tailed Recognition (CVPR2021)

Source code of NeurIPS 2021 Paper ''Be Confident! Towards Trustworthy Graph Neural Networks via Confidence Calibration''

CSAC - Collaborative Semantic Aggregation and Calibration for Separated Domain Generalization

[CVPR 2022] Official code for the paper: "A Stitch in Time Saves Nine: A Train-Time Regularizing Loss for Improved Neural Network Calibration"

Releases(1.0.1)

1.0.1(Mar 1, 2022)

1.0.0(Dec 21, 2021)

Owner

Thomas Pönitz

Just Randoms Cats with python

Artifacts for paper "MMO: Meta Multi-Objectivization for Software Configuration Tuning"

Faster RCNN with PyTorch

Official public repository of paper "Intention Adaptive Graph Neural Network for Category-Aware Session-Based Recommendation"

Code for IntraQ, PyTorch implementation of our paper under review

Auto-updating data to assist in investment to NEPSE

PyTorch code for the "Deep Neural Networks with Box Convolutions" paper

A Closer Look at Invalid Action Masking in Policy Gradient Algorithms

Discriminative Region Suppression for Weakly-Supervised Semantic Segmentation

Supplementary code for TISMIR paper "Sliding-Window Pitch-Class Histograms as a Means of Modeling Musical Form"

SCAN: Learning to Classify Images without Labels, incl. SimCLR. [ECCV 2020]

Structure-Preserving Deraining with Residue Channel Prior Guidance (ICCV2021)

PyTorch Implementation of Small Lesion Segmentation in Brain MRIs with Subpixel Embedding (ORAL, MICCAIW 2021)

[ICLR 2022] Pretraining Text Encoders with Adversarial Mixture of Training Signal Generators

A model that attempts to learn and benefit from data collected on card counting.

Pytorch implementation for "Open Compound Domain Adaptation" (CVPR 2020 ORAL)

This repo uses a combination of logits and feature distillation method to teach the PSPNet model of ResNet18 backbone with the PSPNet model of ResNet50 backbone. All the models are trained and tested on the PASCAL-VOC2012 dataset.

Jittor 64*64 implementation of StyleGAN

Create UIs for prototyping your machine learning model in 3 minutes

PyTorch implementation of SIFT descriptor