A synthetic texture-invariant dataset for object detection of UAVs

Last update: Aug 13, 2022

Overview

A synthetic dataset for object detection of UAVs

This repository contains a synthetic datasets accompanying the paper Sim2Air - Synthetic aerial dataset for UAV monitoring by Antonella Barisic, Frano Petric and Stjepan Bogdan.

In this paper, we propose to use a texture-invariant representation of objects for aerial object detection. Our approach improves the generalisation and robustness of the object detector. A dataset is created with randomly assigned atypical textures and sufficient diversity and photorealism in all other components such as shape, pose, lighting, scale, background, etc. The results also show improved accuracy in case of distant objects and difficult lighting conditions.

All datasets from the paper are available for download. If you use these datasets for your research, please cite:

@misc{barisic2021sim2air,
      title={Sim2Air - Synthetic aerial dataset for UAV monitoring}, 
      author={Antonella Barisic and Frano Petric and Stjepan Bogdan},
      year={2021},
      eprint={2110.05145},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

Datasets

Name	Description
Synthetic Eagle Baseline (SEB)	The SEB dataset is a synthetic dataset with a single UAV model, the custom aerial platform Eagle. Since this dataset serves as the basis for proving our hypothesis, it was created with only one texture, identical to the texture of real-life Eagle. SEB consists of 32 000 images of size 604 x 604 with annotations in YOLO format.
Synthetic Eagle with Textures (SET)	The SET dataset is the main star ⭐ of our work. It is a synthetic dataset of a single model, the custom aerial platform Eagle, with randomly selected atypical textures. The mixture of 32 different textures is applied during the procedural generation of the dataset. SET also consists of 32 000 images of size 604 x 604 with annotations in YOLO format.
Synthetic UAVs with Textures (S-UAV-T)	The S-UAV-T dataset is similar to SET but with many more models of UAVs. The data was created with 10 different multicopter models, 32 atypical textures, and with a variety of poses, backgrounds, viewpoints, etc. S-UAV-T consists of 52 500 images of size 604 x 604 with annotations in YOLO format.

If you want to test your detection results against real data, check out our UAV-Eagle dataset at larics/UAV-Eagle.

Contact

For more information, please contact Antonella Barisic.

A synthetic texture-invariant dataset for object detection of UAVs

Related tags

Overview

A synthetic dataset for object detection of UAVs

Datasets

Contact

Owner

LARICS Lab

MetaTTE: a Meta-Learning Based Travel Time Estimation Model for Multi-city Scenarios

This repository contains code to train and render Mixture of Volumetric Primitives (MVP) models

AirPose: Multi-View Fusion Network for Aerial 3D Human Pose and Shape Estimation

Differentiable Factor Graph Optimization for Learning Smoothers @ IROS 2021

Implements Stacked-RNN in numpy and torch with manual forward and backward functions

A PyTorch Implementation of Gated Graph Sequence Neural Networks (GGNN)

Locally Most Powerful Bayesian Test for Out-of-Distribution Detection using Deep Generative Models

Self-Attention Between Datapoints: Going Beyond Individual Input-Output Pairs in Deep Learning

Robust Self-augmentation for NER with Meta-reweighting

GPU implementation of $k$-Nearest Neighbors and Shared-Nearest Neighbors

This repo contains the source code and a benchmark for predicting user's utilities with Machine Learning techniques for Computational Persuasion

A real world application of a Recurrent Neural Network on a binary classification of time series data

PartImageNet is a large, high-quality dataset with part segmentation annotations

Python wrapper of LSODA (solving ODEs) which can be called from within numba functions.

Small-bets - Ergodic Experiment With Python

This repo uses a combination of logits and feature distillation method to teach the PSPNet model of ResNet18 backbone with the PSPNet model of ResNet50 backbone. All the models are trained and tested on the PASCAL-VOC2012 dataset.

A concise but complete implementation of CLIP with various experimental improvements from recent papers

Implicit Deep Adaptive Design (iDAD)

GPT-Code-Clippy (GPT-CC) is an open source version of GitHub Copilot

meProp: Sparsified Back Propagation for Accelerated Deep Learning (ICML 2017)