A synthetic texture-invariant dataset for object detection of UAVs

Last update: Aug 13, 2022

Overview

A synthetic dataset for object detection of UAVs

This repository contains a synthetic datasets accompanying the paper Sim2Air - Synthetic aerial dataset for UAV monitoring by Antonella Barisic, Frano Petric and Stjepan Bogdan.

In this paper, we propose to use a texture-invariant representation of objects for aerial object detection. Our approach improves the generalisation and robustness of the object detector. A dataset is created with randomly assigned atypical textures and sufficient diversity and photorealism in all other components such as shape, pose, lighting, scale, background, etc. The results also show improved accuracy in case of distant objects and difficult lighting conditions.

All datasets from the paper are available for download. If you use these datasets for your research, please cite:

@misc{barisic2021sim2air,
      title={Sim2Air - Synthetic aerial dataset for UAV monitoring}, 
      author={Antonella Barisic and Frano Petric and Stjepan Bogdan},
      year={2021},
      eprint={2110.05145},
      archivePrefix={arXiv},
      primaryClass={cs.CV}
}

Datasets

Name	Description
Synthetic Eagle Baseline (SEB)	The SEB dataset is a synthetic dataset with a single UAV model, the custom aerial platform Eagle. Since this dataset serves as the basis for proving our hypothesis, it was created with only one texture, identical to the texture of real-life Eagle. SEB consists of 32 000 images of size 604 x 604 with annotations in YOLO format.
Synthetic Eagle with Textures (SET)	The SET dataset is the main star ⭐ of our work. It is a synthetic dataset of a single model, the custom aerial platform Eagle, with randomly selected atypical textures. The mixture of 32 different textures is applied during the procedural generation of the dataset. SET also consists of 32 000 images of size 604 x 604 with annotations in YOLO format.
Synthetic UAVs with Textures (S-UAV-T)	The S-UAV-T dataset is similar to SET but with many more models of UAVs. The data was created with 10 different multicopter models, 32 atypical textures, and with a variety of poses, backgrounds, viewpoints, etc. S-UAV-T consists of 52 500 images of size 604 x 604 with annotations in YOLO format.

If you want to test your detection results against real data, check out our UAV-Eagle dataset at larics/UAV-Eagle.

Contact

For more information, please contact Antonella Barisic.

A synthetic texture-invariant dataset for object detection of UAVs

Related tags

Overview

A synthetic dataset for object detection of UAVs

Datasets

Contact

Owner

LARICS Lab

LiDAR R-CNN: An Efficient and Universal 3D Object Detector

Morphable Detector for Object Detection on Demand

Code repo for "Cross-Scale Internal Graph Neural Network for Image Super-Resolution" (NeurIPS'20)

Detector for Log4Shell exploitation attempts

Gluon CV Toolkit

Code accompanying the NeurIPS 2021 paper "Generating High-Quality Explanations for Navigation in Partially-Revealed Environments"

TorchPQ is a python library for Approximate Nearest Neighbor Search (ANNS) and Maximum Inner Product Search (MIPS) on GPU using Product Quantization (PQ) algorithm.

Pytorch implementation of

Request execution of Galaxy SARS-CoV-2 variation analysis workflows on input data you provide.

Cross-Task Consistency Learning Framework for Multi-Task Learning

Trash Sorter Extraordinaire is a software which efficiently detects the different types of waste in a pile of random trash through feeding it pictures or videos.

Official Pytorch Implementation of 3DV2021 paper: SAFA: Structure Aware Face Animation.

This repository contains the implementation of the paper: Federated Distillation of Natural Language Understanding with Confident Sinkhorns

Prompts - Read a textfile of prompts and import into anki via ankiconnect

A `Neural = Symbolic` framework for sound and complete weighted real-value logic

The goal of the exercises below is to evaluate the candidate knowledge and problem solving expertise regarding the main development focuses for the iFood ML Platform team: MLOps and Feature Store development.

Simple and Effective Few-Shot Named Entity Recognition with Structured Nearest Neighbor Learning

Generalized Proximal Policy Optimization with Sample Reuse (GePPO)

A Simulated Optimal Intrusion Response Game

Chunkmogrify: Real image inversion via Segments