Skip to content

GhostLate/aerial_semantic_segmentation

Repository files navigation

Aerial semantic segmentation

This repository presents approach for semantic segmentation using Semantic Drone Dataset dataset. You can also find this dataset on Kaggle

What is purpose of this repo?

This repo aims to do experiments and verify the idea of robust semantic segmentation and specific datasets.

Semantic Droone Dataset

The Semantic Drone Dataset focuses on semantic understanding of urban scenes for increasing the safety of autonomous drone flight and landing procedures. The imagery depicts more than 20 houses from nadir (bird's eye) view acquired at an altitude of 5 to 30 meters above ground.

Original images and labels had resolution 6000x4000px (24Mpx). They were reduced to 768x512px size. The training set contains 300 and the test set is made up of 100 images.

The original Semantic Drone Dataset contents 24 semanic classes of:

  • background - paved-area - dirt - grass
  • gravel - water - rocks - pool - tree
  • vegetation - roof - wall - window
  • door - fence - fence-pole - person
  • dog - car - bicycle - conflicting
  • bald-tree - ar-marker - obstacle

After uniting some classes to more general view, 24 classes was reduced to 12:

  • road - ground - water - person - car
  • vegetation - construction - bicycle
  • dog - obstacle - conflicting - background

Checkpoints

Method Backbone pretrain img size Crop Size Batch Size Lr schd Mem (GB) mIoU(ms+flip) Num Clasess config download
UperNet Swin-T 768x512 384x384 4 160000 - - 12 config model | log
OCRNet HRNetV2p-W48 768x512 384x384 2 160000 - - 12 config model | log
DNL ResNet-101-D8 768x512 512x512 2 80000 - - 12 config model | log
UperNet Swin-T 768x512 384x384 4 160000 - - 24 config model | log

Usage

inference.py allow you to test models on images/videos in dir you choose. Control keys are:

  • a - left image/video file in dir
  • d - right image/video file in dir
  • w - turn on/off image/video segmentation
  • s - save frame in dir

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published