A self-supervised monocular depth estimation approach based on UAV aerial images
The Unmanned Aerial Vehicles (UAVs) have gained increasing attention recently, and depth estimation is one of the essential tasks for the safe operation of UAVs, especially for drones at low altitudes. Considering the limitations of UAVs’ size and payload, innovative methods combined with deep learn...
Saved in:
Main Authors: | , , , |
---|---|
Other Authors: | |
Format: | Conference or Workshop Item |
Language: | English |
Published: |
2022
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/162468 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-162468 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-1624682022-11-05T23:30:22Z A self-supervised monocular depth estimation approach based on UAV aerial images Zhang, Yuhang Yu, Qing Low Kin Huat Lv, Chen School of Mechanical and Aerospace Engineering 2022 IEEE/AIAA 41st Digital Avionics Systems Conference (DASC) Air Traffic Management Research Institute Engineering::Mechanical engineering Unmanned Aerial Vehicles Self-Supervised Learning Monocular Depth Estimation Aerial Images Multi-Scale Upsampling The Unmanned Aerial Vehicles (UAVs) have gained increasing attention recently, and depth estimation is one of the essential tasks for the safe operation of UAVs, especially for drones at low altitudes. Considering the limitations of UAVs’ size and payload, innovative methods combined with deep learning techniques have taken the place of traditional sensors to become the mainstream for predicting per-pixel depth information. Since supervised depth estimation methods require a massive amount of depth ground truth as the supervisory signal. This article proposes an unsupervised framework to tackle the issue of predicting the depth map given a sequence of monocular images. Our model can solve the problem of scale ambiguity by training the depth subnetwork jointly with the pose subnetwork. Moreover, we introduce a modified loss function that utilizes a weighted photometric loss combined with the edge-aware smoothness loss to optimize the training. The evaluation results are compared with the model without weighted loss and other unsupervised monocular depth estimation models (Monodepth and Monodepth2). Our model shows better performance than the others, indicating potential assistance in enhancing the capability of UAVs to estimate distance with the surrounding environment. Civil Aviation Authority of Singapore (CAAS) Submitted/Accepted version This research is supported by the National Research Foundation, Singapore, and the Civil Aviation Authority of Singapore, under the Aviation Transformation Programme. 2022-11-04T01:03:44Z 2022-11-04T01:03:44Z 2022 Conference Paper Zhang, Y., Yu, Q., Low Kin Huat & Lv, C. (2022). A self-supervised monocular depth estimation approach based on UAV aerial images. 2022 IEEE/AIAA 41st Digital Avionics Systems Conference (DASC). https://dx.doi.org/10.1109/DASC55683.2022.9925733 2155-7209 https://hdl.handle.net/10356/162468 10.1109/DASC55683.2022.9925733 en © 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at: https://doi.org/10.1109/DASC55683.2022.9925733. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
Engineering::Mechanical engineering Unmanned Aerial Vehicles Self-Supervised Learning Monocular Depth Estimation Aerial Images Multi-Scale Upsampling |
spellingShingle |
Engineering::Mechanical engineering Unmanned Aerial Vehicles Self-Supervised Learning Monocular Depth Estimation Aerial Images Multi-Scale Upsampling Zhang, Yuhang Yu, Qing Low Kin Huat Lv, Chen A self-supervised monocular depth estimation approach based on UAV aerial images |
description |
The Unmanned Aerial Vehicles (UAVs) have gained increasing attention recently, and depth estimation is one of the essential tasks for the safe operation of UAVs, especially for drones at low altitudes. Considering the limitations of UAVs’ size and payload, innovative methods combined with deep learning techniques have taken the place of traditional sensors to become the mainstream for predicting per-pixel depth information.
Since supervised depth estimation methods require a massive amount of depth ground truth as the supervisory signal. This article proposes an unsupervised framework to tackle the issue of predicting the depth map given a sequence of monocular images. Our model can solve the problem of scale ambiguity by training the depth subnetwork jointly with the pose subnetwork. Moreover, we introduce a modified loss function that utilizes a weighted photometric loss combined with the edge-aware smoothness loss to optimize the training. The evaluation results are compared with the model without weighted loss and other unsupervised monocular depth estimation models (Monodepth and Monodepth2). Our model shows better performance than the others, indicating potential assistance in enhancing the capability of UAVs to estimate distance with the surrounding environment. |
author2 |
School of Mechanical and Aerospace Engineering |
author_facet |
School of Mechanical and Aerospace Engineering Zhang, Yuhang Yu, Qing Low Kin Huat Lv, Chen |
format |
Conference or Workshop Item |
author |
Zhang, Yuhang Yu, Qing Low Kin Huat Lv, Chen |
author_sort |
Zhang, Yuhang |
title |
A self-supervised monocular depth estimation approach based on UAV aerial images |
title_short |
A self-supervised monocular depth estimation approach based on UAV aerial images |
title_full |
A self-supervised monocular depth estimation approach based on UAV aerial images |
title_fullStr |
A self-supervised monocular depth estimation approach based on UAV aerial images |
title_full_unstemmed |
A self-supervised monocular depth estimation approach based on UAV aerial images |
title_sort |
self-supervised monocular depth estimation approach based on uav aerial images |
publishDate |
2022 |
url |
https://hdl.handle.net/10356/162468 |
_version_ |
1749179213182664704 |