A self-supervised monocular depth estimation approach based on UAV aerial images

The Unmanned Aerial Vehicles (UAVs) have gained increasing attention recently, and depth estimation is one of the essential tasks for the safe operation of UAVs, especially for drones at low altitudes. Considering the limitations of UAVs’ size and payload, innovative methods combined with deep learn...

Full description

Saved in:
Bibliographic Details
Main Authors: Zhang, Yuhang, Yu, Qing, Low Kin Huat, Lv, Chen
Other Authors: School of Mechanical and Aerospace Engineering
Format: Conference or Workshop Item
Language:English
Published: 2022
Subjects:
Online Access:https://hdl.handle.net/10356/162468
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-162468
record_format dspace
spelling sg-ntu-dr.10356-1624682022-11-05T23:30:22Z A self-supervised monocular depth estimation approach based on UAV aerial images Zhang, Yuhang Yu, Qing Low Kin Huat Lv, Chen School of Mechanical and Aerospace Engineering 2022 IEEE/AIAA 41st Digital Avionics Systems Conference (DASC) Air Traffic Management Research Institute Engineering::Mechanical engineering Unmanned Aerial Vehicles Self-Supervised Learning Monocular Depth Estimation Aerial Images Multi-Scale Upsampling The Unmanned Aerial Vehicles (UAVs) have gained increasing attention recently, and depth estimation is one of the essential tasks for the safe operation of UAVs, especially for drones at low altitudes. Considering the limitations of UAVs’ size and payload, innovative methods combined with deep learning techniques have taken the place of traditional sensors to become the mainstream for predicting per-pixel depth information. Since supervised depth estimation methods require a massive amount of depth ground truth as the supervisory signal. This article proposes an unsupervised framework to tackle the issue of predicting the depth map given a sequence of monocular images. Our model can solve the problem of scale ambiguity by training the depth subnetwork jointly with the pose subnetwork. Moreover, we introduce a modified loss function that utilizes a weighted photometric loss combined with the edge-aware smoothness loss to optimize the training. The evaluation results are compared with the model without weighted loss and other unsupervised monocular depth estimation models (Monodepth and Monodepth2). Our model shows better performance than the others, indicating potential assistance in enhancing the capability of UAVs to estimate distance with the surrounding environment. Civil Aviation Authority of Singapore (CAAS) Submitted/Accepted version This research is supported by the National Research Foundation, Singapore, and the Civil Aviation Authority of Singapore, under the Aviation Transformation Programme. 2022-11-04T01:03:44Z 2022-11-04T01:03:44Z 2022 Conference Paper Zhang, Y., Yu, Q., Low Kin Huat & Lv, C. (2022). A self-supervised monocular depth estimation approach based on UAV aerial images. 2022 IEEE/AIAA 41st Digital Avionics Systems Conference (DASC). https://dx.doi.org/10.1109/DASC55683.2022.9925733 2155-7209 https://hdl.handle.net/10356/162468 10.1109/DASC55683.2022.9925733 en © 2022 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. The published version is available at: https://doi.org/10.1109/DASC55683.2022.9925733. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic Engineering::Mechanical engineering
Unmanned Aerial Vehicles
Self-Supervised Learning
Monocular Depth Estimation
Aerial Images
Multi-Scale Upsampling
spellingShingle Engineering::Mechanical engineering
Unmanned Aerial Vehicles
Self-Supervised Learning
Monocular Depth Estimation
Aerial Images
Multi-Scale Upsampling
Zhang, Yuhang
Yu, Qing
Low Kin Huat
Lv, Chen
A self-supervised monocular depth estimation approach based on UAV aerial images
description The Unmanned Aerial Vehicles (UAVs) have gained increasing attention recently, and depth estimation is one of the essential tasks for the safe operation of UAVs, especially for drones at low altitudes. Considering the limitations of UAVs’ size and payload, innovative methods combined with deep learning techniques have taken the place of traditional sensors to become the mainstream for predicting per-pixel depth information. Since supervised depth estimation methods require a massive amount of depth ground truth as the supervisory signal. This article proposes an unsupervised framework to tackle the issue of predicting the depth map given a sequence of monocular images. Our model can solve the problem of scale ambiguity by training the depth subnetwork jointly with the pose subnetwork. Moreover, we introduce a modified loss function that utilizes a weighted photometric loss combined with the edge-aware smoothness loss to optimize the training. The evaluation results are compared with the model without weighted loss and other unsupervised monocular depth estimation models (Monodepth and Monodepth2). Our model shows better performance than the others, indicating potential assistance in enhancing the capability of UAVs to estimate distance with the surrounding environment.
author2 School of Mechanical and Aerospace Engineering
author_facet School of Mechanical and Aerospace Engineering
Zhang, Yuhang
Yu, Qing
Low Kin Huat
Lv, Chen
format Conference or Workshop Item
author Zhang, Yuhang
Yu, Qing
Low Kin Huat
Lv, Chen
author_sort Zhang, Yuhang
title A self-supervised monocular depth estimation approach based on UAV aerial images
title_short A self-supervised monocular depth estimation approach based on UAV aerial images
title_full A self-supervised monocular depth estimation approach based on UAV aerial images
title_fullStr A self-supervised monocular depth estimation approach based on UAV aerial images
title_full_unstemmed A self-supervised monocular depth estimation approach based on UAV aerial images
title_sort self-supervised monocular depth estimation approach based on uav aerial images
publishDate 2022
url https://hdl.handle.net/10356/162468
_version_ 1749179213182664704