Dynamic output feedback image-based visual servoing of rotorcrafts
Recent advances in the field of unmanned aerial vehicles (UAVs) make rotorcrafts equipped with a camera suitable for performing advanced missions. One of the primary applications is tracking stationary and moving targets in GPSdenied environment or when the relative positioning is needed. Visual ser...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Theses and Dissertations |
Language: | English |
Published: |
2018
|
Subjects: | |
Online Access: | http://hdl.handle.net/10356/73849 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-73849 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-738492023-03-11T17:29:21Z Dynamic output feedback image-based visual servoing of rotorcrafts Li, Jianan Low Kin Huat School of Mechanical and Aerospace Engineering DRNTU::Engineering Recent advances in the field of unmanned aerial vehicles (UAVs) make rotorcrafts equipped with a camera suitable for performing advanced missions. One of the primary applications is tracking stationary and moving targets in GPSdenied environment or when the relative positioning is needed. Visual servoing provides such an alternative. However, image-based visual servoing (IBVS) for a rotorcraft UAV is challenging due to the nonlinear perspective projection of image formation, system uncertainties and underactuated nonlinear dynamics of the UAV. An IBVS law in consideration of system dynamics is known as dynamic image-based visual servoing (DIBVS). Among various DIBVS approaches, this research selects the virtual camera approach which is drawing more attention recently because it facilitates the estimation of image points’ depth and image kinematics. This thesis presents a dynamic output feedback image-based visual servoing law for rotorcraft UAVs. The proposed control law enables a UAV to regulate its position and heading relative to a visual target consisting of multiple coplanar points. The UAV is required to be equipped with a minimal set of sensors, i.e., an inertial measurement unit (IMU) and a single downward facing camera. A set of first order image moment features which are defined in virtual camera image plane are used for visual servoing. The proposed control law has the following characteristics. First, traditional IBVS approaches control the lateral and height subsystems separately and usually do not consider the potential loss of the image. Thus, in this research, the desired value of the image feature in controlling the vertical motion of the vehicle is designed to be a function of the image features of the lateral motion instead of a constant. This modification helps to keep the visual target stay in the camera’s field of view (FoV) by indirectly adjusting the height of the vehicle. Second, the dimension of the observer filter state space is reduced by removing an integral term in the observer, in which way the controller’s structure is further simplified while the asymptotic stability of the system is still maintained. Third, the control law is adaptive to various unknown system parameters including the mass of the vehicle, thrust coefficient, and bias errors in Euler angle measurement. Fourth, most traditional DIBVS control laws are developed relying on the measurement of the vehicle’s linear velocity. However, in GNSS-denied situation, this may not be practical. In this thesis, an output feedback method is adopted to DIBVS and the need of linear velocity measurement is removed.The controller guarantees the asymptotic stability of the error dynamics. Both simulation and experimental results are presented to demonstrate the performance of the proposed control law. The experiment architecture includes a quadrotor equipped with an open source Pixhawk autopilot and a CMUcam5 Pixy onboard computer vision system. The experimental result shows that the errors reach the steady state after about 20 seconds. At the steady state, the errors oscillate within a very small range where for position and heading errors, the oscillation amplitudes are less than 0:1 m and 0:1 rad, respectively. Master of Science (Aerospace Engineering) 2018-04-17T05:51:57Z 2018-04-17T05:51:57Z 2018 Thesis http://hdl.handle.net/10356/73849 en 97 p. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
DRNTU::Engineering |
spellingShingle |
DRNTU::Engineering Li, Jianan Dynamic output feedback image-based visual servoing of rotorcrafts |
description |
Recent advances in the field of unmanned aerial vehicles (UAVs) make rotorcrafts equipped with a camera suitable for performing advanced missions. One of the primary applications is tracking stationary and moving targets in GPSdenied environment or when the relative positioning is needed. Visual servoing provides such an alternative. However, image-based visual servoing (IBVS) for a rotorcraft UAV is challenging due to the nonlinear perspective projection of image formation, system uncertainties and underactuated nonlinear dynamics of the UAV. An IBVS law in consideration of system dynamics is known as dynamic image-based visual servoing (DIBVS). Among various DIBVS approaches, this research selects the virtual camera approach which is drawing more attention recently because it facilitates the estimation of image points’ depth and image kinematics. This thesis presents a dynamic output feedback image-based visual servoing law for rotorcraft UAVs. The proposed control law enables a UAV to regulate its position and heading relative to a visual target consisting of multiple coplanar points. The UAV is required to be equipped with a minimal set of sensors, i.e., an inertial measurement unit (IMU) and a single downward facing camera. A set of first order image moment features which are defined in virtual camera image plane are used for visual servoing. The proposed control law has the following characteristics. First, traditional IBVS approaches control the lateral and height subsystems separately and usually do not consider the potential loss of the image. Thus, in this research, the desired value of the image feature in controlling the vertical motion of the vehicle is designed to be a function of the image features of the lateral motion instead of a constant. This modification helps to keep the visual target stay in the camera’s field of view (FoV) by indirectly adjusting the height of the vehicle. Second, the dimension of the observer filter state space is reduced by removing an integral term in the observer, in which way the controller’s structure is further simplified while the asymptotic stability of the system is still maintained. Third, the control law is adaptive to various unknown system parameters including the mass of the vehicle, thrust coefficient, and bias errors in Euler angle measurement. Fourth, most traditional DIBVS control laws are developed relying on the measurement of the vehicle’s linear velocity. However, in GNSS-denied situation, this may not be practical. In this thesis, an output feedback method is adopted to DIBVS and the need of linear velocity measurement is removed.The controller guarantees the asymptotic stability of the error dynamics. Both simulation and experimental results are presented to demonstrate the performance of the proposed control law. The experiment architecture includes a quadrotor equipped with an open source Pixhawk autopilot and a CMUcam5 Pixy onboard computer vision system. The experimental result shows that the errors reach the steady state after about 20 seconds. At the steady state, the errors oscillate within a very small range where for position and heading errors, the oscillation amplitudes are less than 0:1 m and 0:1 rad, respectively. |
author2 |
Low Kin Huat |
author_facet |
Low Kin Huat Li, Jianan |
format |
Theses and Dissertations |
author |
Li, Jianan |
author_sort |
Li, Jianan |
title |
Dynamic output feedback image-based visual servoing of rotorcrafts |
title_short |
Dynamic output feedback image-based visual servoing of rotorcrafts |
title_full |
Dynamic output feedback image-based visual servoing of rotorcrafts |
title_fullStr |
Dynamic output feedback image-based visual servoing of rotorcrafts |
title_full_unstemmed |
Dynamic output feedback image-based visual servoing of rotorcrafts |
title_sort |
dynamic output feedback image-based visual servoing of rotorcrafts |
publishDate |
2018 |
url |
http://hdl.handle.net/10356/73849 |
_version_ |
1761781393255301120 |