End-effector camera usage investigation for dual-arm industrial robot
For robot perception system, accuracy and cost coexist. For single camera perception system, the cost will be very high to achieve high perception accuracy. Thus, the cooperation of several cameras can be a possible solution to balance the cost and accuracy. This report aims to investigate the use...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Final Year Project |
Language: | English |
Published: |
2017
|
Subjects: | |
Online Access: | http://hdl.handle.net/10356/70973 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-70973 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-709732023-03-04T18:37:30Z End-effector camera usage investigation for dual-arm industrial robot Gao, Chuanchao Chen I-Ming School of Mechanical and Aerospace Engineering Robotics Research Centre DRNTU::Engineering::Electrical and electronic engineering::Control and instrumentation::Robotics For robot perception system, accuracy and cost coexist. For single camera perception system, the cost will be very high to achieve high perception accuracy. Thus, the cooperation of several cameras can be a possible solution to balance the cost and accuracy. This report aims to investigate the use of end-effector camera to increase the accuracy of object recognition for dual-arm industrial robot, NEXTAGE. It covers the key parameters for robot perception system, like camera calibration, stereo camera usage, hand camera usage, and robot motion control. The robot integrates with a Kinect stereo camera, two hand cameras, and two grippers. The cameras provide 3D depth and 2D image data, which provide the vision system for the robot. The grippers allow user to implement the desired application. The software development for the robot was done in Robot Operation System (ROS) which is embedded in Linux operation system, Ubuntu 14.04. In this project, the author has provided the necessary knowledge and background for the functions development of the robot, like OpenCV, Point Cloud Library. In addition, the author provided the way of implementing the C++ or Python code into ROS, which enables the robot to handle real time control tasks. In the project, the author has tested the method of coordination of head stereo camera and hand RGB camera in the sensing accuracy improvement. All the codes have been integrated into ROS structure, and each node was intended to perform one or more basic functions. The robot was able to execute the task successfully and achieve desired outcomes with the code developed. Bachelor of Engineering (Mechanical Engineering) 2017-05-12T05:52:22Z 2017-05-12T05:52:22Z 2017 Final Year Project (FYP) http://hdl.handle.net/10356/70973 en Nanyang Technological University 58 p. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
DRNTU::Engineering::Electrical and electronic engineering::Control and instrumentation::Robotics |
spellingShingle |
DRNTU::Engineering::Electrical and electronic engineering::Control and instrumentation::Robotics Gao, Chuanchao End-effector camera usage investigation for dual-arm industrial robot |
description |
For robot perception system, accuracy and cost coexist. For single camera perception system, the cost will be very high to achieve high perception accuracy. Thus, the cooperation of several cameras can be a possible solution to balance the cost and accuracy.
This report aims to investigate the use of end-effector camera to increase the accuracy of object recognition for dual-arm industrial robot, NEXTAGE. It covers the key parameters for robot perception system, like camera calibration, stereo camera usage, hand camera usage, and robot motion control. The robot integrates with a Kinect stereo camera, two hand cameras, and two grippers. The cameras provide 3D depth and 2D image data, which provide the vision system for the robot. The grippers allow user to implement the desired application.
The software development for the robot was done in Robot Operation System (ROS) which is embedded in Linux operation system, Ubuntu 14.04. In this project, the author has provided the necessary knowledge and background for the functions development of the robot, like OpenCV, Point Cloud Library. In addition, the author provided the way of implementing the C++ or Python code into ROS, which enables the robot to handle real time control tasks.
In the project, the author has tested the method of coordination of head stereo camera and hand RGB camera in the sensing accuracy improvement. All the codes have been integrated into ROS structure, and each node was intended to perform one or more basic functions. The robot was able to execute the task successfully and achieve desired outcomes with the code developed. |
author2 |
Chen I-Ming |
author_facet |
Chen I-Ming Gao, Chuanchao |
format |
Final Year Project |
author |
Gao, Chuanchao |
author_sort |
Gao, Chuanchao |
title |
End-effector camera usage investigation for dual-arm industrial robot |
title_short |
End-effector camera usage investigation for dual-arm industrial robot |
title_full |
End-effector camera usage investigation for dual-arm industrial robot |
title_fullStr |
End-effector camera usage investigation for dual-arm industrial robot |
title_full_unstemmed |
End-effector camera usage investigation for dual-arm industrial robot |
title_sort |
end-effector camera usage investigation for dual-arm industrial robot |
publishDate |
2017 |
url |
http://hdl.handle.net/10356/70973 |
_version_ |
1759857884266496000 |