Hadoop debug optimization

This report described the design and development of a class which could aid in the debugging of Hadoop program. Common commercial used of Hadoop framework as mean for large data processing result in an increase of programming projects related to it. However, debugging of such program requires effort...

Full description

Saved in:
Bibliographic Details
Main Author: Siow, Llukelly Jian Yang.
Other Authors: School of Computer Engineering
Format: Final Year Project
Language:English
Published: 2012
Subjects:
Online Access:http://hdl.handle.net/10356/48607
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
id sg-ntu-dr.10356-48607
record_format dspace
spelling sg-ntu-dr.10356-486072023-03-03T20:51:23Z Hadoop debug optimization Siow, Llukelly Jian Yang. School of Computer Engineering Parallel and Distributed Computing Centre He Bingsheng DRNTU::Engineering::Computer science and engineering::Computer systems organization::Special-purpose and application-based systems DRNTU::Engineering::Computer science and engineering::Software::Software engineering This report described the design and development of a class which could aid in the debugging of Hadoop program. Common commercial used of Hadoop framework as mean for large data processing result in an increase of programming projects related to it. However, debugging of such program requires effort and time since it could only be done when the program is completed and not during the development phase. The developed class is capable of implementing with desired code and run. Tests were conducted to find the effects of the developed class when integrated to three chosen Hadoop program. Results found that run time of the program increased insignificantly and would not make any difference to user. Bachelor of Engineering (Computer Engineering) 2012-04-27T04:33:56Z 2012-04-27T04:33:56Z 2012 2012 Final Year Project (FYP) http://hdl.handle.net/10356/48607 en Nanyang Technological University 40 p. application/pdf
institution Nanyang Technological University
building NTU Library
continent Asia
country Singapore
Singapore
content_provider NTU Library
collection DR-NTU
language English
topic DRNTU::Engineering::Computer science and engineering::Computer systems organization::Special-purpose and application-based systems
DRNTU::Engineering::Computer science and engineering::Software::Software engineering
spellingShingle DRNTU::Engineering::Computer science and engineering::Computer systems organization::Special-purpose and application-based systems
DRNTU::Engineering::Computer science and engineering::Software::Software engineering
Siow, Llukelly Jian Yang.
Hadoop debug optimization
description This report described the design and development of a class which could aid in the debugging of Hadoop program. Common commercial used of Hadoop framework as mean for large data processing result in an increase of programming projects related to it. However, debugging of such program requires effort and time since it could only be done when the program is completed and not during the development phase. The developed class is capable of implementing with desired code and run. Tests were conducted to find the effects of the developed class when integrated to three chosen Hadoop program. Results found that run time of the program increased insignificantly and would not make any difference to user.
author2 School of Computer Engineering
author_facet School of Computer Engineering
Siow, Llukelly Jian Yang.
format Final Year Project
author Siow, Llukelly Jian Yang.
author_sort Siow, Llukelly Jian Yang.
title Hadoop debug optimization
title_short Hadoop debug optimization
title_full Hadoop debug optimization
title_fullStr Hadoop debug optimization
title_full_unstemmed Hadoop debug optimization
title_sort hadoop debug optimization
publishDate 2012
url http://hdl.handle.net/10356/48607
_version_ 1759856266688069632