Hadoop debug optimization
This report described the design and development of a class which could aid in the debugging of Hadoop program. Common commercial used of Hadoop framework as mean for large data processing result in an increase of programming projects related to it. However, debugging of such program requires effort...
Saved in:
Main Author: | |
---|---|
Other Authors: | |
Format: | Final Year Project |
Language: | English |
Published: |
2012
|
Subjects: | |
Online Access: | http://hdl.handle.net/10356/48607 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
id |
sg-ntu-dr.10356-48607 |
---|---|
record_format |
dspace |
spelling |
sg-ntu-dr.10356-486072023-03-03T20:51:23Z Hadoop debug optimization Siow, Llukelly Jian Yang. School of Computer Engineering Parallel and Distributed Computing Centre He Bingsheng DRNTU::Engineering::Computer science and engineering::Computer systems organization::Special-purpose and application-based systems DRNTU::Engineering::Computer science and engineering::Software::Software engineering This report described the design and development of a class which could aid in the debugging of Hadoop program. Common commercial used of Hadoop framework as mean for large data processing result in an increase of programming projects related to it. However, debugging of such program requires effort and time since it could only be done when the program is completed and not during the development phase. The developed class is capable of implementing with desired code and run. Tests were conducted to find the effects of the developed class when integrated to three chosen Hadoop program. Results found that run time of the program increased insignificantly and would not make any difference to user. Bachelor of Engineering (Computer Engineering) 2012-04-27T04:33:56Z 2012-04-27T04:33:56Z 2012 2012 Final Year Project (FYP) http://hdl.handle.net/10356/48607 en Nanyang Technological University 40 p. application/pdf |
institution |
Nanyang Technological University |
building |
NTU Library |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
NTU Library |
collection |
DR-NTU |
language |
English |
topic |
DRNTU::Engineering::Computer science and engineering::Computer systems organization::Special-purpose and application-based systems DRNTU::Engineering::Computer science and engineering::Software::Software engineering |
spellingShingle |
DRNTU::Engineering::Computer science and engineering::Computer systems organization::Special-purpose and application-based systems DRNTU::Engineering::Computer science and engineering::Software::Software engineering Siow, Llukelly Jian Yang. Hadoop debug optimization |
description |
This report described the design and development of a class which could aid in the debugging of Hadoop program. Common commercial used of Hadoop framework as mean for large data processing result in an increase of programming projects related to it. However, debugging of such program requires effort and time since it could only be done when the program is completed and not during the development phase. The developed class is capable of implementing with desired code and run. Tests were conducted to find the effects of the developed class when integrated to three chosen Hadoop program. Results found that run time of the program increased insignificantly and would not make any difference to user. |
author2 |
School of Computer Engineering |
author_facet |
School of Computer Engineering Siow, Llukelly Jian Yang. |
format |
Final Year Project |
author |
Siow, Llukelly Jian Yang. |
author_sort |
Siow, Llukelly Jian Yang. |
title |
Hadoop debug optimization |
title_short |
Hadoop debug optimization |
title_full |
Hadoop debug optimization |
title_fullStr |
Hadoop debug optimization |
title_full_unstemmed |
Hadoop debug optimization |
title_sort |
hadoop debug optimization |
publishDate |
2012 |
url |
http://hdl.handle.net/10356/48607 |
_version_ |
1759856266688069632 |