Hadoop debug optimization

Hadoop debug optimization

This report described the design and development of a class which could aid in the debugging of Hadoop program. Common commercial used of Hadoop framework as mean for large data processing result in an increase of programming projects related to it. However, debugging of such program requires effort...

Full description

Saved in:
Bibliographic Details
Main Author: Siow, Llukelly Jian Yang.
Other Authors: School of Computer Engineering
Format: Final Year Project
Language:English
Published: 2012
Subjects:
DRNTU::Engineering::Computer science and engineering::Computer systems organization::Special-purpose and application-based systems
DRNTU::Engineering::Computer science and engineering::Software::Software engineering
Online Access:http://hdl.handle.net/10356/48607
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:This report described the design and development of a class which could aid in the debugging of Hadoop program. Common commercial used of Hadoop framework as mean for large data processing result in an increase of programming projects related to it. However, debugging of such program requires effort and time since it could only be done when the program is completed and not during the development phase. The developed class is capable of implementing with desired code and run. Tests were conducted to find the effects of the developed class when integrated to three chosen Hadoop program. Results found that run time of the program increased insignificantly and would not make any difference to user.

Similar Items