Hadoop debug optimization

This report described the design and development of a class which could aid in the debugging of Hadoop program. Common commercial used of Hadoop framework as mean for large data processing result in an increase of programming projects related to it. However, debugging of such program requires effort...

全面介紹

Saved in:
書目詳細資料
主要作者: Siow, Llukelly Jian Yang.
其他作者: School of Computer Engineering
格式: Final Year Project
語言:English
出版: 2012
主題:
在線閱讀:http://hdl.handle.net/10356/48607
標簽: 添加標簽
沒有標簽, 成為第一個標記此記錄!
實物特徵
總結:This report described the design and development of a class which could aid in the debugging of Hadoop program. Common commercial used of Hadoop framework as mean for large data processing result in an increase of programming projects related to it. However, debugging of such program requires effort and time since it could only be done when the program is completed and not during the development phase. The developed class is capable of implementing with desired code and run. Tests were conducted to find the effects of the developed class when integrated to three chosen Hadoop program. Results found that run time of the program increased insignificantly and would not make any difference to user.