Report on industrial attachment with DSO National Laboratories

Cloud Computing is rapidly gaining widespread acceptance and has delivered its promised benefits, such as reduced cost, mobility, scalability and agility. Data Farming is an iterative process, which is both computation-intensive and dataintensive. With the incorporation of Cloud Computing, Data F...

Full description

Saved in:
Bibliographic Details
Main Author: Yong, Yong Cheng.
Other Authors: Low Yoke Hean, Malcolm
Format: Industrial Attachment (IA)
Language:English
Published: 2011
Subjects:
Online Access:http://hdl.handle.net/10356/46523
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Nanyang Technological University
Language: English
Description
Summary:Cloud Computing is rapidly gaining widespread acceptance and has delivered its promised benefits, such as reduced cost, mobility, scalability and agility. Data Farming is an iterative process, which is both computation-intensive and dataintensive. With the incorporation of Cloud Computing, Data Farming can be performed with a lower cost, in a larger scale and a faster time. MapReduce programming model was introduced by Google in 2004 to support distributed computing on large data-sets on clusters of computers. Since then, MapReduce has been popular and is implemented as a software framework in almost all Cloud Computing platforms. In the project, I have implemented a web service and supplemented three Data Farming tools with the ability to use the web service. These tools are able to execute their simulation runs on NTU Hadoop Cluster through their respective user interfaces and were recently being used in International Data Farming Workshop (IDFW) 19.