Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set

Organized by Universiti Malaysia Perlis (UniMAP), 9th - 12th June 2007 at Park Royal Hotel, Penang.

Saved in:
Bibliographic Details
Main Authors: Norazian, Mohamed Noor, Mohd Mustafa, Al Bakri Abdullah, Ahmad Shukri, Yahaya, Nor Azam, Ramli
Format: Working Paper
Language:English
Published: Universiti Malaysia Perlis (UniMAP) 2008
Subjects:
Online Access:http://dspace.unimap.edu.my/xmlui/handle/123456789/1171
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Universiti Malaysia Perlis
Language: English
id my.unimap-1171
record_format dspace
spelling my.unimap-11712009-04-16T03:26:06Z Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set Norazian, Mohamed Noor Mohd Mustafa, Al Bakri Abdullah Ahmad Shukri, Yahaya Nor Azam, Ramli Linear interpolation method Mean method Missing values Environmental research -- Missing values Environmental engineering -- Research Missing values -- Analysis Organized by Universiti Malaysia Perlis (UniMAP), 9th - 12th June 2007 at Park Royal Hotel, Penang. Missing data is a very frequent problem in many scientific field including environmental research. These are usually due to machine failure, routine maintenance, changes in siting monitors and human error. Incomplete datasets can cause bias due to systematic differences between observed and unobserved data. Therefore, the need to find the best way in estimating missing values is very important so that the data analysed is ensured of high quality. In this study, two methods were used to estimate the missing values in environmental data set and the performances of these methods were compared. The two methods are linear interpolation method and mean method. Annual hourly monitoring data for PM10 were used to generate simulated missing values. Four randomly simulated missing data patterns were generated for evaluating the accuracy of imputation techniques in different missing data conditions. They are 10%, 15%, 25% and 40%. Three types of performance indicators that are mean absolute error (MAE), rootmean squared error (RMSE) and coefficient of determination (R2) were calculated in order to describe the goodness of fit for the two methods. From the two methods applied, it was found that linear interpolation method gave better results compared to mean method in substituting data for all percentage of missing data considered. 2008-05-20T07:38:32Z 2008-05-20T07:38:32Z 2007-06-09 Working Paper http://hdl.handle.net/123456789/1171 en 1st International Conference on Sustainable Materials 2007 (ICoSM2007) Universiti Malaysia Perlis (UniMAP)
institution Universiti Malaysia Perlis
building UniMAP Library
collection Institutional Repository
continent Asia
country Malaysia
content_provider Universiti Malaysia Perlis
content_source UniMAP Library Digital Repository
url_provider http://dspace.unimap.edu.my/
language English
topic Linear interpolation method
Mean method
Missing values
Environmental research -- Missing values
Environmental engineering -- Research
Missing values -- Analysis
spellingShingle Linear interpolation method
Mean method
Missing values
Environmental research -- Missing values
Environmental engineering -- Research
Missing values -- Analysis
Norazian, Mohamed Noor
Mohd Mustafa, Al Bakri Abdullah
Ahmad Shukri, Yahaya
Nor Azam, Ramli
Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set
description Organized by Universiti Malaysia Perlis (UniMAP), 9th - 12th June 2007 at Park Royal Hotel, Penang.
format Working Paper
author Norazian, Mohamed Noor
Mohd Mustafa, Al Bakri Abdullah
Ahmad Shukri, Yahaya
Nor Azam, Ramli
author_facet Norazian, Mohamed Noor
Mohd Mustafa, Al Bakri Abdullah
Ahmad Shukri, Yahaya
Nor Azam, Ramli
author_sort Norazian, Mohamed Noor
title Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set
title_short Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set
title_full Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set
title_fullStr Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set
title_full_unstemmed Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set
title_sort comparison of linear interpolation method and mean method to replace the missing values in environmental data set
publisher Universiti Malaysia Perlis (UniMAP)
publishDate 2008
url http://dspace.unimap.edu.my/xmlui/handle/123456789/1171
_version_ 1643787091084050432