Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set
Organized by Universiti Malaysia Perlis (UniMAP), 9th - 12th June 2007 at Park Royal Hotel, Penang.
Saved in:
Main Authors: | , , , |
---|---|
Format: | Working Paper |
Language: | English |
Published: |
Universiti Malaysia Perlis (UniMAP)
2008
|
Subjects: | |
Online Access: | http://dspace.unimap.edu.my/xmlui/handle/123456789/1171 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Universiti Malaysia Perlis |
Language: | English |
id |
my.unimap-1171 |
---|---|
record_format |
dspace |
spelling |
my.unimap-11712009-04-16T03:26:06Z Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set Norazian, Mohamed Noor Mohd Mustafa, Al Bakri Abdullah Ahmad Shukri, Yahaya Nor Azam, Ramli Linear interpolation method Mean method Missing values Environmental research -- Missing values Environmental engineering -- Research Missing values -- Analysis Organized by Universiti Malaysia Perlis (UniMAP), 9th - 12th June 2007 at Park Royal Hotel, Penang. Missing data is a very frequent problem in many scientific field including environmental research. These are usually due to machine failure, routine maintenance, changes in siting monitors and human error. Incomplete datasets can cause bias due to systematic differences between observed and unobserved data. Therefore, the need to find the best way in estimating missing values is very important so that the data analysed is ensured of high quality. In this study, two methods were used to estimate the missing values in environmental data set and the performances of these methods were compared. The two methods are linear interpolation method and mean method. Annual hourly monitoring data for PM10 were used to generate simulated missing values. Four randomly simulated missing data patterns were generated for evaluating the accuracy of imputation techniques in different missing data conditions. They are 10%, 15%, 25% and 40%. Three types of performance indicators that are mean absolute error (MAE), rootmean squared error (RMSE) and coefficient of determination (R2) were calculated in order to describe the goodness of fit for the two methods. From the two methods applied, it was found that linear interpolation method gave better results compared to mean method in substituting data for all percentage of missing data considered. 2008-05-20T07:38:32Z 2008-05-20T07:38:32Z 2007-06-09 Working Paper http://hdl.handle.net/123456789/1171 en 1st International Conference on Sustainable Materials 2007 (ICoSM2007) Universiti Malaysia Perlis (UniMAP) |
institution |
Universiti Malaysia Perlis |
building |
UniMAP Library |
collection |
Institutional Repository |
continent |
Asia |
country |
Malaysia |
content_provider |
Universiti Malaysia Perlis |
content_source |
UniMAP Library Digital Repository |
url_provider |
http://dspace.unimap.edu.my/ |
language |
English |
topic |
Linear interpolation method Mean method Missing values Environmental research -- Missing values Environmental engineering -- Research Missing values -- Analysis |
spellingShingle |
Linear interpolation method Mean method Missing values Environmental research -- Missing values Environmental engineering -- Research Missing values -- Analysis Norazian, Mohamed Noor Mohd Mustafa, Al Bakri Abdullah Ahmad Shukri, Yahaya Nor Azam, Ramli Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set |
description |
Organized by Universiti Malaysia Perlis (UniMAP), 9th - 12th June 2007 at Park Royal Hotel, Penang. |
format |
Working Paper |
author |
Norazian, Mohamed Noor Mohd Mustafa, Al Bakri Abdullah Ahmad Shukri, Yahaya Nor Azam, Ramli |
author_facet |
Norazian, Mohamed Noor Mohd Mustafa, Al Bakri Abdullah Ahmad Shukri, Yahaya Nor Azam, Ramli |
author_sort |
Norazian, Mohamed Noor |
title |
Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set |
title_short |
Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set |
title_full |
Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set |
title_fullStr |
Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set |
title_full_unstemmed |
Comparison of Linear Interpolation Method and Mean Method to Replace the Missing Values in Environmental Data Set |
title_sort |
comparison of linear interpolation method and mean method to replace the missing values in environmental data set |
publisher |
Universiti Malaysia Perlis (UniMAP) |
publishDate |
2008 |
url |
http://dspace.unimap.edu.my/xmlui/handle/123456789/1171 |
_version_ |
1643787091084050432 |