Data pre-processing on web server logs for generalized association rules mining algorithm

• Main Authors: Abd Wahab, Mohd Helmy, Mohd, Mohd Norzali, Hanafi, Hafizul Fahri, Mohamad Mohsin, Mohamad Farhan
• Format: Article
• Language: English
• Published: World Academy of Science, Engineering and Technology 2008
• Subjects: QA75 Electronic computers. Computer science
• Online Access: http://repo.uum.edu.my/15363/1/10.1.1.193.5952.pdf; http://repo.uum.edu.my/15363/
• Institution: Universiti Utara Malaysia

Web log file analysis began as a way for IT administrators to ensure adequate bandwidth and server capacity on their organizations website. Log file data can offer valuable insight into web site usage.It reflects actual usage in natural working condition, compared to the artificial setting of a usability lab.It represents the activity of many users, over potentially long period of time, compared to a limited number of users for an hour or two each.This paper describes the pre-processing techniques on IIS Web Server Logs ranging from the raw log file until before mining process can be performed. Since the pre-processing is tedious process, it depending on the algorithm and purposes of the applications.