A Comparison of Open Source Web Crawlers for E-Commerce Websites
© 2020 IEEE. Web crawlers are important tools for retrieving data such as text or image from the internet. It is an automated program that can retrieve information from the websites. E-commerce websites are essential areas for crawler applications. Moreover, large-scale crawling involves many proble...
Saved in:
Main Authors: | , |
---|---|
Format: | Conference Proceeding |
Published: |
2020
|
Subjects: | |
Online Access: | https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85085598345&origin=inward http://cmuir.cmu.ac.th/jspui/handle/6653943832/70144 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Chiang Mai University |
id |
th-cmuir.6653943832-70144 |
---|---|
record_format |
dspace |
spelling |
th-cmuir.6653943832-701442020-10-14T08:43:39Z A Comparison of Open Source Web Crawlers for E-Commerce Websites Desheng Yang Pree Thiengburanathum Arts and Humanities Computer Science Energy Engineering Medicine © 2020 IEEE. Web crawlers are important tools for retrieving data such as text or image from the internet. It is an automated program that can retrieve information from the websites. E-commerce websites are essential areas for crawler applications. Moreover, large-scale crawling involves many problems on the internet. Poor performing web crawlers can waste many resources for development and maintenance. Thus, choosing a suitable open source crawler becomes a huge challenge. This paper attempts to review the published previous studies on open source crawlers. The paper focuses on summarizing the performance evaluation methods of open source web crawlers, possible research trends and related research gaps. In addition, a proposed framework of the open source crawler evaluation was presented. 2020-10-14T08:24:52Z 2020-10-14T08:24:52Z 2020-03-01 Conference Proceeding 2-s2.0-85085598345 10.1109/ECTIDAMTNCON48261.2020.9090772 https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85085598345&origin=inward http://cmuir.cmu.ac.th/jspui/handle/6653943832/70144 |
institution |
Chiang Mai University |
building |
Chiang Mai University Library |
continent |
Asia |
country |
Thailand Thailand |
content_provider |
Chiang Mai University Library |
collection |
CMU Intellectual Repository |
topic |
Arts and Humanities Computer Science Energy Engineering Medicine |
spellingShingle |
Arts and Humanities Computer Science Energy Engineering Medicine Desheng Yang Pree Thiengburanathum A Comparison of Open Source Web Crawlers for E-Commerce Websites |
description |
© 2020 IEEE. Web crawlers are important tools for retrieving data such as text or image from the internet. It is an automated program that can retrieve information from the websites. E-commerce websites are essential areas for crawler applications. Moreover, large-scale crawling involves many problems on the internet. Poor performing web crawlers can waste many resources for development and maintenance. Thus, choosing a suitable open source crawler becomes a huge challenge. This paper attempts to review the published previous studies on open source crawlers. The paper focuses on summarizing the performance evaluation methods of open source web crawlers, possible research trends and related research gaps. In addition, a proposed framework of the open source crawler evaluation was presented. |
format |
Conference Proceeding |
author |
Desheng Yang Pree Thiengburanathum |
author_facet |
Desheng Yang Pree Thiengburanathum |
author_sort |
Desheng Yang |
title |
A Comparison of Open Source Web Crawlers for E-Commerce Websites |
title_short |
A Comparison of Open Source Web Crawlers for E-Commerce Websites |
title_full |
A Comparison of Open Source Web Crawlers for E-Commerce Websites |
title_fullStr |
A Comparison of Open Source Web Crawlers for E-Commerce Websites |
title_full_unstemmed |
A Comparison of Open Source Web Crawlers for E-Commerce Websites |
title_sort |
comparison of open source web crawlers for e-commerce websites |
publishDate |
2020 |
url |
https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85085598345&origin=inward http://cmuir.cmu.ac.th/jspui/handle/6653943832/70144 |
_version_ |
1681752849186291712 |