Discovery of concept entities from web sites using web unit mining
A web site usually contains a large number of concept entities, each consisting of one or more web pages connected by hyperlinks. In order to discover these concept entities for more expressive web site queries and other applications, the web unit mining problem has been proposed. Web unit mining ai...
Saved in:
Main Authors: | , , , |
---|---|
Other Authors: | |
Format: | Article |
Language: | English |
Published: |
2010
|
Subjects: | |
Online Access: | https://hdl.handle.net/10356/93769 http://hdl.handle.net/10220/6193 http://www.emeraldinsight.com/Insight/viewContentItem.do?contentType=Article&hdAction=lnkpdf&contentId=1614095 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Nanyang Technological University |
Language: | English |
Summary: | A web site usually contains a large number of concept entities, each consisting of one or more web pages connected by hyperlinks. In order to discover these concept entities for more expressive web site queries and other applications, the web unit mining problem has been proposed. Web unit mining aims to determine web pages that constitute a concept entity and classify concept entities into categories. Nevertheless, the performance of
an existing web unit mining algorithm, iWUM, suffers as it may
create more than one web unit (incomplete web units) from a
single concept entity. This paper presents two methods to solve this problem. The first method introduces a more effective web
fragment construction method so as reduce later classification
errors. The second method incorporates site-specific knowledge to discover and handle incomplete web units. Experiments show that incomplete web units can be removed and overall accuracy
has been significantly improved, especially on the precision and
F1 measures. |
---|