event thumbnail image
Research Track

Exploiting Wikipedia as External Knowledge for Document Clustering

author: Xiaohua Tony Hu, iSchool at Drexel - College of Information Science and Technology, Drexel University

Description

In traditional text clustering methods, documents are represented as bags of words without considering the semantic information of each document. For instance, if two documents use different collections of core words to represent the same topic, they may be falsely assigned to different clusters due to the lack of shared core words, although the core words they use are probably synonyms or semantically associated in other forms. The most common way to solve this problem is to enrich document representation with the background knowledge in an ontology. There are two major issues for this approach: (1) the coverage of the ontology is limited, even for WordNet or Mesh, (2) using ontology terms as replacement or additional features may cause information loss, or introduce noise. In this paper, we present a novel text clustering method to address these two issues by enriching document representation with Wikipedia concept and category information. We develop two approaches, exact match and relatedness-match, to map text documents to Wikipedia concepts, and further to Wikipedia categories. Then the text documents are clustered based on a similarity metric which combines document content information, concept information as well as category information. The experimental results using the proposed clustering framework on three datasets (20-newsgroup, TDT2, and LA Times) show that clustering performance improves significantly by enriching document representation with Wikipedia concepts and categories.

You might be experiencing some problems with Your Video player.
Slides
0:00 Exploiting Wikipedia as External Knowledge for Document Clustering
0:15 Outline
0:46 Introduction (1)
1:35 Introduction (2)
2:53 Wikipedia as Ontology (1)
3:08 Wikipedia as Ontology (2)
4:09 Wikipedia as Ontology (3)
4:25 Wikipedia as Ontology (4) - Wikipedia Article that describes the Concept Artificial intelligence
4:44 Wikipedia as Ontology (5)
4:55 Wikipedia as Ontology (6) - AI is redirected to its equivalent concept Artificial Intelligence
5:18 Wikipedia as Ontology (7)
5:59 Wikipedia as Ontology (8) - The concept
6:04 Wikipedia as Ontology (9)
6:15 Wikipedia as Ontology (10) - The different meanings
6:34 The Framework of leveraging Wikipedia for document clustering
8:18 Concept Mapping
8:26 1. Concept Mapping - Exact Match
8:50 Concept Mapping Schemes: Exact Match (1)
9:06 Concept Mapping Schemes: Exact Match (2)
10:05 Concept Mapping Schemes: Exact Match (3)
10:23 2. Concept Mapping – Relatedness Match
11:14 Concept Mapping Schemes: Relatedness Match (1)
11:35 Concept Mapping Schemes: Relatedness Match (2)
11:58 Concept Mapping Schemes: Relatedness Match (3)
12:24 Category Mapping (1)
12:42 3. Category Mapping
13:00 Category Mapping (2)
14:03 Category Mapping (3)
14:12 Document Clustering
14:30 Experiments (1)
15:00 Experiments (2)
15:42 Experiments (3)
16:19 Agglomerative clustering results (1)
16:38 Agglomerative clustering results (2)
16:49 Agglomerative clustering results (3)
16:55 Partitional Clustering Results (1)
17:04 Partitional Clustering Results (2)
17:32 Partitional Clustering Results (3)
17:35 Conclusions
18:09 Future Work
18:34 Questions

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment:

make sure you have javascript enabled or clear this field: