Exploiting Wikipedia as External Knowledge for Document Clustering
Description
In traditional text clustering methods, documents are represented as bags of words without considering the semantic information of each document. For instance, if two documents use different collections of core words to represent the same topic, they may be falsely assigned to different clusters due to the lack of shared core words, although the core words they use are probably synonyms or semantically associated in other forms. The most common way to solve this problem is to enrich document representation with the background knowledge in an ontology. There are two major issues for this approach: (1) the coverage of the ontology is limited, even for WordNet or Mesh, (2) using ontology terms as replacement or additional features may cause information loss, or introduce noise. In this paper, we present a novel text clustering method to address these two issues by enriching document representation with Wikipedia concept and category information. We develop two approaches, exact match and relatedness-match, to map text documents to Wikipedia concepts, and further to Wikipedia categories. Then the text documents are clustered based on a similarity metric which combines document content information, concept information as well as category information. The experimental results using the proposed clustering framework on three datasets (20-newsgroup, TDT2, and LA Times) show that clustering performance improves significantly by enriching document representation with Wikipedia concepts and categories.
| Slides | |
| 0:00 | Exploiting Wikipedia as External Knowledge for Document Clustering |
| 0:15 | Outline |
| 0:46 | Introduction (1) |
| 1:35 | Introduction (2) |
| 2:53 | Wikipedia as Ontology (1) |
| 3:08 | Wikipedia as Ontology (2) |
| 4:09 | Wikipedia as Ontology (3) |
| 4:25 | Wikipedia as Ontology (4) - Wikipedia Article that describes the Concept Artificial intelligence |
| 4:44 | Wikipedia as Ontology (5) |
| 4:55 | Wikipedia as Ontology (6) - AI is redirected to its equivalent concept Artificial Intelligence |
| 5:18 | Wikipedia as Ontology (7) |
| 5:59 | Wikipedia as Ontology (8) - The concept |
| 6:04 | Wikipedia as Ontology (9) |
| 6:15 | Wikipedia as Ontology (10) - The different meanings |
| 6:34 | The Framework of leveraging Wikipedia for document clustering |
| 8:18 | Concept Mapping |
| 8:26 | 1. Concept Mapping - Exact Match |
| 8:50 | Concept Mapping Schemes: Exact Match (1) |
| 9:06 | Concept Mapping Schemes: Exact Match (2) |
| 10:05 | Concept Mapping Schemes: Exact Match (3) |
| 10:23 | 2. Concept Mapping – Relatedness Match |
| 11:14 | Concept Mapping Schemes: Relatedness Match (1) |
| 11:35 | Concept Mapping Schemes: Relatedness Match (2) |
| 11:58 | Concept Mapping Schemes: Relatedness Match (3) |
| 12:24 | Category Mapping (1) |
| 12:42 | 3. Category Mapping |
| 13:00 | Category Mapping (2) |
| 14:03 | Category Mapping (3) |
| 14:12 | Document Clustering |
| 14:30 | Experiments (1) |
| 15:00 | Experiments (2) |
| 15:42 | Experiments (3) |
| 16:19 | Agglomerative clustering results (1) |
| 16:38 | Agglomerative clustering results (2) |
| 16:49 | Agglomerative clustering results (3) |
| 16:55 | Partitional Clustering Results (1) |
| 17:04 | Partitional Clustering Results (2) |
| 17:32 | Partitional Clustering Results (3) |
| 17:35 | Conclusions |
| 18:09 | Future Work |
| 18:34 | Questions |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
SEE ALSO:
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !




