A Social Network Approach to Unsupervised Induction of Syntactic Clusters for Bengali
published: Dec. 14, 2007, recorded: October 2007, views: 2940
Report a problem or upload filesIf you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
In this paper we describe some experiments on fully unsupervised induction of parts-of-speech tags for Bengali words from a raw text corpus. For this purpose, we construct the network of 5000 most frequent Bengali words, where nodes are the types and the weight on the edge between two types is indicative of their distributional similarity and cluster the network using the Chinese Whispers algorithm . We also propose the concept of tag-entropy that measures the cohesiveness of the word clusters in terms of the lexical categories of the constituent words.
Link this pageWould you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !