Subspace, Latent Structure and Feature Selection techniques: Statistical and Optimisation perspectives Workshop

Latent Semantic Variable Models

author: Thomas Hofmann, Brown University

Description

In the context of information retrieval and natural language processing, latent variable models are quite useful in modeling and discovering hidden structure that often leads to "semantic" data representations. This talk will provide an overview of the most popular approaches and discuss the range of possible applications for such models, including language modeling, ad hoc retrieval, text categorization and collaborative filtering.

Categories

Top: Computer Science: Machine Learning: Principal Component Analysis
Top: Computer Science: Text Mining

You might be experiencing some problems with Your Video player.

*Slides*
0:01	Latent Semantic Variable Models
0:43	Introduction Information Retrieval & Latent Semantic Indexing Probabilistic Latent Semantic Indexing Semantic Features for Text Categorizisation Probabilistic HITS Collaborative Filtering Concl
1:19	Latent Structure
2:23	Matrix Decomposition
3:13	Introduction Information Retrieval & Latent Semantic Indexing Probabilistic Latent Semantic Indexing Semantic Features for Text Categorizisation Probabilistic HITS Collaborative Filtering Concl
3:23	Searching & Finding
4:14	Ad Hoc Retrieval
4:55	Document-Term Matrix
6:47	A 100 Millionths of a Typical Document-Term Matrix
7:45	Robust Information Retrieval — Beyond Keyword-based Search
9:48	Challenges
10:41	Latent Semantic Analysis
12:18	Singular Value Decomposition
13:26	Low-rank Approximation
14:35	LSA Decomposition
15:21	Latent Semantic Analysis
16:31	Introduction Information Retrieval & Latent Semantic Indexing Probabilistic Latent Semantic Indexing Semantic Features for Text Categorizisation Probabilistic HITS Collaborative Filtering Concl
16:39	Search as Statistical Inference
19:00	Language Model Paradigm in IR
20:10	Language Model Paradigm
20:46	Language Model Paradigm
21:13	Naive Approach
21:51	Estimation Problem
22:38	Probabilistic Latent Semantic Analysis
24:13	pLSA – Latent Variable Model
25:25	pLSA: Matrix Decomposition
27:19	pLSA: Graphical Model
28:37	pLSA via Likelihood Maximization
29:26	Expectation Maximization Algorithm
31:22	EM Algorithm: Derivation
31:41	Tempered EM Algorithm
35:05	Example (1)
37:32	Example (2)
38:13	Experimental Evaluation
39:41	Live Implementation
43:08	Latent Dirichlet Allocation
46:17	Introduction Information Retrieval & Latent Semantic Indexing Probabilistic Latent Semantic Indexing Semantic Features for Text Categorizisation Probabilistic HITS Collaborative Filtering Concl
46:32	Concept-based Text Categorization
47:32	Terms & Concepts as Features
48:36	Improvements on Reuters-21578
49:32	Improvements on OHSUMED87
50:59	Literature & Related Work
52:00	Introduction Information Retrieval & Latent Semantic Indexing Probabilistic Latent Semantic Indexing Semantic Features for Text Categorizisation Probabilistic HITS Collaborative Filtering Concl
52:01	Probabilistic HITS
53:40	Finding Latent Web Communities
54:06	Decomposing the Web Graph
55:01	Linking Hyperlinks and Content
56:06	Example: Ulysses
57:38	Literature & Related Work
57:40	Introduction Information Retrieval & Latent Semantic Indexing Probabilistic Latent Semantic Indexing Semantic Features for Text Categorizisation Probabilistic HITS Collaborative Filtering Concl
57:51	Predictions & Recommendations

Lecture rating

People found this lecture:
Worth seeing
because it is:
Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.