Learning Parameters in Discrete Naive Bayes Models by Computing Fibers of the Parametrization map
Description
Discrete Naive Bayes models are usually defined parametrically with a map from a parameter space to a probability distribution space. First, we present two families of algorithms that compute the set of parameters mapped to a given discrete Naive Bayes distribution satisfying certain technical assumptions. Using these results, we then present two families of parameter learning algorithms that operate by projecting the distribution of observed relative frequencies in a dataset onto the discrete Naive Bayes model considered. They have nice convergence properties, but their computational complexity grows very quickly with the number of hidden classes of the model.
You might be experiencing some problems with Your Video player.
| Slides | |
| 0:00 | Learning Parameters in Discrete Naive Bayes models by Computing Fibers of the Parametrization Map |
| 0:19 | Naive Bayesian networks |
| 0:47 | Problem statement |
| 1:58 | Outline |
| 2:31 | Some notation (1) |
| 3:16 | Some notation (2) |
| 5:01 | w is normal to the hyperplane |
| 5:56 | - Some notation (3) |
| 6:38 | - w is normal to the hyperplane (2) |
| 7:11 | The components of A are the roots of a degree m polynomial (1) |
| 8:14 | The components of A are the roots of a degree m polynomial (2) |
| 9:19 | The parameters satisfy simple polynomial equations (1) |
| 10:38 | The parameters satisfy simple polynomial equations (2) |
| 11:17 | Some determinants have an interpretable decomposition |
| 12:45 | Simple implicit equations follow |
| 13:34 | Outline (2) |
| 13:38 | Potential applications of our results |
| 15:35 | An important hypothesis to compute the parameters |
| 16:36 | Computation of w |
| 17:37 | Computation of Ax |
| 18:30 | Computation of Au |
| 19:33 | Computation of Au: a brute force approach |
| 20:38 | Computation of A: a second approach |
| 21:44 | Computation of Au for m=3 |
| 22:17 | The inversion algorithms can be adapted to estimate parameters |
| 23:36 | Practical issues |
| 25:21 | Extension to hierarchical latent class models |
| 26:28 | Conclusion |
| 27:28 | - Questions |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
Visitors who watched this lecture also watched...
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !




