Nonextensive Entropic Kernels
Description
Positive definite kernels on probability measures have been recently applied in structured data classification problems. Some of these kernels are related to classic information theoretic quantities, such as mutual information and the Jensen-Shannon divergence. Meanwhile, driven by recent advances in Tsallis statistics, nonextensive generalizations of Shannon’s information theory have been proposed. This paper bridges these two trends. We introduce the Jensen-Tsallis q-difference, a generalization of the Jensen-Shannon divergence. We then define a new family of nonextensive mutual information kernels, which allow weights to be assigned to their arguments, and which includes the Boolean, Jensen-Shannon, and linear kernels as particular cases. We illustrate the performance of these kernels on text categorization tasks.
| Slides | |
| 0:00 | Nonextensive Entropic Kernels |
| 0:21 | Summary |
| 0:23 | Outline - Outline |
| 0:25 | Outline - 1 |
| 0:42 | Outline - 2 |
| 1:25 | Outline - 3 |
| 1:28 | Outline - 4 |
| 1:40 | Outline - 5 |
| 1:44 | Outline - 6 |
| 2:05 | Outline - Kernels |
| 2:06 | Hilbert Space Embedding |
| 2:40 | Kernels for Structured Data - 1 |
| 2:46 | Kernels for Structured Data - 2 |
| 3:16 | Kernels for Structured Data - 3 |
| 3:54 | Kernels on Probability Distributions |
| 5:21 | Kernels on Probability Distributions (c’ed) |
| 6:29 | Outline - Shannon, Renyi, and Tsallis Entropies |
| 6:31 | Shannon Entropy |
| 7:03 | Renyi Entropies |
| 7:27 | Tsallis Entropies - 1 |
| 8:19 | Tsallis Entropies - 2 |
| 8:29 | Tsallis Entropies - 3 |
| 8:49 | Tsallis Entropies - 4 |
| 9:08 | Tsallis Entropies - 5 |
| 9:47 | Outline - Jensen Differences and Divergences |
| 9:48 | Jensen Differences - 1 |
| 11:04 | Jensen Differences - 2 |
| 11:13 | Jensen Differences - 3 |
| 11:16 | Outline - Jensen q-Differences |
| 11:19 | Jensen q-Differences - 1 |
| 12:20 | Jensen q-Differences - 2 |
| 12:40 | Jensen-Tsallis q-Differences |
| 13:43 | Outline - Jensen-Tsallis Kernels |
| 13:45 | Jensen-Tsallis Kernels |
| 14:16 | Special Cases |
| 15:04 | Outline - Experiments |
| 15:06 | Text Classification Experiments |
| 16:26 | Text Classification Experiments (c’ed) |
| 17:15 | Outline - Conclusions |
| 17:16 | Conclusions and Future Work |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
SEE ALSO:
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !




