Statistical Change Detection for Multi-Dimensional Data
author:
Xiuyao Song
Description
This paper deals with detecting change of distribution in multi-dimensional data sets. For a given baseline data set and a set of newly observed data points, we define a statistical test called the density test for deciding if the observed data points are sampled from the underlying distribution that produced the baseline data set. We define a test statistic that is strictly distribution-free under the null hypothesis. Our experimental results show that the density test has substantially more power than the two existing methods for multi-dimensional change detection.
Categories
Top: Computer Science: Machine Learning: Density estimationTop: Computer Science: Data Mining
You might be experiencing some problems with Your Video player.
| Slides | |
| 0:03 | Statistical Change Detection for Multi-Dimensional Data |
| 0:25 | Motivation Example: Antibiotic Resistance Pattern |
| 1:27 | Problem Definition |
| 1:45 | Related Work |
| 2:41 | Hypothesis Test Framework |
| 3:14 | Density Test High-Level Overview |
| 4:11 | Step 1: Kernel Density Estimate (KDE) |
| 5:44 | Choose Bandwidth by MLE/EM |
| 7:13 | Effectiveness of EM Bandwidth |
| 7:49 | Step 2: Define and Calculate |
| 8:52 | Step 3: Derive the Null Distribution |
| 10:02 | Estimating |
| 11:13 | Step 4: Calculate Critical Value and Make a Decision |
| 12:28 | Density Test – All 4 Steps |
| 12:38 | Run Density Test in 2 Directions |
| 13:03 | False Positive |
| 13:54 | False Negative on Low-D Group |
| 14:19 | False Negative on High-D Group |
| 14:30 | Scalability |
| 15:17 | Conclusion |
| 15:44 | Thanks |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
Visitors who watched this lecture also watched...
SEE ALSO:
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !





