event thumbnail image
The 13th International Conference on Knowledge Discovery and Data Mining

Statistical Change Detection for Multi-Dimensional Data

author: Xiuyao Song

Description

This paper deals with detecting change of distribution in multi-dimensional data sets. For a given baseline data set and a set of newly observed data points, we define a statistical test called the density test for deciding if the observed data points are sampled from the underlying distribution that produced the baseline data set. We define a test statistic that is strictly distribution-free under the null hypothesis. Our experimental results show that the density test has substantially more power than the two existing methods for multi-dimensional change detection.

You might be experiencing some problems with Your Video player.
Slides
0:03 Statistical Change Detection for Multi-Dimensional Data
0:25 Motivation Example: Antibiotic Resistance Pattern
1:27 Problem Definition
1:45 Related Work
2:41 Hypothesis Test Framework
3:14 Density Test High-Level Overview
4:11 Step 1: Kernel Density Estimate (KDE)
5:44 Choose Bandwidth by MLE/EM
7:13 Effectiveness of EM Bandwidth
7:49 Step 2: Define and Calculate
8:52 Step 3: Derive the Null Distribution
10:02 Estimating
11:13 Step 4: Calculate Critical Value and Make a Decision
12:28 Density Test – All 4 Steps
12:38 Run Density Test in 2 Directions
13:03 False Positive
13:54 False Negative on Low-D Group
14:19 False Negative on High-D Group
14:30 Scalability
15:17 Conclusion
15:44 Thanks

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment: