Detecting Changes in Large Data Sets of Payments Cards Data: A Case Study
author:
Robert Grossman,
University of Illinois at Urbana-Champaign
Description
An important problem in data mining is detecting changes in large
data sets. Although there are a variety of change detection algorithms
that have been developed, in practice it can be a problem to
scale these algorithms to large data sets due to the heterogeneity of
the data. In this paper, we describe a case study involving payment
card data in which we built and monitored a separate change detection
model for each cell in a multi-dimensional data cube. We
describe a system that has been in operation for the past two years
that builds and monitors over 15,000 separate baseline models and
the process that is used for generating and investigating alerts using
these baselines.
You might be experiencing some problems with Your Video player.
| Slides | |
| 0:00 | Data Quality Models for High Volume Transaction Streams: A Case Study |
| 0:04 | The Problem: Detect Significant Changes in Visa’s Payments Network |
| 1:12 | Visa Payment Network |
| 1:24 | The Challenge: Payments Data is Highly Heterogeneous |
| 2:18 | Observe: If Data Were Homogeneous, Could Use Change Detection Model |
| 3:42 | Key Idea: Build 104+ Models, One for Each Cell in Data Cube |
| 5:56 | Augustus |
| 6:54 | Some Results to Date |
| 7:26 | Summary |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
Visitors who watched this lecture also watched...
SEE ALSO:
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !






Great idea to tape these and make them available.
Would be better if speakers could be confined to the
microphone and podium. This talk is difficult to hear.
Every professor believes their voice projects sufficiently.
Most are wrong :)