event thumbnail image
Tutorials

Data Quality

author: Hans-Joachim Lenz, Free University

Description

In industry the term „Quality“ used in the context of “Quality Control or Assurance” of products - and later services - has a history of about one hundred years. It is used in an ISO norm as “Suitability for use relative to a given objective of usage”. Looking at “Products” and “Processes” one distinguishes between “Quality of Design” and “Quality of Performance”. “Data Quality” is a term which is used at Statistical Offices and supranational Organizations (OECD, UN NAGroup etc.) for about the same time. It became popular in computer science twenty years ago, when data quality problems related to data warehousing, ETL, data cleansing , data mining and data integration were detected. Data Quality is mostly defined as above, i.e. fitness for use given an objective of data processing on a specific domain. For example, the objective may be web-mining where semi-structured data is to be integrated. Evidently, the term “data quality” has many various facets. Stepwise refining the granularity starting from several data sources to a single value of an attribute (variable) one can differ between multi-sources or data bases, single databases (on the schema or data level), records and values. For instance, on the data level errors, outliers, null-values (missing values), inconsistent (incoherent) values or simply semantic misuse of data are of concern while on the schema level integrity constraints may be violated. All these factors may lead to low data quality.

You might be experiencing some problems with Your Video player.
Slides
0:00 Data Quality
8:23 All You Should Know about Data Quality
10:07 You Should Know the Cost of \"Poor Data Quality\"
11:25 Data Quality - Example
13:51 Poor Data Quality
15:03 Contents
15:45 1 Definition of Quality
17:45 2 A Short History of QC
18:39 3 Data Sources
21:35 3 Kinds of Data Quality
24:08 3 Data Errors as Trouble Makers
24:50 3.1 Data Error Classification pt 1
26:05 3.1 Data Error Classification pt 2
26:38 3.1 Data Error Classification pt 3
28:20 3.1 Data Error Classification pt 4
28:38 3.1 Data Error Classification pt 5
30:02 3.2 Data Quality: Focus and Dimensions pt 1
32:12 3.2 Data Quality: Focus and Dimensions pt 2
34:26 3.2 Data Quality: Focus and Dimensions pt 3
36:02 3.3 Single Dimension
36:53 3.3.1 Accuracy
39:22 3.3.1 Syntactic Accuracy
41:02 3.3.1 Semantic Accuracy
41:43 3.3.1 Accuracy Measures pt 1
41:46 3.3.1 Accuracy Measures pt 2
43:40 3.3.2 Completeness pt 1
48:57 3.3.2 Completeness pt 2
49:27 3.3.2 Completeness pt 3
50:09 3.3.3 Time-Related Dimensions pt 1
51:30 3.3.3 Time-Related Dimensions pt 2
52:48 3.3.3 Time-Related Dimensions pt 3
53:17 3.3.3 Time-Related Dimensions pt 4
53:39 3.3.3 Time-Related Dimensions pt 5
53:40 3.3.4 Consistency pt 1
58:09 3.3.4 Consistency pt 2
58:28 3.3.4 Consistency pt 3
60:57 3.3.4 Consistency pt 4
64:25 Incorrect Dicing (Marginalisation)
71:13 3.3.4 Consistency pt 5
71:56 Quality Remains
72:06 4. References

Lecture rating

People found this lecture:
Worth seeing
because it is:
 Valuable and informative
Well presented
Easily understandable
Acceptably recorded
You need to login to cast your vote.

Report a problem or upload files

If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.
Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.

 Watch videos:   (click on thumbnail to launch)

Watch Part 1
Part 1 1:13:43
Flash video Slide Synchronization Windows Media video

!NOW PLAYING
Watch Part 2
Part 2 1:26:30
Flash video Slide Synchronization Windows Media video

Link this page

Would you like to put a link to this lecture on your homepage?
Go ahead! Copy the HTML snippet !

Write your own review or comment: