Data Quality
Description
In industry the term „Quality“ used in the context of “Quality Control or Assurance” of products - and later
services - has a history of about one hundred years. It is used in an ISO norm as “Suitability for use relative to a
given objective of usage”. Looking at “Products” and “Processes” one distinguishes between “Quality of
Design” and “Quality of Performance”.
“Data Quality” is a term which is used at Statistical Offices and supranational Organizations (OECD, UN NAGroup
etc.) for about the same time. It became popular in computer science twenty years ago, when data quality
problems related to data warehousing, ETL, data cleansing , data mining and data integration were detected.
Data Quality is mostly defined as above, i.e. fitness for use given an objective of data processing on a specific
domain. For example, the objective may be web-mining where semi-structured data is to be integrated.
Evidently, the term “data quality” has many various facets. Stepwise refining the granularity starting from
several data sources to a single value of an attribute (variable) one can differ between multi-sources or data
bases, single databases (on the schema or data level), records and values. For instance, on the data level errors,
outliers, null-values (missing values), inconsistent (incoherent) values or simply semantic misuse of data are of
concern while on the schema level integrity constraints may be violated. All these factors may lead to low data
quality.
| Slides | |
| 0:00 | Data Quality |
| 8:23 | All You Should Know about Data Quality |
| 10:07 | You Should Know the Cost of \"Poor Data Quality\" |
| 11:25 | Data Quality - Example |
| 13:51 | Poor Data Quality |
| 15:03 | Contents |
| 15:45 | 1 Definition of Quality |
| 17:45 | 2 A Short History of QC |
| 18:39 | 3 Data Sources |
| 21:35 | 3 Kinds of Data Quality |
| 24:08 | 3 Data Errors as Trouble Makers |
| 24:50 | 3.1 Data Error Classification pt 1 |
| 26:05 | 3.1 Data Error Classification pt 2 |
| 26:38 | 3.1 Data Error Classification pt 3 |
| 28:20 | 3.1 Data Error Classification pt 4 |
| 28:38 | 3.1 Data Error Classification pt 5 |
| 30:02 | 3.2 Data Quality: Focus and Dimensions pt 1 |
| 32:12 | 3.2 Data Quality: Focus and Dimensions pt 2 |
| 34:26 | 3.2 Data Quality: Focus and Dimensions pt 3 |
| 36:02 | 3.3 Single Dimension |
| 36:53 | 3.3.1 Accuracy |
| 39:22 | 3.3.1 Syntactic Accuracy |
| 41:02 | 3.3.1 Semantic Accuracy |
| 41:43 | 3.3.1 Accuracy Measures pt 1 |
| 41:46 | 3.3.1 Accuracy Measures pt 2 |
| 43:40 | 3.3.2 Completeness pt 1 |
| 48:57 | 3.3.2 Completeness pt 2 |
| 49:27 | 3.3.2 Completeness pt 3 |
| 50:09 | 3.3.3 Time-Related Dimensions pt 1 |
| 51:30 | 3.3.3 Time-Related Dimensions pt 2 |
| 52:48 | 3.3.3 Time-Related Dimensions pt 3 |
| 53:17 | 3.3.3 Time-Related Dimensions pt 4 |
| 53:39 | 3.3.3 Time-Related Dimensions pt 5 |
| 53:40 | 3.3.4 Consistency pt 1 |
| 58:09 | 3.3.4 Consistency pt 2 |
| 58:28 | 3.3.4 Consistency pt 3 |
| 60:57 | 3.3.4 Consistency pt 4 |
| 64:25 | Incorrect Dicing (Marginalisation) |
| 71:13 | 3.3.4 Consistency pt 5 |
| 71:56 | Quality Remains |
| 72:06 | 4. References |
Lecture rating
| People found this lecture: | ||
| Worth seeing | ||
| because it is: | ||
| Valuable and informative | ||
| Well presented | ||
| Easily understandable | ||
| Acceptably recorded | ||
| You need to login to cast your vote. | ||
Report a problem or upload files
If you have found a problem with this lecture or would like to send us extra material, articles, exercises, etc., please use our ticket system to describe your request and upload the data.Enter your e-mail into the 'Cc' field, and we will keep you updated with your request's status.
Related content
SEE ALSO:
Link this page
Would you like to put a link to this lecture on your homepage?Go ahead! Copy the HTML snippet !




