Mind Your Metadata: Exploiting Semantics for Configuration, Adaptation, and Provenance in Scientific Workflows

Published on 2011-11-252354 Views

Pedro Szekely

Scientific metadata containing semantic descriptions of scientific data is expensive to capture and is typically not used across entire data analytic processes. We present an approach where semantic m

In-Use Track

Related categories

Presentation

Mind Your Metadata00:00

River Continuum vs Human Activities00:17

Case Study00:59

Stream Metabolism Response to Human Disturbances - 101:21

Stream Metabolism Response to Human Disturbances - 201:54

Aquatic Photosynthesis - 102:07

Aquatic Photosynthesis - 202:37

Workflow - 102:55

Vision: Automated & Fast03:48

Reality: Difficult & Time Consuming04:01

Picture - 104:37

Current Method - 104:42

Current Method - 205:54

Our Approach06:13

Data Sources06:51

KARMA - 107:41

KARMA - 208:17

Data Import08:34

Need to Clean Data - 108:46

Need to Clean Data - 209:22

Data Cleaning with KARMA - 109:42

Data Cleaning with KARMA - 209:49

Need to Integrate All the Sources10:21

Integrated Dataset11:16

KARMA Generates Data Processing Script - 111:59

KARMA Generates Data Processing Script - 212:17

KARMA Generates Data Processing Script - 312:26

Publishing Processed Data to WINGS12:42

Semantic Metadata for Input Files - 113:09

Semantic Metadata for Input Files - 213:13

Workflows with WINGS13:53

WINGS Received Metadata from KARMA - 114:50

WINGS Received Metadata from KARMA - 214:53

Workflow - 215:07

Using Metadata in Workflow Execution - 116:05

Using Metadata in Workflow Execution - 216:18

Using Metadata in Workflow Execution - 316:50

Workflow Results - 116:50

Workflow Results - 217:16

Workflow Results Have Metadata18:10

WINGS Generates Provenance Metadata18:22

Aquatic Photosynthesis - 318:54

Aquatic Photosynthesis - 419:04

Aquatic Photosynthesis - 519:39

Summary19:58

Related Work21:26

Thank you22:28