Mind Your Metadata: Exploiting Semantics for Configuration, Adaptation, and Provenance in Scientific Workflows

Published on 2011-11-252346 Views

Scientific metadata containing semantic descriptions of scientific data is expensive to capture and is typically not used across entire data analytic processes. We present an approach where semantic m

In-Use Track

Presentation

Mind Your Metadata00:00

River Continuum vs Human Activities04:58:53

Case Study16:30:33

Stream Metabolism Response to Human Disturbances - 122:34:27

Stream Metabolism Response to Human Disturbances - 231:44:57

Aquatic Photosynthesis - 135:27:02

Aquatic Photosynthesis - 243:39:36

Workflow - 148:43:28

Vision: Automated & Fast63:21:47

Reality: Difficult & Time Consuming67:01:44

Picture - 176:57:12

Current Method - 178:25:55

Current Method - 298:33:36

Our Approach103:46:27

Data Sources114:24:01

KARMA - 1128:09:54

KARMA - 2138:15:04

Data Import142:48:04

Need to Clean Data - 1146:15:41

Need to Clean Data - 2156:22:53

Data Cleaning with KARMA - 1161:44:38

Data Cleaning with KARMA - 2163:40:05

Need to Integrate All the Sources172:30:02

Integrated Dataset187:57:48

KARMA Generates Data Processing Script - 1199:46:44

KARMA Generates Data Processing Script - 2204:47:17

KARMA Generates Data Processing Script - 3207:24:04

Publishing Processed Data to WINGS211:43:36

Semantic Metadata for Input Files - 1219:12:38

Semantic Metadata for Input Files - 2220:19:08

Workflows with WINGS231:38:21

WINGS Received Metadata from KARMA - 1247:28:37

WINGS Received Metadata from KARMA - 2248:06:55

Workflow - 2252:03:25

Using Metadata in Workflow Execution - 1268:07:26

Using Metadata in Workflow Execution - 2271:43:26

Using Metadata in Workflow Execution - 3280:33:20

Workflow Results - 1280:44:11

Workflow Results - 2287:49:52

Workflow Results Have Metadata302:49:32

WINGS Generates Provenance Metadata306:08:22

Aquatic Photosynthesis - 3315:13:22

Aquatic Photosynthesis - 4317:57:30

Aquatic Photosynthesis - 5327:42:32

Summary332:53:21

Related Work357:29:35

Thank you374:34:18