Evaluating Machine Learning for Information Extraction

Published on Feb 25, 20074831 Views

ICML 2005 - Bonn

PASCAL CHALLENGE ON EVALUATING MACHINE LEARNING FOR INFORMATION EXTRACTION 00:01

Organisers00:24

Outline00:44

Goal : Provide a testbed for comparative evaluation of ML-based IE01:39

Data (Workshop CFP)03:50

Data (Workshop CFP)04:42

Data (Workshop CFP)04:54

Data (Workshop CFP)05:03

TITLE05:37

Annotation Slots07:19

Preprocessing07:42

Evaluation Tasks08:34

Evaluation09:42

Participants10:17

Task111:13

Task1: Test Corpus11:17

Task1: Test Corpus12:06

Task1: Test Corpus12:52

Task1: 4-Fold Cross-validation13:17

Task1: 4-Fold & Test Corpus13:31

Task1: Slot FMeasure14:17

Best Slot FMeasures Task1: Test Corpus15:41

Task 2a16:46

Task2a: Learning Curve FMeasure16:50

Task2a: Learning Curve Precision17:21

Task2a: Learning Curve Recall17:48

Task 2b18:34

Task2b: Active Learning18:37

Task2b: Active Learning Increased FMeasure over random selection19:06

Task 319:33

Conclusions (Task1)19:40

Conclusion (Task2 & Task3)23:15

Future Work23:28

Thank You24:21