0.25
0.5
0.75
1.25
1.5
1.75
2
Evaluating Class Membership Relations in Knowledge Graphs using Large Language Models
Published on Jun 17, 202491 Views
A backbone of knowledge graphs are their class membership relations, which assign entities to a given class. As part of the knowledge engineering process, we propose a new method for evaluating the q
Related categories
Chapter list
Evaluating Class Membership Relations in Knowledge Graphs using Large Language Models00:00
Background00:37
Related work00:57
Problem statement01:31
Class membership relation evaluation by a human reviewer02:14
Class membership relation evaluation by an LLM02:41
Approach02:53
A zero-shot chain-of-thought classifier that generates rationales for its decisions03:55
A zero-shot chain - 104:02
A zero-shot chain - 204:28
A zero-shot chain - 304:41
A zero-shot chain - 405:15
A zero-shot chain - 505:37
A zero-shot chain - 605:38
Research questions05:47
Experiments06:02
Performance metrics07:36
Error analysis results08:42
Incorrect relation (Wikidata)10:26
Missing relation (CaLiGraph)11:49
Missing data (CaLiGraph)13:08
Incorrect LLM reasoning (Wikidata)13:11
Limitations14:12
Discussion15:19
Conclusion & Future work17:43