Skip to content

GERBIL OKE2015
Compare
Choose a tag to compare
@MichaelRoeder MichaelRoeder released this 08 Jul 11:01
OKE2015
0e2b01b

This is an adapted version of GERBIL that has been used for the OKE Challenge 2015.

Features:

  • Contains a new benchmark core that is not based on the BAT-Framework but on URIs instead of Wikipedia IDs (refs #51). Thus, benchmarking the linkage to other knowledge bases than Wikipedia as well as the identification of emerging entities is now supported.
  • The evaluation is more flexible and open to new metrics (refs #5).
  • Added the concept of well-known knowledge bases to ensure the identification of emerging entities.
  • Added Task 1 as well as Task 2 of the OKE Challenge as new experiment types.
  • Added Entity Typing as experiment type and a hierarchical f-measure for its evaluation.
  • Added the new concept of sub tasks. Thus, it can be seen whether the linking or the recognition of an annotator caused the most problems.
  • Used version 1.1.0 of the gerbil.nif.transfer library and its more detailed datatype hierarchy.
  • Compared to the last version of GERBIL, this adapted version has not all features of the "normal" GERBIL since they are not needed for the OKE Challenge 2015 and their adaption to the new benchmarking core is still work in progress.

Missing Features:

  • C2KB, Rc2KB, Sc2KB and Sa2KB are missing in this release
  • Some adapters (annotators as well as datasets) might be missing
Assets 3
Loading