GERBIL 1.2.1
Changes from 1.2.0 to 1.2.1
- Added a filter to the D2KB and Entity Typing experiment tasks that are removing all markings that do not (strongly) match the positions of the mentions that have been given in the request (refs #98).
Changes from 1.1.4 to 1.2.0
Features
- Contains a new benchmark core that is based on URIs instead of Wikipedia IDs (refs #51 and #74). Thus, the evaluation is knowledge base agnostic (refs #88).
- Implements a better URI matching. Added the concept of well-known knowledge bases to ensure the identification of emerging entities (solves #94).
- The evaluation is more flexible and open to new metrics (refs #5).
- Added Task 1 as well as Task 2 of the OKE Challenge as new experiment types.
- Added Entity Typing (#48) as experiment type and a hierarchical f-measure for its evaluation.
- Added the new concept of sub tasks. Thus, it can be seen whether the linking or the recognition of an annotator caused the most problems.
- The single responses of the annotators can be stored in a NIF file for later debugging.
- Offers backwards compatibility to the BAT-framework
- Gives a better way to activate and deactivate single annotators and datasets that is based on property files instead of coded java classes (refs #22).
- Added run time measurement (refs #63).
Bug Fixes