From 20628597fac388252a8e59f1514727dc74f6affc Mon Sep 17 00:00:00 2001 From: Anders Jess Pedersen Date: Wed, 22 Feb 2023 13:35:55 +0100 Subject: [PATCH] feat: update changelog --- CHANGELOG.md | 31 +++++++++++++++++++++++++++++++ 1 file changed, 31 insertions(+) diff --git a/CHANGELOG.md b/CHANGELOG.md index b2079310..6585ee21 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -5,9 +5,40 @@ All notable changes to this project will be documented in this file. The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/) and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.html). +## [Unreleased] + +### Added + +- Support for evaluation of local Hugging Face models. + +### Added + +- Tests for the `question_answering`-task. + +### Added + +- The `automatic_speech_recognition`-task. + +### Added + +- Util functions, `leaderboard_utils`, for interacting with the associated REST-api which interacts with the leaderboard holding the evaluation results. + +### Added + +- A new function in the `evaluator` module, called `_send_results_to_leaderboard` which sends evaluation results to the leaderboard using the util functions from `leaderboard_utils`, and tests for this function and `leaderboard_utils`. + +### Added + +- The `discourse-coherence`-task. + +### Added + +- Support for integer labels. ## [v0.0.1] - 2022-08-29 + ### Added + - First release, which includes evaluation of sentiment models from the Hugging Face Hub. This can be run with the CLI using the `evaluate` command, or via a script using the `Evaluator` class.