1.6.17

1.6.17 (2024-04-18)

Fix

• fix: Id clickbait (#411)

• add indonesian clickbait

• Update points.md

• update

---

Co-authored-by: Manan Dey <[email protected]> (a0fa60b)

Unknown

• Add Czech Subjectivity Classification Dataset (#413)

• CzechSubjectivityClassification

• add results

• review comments

• points

• update results

---

Co-authored-by: Imene Kerboua <[email protected]> (deebcb0)

• Add 3 Arabic classification datasets (#410)

• add ara-sarcasm dataset

• add tweet emotion dataset

• add hard dataset

• fix formatting

• Update mteb/tasks/Classification/ara/HotelReviewSentimentClassification.py

Co-authored-by: Imene Kerboua <[email protected]>

• Update mteb/tasks/Classification/ara/HotelReviewSentimentClassification.py

Co-authored-by: Imene Kerboua <[email protected]>

• Update mteb/tasks/Classification/ara/HotelReviewSentimentClassification.py

Co-authored-by: Imene Kerboua <[email protected]>

• Update mteb/tasks/Classification/ara/TweetSarcasmClassification.py

Co-authored-by: Imene Kerboua <[email protected]>

• add points and suggestions

• Update points.md

---

Co-authored-by: Imene Kerboua <[email protected]> (c874110)

• Turkish multidomain product review data (#406)

• Tur multidomain product review data

• Update mteb/tasks/Classification/tur/TurkishProductSentimentClassification.py

Co-authored-by: Imene Kerboua <[email protected]>

• point update

---

Co-authored-by: Imene Kerboua <[email protected]> (86db1b8)

• Add Romanian Sentiment Classification Task (#404)

• add RomanianSentimentClassification

• add run results

• e5-base results

• add points

• only sample test set

• thanks Imene! (268324b)

• Add points missing from PR#389 (#403)

add points missing from PR 389 (628beb4)

• Adding Turkish Movie Sentiment Dataset (#389)

• Adding Turkish Movie Sentiment Dataset

• Update mteb/tasks/Classification/tur/TurkishMovieSentimentClassification.py
  Co-authored-by: Isaac Chung <[email protected]>

• Update mteb/tasks/Classification/tur/TurkishMovieSentimentClassification.py
  Co-authored-by: Isaac Chung <[email protected]>

• Update mteb/tasks/Classification/tur/TurkishMovieSentimentClassification.py
  Co-authored-by: Isaac Chung <[email protected]>

• Update mteb/tasks/Classification/tur/TurkishMovieSentimentClassification.py
  Co-authored-by: Isaac Chung <[email protected]>

• Update mteb/tasks/Classification/tur/TurkishMovieSentimentClassification.py
  Co-authored-by: Isaac Chung <[email protected]>

• Update avg_character length and socioecon status

• Updating licence

• Update TurkishMovieSentimentClassification.py

• Update mteb/tasks/Classification/tur/TurkishMovieSentimentClassification.py
  Co-authored-by: Isaac Chung <[email protected]>

• Update mteb/tasks/Classification/tur/TurkishMovieSentimentClassification.py
  Co-authored-by: Isaac Chung <[email protected]>

• Update TurkishMovieSentimentClassification.py

• Update TurkishMovieSentimentClassification.py

• Create init.py

• Update points.md

• Update TurkishMovieSentimentClassification.py

• Update points.md

• Update TurkishMovieSentimentClassification.py

• formatting

• Update points.md

• Update points.md

• Update points.md

---

Co-authored-by: Isaac Chung <[email protected]> (b01382b)

1.6.16

1.6.16 (2024-04-17)

Documentation

• docs: Added missing point for pr (#394) (a2d4705)

• docs: Added missing point for pr (32d8979)

Fix

• fix: Add BengaliHateSpeechClassification (#398)

• Add BengaliHateSpeechClassification

• Update mteb/tasks/Classification/ben/BengaliHateSpeechClassification.py

Co-authored-by: Kenneth Enevoldsen <[email protected]>

• update scores

• make lint

• add points

• Update points.md

---

Co-authored-by: Manan Dey <[email protected]>
Co-authored-by: Kenneth Enevoldsen <[email protected]> (2772ec8)

Unknown

• Merge branch 'main' of https://github.com/embeddings-benchmark/mteb (ad8cda3)

1.6.15

1.6.15 (2024-04-17)

Fix

• fix: Add Macedonian Tweet Sentiment Classification Task (#392)

• add MacedonianTweetSentimentClassification

• add results from runs

• edits from review

• add points (206f2c9)

1.6.14

1.6.14 (2024-04-17)

Ci

• ci: Ensure that linting fails when files are not linted (#394)

• style: This should fail linting

• ci: update linting to check if project is linted

• style: running linting

This should pass tests

• Add comment to ci rule to ensure that it isn't removed in the future (ff3cbfc)

Fix

• fix: Add Dutch Book Review Sentiment Classification Task (#388)

• add DutchBookReviewSentimentClassification and run models

• add points

• add name

• minor edits from review

• add multilingual-e5-base results

• add pointer for reviewers (10d50b6)

1.6.13

1.6.13 (2024-04-17)

Fix

• fix: Added HunSum2 dataset with results (#384)

• Added HunSum2 dataset with results

• Minor fixes to HunSum2

• Updated points for Kenneth and Marton

---

Co-authored-by: Kenneth Enevoldsen <[email protected]> (c65e1d7)

1.6.12

1.6.12 (2024-04-17)

Fix

• fix: Added EstQA and Eesti Valentsikorpus datasets (#382)

• Added EstQA dataset with results.

• Added new points and e-mail address to x-tabdeveloping

• Added Estonian Valence task + results

• Added new points for Estonian Valence task

• Addressed issues highlighted by Kenneth

• Reran EstQA (282d421)

1.6.11

1.6.11 (2024-04-16)

Fix

• fix: Add neuclir (#350)

• init commit

• add revision and results

• multilingual version

• run lint

• metadata

• add new results, update metaedata

• add lint

• fix bug; add points

• update citation

• fix: Moved metadata calcuation to abstask and added minor updates to metadata

• tests: Added test for metadata calculation

---

Co-authored-by: Kenneth Enevoldsen <[email protected]> (e773f64)

Unknown

• fix Added Arabic reviews (#380) (original PR #369)

• fix: Add Arabic Restaurant Reviews (#369)

• add arabic res reviews dataset

• update changes

• update metadata

• add multilingual-e5-base results

• Update mteb/tasks/Classification/ara/RestaurantReviewSentimentClassification.py

Co-authored-by: Kenneth Enevoldsen <[email protected]>

---

Co-authored-by: Kenneth Enevoldsen <[email protected]>

• docs: Added points

Added 6 poins for first ara clf task (2+4) and a review points for kenneth and imene

Additionally also ran the formatter

• docs: formatted points tables

---

Co-authored-by: Mohammed Hamdy <[email protected]> (dc82dc5)

1.6.10

1.6.10 (2024-04-15)

Fix

• fix: ADD JSTS Dataset for STS TASK (#359)

• add JaQuAD dataset

• fix

• add dataset stats

• add Japanese social network posts sentiment classification dataset

• add stats

• add JSTS dataset for STS tasks

• adjust points

• Update mteb/tasks/STS/jpn/JSTS.py

Co-authored-by: Kenneth Enevoldsen <[email protected]>

• Update mteb/tasks/STS/jpn/JSTS.py

Co-authored-by: Kenneth Enevoldsen <[email protected]>

---

Co-authored-by: Kenneth Enevoldsen <[email protected]> (7ce0601)

1.6.9

1.6.9 (2024-04-15)

Documentation

• docs: update mmteb points for slvnwhrl (#373)

Co-authored-by: Kenneth Enevoldsen <[email protected]> (b03573b)

Fix

• fix: Add Cantonese Openrice Classification task (#370)

• add openrice

• add results

• fix n_samples and lint

• rename to YueOpenriceReviewClassification

• move to zho and fix revision

• add points

---

Co-authored-by: Kenneth Enevoldsen <[email protected]> (91cf99e)

1.6.8

1.6.8 (2024-04-15)

Chore

• chore: move and update contributing.md (#372)

chore: delete contributing.md (bc6a1e3)

Documentation

• docs: updated link in readme (4cfd94b)

Fix

• fix: Add German False friend dataset (#374)

• fix: added false friends en de dataset to pair classification (#349)

• added false friends en de dataset to pair classification

• Update init.py to also have deu

• Rename FalseFriendsDeEnPC to FalseFriendsDeEnPC.py

• Update run_mteb_german.py

• Update points.md

• Update FalseFriendsDeEnPC.py

to the latest revision

• Create init.py

• Update mteb/tasks/PairClassification/deu/FalseFriendsDeEnPC.py

Co-authored-by: Kenneth Enevoldsen <[email protected]>

• Update mteb/tasks/PairClassification/deu/FalseFriendsDeEnPC.py

Co-authored-by: Kenneth Enevoldsen <[email protected]>

• Update mteb/tasks/PairClassification/deu/FalseFriendsDeEnPC.py

Co-authored-by: Kenneth Enevoldsen <[email protected]>

• Update points.md

• Update FalseFriendsDeEnPC.py

• Update FalseFriendsDeEnPC.py

• Update FalseFriendsDeEnPC.py

add bibtex

• Update mteb/tasks/PairClassification/deu/FalseFriendsDeEnPC.py

---

Co-authored-by: Kenneth Enevoldsen <[email protected]>

• fix: Updated to task metadata of false friend

• fix: ran linting

---

Co-authored-by: achibb <[email protected]> (9ef2246)