Skip to content

Actions: EleutherAI/lm-evaluation-harness

Actions

Tasks Modified

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
new_tasks.yml
2,934 workflow runs
2,934 workflow runs

Filter by Event

Filter by Status

Filter by Branch

Filter by Actor

Bump version to v0.4.4 ; Fixes to TMMLUplus (#2280) Tasks Modified #3318: Commit 543617f pushed by haileyschoelkopf
September 5, 2024 15:01 2m 8s main
main
September 5, 2024 15:01 2m 8s
Bump version to v0.4.4 ; Fixes to TMMLUplus Tasks Modified #3317: Pull request #2280 opened by haileyschoelkopf
September 5, 2024 13:51 1m 45s push-0.4.4
push-0.4.4
September 5, 2024 13:51 1m 45s
Free space allocated for LM in the memory after evaluation finishes Tasks Modified #3316: Pull request #2277 synchronize by ahmedamrelhefnawy
September 4, 2024 20:54 18s ahmedamrelhefnawy:main
ahmedamrelhefnawy:main
September 4, 2024 20:54 18s
Chat Template fix (cont. #2235) (#2269) Tasks Modified #3315: Commit 7a1614e pushed by haileyschoelkopf
September 4, 2024 14:10 1m 45s main
main
September 4, 2024 14:10 1m 45s
Chat Template fix (cont. #2235) Tasks Modified #3314: Pull request #2269 synchronize by baberabb
September 4, 2024 01:10 2m 1s chattfix
chattfix
September 4, 2024 01:10 2m 1s
Chat Template fix (cont. #2235) Tasks Modified #3313: Pull request #2269 synchronize by baberabb
September 4, 2024 01:06 1m 47s chattfix
chattfix
September 4, 2024 01:06 1m 47s
Add Open Arabic LLM Leaderboard Benchmarks (Full and Light Version) Tasks Modified #3312: Pull request #2232 synchronize by shahrzads
September 3, 2024 18:37 11m 48s Malikeh97:arabic-leaderboard
Malikeh97:arabic-leaderboard
September 3, 2024 18:37 11m 48s
Chat Template fix (cont. #2235) Tasks Modified #3311: Pull request #2269 synchronize by baberabb
September 3, 2024 18:20 1m 35s chattfix
chattfix
September 3, 2024 18:20 1m 35s
Chat Template fix (cont. #2235) Tasks Modified #3310: Pull request #2269 synchronize by baberabb
September 3, 2024 18:19 1m 38s chattfix
chattfix
September 3, 2024 18:19 1m 38s
Free space allocated for LM in the memory after evaluation finishes Tasks Modified #3308: Pull request #2277 opened by ahmedamrelhefnawy
September 3, 2024 12:38 16s ahmedamrelhefnawy:main
ahmedamrelhefnawy:main
September 3, 2024 12:38 16s
Draft - Support ov models via genai Tasks Modified #3307: Pull request #1862 synchronize by sstrehlk
September 3, 2024 12:31 Action required sstrehlk:support-ov-models-via-genai
sstrehlk:support-ov-models-via-genai
September 3, 2024 12:31 Action required
Draft - Support ov models via genai Tasks Modified #3306: Pull request #1862 synchronize by sstrehlk
September 3, 2024 08:55 Action required sstrehlk:support-ov-models-via-genai
sstrehlk:support-ov-models-via-genai
September 3, 2024 08:55 Action required
Add Yue-Benchmark and update tasks description Tasks Modified #3304: Pull request #2270 synchronize by cpa2001
September 2, 2024 06:13 Action required cpa2001:add-yue-benchmark
cpa2001:add-yue-benchmark
September 2, 2024 06:13 Action required
Gen Prefix Tasks Modified #3303: Pull request #2274 opened by baberabb
September 2, 2024 05:34 2m 0s prefill
prefill
September 2, 2024 05:34 2m 0s
Nvidia TensorRT-LLM Tasks Modified #3302: Pull request #2271 opened by abhishekvijeev
September 1, 2024 00:57 18s abhishekvijeev:trt_llm
abhishekvijeev:trt_llm
September 1, 2024 00:57 18s
Add Yue-Benchmark and update tasks description Tasks Modified #3301: Pull request #2270 opened by cpa2001
August 31, 2024 11:05 1m 34s cpa2001:add-yue-benchmark
cpa2001:add-yue-benchmark
August 31, 2024 11:05 1m 34s
Chat Template fix (cont. #2235) Tasks Modified #3295: Pull request #2269 opened by baberabb
August 30, 2024 17:33 1m 41s chattfix
chattfix
August 30, 2024 17:33 1m 41s
Ifeval: Dowload punkt_tab on rank 0 Tasks Modified #3292: Pull request #2267 opened by baberabb
August 30, 2024 11:18 1m 33s ifeval_rank
ifeval_rank
August 30, 2024 11:18 1m 33s
log_samples=True if provided hf_hub_log_args Tasks Modified #3291: Pull request #2265 opened by baberabb
August 30, 2024 02:16 11s hfeval
hfeval
August 30, 2024 02:16 11s
hotfix #2262 (#2264) Tasks Modified #3290: Commit 928e8bb pushed by baberabb
August 30, 2024 01:40 11s main
main
August 30, 2024 01:40 11s
hotfix #2262 Tasks Modified #3289: Pull request #2264 synchronize by baberabb
August 30, 2024 01:34 10s maxlen
maxlen
August 30, 2024 01:34 10s
API: fix maxlen; vllm: prefix_token_id bug (#2262) Tasks Modified #3288: Commit b31f92e pushed by lintangsutawika
August 30, 2024 01:25 16s main
main
August 30, 2024 01:25 16s
API: fix maxlen; vllm: prefix_token_id bug Tasks Modified #3287: Pull request #2262 synchronize by baberabb
August 30, 2024 01:15 18s maxlen
maxlen
August 30, 2024 01:15 18s
Minor features Tasks Modified #3285: Pull request #2249 synchronize by artemorloff
August 29, 2024 18:28 1m 38s artemorloff:feature/small_fixes
artemorloff:feature/small_fixes
August 29, 2024 18:28 1m 38s
Minor features Tasks Modified #3284: Pull request #2249 synchronize by artemorloff
August 29, 2024 18:26 2m 3s artemorloff:feature/small_fixes
artemorloff:feature/small_fixes
August 29, 2024 18:26 2m 3s