Skip to content

Actions: huggingface/lighteval

Actions

All workflows

Actions

Loading...
Loading

Showing runs from all workflows
2,500+ workflow runs
2,500+ workflow runs

Filter by Workflow

⌥ + click/return to exclude

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
fix(inspect): align GenerateConfig field names with current inspect-ai (fixes #1327) .github/workflows/pr_style_bot.yaml #363: Issue comment #1328 (comment) by sk8ordie84
Failure
Failure
Restore log-likelihood HellaSwag and PIQA variants Build PR Documentation #2183: Pull request #1315 synchronize by kunwar-vikrant
Action required kunwar-vikrant:fix/1090-restore-loglikelihood-tasks
kunwar-vikrant:fix/1090-restore-loglikelihood-tasks
Action required
Restore log-likelihood HellaSwag and PIQA variants Tests #4084: Pull request #1315 synchronize by kunwar-vikrant
Action required kunwar-vikrant:fix/1090-restore-loglikelihood-tasks
kunwar-vikrant:fix/1090-restore-loglikelihood-tasks
Action required
Restore log-likelihood HellaSwag and PIQA variants Slow end to end tests #1684: Pull request #1315 synchronize by kunwar-vikrant
Action required kunwar-vikrant:fix/1090-restore-loglikelihood-tasks
kunwar-vikrant:fix/1090-restore-loglikelihood-tasks
Action required
Restore log-likelihood HellaSwag and PIQA variants Quality #4085: Pull request #1315 synchronize by kunwar-vikrant
Action required kunwar-vikrant:fix/1090-restore-loglikelihood-tasks
kunwar-vikrant:fix/1090-restore-loglikelihood-tasks
Action required
vLLM Main Branch Tests vLLM Main Branch Tests #33: Scheduled
5m 45s main
main
5m 45s
Add ArxivRollBench tasks Build PR Documentation #2182: Pull request #1245 synchronize by liangzid
Action required liangzid:add-arxivrollbench-tasks
liangzid:add-arxivrollbench-tasks
Action required
Add ArxivRollBench tasks Slow end to end tests #1683: Pull request #1245 synchronize by liangzid
Action required liangzid:add-arxivrollbench-tasks
liangzid:add-arxivrollbench-tasks
Action required
Add ArxivRollBench tasks Quality #4084: Pull request #1245 synchronize by liangzid
Action required liangzid:add-arxivrollbench-tasks
liangzid:add-arxivrollbench-tasks
Action required
Add ArxivRollBench tasks Tests #4083: Pull request #1245 synchronize by liangzid
Action required liangzid:add-arxivrollbench-tasks
liangzid:add-arxivrollbench-tasks
Action required
fix(metrics): ignore boundary whitespace in word-unit counts Build PR Documentation #2181: Pull request #1416 opened by March-7
Action required March-7:codex/lighteval-word-perplexity-whitespace
March-7:codex/lighteval-word-perplexity-whitespace
Action required
fix(metrics): ignore boundary whitespace in word-unit counts Slow end to end tests #1682: Pull request #1416 opened by March-7
Action required March-7:codex/lighteval-word-perplexity-whitespace
March-7:codex/lighteval-word-perplexity-whitespace
Action required
fix(metrics): ignore boundary whitespace in word-unit counts Tests #4082: Pull request #1416 opened by March-7
Action required March-7:codex/lighteval-word-perplexity-whitespace
March-7:codex/lighteval-word-perplexity-whitespace
Action required
fix(metrics): ignore boundary whitespace in word-unit counts Quality #4083: Pull request #1416 opened by March-7
Action required March-7:codex/lighteval-word-perplexity-whitespace
March-7:codex/lighteval-word-perplexity-whitespace
Action required
Upload PR Documentation Upload PR Documentation #1631: completed by gyanu2507
9s
9s
Upload PR Documentation Upload PR Documentation #1630: completed by sneha4175
10s
10s
[FT] Allow configuration of litellm cache location .github/workflows/pr_style_bot.yaml #362: Issue comment #806 (comment) by lindicaphxag-tech
Failure
Failure
Don't change global torch matmul precision when importing swiss_legal metrics Build PR Documentation #2180: Pull request #1415 opened by jayzuccarelli
Action required jayzuccarelli:fix/issue-1414
jayzuccarelli:fix/issue-1414
Action required
Don't change global torch matmul precision when importing swiss_legal metrics Slow end to end tests #1681: Pull request #1415 opened by jayzuccarelli
Action required jayzuccarelli:fix/issue-1414
jayzuccarelli:fix/issue-1414
Action required
Don't change global torch matmul precision when importing swiss_legal metrics Quality #4082: Pull request #1415 opened by jayzuccarelli
Action required jayzuccarelli:fix/issue-1414
jayzuccarelli:fix/issue-1414
Action required
Don't change global torch matmul precision when importing swiss_legal metrics Tests #4081: Pull request #1415 opened by jayzuccarelli
Action required jayzuccarelli:fix/issue-1414
jayzuccarelli:fix/issue-1414
Action required
fix(metrics): raise when pass@k is called with k > n Build PR Documentation #2179: Pull request #1412 synchronize by woodforestsen
Action required woodforestsen:fix/pass-at-k-k-greater-than-n
woodforestsen:fix/pass-at-k-k-greater-than-n
Action required
fix(metrics): raise when pass@k is called with k > n Quality #4081: Pull request #1412 synchronize by woodforestsen
Action required woodforestsen:fix/pass-at-k-k-greater-than-n
woodforestsen:fix/pass-at-k-k-greater-than-n
Action required
fix(metrics): raise when pass@k is called with k > n Slow end to end tests #1680: Pull request #1412 synchronize by woodforestsen
Action required woodforestsen:fix/pass-at-k-k-greater-than-n
woodforestsen:fix/pass-at-k-k-greater-than-n
Action required
fix(metrics): raise when pass@k is called with k > n Tests #4080: Pull request #1412 synchronize by woodforestsen
Action required woodforestsen:fix/pass-at-k-k-greater-than-n
woodforestsen:fix/pass-at-k-k-greater-than-n
Action required