-
Notifications
You must be signed in to change notification settings - Fork 251
Pull requests: bigcode-project/bigcode-evaluation-harness
Pull requests list
[Community Submission] Model: Isaac-AI-OS/isaac-20b, Username: petermantell
#316
opened Oct 15, 2025 by
pedroMantAmp
Loading...
Fix UnboundLocalError in APPS task evaluation
#310
opened Apr 20, 2025 by
sad-mathematician
Loading...
Updated bigcode-evaluation-harness/leaderboard/README.md
#305
opened Mar 13, 2025 by
zoya-hammad
Loading...
use tokenizer.chat_template by default for instruction type tasks
#301
opened Jan 25, 2025 by
TK-21st
Loading...
[Pytest] Fix bad import to use relative instead @ module_test
#298
opened Jan 11, 2025 by
ggcr
Loading...
Fix the bugs in the ds1000 sample bash script; Fix typos
#295
opened Dec 10, 2024 by
gameofby
Loading...
Support multiple datasets from MBPP; Fix missing commas in python list; Fix doc typos;
#291
opened Dec 4, 2024 by
gameofby
Loading...
Speedup execute.py: Reuse same manager and dict in
#277
opened Oct 1, 2024 by
michaelfeil
Loading...
Add a new benchmark ENAMEL for evaluating the efficiency of LLM-generated code
#260
opened Jul 22, 2024 by
q-rz
Loading...
remove pad tokens added by the accelerator.pad_across_processes
#216
opened Apr 13, 2024 by
IQ17
Loading...
fix apps evaluate error: local variable 'level' referenced before assignment
#206
opened Mar 10, 2024 by
koking0
Loading...
ProTip!
no:milestone will show everything without a milestone.