Pull requests: bigcode-project/bigcode-inference-benchmark

Pull requests list

📦 onnx support for santacoder

#20 by mayank31398 was closed Aug 10, 2024

Multi-value filter

#19 by jlamypoirier was merged Mar 3, 2023

Refactor metrics, save results, new benchmarking

#18 by jlamypoirier was merged Mar 2, 2023

Refactor repo

#17 by jlamypoirier was merged Feb 25, 2023

Misc additions

#16 by jlamypoirier was merged Feb 25, 2023

Support generic models and arguments

#15 by jlamypoirier was merged Feb 15, 2023

Fork model

#14 by jlamypoirier was closed Feb 14, 2023 • Draft

Pre allocate KV tensors and use inference mode

#13 by jlamypoirier was closed Feb 8, 2023 • Draft

Profiling and misc

#10 by jlamypoirier was merged Jan 30, 2023

Add dockerfile, requirements and code style

#9 by jlamypoirier was merged Jan 14, 2023

add MQA results

#8 by mayank31398 was merged Dec 12, 2022

Add graphs

#7 by mayank31398 was merged Dec 12, 2022

run inference benchmarks with a better system

#6 by mayank31398 was merged Dec 10, 2022

Add code to vary input length

#5 by minimario was merged Dec 6, 2022

Add MQA

#4 by mayank31398 was merged Dec 6, 2022

refactor for pipelines [WIP]

#2 by mayank31398 was merged Oct 17, 2022

add benchmark scripts

#1 by mayank31398 was merged Oct 16, 2022

ProTip! What’s not been updated in a month: updated:<2025年09月30日.

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Pull requests: bigcode-project/bigcode-inference-benchmark

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Pull requests list