Pull requests: bigcode-project/bigcode-inference-benchmark

Pull requests list

refactor for pipelines [WIP]

#2 by mayank31398 was merged Oct 17, 2022

add benchmark scripts

#1 by mayank31398 was merged Oct 16, 2022

Misc additions

#16 by jlamypoirier was merged Feb 25, 2023

Pre allocate KV tensors and use inference mode

#13 by jlamypoirier was closed Feb 8, 2023 • Draft

Add code to vary input length

#5 by minimario was merged Dec 6, 2022

Add MQA

#4 by mayank31398 was merged Dec 6, 2022

Refactor repo

#17 by jlamypoirier was merged Feb 25, 2023

Add graphs

#7 by mayank31398 was merged Dec 12, 2022

run inference benchmarks with a better system

#6 by mayank31398 was merged Dec 10, 2022

add MQA results

#8 by mayank31398 was merged Dec 12, 2022

Profiling and misc

#10 by jlamypoirier was merged Jan 30, 2023

Fork model

#14 by jlamypoirier was closed Feb 14, 2023 • Draft

Add dockerfile, requirements and code style

#9 by jlamypoirier was merged Jan 14, 2023

Support generic models and arguments

#15 by jlamypoirier was merged Feb 15, 2023

Multi-value filter

#19 by jlamypoirier was merged Mar 3, 2023

Refactor metrics, save results, new benchmarking

#18 by jlamypoirier was merged Mar 2, 2023

📦 onnx support for santacoder

#20 by mayank31398 was closed Aug 10, 2024

ProTip! Type g i on any issue or pull request to go back to the issue listing page.

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Pull requests: bigcode-project/bigcode-inference-benchmark

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Pull requests list