- 
  Notifications
 You must be signed in to change notification settings 
- Fork 4
Pull requests: bigcode-project/bigcode-inference-benchmark
Pull requests list
 📦 onnx support for santacoder
 
 
 
 
 
 #20
 by mayank31398
 
 was closed Aug 10, 2024 
 
 
 
 
 
 Loading...
 
 
 
 updated Aug 10, 2024 
 
 
 
 
 
 Refactor metrics, save results, new benchmarking
 
 
 
 #18
 by jlamypoirier
 
 was merged Mar 2, 2023 
 
 
 
 
 
 Loading...
 
 
 
 updated Mar 3, 2023 
 
 
 
 
 
 Support generic models and arguments
 
 
 
 #15
 by jlamypoirier
 
 was merged Feb 15, 2023 
 
 
 
 
 
 Loading...
 
 
 
 updated Feb 15, 2023 
 
 
 
 
 
 Pre allocate KV tensors and use inference mode
 
 
 
 
 
 #13
 by jlamypoirier
 
 was closed Feb 8, 2023 
 
 
 
 •
 
 Draft
 
 
 
 
 updated Feb 8, 2023 
 
 
 
 
 
 Add dockerfile, requirements and code style
 
 
 
 
 
 #9
 by jlamypoirier
 
 was merged Jan 14, 2023 
 
 
 
 
 
 Loading...
 
 
 
 updated Jan 14, 2023 
 
 
 
 
 
 run inference benchmarks with a better system
 
 
 
 #6
 by mayank31398
 
 was merged Dec 10, 2022 
 
 
 
 
 
 Loading...
 
 
 
 updated Dec 10, 2022 
 
 
 
 
 
 refactor for pipelines [WIP]
 
 
 
 #2
 by mayank31398
 
 was merged Oct 17, 2022 
 
 
 
 
 
 Loading...
 
 
 
 updated Oct 17, 2022 
 
 
 
 
 
 
 ProTip!
 Type g p on any issue or pull request to go back to the pull request listing page.