Pull requests: triton-inference-server/server

New pull request New

81 Open 4,093 Closed

Pull requests list

Removing unused values for TensorRT-LLM container build

#8472 opened Oct 23, 2025 by mc-nv

ci: Add support for max_inflight_requests parameter to prevent unbounded memory growth in ensemble models PR: ci

#8458 opened Oct 13, 2025 by pskiran1

7 of 20 tasks

feat: Add Hermes tool call parser for OpenAI API

#8456 opened Oct 12, 2025 by amit-timalsina

11 of 12 tasks

Feat: revamp build.py CLI to improve usability and maintainability

#8437 opened Oct 2, 2025 by kpedro88

9 of 22 tasks

Install libboost-dev with apt

#8416 opened Sep 26, 2025 by dmitry-tokarev-nv

feat: Minor improvements to build.py build enhancement

#8362 opened Aug 19, 2025 by kpedro88

6 of 22 tasks

fix: WAR for Python CUDA library unknown race condition PR: fix

#8360 opened Aug 19, 2025 by GuanLuo

feat: Added --build_variant flag for cpu only build.

#8329 opened Aug 5, 2025 by Sunidhi-Gaonkar1

4 of 22 tasks

feat: Add support for usage in the OpenAI frontend TRT-LLM backend

#8326 opened Aug 4, 2025 by pskiran1 • Draft

20 tasks

feat: add parameters in onprem k8s chart (volume, resources & env. variables)

#8324 opened Aug 1, 2025 by vladmirtxrx

3 of 22 tasks

Support tokenizer override per model for multi-model Triton + vLLM serving with OpenAI-Compatible

#8321 opened Jul 31, 2025 by JunmooByun

11 of 13 tasks

docs: Fix typos and grammar issues in markdown files

#8306 opened Jul 23, 2025 by cluster2600

12 of 13 tasks

fix: mlflow plugin model deletion

#8283 opened Jul 8, 2025 by cile98

7 of 22 tasks

fix: Fix the server runtime errors on cpu only platform and with pytorch backend

#8272 opened Jun 27, 2025 by snadampal

6 of 21 tasks

docs: fix capitalization of Triton Inference Server

#8252 opened Jun 13, 2025 by ShriyashP

5 of 13 tasks

feat: Add guided decoding support to OpenAI frontend

#8245 opened Jun 11, 2025 by pei0033

7 of 22 tasks

docs: update the link formats for additional security networking guides

#8229 opened Jun 2, 2025 by xander-aphe-hatschi

22 tasks

test: L0_orca_trtllm fixed

#8191 opened May 7, 2025 by indrajit96

7 of 20 tasks

Ibhosale grpc callback model infer

#8138 opened Apr 9, 2025 by indrajit96 • Draft

refactor: replace tf model with onnx model for L0_response_cache

#8114 opened Apr 2, 2025 by ziqifan617 • Draft

fix: Fix syntax

#8098 opened Mar 24, 2025 by krishung5

Update quickstart.md - grammar correction

#8086 opened Mar 21, 2025 by scott------

[build]: Add rt_base_image parameter to differentiate triton build base image and runtime base image

#8064 opened Mar 12, 2025 by nv-tusharma • Draft

5 of 20 tasks

feat: GRPC Callback API migration for Non Inference

#8062 opened Mar 11, 2025 by indrajit96

7 of 20 tasks

Build: Build using the PA binaries and whl if available.

#8043 opened Feb 27, 2025 by pvijayakrish

8 of 20 tasks

ProTip! Type g i on any issue or pull request to go back to the issue listing page.

Navigation Menu

Search code, repositories, users, issues, pull requests...

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Pull requests: triton-inference-server/server

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Pull requests list