Repository navigation

All pull requests

Labels (19)Milestones (0)New pull request

Open

(24)

Closed

(257)

docs: Improve LLMAPI backend documentation
#839arysef opened Jan 21, 2026
[fix] deprecated LABEL syntax in docker build file
#790BaiqingL opened Aug 17, 2025
Update submodule config
#758chzblych opened Jun 5, 2025Contributor
Corrected steps for TRTLLM deployment over Triton
#746snlpatel001213 opened May 8, 2025
Add composite metrics for kubernetes inference gateway metrics protocol
#725BenjaminBraunDev opened Mar 17, 2025
10
import PIL on demand
#673ShuaiShao93 opened Jan 2, 2025
update tensorrt-llm default version
#670BasicCoder opened Dec 25, 2024
Update the multinode tutorial link
#644harryskim opened Nov 14, 2024
Update launch_triton_server.py
#628ankur1-samsung opened Oct 22, 2024
Update llama.md
#604surprisedPikachu007 opened Sep 25, 2024
Add missing kv_cache related metrics
#592Pernekhan opened Sep 3, 2024
[Bugfix]fix the thread lock when user input same id
#585GGBond8488 opened Aug 27, 2024
Fix the exiting bug in docker compose when using the scripts/launch_t…
#581AliRazghandi opened Aug 21, 2024
1
fix inference quality caused by temperature parameter in bls
#523activezhao opened Jul 4, 2024
Added documentation of using warmups to initialize lora weights
#515TheCodeWrangler opened Jun 27, 2024
2
Replace subprocess.Popen with subprocess.run
#452rlempka opened May 14, 2024
Fixed Whitespace Error in Streaming mode
#423enochlev opened Apr 19, 2024
2
Update end_to_end_test.py
#409r0cketdyne opened Apr 14, 2024
fix: add foreground argument
#343pfldy2850 opened Feb 21, 2024
Expose verbose as pram in launch triton script
#295ekagra-ranjan opened Jan 12, 2024
Add all_models/bert as an example for tensorrt-llm classification models
#269erenup opened Dec 31, 2023
Add example of tensorrt-llm usage
#225Pernekhan opened Dec 15, 2023
4
Wrap long command-lines in README.md
#134wangkuiyi opened Nov 15, 2023
draft pr about non-streaming output
#95BasicCoder opened Nov 3, 2023
1

Pull requests