Repository navigation

[TRTLLM-8920][feat] decouple disagg service from fastapi - #8714

Merged

reasonsolo merged 7 commits into

NVIDIA:mainfrom

reasonsolo:TRTLLM-8920_decouplefastapi

Dec 5, 2025

Merged

[TRTLLM-8920][feat] decouple disagg service from fastapi#8714
reasonsolo merged 7 commits into
NVIDIA:mainfrom
reasonsolo:TRTLLM-8920_decouplefastapi

Commits on Dec 3, 2025
- implement prototype
  reasonsolo
  committed
  6df0033
- fix tests
  reasonsolo
  committed
  0b622c3
- fix failed CI tests
  reasonsolo
  committed
  598efa9
- fix failed tests
  reasonsolo
  committed
  39cc192
- address review comments
  reasonsolo
  committed
  4e120fa
- add a UT for OpenAIHttpClient
  reasonsolo
  committed
  3428173
Commits on Dec 4, 2025
- Merge branch 'main' into TRTLLM-8920_decouplefastapi
  reasonsolo
  committed
  67cacb6