Skip to content

Expose build_info in router mode - #21835

Merged
ngxson merged 1 commit into
ggml-org:masterfrom
gaspardpetit:feat/llama-server-exposes-build-info-in-router-mode
Apr 13, 2026
Merged

ngxson merged 1 commit into
ggml-org:masterfrom
gaspardpetit:feat/llama-server-exposes-build-info-in-router-mode

Conversation

@gaspardpetit

@gaspardpetit gaspardpetit commented Apr 13, 2026 •

Copy link
Copy Markdown
Contributor

Overview

  • Include the build_info in llama-server 's /prop endpoint when running in router mode;
  • also expose params.models_max instead of dummy value and params.models_autoload

Requirements


For context, with this change, in router mode, for GET /props

BEFORE

{
  "role":"router",
  "max_instances":4,
  "model_alias":"llama-server",
  "model_path":"none",
  "default_generation_settings":{"params":null,"n_ctx":0},
  "webui_settings":{}
}

AFTER

{
  "role":"router",
  "max_instances":4,
  "models_autoload":true,
  "model_alias":"llama-server",
  "model_path":"none",
  "default_generation_settings":{"params":null,"n_ctx":0},
  "webui_settings":{},
  "build_info":"b8771-9ef1fab9c"
}

@gaspardpetit
gaspardpetit requested a review from a team as a code owner April 13, 2026 01:58
@github-actions github-actions Bot added examples python python script changes server labels Apr 13, 2026
@ngxson
ngxson merged commit ce8fd4b into ggml-org:master Apr 13, 2026
49 of 50 checks passed
@gaspardpetit
gaspardpetit deleted the feat/llama-server-exposes-build-info-in-router-mode branch April 13, 2026 22:08
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
fukuro-kun pushed a commit to fukuro-kun/fukuro-llama-cpp-turboquant that referenced this pull request Jul 5, 2026
MrLordCat referenced this pull request in MrLordCat/llama.cpp-rdna-lab Jul 16, 2026
zommiommy pushed a commit to zommiommy/llama.cpp that referenced this pull request Aug 18, 2026
frostyautumnleaf pushed a commit to frostyautumnleaf/llama.cpp that referenced this pull request Oct 5, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

examples python python script changes server

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants