You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
server router: CLI API key fails for chat when an API-key file is also used #46
Observed: listing returns 200, chat returns 401 Invalid API Key. Both file keys return 200 for both endpoints. A direct, non-router server accepts all three keys for chat.
Cause: unset_reserved_args() strips LLAMA_API_KEY but preserves LLAMA_ARG_API_KEY_FILE; the spawned child only receives the file source. This filtering was added in 98c1c7a7bf433f1f64dee23f25e7237caab868c9 (ggml-org#18169); runtime introduction has not been bisected.
Activity