You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Loading a model through the SDK does not use per model defaults #178
Let’s take Qwen3 1.7B. The installed model default temp is 0.8.
I change the default temp to 0.6.
When I load the model in the UI, the temp is 0.8.
If I use the cli with lms load, the temp is 0.8.
If I use the REST API v1, the temp is 0.8
If I use the python sdk lmstudio.llm(), the temp is not 0.8, but back to 0.6.
The other params follow the same pattern - use my custom defaults when loaded everywhere except the python sdk.
The SDK should load using the per model custom defaults I set.
Activity