You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Non-runtime applications of LoRA in Vulkan now fail with an assert in ggml_vk_mul_mat_q_f16
This even applies when wtype is set to q4_0 which worked before
ggml/src/ggml-vulkan/ggml-vulkan.cpp:6552: GGML_ASSERT(y_non_contig || !qy_needs_dequant) failed
both my lora and model are .safetensors, runtime converted to q4_0
model is a SDXL model.
previously, this combination worked fine. running in immediate mode works, though.
Activity
leejet commentedon Nov 30, 2025
This PR #1021 should fix the issue.