Skip to content

ggml-openvino: enable in-place 4-D stateless KV cache updates on GPU - #344

Merged
cavusmustafa merged 1 commit into
ravi9:dev_backend_openvinofrom
osabnis:ov-kv-cache-4d
Oct 12, 2026
Merged

ggml-openvino: enable in-place 4-D stateless KV cache updates on GPU#344
cavusmustafa merged 1 commit into
ravi9:dev_backend_openvinofrom
osabnis:ov-kv-cache-4d

ggml-openvino: use a 4-D stateless KV cache on GPU

dd04231
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs