Repository navigation
[0.17.1] Qualify llama.cpp v0.8.0 as the next runtime - #131
Merged
Merged
Conversation
Add b11912 (961c376a) rows to every native validation lane and skip the Qwen3-TTS projector RNG priming where mtmd seeds a fresh generation state per synthesis (mtmd_gen_state, upstream #30902).
b11912 adds two SVE Q8_0 kernels reachable only behind runtime SVE256, SVE I8MM and DOTPROD (mask 69). Bind them to the exact b11912 source pair and extend the dispatch selector sweep to the new feature bit.
v0.8.0 (8642541b) is b11912 plus 48 commits. Every native lane's candidate row now builds it instead of b11912. The Android ISA policy binds the v0.8.0 ggml/src fingerprint to the unchanged KleidiAI v1.32.0 source and its existing function set: the only ggml-cpu change since b11912 is the non-contiguous scale op (#31146). The armv8.2 audit passes with 3,130 scalable instructions in the same 22 functions. The three carried patches apply strictly. 0003 is redundant on v0.8.0 but stays while the pinned v0.7.0 builds from the same series.
This was referenced Oct 29, 2026
Owner
Author
|
Independent audit at exact head Corrections to this PR's claims, none affecting code:
The v0.8.0 CUDA, HIP and Apple release rows have no proof yet. The release fails closed: |
leehack
marked this pull request as ready for review
October 29, 2026 22:09
This was referenced Oct 29, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Qualifies upstream stable v0.8.0 (
8642541b, b11912 + 48 commits) as the next native runtime, for llamadart 0.17.1 (#112, plan llamadart#922). Supersedes #125 (b11912): its four commits are carried unchanged onto currentmain, plus one retarget commit.Draft, not for merge. No tag, release, workflow dispatch or downstream pin change. The production submodule stays at v0.7.0.
Changes
validate_wrapper.yml: av0.8.0row in every native lane, pinned to the exact SHA (replaces [0.17] Qualify llama.cpp b11912 as the next runtime #125'sb11912rows).test_ci_scope.pycovers it.mtmd_gen_state; the Seed every Qwen3-TTS codebook from the request on each synthesis #122 priming call compiles only without that API. Exports unchanged (89). TTS still accepts only Qwen3-TTS; Soprano and LFM3-Audio report unsupported.ggml/srcfingerprint bound to the unchanged KleidiAI v1.32.0kaidigest and the b11912 function set. The onlyggml-cpuchange since b11912 is the non-contiguous scale op (#31146).docs/v080_qualification.md(patch status, consumer ABI delta from v0.7.0),docs/v080_android_isa_qualification.md.Carried patches
All three apply strictly (
llama_cpp_patches.py apply --strict).bufferDeviceAddresswithout the entry-point check.model-sessionandmodel-embedding-toggle. It cannot leaveseries.jsonhere: the pinned v0.7.0 and its rows build from the same series and need it. Remove it with the pin move to v0.8.0.Local evidence (macOS arm64, M4 Max)
validate_exports.py/ grammar boundary*_test.py22 OKwindows-11-vs2026-armlabeltts_smoke(CPU, model hashes as in #125)Not covered
ubuntu-latest(26.04), independent of this PR: ubuntu-latest moved to 26.04: Linux CUDA release build and Linux arm64 ISA audit fail #132. It blocks publishing v0.8.0.Hosted evidence (head
defccfb)v0.8.0row except Linux arm64: Android ISA, Android Vulkan shaders, emulated KleidiAI dispatch, Windows arm64 KleidiAI and Vulkan, Windows x64 runtime closure, MSVC mtmd link, Linux x64 artifact contract, wrapper contract, macOS exit teardown (release and ASan).linux-artifact-contract (arm64)on the pinned v0.7.0, v0.7.0 and v0.8.0 rows, plus thewrapper-validationaggregate. The Linux arm64 CPU ISA audit rejects four SVE instructions outside any sized function in the baselinelibggml-cpu.so. The job now runs on ubuntu-26.04 / aarch64 GCC 15.2; the last greenmainrun was on 24.04. It fails on the pinned row too, so this PR did not cause it: ubuntu-latest moved to 26.04: Linux CUDA release build and Linux arm64 ISA audit fail #132.