Skip to content

convert : support text-only checkpoints in pplx-decider - #30575

Merged
CISC merged 3 commits into
ggml-org:masterfrom
final-bench:final-bench-patch-1
Oct 16, 2026
Merged

CISC merged 3 commits into
ggml-org:masterfrom
final-bench:final-bench-patch-1

Conversation

@final-bench

@final-bench final-bench commented Oct 15, 2026 •

Copy link
Copy Markdown
Contributor

Overview

The pplx-decider converter only accepted the multimodal checkpoint layout (a nested text_config and language_model.* tensor names). This change also accepts text-only checkpoints, where the config is flat (Qwen3_5TextModel) and the tensors have bare names, such as FINAL-Bench/Darwin-27B-ZTC-v5, which uses the same decision format but failed to convert before.

Additional information

Tested with FINAL-Bench/Darwin-27B-ZTC-v5:

  • convert_hf_to_gguf.py: detected pplx-decider checkpoint, 851 tensors, bf16 53.8G
  • llama-quantize Q8_0: 28.6G
  • llama-server: "decision model type: pplx-decider"
  • /v1/systemone vs the original engine, Typed Decisions test, 20 cases / 100 decisions (Q8_0, CPU):
    same top answer 98/100, accuracy 0.730 vs 0.730, mean max|dp| 0.0058
  • Multimodal pplx-decider checkpoints (language_model.* / visual.*) take the same path as before.

Requirements

Requirements

  • I have read and agree with the contributing guidelines
  • AI usage disclosure: YES - an AI coding assistant helped write the conversion change, run the tests, and draft this description; I reviewed all of it.

convert : support text-only checkpoints in pplx-decider
@final-bench
final-bench requested a review from CISC as a code owner October 15, 2026 07:57
@ggml-gh-bot

This comment was marked as resolved.

@ggml-gh-bot ggml-gh-bot Bot added the draft PR will be changed to draft by github-actions bot label Oct 15, 2026
Comment thread conversion/pplx_decider.py Resolved
Comment thread conversion/pplx_decider.py Resolved
@github-actions
github-actions Bot marked this pull request as draft October 15, 2026 08:42
@github-actions github-actions Bot removed the draft PR will be changed to draft by github-actions bot label Oct 15, 2026
Comment thread conversion/pplx_decider.py Resolved
@CISC
CISC requested a review from ngxson October 15, 2026 09:25
@final-bench
final-bench marked this pull request as ready for review October 15, 2026 11:17
ngxson
ngxson previously approved these changes Oct 15, 2026
@ngxson
ngxson dismissed their stale review October 15, 2026 21:17

lint failed

@CISC
CISC merged commit 0f43762 into ggml-org:master Oct 16, 2026
5 checks passed
auRose94 pushed a commit to auRose94/llama.cpp that referenced this pull request Oct 28, 2026
* pplx-decider-text-only

convert : support text-only checkpoints in pplx-decider

* Apply suggestions from code review

* convert : remove unused import
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants