Skip to content

mtmd : add MiniCPM-OCR 1.0 support - #30979

Merged
ngxson merged 1 commit into
ggml-org:masterfrom
tc-mb:model/MiniCPM-OCR-1.0
Oct 22, 2026
Merged

ngxson merged 1 commit into
ggml-org:masterfrom
tc-mb:model/MiniCPM-OCR-1.0

Conversation

@tc-mb

@tc-mb tc-mb commented Oct 22, 2026 •

Copy link
Copy Markdown
Contributor

Overview

MiniCPM-OCR 1.0 is the MiniCPM-V 4.6 stack with a different model_type, so
this only registers it: a new PROJECTOR_TYPE_MINICPM_OCR_1_0 reusing
clip_graph_minicpmv4_6 and the 4.6 conversion path.

Additional information

The model writes its transcription inside the thinking block, so run with
--reasoning off (or reasoning_effort: "none" per request) to get it in
content. With the default auto the reply comes back as empty content and
the text lands in reasoning_content.

Requirements

  • I have read and agree with the contributing guidelines
  • AI usage disclosure: YES — AI tools were used for part of the code changes.

Signed-off-by: tc-mb <tianchi_cai@icloud.com>
@tc-mb
tc-mb requested review from a team and CISC as code owners October 22, 2026 13:35
@github-actions github-actions Bot added mtmd Related to multimodal functionality (video/image/audio) conversion labels Oct 22, 2026
@ngxson

ngxson commented Oct 22, 2026

Copy link
Copy Markdown
Collaborator

chat_template_kwargs={"enable_thinking": false} is needed for plain
transcription, otherwise the template emits <think>.

that is --reasoning off

which AI agent you are using? seems like it didn't discover the code base deeply

@tc-mb

tc-mb commented Oct 22, 2026

Copy link
Copy Markdown
Contributor Author

chat_template_kwargs={"enable_thinking": false} is needed for plain
transcription, otherwise the template emits <think>.

that is --reasoning off

which AI agent you are using? seems like it didn't discover the code base deeply

You are correct; I seem to have conflated the AI-related terminology with the specific usage within vLLM. I have updated.

@ngxson
ngxson merged commit a08ab75 into ggml-org:master Oct 22, 2026
15 checks passed
@tc-mb
tc-mb deleted the model/MiniCPM-OCR-1.0 branch October 23, 2026 01:57
auRose94 pushed a commit to auRose94/llama.cpp that referenced this pull request Oct 28, 2026
Signed-off-by: tc-mb <tianchi_cai@icloud.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

conversion mtmd Related to multimodal functionality (video/image/audio)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants