Skip to content

ggml : extend bin bcast for permuted src1 - #19484

Merged
ggerganov merged 4 commits into
masterfrom
gg/bin-bcast-extend
Feb 11, 2026
Merged

ggerganov merged 4 commits into
masterfrom
gg/bin-bcast-extend

Conversation

@ggerganov

@ggerganov ggerganov commented Feb 10, 2026 •

Copy link
Copy Markdown
Member
  • Remove CPU asserts preventing src1 from being permuted
  • Update CUDA kernels to support permuted src1
  • Add tests to exercise src1 permutation

@github-actions github-actions Bot added testing Everything test related Nvidia GPU Issues specific to Nvidia GPUs ggml changes relating to the ggml tensor library for machine learning labels Feb 10, 2026
@ggerganov
ggerganov marked this pull request as ready for review February 10, 2026 15:13
@ggerganov
ggerganov requested a review from am17an February 10, 2026 15:14
@ggerganov
ggerganov merged commit 89181c0 into master Feb 11, 2026
71 of 78 checks passed
@ggerganov
ggerganov deleted the gg/bin-bcast-extend branch February 11, 2026 05:52
@ggerganov ggerganov mentioned this pull request Feb 11, 2026
1 of 3 tasks
liparetejas pushed a commit to liparetejas/llama.cpp that referenced this pull request Feb 23, 2026
* tests : extend bin bcast for permuted src1

* cont : extend bin support

* cont : s0 is always 1

* tests : simplify
Seunghhon pushed a commit to Seunghhon/llama.cpp that referenced this pull request Apr 26, 2026
* tests : extend bin bcast for permuted src1

* cont : extend bin support

* cont : s0 is always 1

* tests : simplify
my-other-github-account pushed a commit to my-other-github-account/llama.cpp that referenced this pull request May 15, 2026
* tests : extend bin bcast for permuted src1

* cont : extend bin support

* cont : s0 is always 1

* tests : simplify
fukuro-kun pushed a commit to fukuro-kun/fukuro-llama-cpp-turboquant that referenced this pull request Jul 5, 2026
* tests : extend bin bcast for permuted src1

* cont : extend bin support

* cont : s0 is always 1

* tests : simplify
MrLordCat referenced this pull request in MrLordCat/llama.cpp-rdna-lab Jul 16, 2026
* tests : extend bin bcast for permuted src1

* cont : extend bin support

* cont : s0 is always 1

* tests : simplify
zommiommy pushed a commit to zommiommy/llama.cpp that referenced this pull request Aug 18, 2026
* tests : extend bin bcast for permuted src1

* cont : extend bin support

* cont : s0 is always 1

* tests : simplify
frostyautumnleaf pushed a commit to frostyautumnleaf/llama.cpp that referenced this pull request Oct 5, 2026
* tests : extend bin bcast for permuted src1

* cont : extend bin support

* cont : s0 is always 1

* tests : simplify
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ggml changes relating to the ggml tensor library for machine learning Nvidia GPU Issues specific to Nvidia GPUs testing Everything test related

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants