Skip to content

ci : update the oneAPI toolkit to 2026.1 - #29273

Merged
arthw merged 5 commits into
ggml-org:masterfrom
Asahi-Prv:sycl-oneapi-2026-1
Sep 29, 2026
Merged

arthw merged 5 commits into
ggml-org:masterfrom
Asahi-Prv:sycl-oneapi-2026-1

Conversation

@Asahi-Prv

Copy link
Copy Markdown
Contributor

Overview

Updates the CI build environment and the release package build from oneAPI 2025.3.3 (Deep Learning Essentials) to oneAPI 2026.1 (the unified oneAPI Toolkit installer). Since oneDNN was removed from the Deep Learning Essentials package in oneAPI 2026.0, this keeps oneDNN support available through the unified Toolkit and updates the corresponding SYCL documentation.

Additional information

Changes

  • Update the CI build environment from oneAPI 2025.3.3 (Deep Learning Essentials) to oneAPI 2026.1 (the unified oneAPI Toolkit installer).

  • Keep oneDNN support available with the unified oneAPI Toolkit. oneDNN was removed from the Deep Learning Essentials package in oneAPI 2026.0.

  • The Windows install script (scripts/install-oneapi.bat) works as-is because the component IDs are unchanged in oneAPI 2026.1.

  • Align the release package build (.github/workflows/release.yml):

    • Level Zero SDK 1.28.2 -> 1.33.1 (the libze1/libze-dev Debian package names).
    • The Windows runtime DLL list for the 2026.1 versions (sycl9.dll, .6/.3 MKL libraries).
  • Update docs/backend/SYCL.md:

    • Update the installation instructions.
    • Add oneAPI 2026.1 to the verified release table.
    • Update the news section.

Verification

Using the same code (b10899) on an Intel Arc B570 with Qwen3.8-9B Q4_K_M and -ngl 99:

  • Prompt processing (pp512): 1331 t/s with oneAPI 2026.1 vs 434 t/s with the 2025.3-based release build (~3.1x).
  • Token generation (tg128): 50.1 t/s with oneAPI 2026.1 vs 45.3-48.0 t/s with the 2025.3-based release build.
  • test-backend-ops: correct results verified with the oneAPI 2026.1 build.

Requirements

  • I have read and agree to the contributing guidelines

  • AI usage disclosure: YES - GLM-5.3 Flash via OpenCode was used for analysis, implementation, routine edits, and debugging assistance. The author identified the issue and provided the overall direction for the fix.

oneDNN is removed from Intel Deep Learning Essentials in 2026.0, so
staying on the deep-learning-essentials path would silently lose oneDNN
support when the toolkit version is updated. Switch both the Ubuntu and
Windows CI jobs to the new unified Intel oneAPI Toolkit installer,
which still includes oneDNN (until 2027.0) and keeps the component IDs
unchanged for the Windows install script.

Measured with the same code (b10899) built with oneAPI 2026.1 vs the
2025.3-based release build on Arc B570: prompt processing 1331 vs 434
t/s (3.1x), token generation 50.1 vs 45.3-48.0 t/s.

Assisted-by: GLM (z-ai/glm-5.3-flash)
With the 2026.0 release the Base toolkit and the HPC toolkit are
combined into the oneAPI Toolkit, and oneDNN is removed from the Deep
Learning Essentials package. Update the install instructions, the
verified release table and the news section accordingly.

Assisted-by: GLM (z-ai/glm-5.3-flash)
… 1.33.1

Align the release package build with the CI build update:
- oneAPI toolkit 2025.3.3 -> 2026.1 (the unified oneAPI Toolkit)
- Level Zero SDK 1.28.2 -> 1.33.1, and the Debian package names
  (level-zero/level-zero-devel -> libze1/libze-dev)
- The Windows DLL copy list for the 2026.1 runtime: sycl9.dll and the
  .6/.3 MKL library versions

Assisted-by: GLM (z-ai/glm-5.3-flash)
@Asahi-Prv
Asahi-Prv requested a review from a team as a code owner September 22, 2026 13:50
@github-actions github-actions Bot added documentation Improvements or additions to documentation devops improvements to build systems and github actions SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language labels Sep 22, 2026
@CISC

CISC commented Sep 22, 2026

Copy link
Copy Markdown
Member

Provide link to successful release job please.

… list

oneAPI 2026.1 no longer ships libsycl-fallback-bfloat16.spv and
libsycl-native-bfloat16.spv (the OpenCL fallback mechanism changed), so
the copy step failed with exit 1.

Assisted-by: GLM (z-ai/glm-5.3-flash)
@Asahi-Prv

Copy link
Copy Markdown
Contributor Author

@CISC I ran the release workflow with the updated config. All jobs are green (28/28), including windows-sycl and ubuntu-24-sycl (fp32/fp16) with oneAPI 2026.1 + Level Zero SDK 1.33.1:
https://github.com/Asahi-Prv/llama.cpp/actions/runs/35826107843

@CISC
CISC requested a review from arthw September 23, 2026 11:16

@arthw arthw left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The oneapi used in dockerfile need to be updated in same time:

update .devops/intel.Dockerfile with intel/oneapi-toolkit:2026.1.1-devel-ubuntu24.04

Thank you!

@Asahi-Prv
Asahi-Prv requested a review from ngxson as a code owner September 24, 2026 09:02
@Asahi-Prv

Copy link
Copy Markdown
Contributor Author

I forgot left comment. I fixed dockerfile. Thank you!

@WizardlyBump17

Copy link
Copy Markdown
Contributor

I would like to speak against the upgrade on the intel.Dockerfile. It is known that the base oneAPI 2026.1 image causes performance decrease: #25973

@NickM-27

NickM-27 commented Sep 25, 2026 •

Copy link
Copy Markdown
Contributor

@WizardlyBump17 The change here doesn't just bump the version, it also changes to a different image, one which contains oneDNN (unlike the updated version of the original image).

I tested on B70 and I see no performance difference:

current master

Found 1 SYCL devices:
|  |                   |                                       |       |Max    |        |Max  |Global |                     |
|  |                   |                                       |       |compute|Max work|sub  |mem    |                     |
|ID|        Device Type|                                   Name|Version|units  |group   |group|size   |       Driver version|
|--|-------------------|---------------------------------------|-------|-------|--------|-----|-------|---------------------|
| 0| [level_zero:gpu:0]|             Intel Arc Pro B70 Graphics|   20.2|    256|    1024|   32| 34242M|         1.15.38308+1|
SYCL Optimization Feature:
|ID|        Device Type|Reorder|
|--|-------------------|-------|
| 0| [level_zero:gpu:0]|      Y|
load_backend: loaded SYCL backend from /app/libggml-sycl.so
load_backend: loaded CPU backend from /app/libggml-cpu-haswell.so
| model                          |       size |     params | backend    | ngl | n_ubatch |  fa |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | --: | --------------: | -------------------: |
| qwen35 27B Q6_K                |  20.46 GiB |    27.32 B | SYCL       |  -1 |     1024 |   1 |          pp2048 |       1212.47 ± 9.64 |
| qwen35 27B Q6_K                |  20.46 GiB |    27.32 B | SYCL       |  -1 |     1024 |   1 |           tg256 |         21.32 ± 0.05 |
| qwen35 27B Q6_K                |  20.46 GiB |    27.32 B | SYCL       |  -1 |     1024 |   1 |  pp2048 @ d8192 |       1029.24 ± 2.03 |
| qwen35 27B Q6_K                |  20.46 GiB |    27.32 B | SYCL       |  -1 |     1024 |   1 |   tg256 @ d8192 |         19.60 ± 0.03 |
| qwen35 27B Q6_K                |  20.46 GiB |    27.32 B | SYCL       |  -1 |     1024 |   1 | pp2048 @ d16384 |        968.59 ± 1.90 |
| qwen35 27B Q6_K                |  20.46 GiB |    27.32 B | SYCL       |  -1 |     1024 |   1 |  tg256 @ d16384 |         18.15 ± 0.02 |

this PR

Found 1 SYCL devices:
|  |                   |                                       |       |Max    |        |Max  |Global |                     |
|  |                   |                                       |       |compute|Max work|sub  |mem    |                     |
|ID|        Device Type|                                   Name|Version|units  |group   |group|size   |       Driver version|
|--|-------------------|---------------------------------------|-------|-------|--------|-----|-------|---------------------|
| 0| [level_zero:gpu:0]|             Intel Arc Pro B70 Graphics|   20.2|    256|    1024|   32| 34242M|         1.15.38308+1|
SYCL Optimization Feature:
|ID|        Device Type|Reorder|
|--|-------------------|-------|
| 0| [level_zero:gpu:0]|      Y|
load_backend: loaded SYCL backend from /app/libggml-sycl.so
load_backend: loaded CPU backend from /app/libggml-cpu-haswell.so
| model                          |       size |     params | backend    | ngl | n_ubatch |  fa |            test |                  t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | --: | --------------: | -------------------: |
| qwen35 27B Q6_K                |  20.46 GiB |    27.32 B | SYCL       |  -1 |     1024 |   1 |          pp2048 |      1215.89 ± 10.86 |
| qwen35 27B Q6_K                |  20.46 GiB |    27.32 B | SYCL       |  -1 |     1024 |   1 |           tg256 |         21.36 ± 0.04 |
| qwen35 27B Q6_K                |  20.46 GiB |    27.32 B | SYCL       |  -1 |     1024 |   1 |  pp2048 @ d8192 |       1034.93 ± 0.35 |
| qwen35 27B Q6_K                |  20.46 GiB |    27.32 B | SYCL       |  -1 |     1024 |   1 |   tg256 @ d8192 |         19.66 ± 0.03 |
| qwen35 27B Q6_K                |  20.46 GiB |    27.32 B | SYCL       |  -1 |     1024 |   1 | pp2048 @ d16384 |        976.01 ± 0.95 |
| qwen35 27B Q6_K                |  20.46 GiB |    27.32 B | SYCL       |  -1 |     1024 |   1 |  tg256 @ d16384 |         18.23 ± 0.01 |

@Asahi-Prv

Copy link
Copy Markdown
Contributor Author

@WizardlyBump17 Yeah, I knew this issue.
Reason is simple. Separation oneDNN Package by oneAPI Toolkits.
oneDNN is bundled my changed dockerfile.
Thank you!

@WizardlyBump17

Copy link
Copy Markdown
Contributor

@WizardlyBump17 Yeah, I knew this issue. Reason is simple. Separation oneDNN Package by oneAPI Toolkits. oneDNN is bundled my changed dockerfile. Thank you!

I didnt realize that, sorry. But it would be cooler if it still used the deep-learning-essentials image as it is smaller by 3GB:
image

@NeoZhangJianyu NeoZhangJianyu left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's good job!

Thank you!

@arthw
arthw merged commit fc07d78 into ggml-org:master Sep 29, 2026
6 checks passed
@arthw

arthw commented Sep 29, 2026

Copy link
Copy Markdown
Contributor

@WizardlyBump17
deep-learning-essentials (DLE) has removed the oneDNN package from it.
oneDNN is mandatory package of SYCL backend.
It's simple way to install from oneAPI toolkit package.

I will consider to install DLE+oneDNN in the future.

Thank you!

pierreguillot pushed a commit to Ircam-Partiels/llama.cpp that referenced this pull request Oct 1, 2026
* ci : update the oneAPI toolkit to 2026.1

oneDNN is removed from Intel Deep Learning Essentials in 2026.0, so
staying on the deep-learning-essentials path would silently lose oneDNN
support when the toolkit version is updated. Switch both the Ubuntu and
Windows CI jobs to the new unified Intel oneAPI Toolkit installer,
which still includes oneDNN (until 2027.0) and keeps the component IDs
unchanged for the Windows install script.

Measured with the same code (b10899) built with oneAPI 2026.1 vs the
2025.3-based release build on Arc B570: prompt processing 1331 vs 434
t/s (3.1x), token generation 50.1 vs 45.3-48.0 t/s.

Assisted-by: GLM (z-ai/glm-5.3-flash)

* docs : update the SYCL backend build requirements for oneAPI 2026.1

With the 2026.0 release the Base toolkit and the HPC toolkit are
combined into the oneAPI Toolkit, and oneDNN is removed from the Deep
Learning Essentials package. Update the install instructions, the
verified release table and the news section accordingly.

Assisted-by: GLM (z-ai/glm-5.3-flash)

* ci : update the release workflow for oneAPI 2026.1 and Level Zero SDK 1.33.1

Align the release package build with the CI build update:
- oneAPI toolkit 2025.3.3 -> 2026.1 (the unified oneAPI Toolkit)
- Level Zero SDK 1.28.2 -> 1.33.1, and the Debian package names
  (level-zero/level-zero-devel -> libze1/libze-dev)
- The Windows DLL copy list for the 2026.1 runtime: sycl9.dll and the
  .6/.3 MKL library versions

Assisted-by: GLM (z-ai/glm-5.3-flash)

* ci : remove the removed .spv fallback files from the Windows DLL copy list

oneAPI 2026.1 no longer ships libsycl-fallback-bfloat16.spv and
libsycl-native-bfloat16.spv (the OpenCL fallback mechanism changed), so
the copy step failed with exit 1.

Assisted-by: GLM (z-ai/glm-5.3-flash)

* devops : update the oneAPI toolkit image in the Intel Dockerfile

Assisted-by: GLM (z-ai/glm-5.3-flash)

---------

Co-authored-by: Asahi-Prv <Asahi-Prv@users.noreply.github.com>
marcusds added a commit to marcusds/llama-swap-custom that referenced this pull request Oct 1, 2026
Upstream validates oneAPI 2026.1 since ggml-org/llama.cpp#29273, so the
2025.3.3 default no longer has a reason to exist and -2026 became identical
to it. -bmg follows to 2026.1.4; -multigpu stays on 2025.3.3 as the
known-good fallback.
frostyautumnleaf pushed a commit to frostyautumnleaf/llama.cpp that referenced this pull request Oct 5, 2026
* ci : update the oneAPI toolkit to 2026.1

oneDNN is removed from Intel Deep Learning Essentials in 2026.0, so
staying on the deep-learning-essentials path would silently lose oneDNN
support when the toolkit version is updated. Switch both the Ubuntu and
Windows CI jobs to the new unified Intel oneAPI Toolkit installer,
which still includes oneDNN (until 2027.0) and keeps the component IDs
unchanged for the Windows install script.

Measured with the same code (b10899) built with oneAPI 2026.1 vs the
2025.3-based release build on Arc B570: prompt processing 1331 vs 434
t/s (3.1x), token generation 50.1 vs 45.3-48.0 t/s.

Assisted-by: GLM (z-ai/glm-5.3-flash)

* docs : update the SYCL backend build requirements for oneAPI 2026.1

With the 2026.0 release the Base toolkit and the HPC toolkit are
combined into the oneAPI Toolkit, and oneDNN is removed from the Deep
Learning Essentials package. Update the install instructions, the
verified release table and the news section accordingly.

Assisted-by: GLM (z-ai/glm-5.3-flash)

* ci : update the release workflow for oneAPI 2026.1 and Level Zero SDK 1.33.1

Align the release package build with the CI build update:
- oneAPI toolkit 2025.3.3 -> 2026.1 (the unified oneAPI Toolkit)
- Level Zero SDK 1.28.2 -> 1.33.1, and the Debian package names
  (level-zero/level-zero-devel -> libze1/libze-dev)
- The Windows DLL copy list for the 2026.1 runtime: sycl9.dll and the
  .6/.3 MKL library versions

Assisted-by: GLM (z-ai/glm-5.3-flash)

* ci : remove the removed .spv fallback files from the Windows DLL copy list

oneAPI 2026.1 no longer ships libsycl-fallback-bfloat16.spv and
libsycl-native-bfloat16.spv (the OpenCL fallback mechanism changed), so
the copy step failed with exit 1.

Assisted-by: GLM (z-ai/glm-5.3-flash)

* devops : update the oneAPI toolkit image in the Intel Dockerfile

Assisted-by: GLM (z-ai/glm-5.3-flash)

---------

Co-authored-by: Asahi-Prv <Asahi-Prv@users.noreply.github.com>
edwardyoon pushed a commit to edwardyoon/focus-llama that referenced this pull request Oct 7, 2026
* ci : update the oneAPI toolkit to 2026.1

oneDNN is removed from Intel Deep Learning Essentials in 2026.0, so
staying on the deep-learning-essentials path would silently lose oneDNN
support when the toolkit version is updated. Switch both the Ubuntu and
Windows CI jobs to the new unified Intel oneAPI Toolkit installer,
which still includes oneDNN (until 2027.0) and keeps the component IDs
unchanged for the Windows install script.

Measured with the same code (b10899) built with oneAPI 2026.1 vs the
2025.3-based release build on Arc B570: prompt processing 1331 vs 434
t/s (3.1x), token generation 50.1 vs 45.3-48.0 t/s.

Assisted-by: GLM (z-ai/glm-5.3-flash)

* docs : update the SYCL backend build requirements for oneAPI 2026.1

With the 2026.0 release the Base toolkit and the HPC toolkit are
combined into the oneAPI Toolkit, and oneDNN is removed from the Deep
Learning Essentials package. Update the install instructions, the
verified release table and the news section accordingly.

Assisted-by: GLM (z-ai/glm-5.3-flash)

* ci : update the release workflow for oneAPI 2026.1 and Level Zero SDK 1.33.1

Align the release package build with the CI build update:
- oneAPI toolkit 2025.3.3 -> 2026.1 (the unified oneAPI Toolkit)
- Level Zero SDK 1.28.2 -> 1.33.1, and the Debian package names
  (level-zero/level-zero-devel -> libze1/libze-dev)
- The Windows DLL copy list for the 2026.1 runtime: sycl9.dll and the
  .6/.3 MKL library versions

Assisted-by: GLM (z-ai/glm-5.3-flash)

* ci : remove the removed .spv fallback files from the Windows DLL copy list

oneAPI 2026.1 no longer ships libsycl-fallback-bfloat16.spv and
libsycl-native-bfloat16.spv (the OpenCL fallback mechanism changed), so
the copy step failed with exit 1.

Assisted-by: GLM (z-ai/glm-5.3-flash)

* devops : update the oneAPI toolkit image in the Intel Dockerfile

Assisted-by: GLM (z-ai/glm-5.3-flash)

---------

Co-authored-by: Asahi-Prv <Asahi-Prv@users.noreply.github.com>
(cherry picked from commit fc07d78)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

devops improvements to build systems and github actions documentation Improvements or additions to documentation SYCL https://en.wikipedia.org/wiki/SYCL - GPU programming language

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants