Repository navigation
bench: community report, 2x RX 6900 XT (gfx1030) + Ryzen 5 5600X, IQ3_S at 131K on 0.1.40.1 - one card, layer split and expert helper; stock, the two gfx103x switches, and #1150 #1151 #1167 - #1270
Closed
Vop3p wants to merge 1 commit into
Conversation
…_S at 131K on 0.1.40.1 - one card, layer split and expert helper; stock, the two gfx103x switches, and Niko1221#1150 Niko1221#1151 Niko1221#1167 Nine configurations (three layouts x stock / STRATA_HIP_PROMPT_F16=1 STRATA_SH_STREAM=1 / those plus the three open gfx103x pull requests), adaptive swaps on, benchmark.py at 4,096 / 32,768 / 128,000 tokens x 3 and six needles each, plus the two layer-split runs that stalled at GFXOFF's default (Niko1221#884) kept with their 4K and 32K rows. Paths in the copied files are anonymised the way the 2026-10-05 report's were. Co-Authored-By: Claude Fable 5.1 <noreply@anthropic.com>
Niko1221
pushed a commit
that referenced
this pull request
Oct 7, 2026
…S, 131K (PR #1270) Ported from the community PR with the author kept. Raw dumps and logs were trimmed (TRIMMED.md in the folder lists them); the README, summaries and configs are unchanged. Indexed in bench/results/COMMUNITY.md.
Owner
|
Thank you, xjc10. The 2x RX 6900 XT report is in 0.1.40.2 as a bench/results folder with your authorship kept. Raw dumps and logs were trimmed (TRIMMED.md in the folder lists them); the README, summaries and configs are unchanged. The row is in bench/results/COMMUNITY.md. |
0xrjman
pushed a commit
to 0xrjman/Strata
that referenced
this pull request
Oct 7, 2026
…S, 131K (PR Niko1221#1270) Ported from the community PR with the author kept. Raw dumps and logs were trimmed (TRIMMED.md in the folder lists them); the README, summaries and configs are unchanged. Indexed in bench/results/COMMUNITY.md.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Data only: one folder under
bench/results/and its line indocs/COMMUNITY_BENCHMARKS.md. Re-filed from #927 (closed with the history rewrite), measured again on 0.1.40.1 instead of 0.1.39.2x RX 6900 XT (gfx1030, PCIe 4.0 x8 each), Ryzen 5 5600X, 128 GB, Ubuntu 26.04 / Linux 7.0 / ROCm 10.0.0, Qwen3.8-Flash-Next GSQ-RCO IQ3_S at a 131,072-token context, the repository's
benchmark.py(4,096 / 32,768 / 128,000 tokens x 3) andneedle_bench.py(six needles), one cold server per configuration, adaptive swaps on. Nine configurations: one card, the layer split and the expert-helper mode, each as stock82f46a8, with the two switches 0.1.40 ships for gfx103x (STRATA_HIP_PROMPT_F16=1 STRATA_SH_STREAM=1), and with #1150 + #1151 + #1167 on top.All 54 needles found. Two things the README says in full: the two-card configurations were measured with GFXOFF disabled, because at the kernel's default the stock and the switches-only layer split both stalled on their first 128,000-token request with the adaptive swaps on (#884; the stalled runs' 4K and 32K rows are kept and match); and the decode gain over the 0.1.39 report from this machine (8-18%) is the swaps and the 0.1.40 changes together.
Developed with an AI coding assistant; every number above was measured on 2x RX 6900 XT (gfx1030, PCIe 4.0 x8 each) / Ryzen 5 5600X, ROCm 10.0.