You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The spmd_paged_attention_highperf scene test works for shorter decode
sequence lengths, but fails when extended to longer paged-attention sequences.
The failure is reproducible for the 8192-token case added in hw-native-sys/simpler#986.
The compared PyPTO SPMD implementation can run the same logical GQA paged
attention problem for 8192 and 16384 tokens, so the long-sequence failure
appears specific to the simpler highperf kernel/runtime path rather than the
input shape itself.
The highperf SPMD paged-attention kernel should complete successfully for the
8192-token GQA decode case and produce output matching the golden reference.
Activity
MirkoDeVita98 commentedon Jun 19, 2026
Fix: #1091