Skip to content

Two-GPU decode: bounded attention merge (bitwise, opt-in) and pipelined PLE read-ahead / early chain (stacked on #905) - #910

Closed
Hardin22 wants to merge 853 commits into
Niko1221:mainfrom
Hardin22:pr/pipe-team
Closed

Two-GPU decode: bounded attention merge (bitwise, opt-in) and pipelined PLE read-ahead / early chain (stacked on #905)#910
Hardin22 wants to merge 853 commits into
Niko1221:mainfrom
Hardin22:pr/pipe-team

Decode attention: STRATA_ATTN_MERGE_V2 opt-in

9d27f7e
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs