Skip to content

prefill: the fused int8 prompt experts on Turing (sm_75), opt-in (+9 % prefill on RTX 2080 Ti) - #2145

Closed
rafatxf wants to merge 1 commit into
Niko1221:mainfrom
rafatxf:pr/sm75-fused-experts
Closed

prefill: the fused int8 prompt experts on Turing (sm_75), opt-in (+9 % prefill on RTX 2080 Ti)#2145
rafatxf wants to merge 1 commit into
Niko1221:mainfrom
rafatxf:pr/sm75-fused-experts

Commits

  1. Commits on Oct 12, 2026