Skip to content

serve --batch: a layer split reads a prompt in STRATA_SPLIT_PIECE-token runs, decided at every boundary - #1504

Closed
sanastasiou wants to merge 1 commit into
Niko1221:mainfrom
sanastasiou:perf/split-read-piece
Closed

serve --batch: a layer split reads a prompt in STRATA_SPLIT_PIECE-token runs, decided at every boundary#1504
sanastasiou wants to merge 1 commit into
Niko1221:mainfrom
sanastasiou:perf/split-read-piece

serve --batch: a layer split reads a prompt in STRATA_SPLIT_PIECE-tok…

1730b87
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs