[Unity] GPU sampling - #16575

Merged

tqchen merged 13 commits into

apache:mainfrom

yongwww:sampling_gpu

Feb 23, 2024

Commits on Feb 20, 2024

Add multinomial_from_uniform
yongwww
committed
a6d4524
Add this sampling for CPU
yongwww
committed
10d99fa
Add test cases
yongwww
committed
810b9cf
Remove compilation and run in the nn module test
yongwww
committed
629a342
update test
yongwww
committed
4c1ac31
fix typo
yongwww
committed
652a526
fix lint
yongwww
committed
36f7c69
handle corner case
yongwww
committed
0ea3dec
update tests
yongwww
committed
c7b085a
GPU sampling top_p top_k
yongwww
committed
183cf98

Commits on Feb 21, 2024

Add test cases for the compile and run
yongwww
committed
1db7d03

Commits on Feb 22, 2024

Fix lint
yongwww
committed
1a150c0

Commits on Feb 23, 2024

Fuse cumsum mask
yongwww
committed
76695b9