Skip to content

CUDA performance optimization: asynchronous computation by using only one cudaStream - #1898

Merged
JohannesGaessler merged 1 commit into
ggml-org:masterfrom
JohannesGaessler:cuda-async-compute
Jun 17, 2023
Merged

CUDA performance optimization: asynchronous computation by using only one cudaStream#1898
JohannesGaessler merged 1 commit into
ggml-org:masterfrom
JohannesGaessler:cuda-async-compute

Only one CUDA stream per device for async compute

8a93a05
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs