Repository navigation
Misc. bug: Optimize GPU token gen perf when context depth is passed (llama-bench) #188
Description
Name and Version
llama-bench tool
e.g. PP0, TG128, D8192, NITER3
Operating systems
No response
Which llama.cpp modules do you know to be affected?
No response
Command line
Problem description & steps to reproduce
See token gen graphs showing D8192 perf
First Bad Commit
No response
Activity