Popular repositories Loading

1. llama.cpp llama.cpp Public

   Forked from ggml-org/llama.cpp

   llama.cpp tuned for 2x Tesla P100 (sm_60). Decode 1.86x, 3-4x with MTP (up to ~70 t/s on code). Prefill 2x, full 262k context with vision. More numerically accurate than upstream.

   C++ 14 6