ggml: avoid rebuild of GGML graph for each token (#7456) - #8366

ggml: avoid rebuild of GGML graph for each token (#7456)#8366

agray3 wants to merge 1 commit into

ggml-org:masterggml-org/llama.cpp:masterfrom

agray3:ag_ggml_graph_cachingagray3/llama.cpp:ag_ggml_graph_cachingCopy head branch name to clipboard