Add memoized cache to llama_grammar_reject_candidates_for_stack - #1615

Add memoized cache to llama_grammar_reject_candidates_for_stack#1615

LostRuins merged 5 commits into

LostRuins:concedo_experimentalLostRuins/koboldcpp:concedo_experimentalfrom

Reithan:add-memoized-cache-to-grammar-rejectionReithan/koboldcpp:add-memoized-cache-to-grammar-rejectionCopy head branch name to clipboard