Repository navigation

Add memoized cache to `llama_grammar_reject_candidates_for_stack` - #1615

Merged

LostRuins merged 5 commits into

LostRuins:concedo_experimentalfrom

Reithan:add-memoized-cache-to-grammar-rejection

Jun 25, 2025

Merged

Add memoized cache to `llama_grammar_reject_candidates_for_stack`#1615
LostRuins merged 5 commits into
LostRuins:concedo_experimentalfrom
Reithan:add-memoized-cache-to-grammar-rejection

Commits on Jun 23, 2025
- Add memoized cache to llama_grammar_reject_candidates_for_stack
  Reithan
  committed
  dbff279
- make size cutoff more aggressive and move to outer branch
  Reithan
  committed
  4510328
- update comment
  Reithan
  committed
  241414e
- add cache reset whenever grammar is reloaded
  Reithan
  committed
  0fc4a88
Commits on Jun 25, 2025
- remove explicit reference types for compiler transportability
  Reithan
  committed
  8ade803