Skip to content

Eval bug: Qwen3.5-35B-a3b full prompt re-processing with Claude Code #20003

Closed
Closed
Eval bug: Qwen3.5-35B-a3b full prompt re-processing with Claude Code#20003
Labels
bug-unconfirmed

Description

@anubhavgupta
anubhavgupta
opened on Mar 1, 2026

Name and Version

version: 8179 (ecbcb7e)

Operating systems

Windows

GGML backends

CUDA

Hardware

5090 Mobile (24GB Vram), cuda 13.1.

Models

unsloth's Qwen3.5-35B-A3B-UD-Q4_K_M.gguf

Problem description & steps to reproduce

args that I use to launch llama.cpp:
-m C:\Users\anubh.lmstudio\models\lmstudio-community\Qwen3.5-35b-a3b-GGUF\Qwen3.5-35B-A3B-UD-Q4_K_M.gguf -ngl 99 -t 23 --temp 0.6 --top-k 20 --top-p 0.95 --parallel 1 --mlock --swa-full -c 200000 -ctk q8_0 -ctv q8_0 -fa on --jinja --reasoning-budget 0 --host 0.0.0.0 -fit off

When using the model with Claude code, full prompt re-processing happens every time(as can be seen in the logs), although this behaviour is not observed with OpenCode.

Repo Steps:
1 Load the model
2 Configure Claude code to run it with the model locally.
3 go inside any codebase and delete any existing CLAUED.md file
4 run /init inside claude code.

Expected:

  • Full prompt re-processing should not happen. i.e: "forcing full prompt re-processing due to lack of cache data" log.

Actual:

  • Full prompt re-processing happens.

First Bad Commit

No response

Relevant log output

Logs 
STDERR: srv  params_from_: Chat format: peg-constructed

STDERR: slot get_availabl: id  0 | task -1 | selected slot by LCP similarity, sim_best = 0.810 (> 0.100 thold), f_keep = 0.811

STDERR: slot launch_slot_: id  0 | task -1 | sampler chain: logits -> ?penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> top-p -> min-p -> ?xtc -> temp-ext -> dist
slot launch_slot_: id  0 | task 745 | processing task, is_child = 0
slot update_slots: id  0 | task 745 | new prompt, n_ctx_slot = 200192, n_keep = 0, task.n_tokens = 18673
slot update_slots: id  0 | task 745 | n_past = 15126, slot.prompt.tokens.size() = 18662, seq_id = 0, pos_min = 18661, n_swa = 1
slot update_slots: id  0 | task 745 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
slot update_slots: id  0 | task 745 | erased invalidated context checkpoint (pos_min = 18134, pos_max = 18134, n_tokens = 18135, n_swa = 1, size = 62.813 MiB)

STDERR: slot update_slots: id  0 | task 745 | n_tokens = 0, memory_seq_rm [0, end)

Activity

  1. anubhavgupta
    added
    bug-unconfirmed
    on Mar 1, 2026

  2. allkhor commented on Mar 1, 2026

    @allkhor
    allkhor
    on Mar 1, 2026

    You can try set env "CLAUDE_CODE_ATTRIBUTION_HEADER": "0", in claude settings.json, https://www.reddit.com/r/LocalLLaMA/comments/1r47fz0/claude_code_with_local_models_full_prompt/

  3. anubhavgupta commented on Mar 1, 2026

    @anubhavgupta
    anubhavgupta
    on Mar 1, 2026
    Author

    Thank you so much, this mostly solves the problem. Now I don't see this with every action that Claude Code takes.
    Though I still see the below logs when a task gets complete. eg: running /init in claude code on a project.

    
STDERR: slot launch_slot_: id  0 | task -1 | sampler chain: logits -> ?penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> top-p -> min-p -> ?xtc -> temp-ext -> dist
slot launch_slot_: id  0 | task 3858 | processing task, is_child = 0
slot update_slots: id  0 | task 3858 | new prompt, n_ctx_slot = 200192, n_keep = 0, task.n_tokens = 46752
slot update_slots: id  0 | task 3858 | n_past = 19205, slot.prompt.tokens.size() = 46533, seq_id = 0, pos_min = 46532, n_swa = 1
slot update_slots: id  0 | task 3858 | forcing full prompt re-processing due to lack of cache data (likely due to SWA or hybrid/recurrent memory, see https://github.com/ggml-org/llama.cpp/pull/13194#issuecomment-2868343055)
slot update_slots: id  0 | task 3858 | erased invalidated context checkpoint (pos_min = 37405, pos_max = 37405, n_tokens = 37406, n_swa = 1, size = 62.813 MiB)

STDERR: slot update_slots: id  0 | task 3858 | erased invalidated context checkpoint (pos_min = 39099, pos_max = 39099, n_tokens = 39100, n_swa = 1, size = 62.813 MiB)

STDERR: slot update_slots: id  0 | task 3858 | erased invalidated context checkpoint (pos_min = 40416, pos_max = 40416, n_tokens = 40417, n_swa = 1, size = 62.813 MiB)

STDERR: slot update_slots: id  0 | task 3858 | erased invalidated context checkpoint (pos_min = 42981, pos_max = 42981, n_tokens = 42982, n_swa = 1, size = 62.813 MiB)

STDERR: slot update_slots: id  0 | task 3858 | erased invalidated context checkpoint (pos_min = 44040, pos_max = 44040, n_tokens = 44041, n_swa = 1, size = 62.813 MiB)

STDERR: slot update_slots: id  0 | task 3858 | erased invalidated context checkpoint (pos_min = 44438, pos_max = 44438, n_tokens = 44439, n_swa = 1, size = 62.813 MiB)

STDERR: slot update_slots: id  0 | task 3858 | erased invalidated context checkpoint (pos_min = 45000, pos_max = 45000, n_tokens = 45001, n_swa = 1, size = 62.813 MiB)

STDERR: slot update_slots: id  0 | task 3858 | erased invalidated context checkpoint (pos_min = 45868, pos_max = 45868, n_tokens = 45869, n_swa = 1, size = 62.813 MiB)

STDERR: slot update_slots: id  0 | task 3858 | n_tokens = 0, memory_seq_rm [0, end)

STDERR: slot update_slots: id  0 | task 3858 | prompt processing progress, n_tokens = 2048, batch.n_tokens = 2048, progress = 0.043806

STDERR: slot update_slots: id  0 | task 3858 | n_tokens = 2048, memory_seq_rm [2048, end)

STDERR: slot update_slots: id  0 | task 3858 | prompt processing progress, n_tokens = 4096, batch.n_tokens = 2048, progress = 0.087611

STDERR: slot update_slots: id  0 | task 3858 | n_tokens = 4096, memory_seq_rm [4096, end)

STDERR: slot update_slots: id  0 | task 3858 | prompt processing progress, n_tokens = 6144, batch.n_tokens = 2048, progress = 0.131417

STDERR: slot update_slots: id  0 | task 3858 | n_tokens = 6144, memory_seq_rm [6144, end)

STDERR: slot update_slots: id  0 | task 3858 | prompt processing progress, n_tokens = 8192, batch.n_tokens = 2048, progress = 0.175222

STDERR: slot update_slots: id  0 | task 3858 | n_tokens = 8192, memory_seq_rm [8192, end)

STDERR: slot update_slots: id  0 | task 3858 | prompt processing progress, n_tokens = 10240, batch.n_tokens = 2048, progress = 0.219028

STDERR: srv          stop: cancel task, id_task = 3858

  4. anubhavgupta commented on Mar 1, 2026

    @anubhavgupta
    anubhavgupta
    on Mar 1, 2026
    Author

    The same is not seen when I am running another model like GLM 4.7-flash.

  5. allkhor commented on Mar 1, 2026

    @allkhor
    allkhor
    on Mar 1, 2026

    I’m seeing the same log. I’m not sure whether this is the expected behavior or not, but in any case, the original issue with the full prompt being reprocessed can be resolved using this flag.

  6. anubhavgupta commented on Mar 1, 2026

    @anubhavgupta
    anubhavgupta
    on Mar 1, 2026
    Author

    Marking the original issue as closed. Setting env variable "CLAUDE_CODE_ATTRIBUTION_HEADER" to "0" solves the problem mostly.

  7. anubhavgupta
    closed this as completedon Mar 1, 2026

  8. alexellis commented on Mar 24, 2026

    @alexellis
    alexellis
    on Mar 24, 2026

    Came here to say that I have this setting, but still get output with the same error message such as ( expand to view - it's quite long.. but shows erased invalidated context checkpoint repeating towards the end)

    Details 
      slot      release: id  0 | task 671 | stop processing: n_tokens = 21725, truncated = 0                                                                                                       
  srv  update_slots: all slots are idle                                                                                                                                                        
  srv  params_from_: Chat format: peg-native                                                                                                                                                               
  slot get_availabl: id  0 | task -1 | selected slot by LCP similarity, sim_best = 0.894 (> 0.100 thold), f_keep = 0.999                                                                                   
  slot launch_slot_: id  0 | task -1 | sampler chain: logits -> reasoning-budget -> ?penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> top-p -> min-p -> ?xtc -> temp-ext -> dist                  
  slot launch_slot_: id  0 | task 843 | processing task, is_child = 0                                                                                                                                      
  slot update_slots: id  0 | task 843 | new prompt, n_ctx_slot = 200192, n_keep = 0, task.n_tokens = 24275                                                                                                 
  slot update_slots: id  0 | task 843 | n_past = 21700, slot.prompt.tokens.size() = 21725, seq_id = 0, pos_min = 21724, n_swa = 1                                                                          
  slot update_slots: id  0 | task 843 | Checking checkpoint with [21493, 21493] against 21699...                                                                    
  slot update_slots: id  0 | task 843 | restored context checkpoint (pos_min = 21493, pos_max = 21493, n_tokens = 21494, n_past = 21494, size = 149.626 MiB)                                                                                                   
  slot update_slots: id  0 | task 843 | n_tokens = 21494, memory_seq_rm [21494, end)                                                                                            
  slot update_slots: id  0 | task 843 | prompt processing progress, n_tokens = 23542, batch.n_tokens = 2048, progress = 0.969804                       
  slot update_slots: id  0 | task 843 | n_tokens = 23542, memory_seq_rm [23542, end)                                                                                
  slot update_slots: id  0 | task 843 | prompt processing progress, n_tokens = 23759, batch.n_tokens = 217, progress = 0.978744                                                                
  slot update_slots: id  0 | task 843 | n_tokens = 23759, memory_seq_rm [23759, end)                                                                                                           
  slot update_slots: id  0 | task 843 | prompt processing progress, n_tokens = 24271, batch.n_tokens = 512, progress = 0.999835                        
  slot update_slots: id  0 | task 843 | created context checkpoint 11 of 32 (pos_min = 23758, pos_max = 23758, n_tokens = 23759, size = 149.626 MiB)   
  slot update_slots: id  0 | task 843 | n_tokens = 24271, memory_seq_rm [24271, end)                                                                                
  reasoning-budget: activated, budget=2047 tokens                                                                                                      
  reasoning-budget: deactivated (natural end)                                                                                                                                                  
  slot init_sampler: id  0 | task 843 | init sampler, took 2.14 ms, tokens: text = 24275, total = 24275                                                                                                    
  slot update_slots: id  0 | task 843 | prompt processing done, n_tokens = 24275, batch.n_tokens = 4                                                                
  slot update_slots: id  0 | task 843 | created context checkpoint 12 of 32 (pos_min = 24270, pos_max = 24270, n_tokens = 24271, size = 149.626 MiB)                
  srv  log_server_r: done request: POST /v1/messages 127.0.0.1 200                                                                                                                             
  slot print_timing: id  0 | task 843 |                                                                                                                             
  prompt eval time =    2758.43 ms /  2781 tokens (    0.99 ms per token,  1008.18 tokens per second)                                                                                                      
        eval time =    3832.79 ms /   131 tokens (   29.26 ms per token,    34.18 tokens per second)                                                                                                                                           
        total time =    6591.22 ms /  2912 tokens                                                                                                                                              
  slot      release: id  0 | task 843 | stop processing: n_tokens = 24405, truncated = 0                                                                                                       
  srv  update_slots: all slots are idle                                                                                                                                                                    
  srv  params_from_: Chat format: peg-native                                                                                                                                                   
  slot get_availabl: id  0 | task -1 | selected slot by LCP similarity, sim_best = 0.882 (> 0.100 thold), f_keep = 1.000                                                                                                                        
  slot launch_slot_: id  0 | task -1 | sampler chain: logits -> reasoning-budget -> ?penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> top-p -> min-p -> ?xtc -> temp-ext -> dist                                                       
  slot launch_slot_: id  0 | task 978 | processing task, is_child = 0                                                                                                                                      
  slot update_slots: id  0 | task 978 | new prompt, n_ctx_slot = 200192, n_keep = 0, task.n_tokens = 27667                                                                                                 
  slot update_slots: id  0 | task 978 | n_tokens = 24405, memory_seq_rm [24405, end)                                                                                                                                                            
  slot update_slots: id  0 | task 978 | prompt processing progress, n_tokens = 26453, batch.n_tokens = 2048, progress = 0.956121                                                                           
  slot update_slots: id  0 | task 978 | n_tokens = 26453, memory_seq_rm [26453, end)                                                                                                                                                            
  slot update_slots: id  0 | task 978 | prompt processing progress, n_tokens = 27151, batch.n_tokens = 698, progress = 0.981350                                                                                                                 
  slot update_slots: id  0 | task 978 | n_tokens = 27151, memory_seq_rm [27151, end)                                                                                                                                                            
  slot update_slots: id  0 | task 978 | prompt processing progress, n_tokens = 27663, batch.n_tokens = 512, progress = 0.999855                                                                                                                 
  slot update_slots: id  0 | task 978 | created context checkpoint 13 of 32 (pos_min = 27150, pos_max = 27150, n_tokens = 27151, size = 149.626 MiB)                                                                                            
  slot update_slots: id  0 | task 978 | n_tokens = 27663, memory_seq_rm [27663, end)                                                                                                                                                            
  reasoning-budget: activated, budget=2047 tokens                                                                                                                                                                                               
  reasoning-budget: deactivated (natural end)                                                                                                                                                                                                   
  slot init_sampler: id  0 | task 978 | init sampler, took 2.46 ms, tokens: text = 27667, total = 27667                                                                                                                                         
  slot update_slots: id  0 | task 978 | prompt processing done, n_tokens = 27667, batch.n_tokens = 4                                                                                                                                            
  slot update_slots: id  0 | task 978 | created context checkpoint 14 of 32 (pos_min = 27662, pos_max = 27662, n_tokens = 27663, size = 149.626 MiB)                                                                                            
  srv  log_server_r: done request: POST /v1/messages 127.0.0.1 200                                                                                                                                                                              
  slot print_timing: id  0 | task 978 |                                                                                                                                                                                                         
  prompt eval time =    3303.58 ms /  3262 tokens (    1.01 ms per token,   987.41 tokens per second)                                                                                                                                           
        eval time =    3841.03 ms /   129 tokens (   29.78 ms per token,    33.58 tokens per second)                                                                                                                                           
        total time =    7144.61 ms /  3391 tokens                                                                                                                                                                                               
  slot      release: id  0 | task 978 | stop processing: n_tokens = 27795, truncated = 0                                                                                                                                                        
  srv  update_slots: all slots are idle                                                                                                                                         
  srv  params_from_: Chat format: peg-native                                                                                                                                                                                                    
  slot get_availabl: id  0 | task -1 | selected slot by LCP similarity, sim_best = 0.912 (> 0.100 thold), f_keep = 1.000                                                                                                                        
  slot launch_slot_: id  0 | task -1 | sampler chain: logits -> reasoning-budget -> ?penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> top-p -> min-p -> ?xtc -> temp-ext -> dist                                                       
  slot launch_slot_: id  0 | task 1111 | processing task, is_child = 0                                                                                                          
  slot update_slots: id  0 | task 1111 | new prompt, n_ctx_slot = 200192, n_keep = 0, task.n_tokens = 30469                                                                     
  slot update_slots: id  0 | task 1111 | n_tokens = 27795, memory_seq_rm [27795, end)                                                                                           
  slot update_slots: id  0 | task 1111 | prompt processing progress, n_tokens = 29843, batch.n_tokens = 2048, progress = 0.979455                                                                                                               
  slot update_slots: id  0 | task 1111 | n_tokens = 29843, memory_seq_rm [29843, end)                                                                                                                                                           
  slot update_slots: id  0 | task 1111 | prompt processing progress, n_tokens = 29953, batch.n_tokens = 110, progress = 0.983065                                                
  slot update_slots: id  0 | task 1111 | n_tokens = 29953, memory_seq_rm [29953, end)                                                                                                                                                           
  slot update_slots: id  0 | task 1111 | prompt processing progress, n_tokens = 30465, batch.n_tokens = 512, progress = 0.999869                                                
  slot update_slots: id  0 | task 1111 | created context checkpoint 15 of 32 (pos_min = 29952, pos_max = 29952, n_tokens = 29953, size = 149.626 MiB)                           
  slot update_slots: id  0 | task 1111 | n_tokens = 30465, memory_seq_rm [30465, end)                                                                                           
  reasoning-budget: activated, budget=2047 tokens                                                                                                                               
  reasoning-budget: deactivated (natural end)                                                                                                                                   
  slot init_sampler: id  0 | task 1111 | init sampler, took 2.71 ms, tokens: text = 30469, total = 30469                                                                        
  slot update_slots: id  0 | task 1111 | prompt processing done, n_tokens = 30469, batch.n_tokens = 4                                                                           
  slot update_slots: id  0 | task 1111 | created context checkpoint 16 of 32 (pos_min = 30464, pos_max = 30464, n_tokens = 30465, size = 149.626 MiB)                           
  srv  log_server_r: done request: POST /v1/messages 127.0.0.1 200                                                                                                              
  slot print_timing: id  0 | task 1111 |                                                                                                                                        
  prompt eval time =    2831.28 ms /  2674 tokens (    1.06 ms per token,   944.45 tokens per second)                                                                           
        eval time =    3973.74 ms /   131 tokens (   30.33 ms per token,    32.97 tokens per second)                                                                           
        total time =    6805.01 ms /  2805 tokens                                                                                                                               
  slot      release: id  0 | task 1111 | stop processing: n_tokens = 30599, truncated = 0                                                                                       
  srv  update_slots: all slots are idle                                                                                                                                         
  srv  params_from_: Chat format: peg-native                                                                                                                                    
  slot get_availabl: id  0 | task -1 | selected slot by LCP similarity, sim_best = 0.971 (> 0.100 thold), f_keep = 1.000                                                        
  slot launch_slot_: id  0 | task -1 | sampler chain: logits -> reasoning-budget -> ?penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> top-p -> min-p -> ?xtc -> temp-ext -> dist                                                                      
  slot launch_slot_: id  0 | task 1246 | processing task, is_child = 0                                                                                                          
  slot update_slots: id  0 | task 1246 | new prompt, n_ctx_slot = 200192, n_keep = 0, task.n_tokens = 31501                                                                     
  slot update_slots: id  0 | task 1246 | n_tokens = 30599, memory_seq_rm [30599, end)                                                                                           
  slot update_slots: id  0 | task 1246 | prompt processing progress, n_tokens = 30985, batch.n_tokens = 386, progress = 0.983620                                                
  slot update_slots: id  0 | task 1246 | n_tokens = 30985, memory_seq_rm [30985, end)                                                                                           
  slot update_slots: id  0 | task 1246 | prompt processing progress, n_tokens = 31497, batch.n_tokens = 512, progress = 0.999873                                                
  slot update_slots: id  0 | task 1246 | created context checkpoint 17 of 32 (pos_min = 30984, pos_max = 30984, n_tokens = 30985, size = 149.626 MiB)                           
  slot update_slots: id  0 | task 1246 | n_tokens = 31497, memory_seq_rm [31497, end)                                                                                           
  reasoning-budget: activated, budget=2047 tokens                                                                                                                               
  reasoning-budget: deactivated (natural end)                                                                                                                                   
  slot init_sampler: id  0 | task 1246 | init sampler, took 2.81 ms, tokens: text = 31501, total = 31501                                                                        
  slot update_slots: id  0 | task 1246 | prompt processing done, n_tokens = 31501, batch.n_tokens = 4                                                                           
  slot update_slots: id  0 | task 1246 | created context checkpoint 18 of 32 (pos_min = 31496, pos_max = 31496, n_tokens = 31497, size = 149.626 MiB)                           
  srv  log_server_r: done request: POST /v1/messages 127.0.0.1 200                                                                                                              
  slot print_timing: id  0 | task 1246 |                                                                                                                                        
  prompt eval time =    1070.21 ms /   902 tokens (    1.19 ms per token,   842.83 tokens per second)                                                                           
        eval time =   17254.03 ms /   561 tokens (   30.76 ms per token,    32.51 tokens per second)                                                                           
        total time =   18324.24 ms /  1463 tokens                                                                                                                               
  slot      release: id  0 | task 1246 | stop processing: n_tokens = 32061, truncated = 0                                                                                                                                                                      
  srv  update_slots: all slots are idle                                                                                                                                         
  srv  params_from_: Chat format: peg-native                                                                                                                                    
  slot get_availabl: id  0 | task -1 | selected slot by LCP similarity, sim_best = 0.618 (> 0.100 thold), f_keep = 0.618                                                        
  slot launch_slot_: id  0 | task -1 | sampler chain: logits -> reasoning-budget -> ?penalties -> ?dry -> ?top-n-sigma -> top-k -> ?typical -> top-p -> min-p -> ?xtc -> temp-ext -> dist                                                                      
  slot launch_slot_: id  0 | task 1810 | processing task, is_child = 0                   
  slot update_slots: id  0 | task 1810 | new prompt, n_ctx_slot = 200192, n_keep = 0, task.n_tokens = 32055                                                                                                                                                    
  slot update_slots: id  0 | task 1810 | n_past = 19806, slot.prompt.tokens.size() = 32061, seq_id = 0, pos_min = 32060, n_swa = 1                                              
  slot update_slots: id  0 | task 1810 | Checking checkpoint with [31496, 31496] against 19805...                                                                               
  slot update_slots: id  0 | task 1810 | Checking checkpoint with [30984, 30984] against 19805...                                                                                                                                                              
  slot update_slots: id  0 | task 1810 | Checking checkpoint with [30464, 30464] against 19805...                                                                               
  slot update_slots: id  0 | task 1810 | Checking checkpoint with [29952, 29952] against 19805...                                                                                                                                                              
  slot update_slots: id  0 | task 1810 | Checking checkpoint with [27662, 27662] against 19805...                                                                                                                                                              
  slot update_slots: id  0 | task 1810 | Checking checkpoint with [27150, 27150] against 19805...                                                                                                                                                              
  slot update_slots: id  0 | task 1810 | Checking checkpoint with [24270, 24270] against 19805...                                                                                                                                                              
  slot update_slots: id  0 | task 1810 | Checking checkpoint with [23758, 23758] against 19805...                                                                                                                                                              
  slot update_slots: id  0 | task 1810 | Checking checkpoint with [21493, 21493] against 19805...                                                                                                                                                              
  slot update_slots: id  0 | task 1810 | Checking checkpoint with [21379, 21379] against 19805...                                                                                                                                                              
  slot update_slots: id  0 | task 1810 | Checking checkpoint with [20867, 20867] against 19805...                                                                                                                                                              
  slot update_slots: id  0 | task 1810 | Checking checkpoint with [20420, 20420] against 19805...                                                                                                                                                              
  slot update_slots: id  0 | task 1810 | Checking checkpoint with [20332, 20332] against 19805...                                                                                                                                                              
  slot update_slots: id  0 | task 1810 | Checking checkpoint with [19895, 19895] against 19805...                                                                                                                                                              
  slot update_slots: id  0 | task 1810 | Checking checkpoint with [19803, 19803] against 19805...                                                                                                                                                              
  slot update_slots: id  0 | task 1810 | restored context checkpoint (pos_min = 19803, pos_max = 19803, n_tokens = 19804, n_past = 19804, size = 149.626 MiB)                                                                                                  
  slot update_slots: id  0 | task 1810 | erased invalidated context checkpoint (pos_min = 19895, pos_max = 19895, n_tokens = 19896, n_swa = 1, size = 149.626 MiB)                                                                                             
  slot update_slots: id  0 | task 1810 | erased invalidated context checkpoint (pos_min = 20332, pos_max = 20332, n_tokens = 20333, n_swa = 1, size = 149.626 MiB)                                                                                             
  slot update_slots: id  0 | task 1810 | erased invalidated context checkpoint (pos_min = 20420, pos_max = 20420, n_tokens = 20421, n_swa = 1, size = 149.626 MiB)                                                                                             
  slot update_slots: id  0 | task 1810 | erased invalidated context checkpoint (pos_min = 20867, pos_max = 20867, n_tokens = 20868, n_swa = 1, size = 149.626 MiB)                                                                                             
  slot update_slots: id  0 | task 1810 | erased invalidated context checkpoint (pos_min = 21379, pos_max = 21379, n_tokens = 21380, n_swa = 1, size = 149.626 MiB)                                                                                             
  slot update_slots: id  0 | task 1810 | erased invalidated context checkpoint (pos_min = 21493, pos_max = 21493, n_tokens = 21494, n_swa = 1, size = 149.626 MiB)                                                                                             
  slot update_slots: id  0 | task 1810 | erased invalidated context checkpoint (pos_min = 23758, pos_max = 23758, n_tokens = 23759, n_swa = 1, size = 149.626 MiB)                                                                                             
  slot update_slots: id  0 | task 1810 | erased invalidated context checkpoint (pos_min = 24270, pos_max = 24270, n_tokens = 24271, n_swa = 1, size = 149.626 MiB)                                                                                             
  slot update_slots: id  0 | task 1810 | erased invalidated context checkpoint (pos_min = 27150, pos_max = 27150, n_tokens = 27151, n_swa = 1, size = 149.626 MiB)                                                                                             
  slot update_slots: id  0 | task 1810 | erased invalidated context checkpoint (pos_min = 27662, pos_max = 27662, n_tokens = 27663, n_swa = 1, size = 149.626 MiB)                                                                                             
  slot update_slots: id  0 | task 1810 | erased invalidated context checkpoint (pos_min = 29952, pos_max = 29952, n_tokens = 29953, n_swa = 1, size = 149.626 MiB)                                                                                             
  slot update_slots: id  0 | task 1810 | erased invalidated context checkpoint (pos_min = 30464, pos_max = 30464, n_tokens = 30465, n_swa = 1, size = 149.626 MiB)                                                                                             
  slot update_slots: id  0 | task 1810 | erased invalidated context checkpoint (pos_min = 30984, pos_max = 30984, n_tokens = 30985, n_swa = 1, size = 149.626 MiB)                                                                                             
  slot update_slots: id  0 | task 1810 | erased invalidated context checkpoint (pos_min = 31496, pos_max = 31496, n_tokens = 31497, n_swa = 1, size = 149.626 MiB)                                                                                             
  slot update_slots: id  0 | task 1810 | n_tokens = 19804, memory_seq_rm [19804, end)                                                                                                                                                                          
  slot update_slots: id  0 | task 1810 | prompt processing progress, n_tokens = 21852, batch.n_tokens = 2048, progress = 0.681703                                                                                                                              
  slot update_slots: id  0 | task 1810 | n_tokens = 21852, memory_seq_rm [21852, end)                                                                                                                                                                          
  slot update_slots: id  0 | task 1810 | prompt processing progress, n_tokens = 23900, batch.n_tokens = 2048, progress = 0.745593                                                                                                                              
  slot update_slots: id  0 | task 1810 | n_tokens = 23900, memory_seq_rm [23900, end)                                                                                                                                                                          
  slot update_slots: id  0 | task 1810 | prompt processing progress, n_tokens = 25948, batch.n_tokens = 2048, progress = 0.809484                                                                                                                              
  slot update_slots: id  0 | task 1810 | n_tokens = 25948, memory_seq_rm [25948, end)                                                                                                                                                                          
  slot update_slots: id  0 | task 1810 | prompt processing progress, n_tokens = 27996, batch.n_tokens = 2048, progress = 0.873374                                                                                                                              
  slot update_slots: id  0 | task 1810 | n_tokens = 27996, memory_seq_rm [27996, end)                                                                                                                                                                          
  slot update_slots: id  0 | task 1810 | 8192 tokens since last checkpoint at 19804, creating new checkpoint during processing at position 30044                                                                                                               
  slot update_slots: id  0 | task 1810 | prompt processing progress, n_tokens = 30044, batch.n_tokens = 2048, progress = 0.937264                                                                                                                              
  slot update_slots: id  0 | task 1810 | created context checkpoint 5 of 32 (pos_min = 27995, pos_max = 27995, n_tokens = 27996, size = 149.626 MiB)                                                                                                           
  slot update_slots: id  0 | task 1810 | n_tokens = 30044, memory_seq_rm [30044, end)                                                                                                                                                                          
  slot update_slots: id  0 | task 1810 | prompt processing progress, n_tokens = 31539, batch.n_tokens = 1495, progress = 0.983903                                                                                                                              
  slot update_slots: id  0 | task 1810 | n_tokens = 31539, memory_seq_rm [31539, end)                                                                                                                                                                          
  slot update_slots: id  0 | task 1810 | prompt processing progress, n_tokens = 32051, batch.n_tokens = 512, progress = 0.999875                                                                                                                               
  slot update_slots: id  0 | task 1810 | created context checkpoint 6 of 32 (pos_min = 31538, pos_max = 31538, n_tokens = 31539, size = 149.626 MiB)                                                                                                           
  slot update_slots: id  0 | task 1810 | n_tokens = 32051, memory_seq_rm [32051, end)                                                                                                                                                                          
  reasoning-budget: activated, budget=2047 tokens                                                                               
  slot init_sampler: id  0 | task 1810 | init sampler, took 2.83 ms, tokens: text = 32055, total = 32055                                                                                                                                                       
  slot update_slots: id  0 | task 1810 | prompt processing done, n_tokens = 32055, batch.n_tokens = 4                                                                                                                                                          
  slot update_slots: id  0 | task 1810 | created context checkpoint 7 of 32 (pos_min = 32050, pos_max = 32050, n_tokens = 32051, size = 149.626 MiB)                                                                                                           
  srv  log_server_r: done request: POST /v1/messages 127.0.0.1 200                                                              
  reasoning-budget: deactivated (natural end)                                                                                   
  slot print_timing: id  0 | task 1810 |                                                                                        
  prompt eval time =   12322.58 ms / 12251 tokens (    1.01 ms per token,   994.19 tokens per second)                                                                                                                                                          
        eval time =    2475.43 ms /    81 tokens (   30.56 ms per token,    32.72 tokens per second)                                                                                                                                                          
        total time =   14798.01 ms / 12332 tokens                                                                               
  slot      release: id  0 | task 1810 | stop processing: n_tokens = 32135, truncated = 0                                                                                                                                                                      
  srv  update_slots: all slots are idle
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    bug-unconfirmed

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions