experiments-07-07-12-local-.../results_roles/gemma4-31b.server.log

0.00.067.721 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg)
0.00.067.724 I device_info:
0.00.067.744 I   - ROCm0   : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.067.748 I   - ROCm1   : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.067.755 I   - CPU     : AMD Ryzen 9 3900X 12-Core Processor (128730 MiB, 128730 MiB free)
0.00.067.814 I system_info: n_threads = 12 (n_threads_batch = 12) / 24 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | 
0.00.067.817 I srv  llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true
0.00.067.858 I srv          init: running without SSL
0.00.067.920 I srv          init: using 23 threads for HTTP server
0.00.068.241 I srv         start: binding port with default address family
0.00.069.448 I srv  llama_server: loading model
0.00.069.456 I srv    load_model: loading model '/home/qrf/.cache/llama.cpp/google_gemma-4-31B-it-Q4_K_M.gguf'
0.00.069.507 I common_init_result: fitting params to device memory ...
0.00.069.508 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on)
0.01.857.561 W load: control-looking token:    212 '</s>' was not control-type; this is probably a bug in the model. its type will be overridden
0.01.858.091 W load: control-looking token:     50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden
0.01.885.652 W load: special_eog_ids contains '<|tool_response>', removing '</s>' token from EOG list
0.14.832.023 W llama_context: n_ctx_seq (24576) < n_ctx_train (262144) -- the full capacity of the model will not be utilized
0.14.959.656 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
0.15.159.463 I srv    load_model: initializing slots, n_slots = 4
0.15.280.355 W common_speculative_init: no implementations specified for speculative decoding
0.15.280.359 I slot   load_model: id  0 | task -1 | new slot, n_ctx = 24576
0.15.280.363 I slot   load_model: id  1 | task -1 | new slot, n_ctx = 24576
0.15.280.364 I slot   load_model: id  2 | task -1 | new slot, n_ctx = 24576
0.15.280.364 I slot   load_model: id  3 | task -1 | new slot, n_ctx = 24576
0.15.280.406 I srv    load_model: prompt cache is enabled, size limit: 8192 MiB
0.15.280.407 I srv    load_model: use `--cache-ram 0` to disable the prompt cache
0.15.280.407 I srv    load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391
0.15.280.407 I srv    load_model: context checkpoints enabled, max = 32, min spacing = 256
0.15.280.426 I srv          init: idle slots will be saved to prompt cache and cleared upon starting a new task
0.15.290.897 I init: chat template, example_format: '<|turn>system
<|think|>
You are a helpful assistant<turn|>
<|turn>user
Hello<turn|>
<|turn>model
Hi there<turn|>
<|turn>user
How are you?<turn|>
<|turn>model
'
0.15.291.638 I srv          init: init: chat template, thinking = 1
0.15.291.672 I srv  llama_server: model loaded
0.15.291.675 I srv  llama_server: server is listening on http://127.0.0.1:8090
0.15.291.680 I srv  update_slots: all slots are idle
0.19.966.523 I srv    operator(): Chat format: peg-gemma4
0.19.966.873 I slot get_availabl: id  3 | task -1 | selected slot by LRU, t_last = -1
0.19.966.876 I srv  get_availabl: updating prompt cache
0.19.966.884 I srv          load:  - looking for better prompt, base f_keep = -1.000, sim = 0.000
0.19.966.889 I srv        update:  - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 24576 tokens, 8589934592 est)
0.19.966.890 I srv  get_availabl: prompt cache update took 0.01 ms
0.19.966.948 I slot launch_slot_: id  3 | task 0 | processing task, is_child = 0
0.19.966.950 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
0.19.966.951 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
0.19.966.982 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
0.19.966.982 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
0.19.966.999 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
0.19.967.000 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
0.20.343.275 I slot create_check: id  3 | task 0 | created context checkpoint 1 of 32 (pos_min = 0, pos_max = 41, n_tokens = 42, size = 32.814 MiB)
0.26.457.431 I slot print_timing: id  3 | task 0 | n_decoded =    100, tg =  17.43 t/s, tg_3s =  17.43 t/s
0.29.467.726 I slot print_timing: id  3 | task 0 | n_decoded =    152, tg =  17.38 t/s, tg_3s =  17.27 t/s
0.32.495.141 I slot print_timing: id  3 | task 0 | n_decoded =    204, tg =  17.33 t/s, tg_3s =  17.18 t/s
0.35.526.637 I slot print_timing: id  3 | task 0 | n_decoded =    256, tg =  17.29 t/s, tg_3s =  17.15 t/s
0.38.561.137 I slot print_timing: id  3 | task 0 | n_decoded =    308, tg =  17.26 t/s, tg_3s =  17.14 t/s
0.38.619.614 I slot print_timing: id  3 | task 0 | prompt eval time =     753.57 ms /    66 tokens (   11.42 ms per token,    87.58 tokens per second)
0.38.619.617 I slot print_timing: id  3 | task 0 |        eval time =   17899.01 ms /   309 tokens (   57.93 ms per token,    17.26 tokens per second)
0.38.619.617 I slot print_timing: id  3 | task 0 |       total time =   18652.58 ms /   375 tokens
0.38.619.622 I slot print_timing: id  3 | task 0 |    graphs reused =        307
0.38.619.670 I slot      release: id  3 | task 0 | stop processing: n_tokens = 374, truncated = 0
0.38.619.675 I srv  update_slots: all slots are idle
0.38.623.057 I srv    operator(): Chat format: peg-gemma4
0.38.623.318 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.652 (> 0.100 thold), f_keep = 0.120
0.38.623.319 I srv  get_availabl: updating prompt cache
0.38.623.373 W srv   prompt_save:  - saving prompt with length 374, total state size = 321.416 MiB (draft: 0.000 MiB)
0.39.084.471 I srv          load:  - looking for better prompt, base f_keep = 0.120, sim = 0.652
0.39.084.477 I srv        update:  - cache state: 1 prompts, 354.230 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
0.39.084.478 I srv        update:    - prompt 0x57480c865720:     374 tokens, checkpoints:  1,   354.230 MiB
0.39.084.479 I srv  get_availabl: prompt cache update took 461.16 ms
0.39.084.550 I slot launch_slot_: id  3 | task 312 | processing task, is_child = 0
0.39.084.550 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
0.39.084.551 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
0.39.084.573 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
0.39.084.573 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
0.39.084.588 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
0.39.084.588 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
0.39.084.611 I slot update_slots: id  3 | task 312 | Checking checkpoint with [0, 41] against 0...
0.39.096.876 W slot update_slots: id  3 | task 312 | restored context checkpoint (pos_min = 0, pos_max = 41, n_tokens = 42, n_past = 41, size = 32.814 MiB)
0.42.455.692 I slot print_timing: id  3 | task 312 | prompt eval time =     420.21 ms /    28 tokens (   15.01 ms per token,    66.63 tokens per second)
0.42.455.695 I slot print_timing: id  3 | task 312 |        eval time =    2950.86 ms /    52 tokens (   56.75 ms per token,    17.62 tokens per second)
0.42.455.696 I slot print_timing: id  3 | task 312 |       total time =    3371.07 ms /    80 tokens
0.42.455.696 I slot print_timing: id  3 | task 312 |    graphs reused =        357
0.42.455.726 I slot      release: id  3 | task 312 | stop processing: n_tokens = 120, truncated = 0
0.42.455.734 I srv  update_slots: all slots are idle
0.42.458.367 I srv    operator(): Chat format: peg-gemma4
0.42.458.880 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.506 (> 0.100 thold), f_keep = 0.375
0.42.458.882 I srv  get_availabl: updating prompt cache
0.42.458.924 W srv   prompt_save:  - saving prompt with length 120, total state size = 103.129 MiB (draft: 0.000 MiB)
0.42.552.700 I srv          load:  - looking for better prompt, base f_keep = 0.375, sim = 0.506
0.42.552.710 I srv        update:  - cache state: 2 prompts, 490.174 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
0.42.552.711 I srv        update:    - prompt 0x57480c865720:     374 tokens, checkpoints:  1,   354.230 MiB
0.42.552.712 I srv        update:    - prompt 0x57480cb2c330:     120 tokens, checkpoints:  1,   135.943 MiB
0.42.552.713 I srv  get_availabl: prompt cache update took 93.83 ms
0.42.552.791 I slot launch_slot_: id  3 | task 367 | processing task, is_child = 0
0.42.552.792 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
0.42.552.793 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
0.42.552.813 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
0.42.552.813 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
0.42.552.828 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
0.42.552.828 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
0.42.552.851 I slot update_slots: id  3 | task 367 | Checking checkpoint with [0, 41] against 0...
0.42.565.296 W slot update_slots: id  3 | task 367 | restored context checkpoint (pos_min = 0, pos_max = 41, n_tokens = 42, n_past = 41, size = 32.814 MiB)
0.48.883.676 I slot print_timing: id  3 | task 367 | n_decoded =    100, tg =  17.01 t/s, tg_3s =  17.01 t/s
0.51.889.536 I slot print_timing: id  3 | task 367 | n_decoded =    152, tg =  17.11 t/s, tg_3s =  17.30 t/s
0.54.914.253 I slot print_timing: id  3 | task 367 | n_decoded =    204, tg =  17.13 t/s, tg_3s =  17.19 t/s
0.57.931.338 I slot print_timing: id  3 | task 367 | n_decoded =    256, tg =  17.15 t/s, tg_3s =  17.24 t/s
1.00.950.375 I slot print_timing: id  3 | task 367 | n_decoded =    308, tg =  17.16 t/s, tg_3s =  17.22 t/s
1.03.985.336 I slot print_timing: id  3 | task 367 | n_decoded =    360, tg =  17.16 t/s, tg_3s =  17.13 t/s
1.04.799.386 I slot print_timing: id  3 | task 367 | prompt eval time =     450.68 ms /    48 tokens (    9.39 ms per token,   106.51 tokens per second)
1.04.799.389 I slot print_timing: id  3 | task 367 |        eval time =   21795.85 ms /   374 tokens (   58.28 ms per token,    17.16 tokens per second)
1.04.799.390 I slot print_timing: id  3 | task 367 |       total time =   22246.53 ms /   422 tokens
1.04.799.391 I slot print_timing: id  3 | task 367 |    graphs reused =        728
1.04.799.425 I slot      release: id  3 | task 367 | stop processing: n_tokens = 462, truncated = 0
1.04.799.434 I srv  update_slots: all slots are idle
1.04.802.120 I srv    operator(): Chat format: peg-gemma4
1.04.802.367 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.634 (> 0.100 thold), f_keep = 0.097
1.04.802.369 I srv  get_availabl: updating prompt cache
1.04.802.421 W srv   prompt_save:  - saving prompt with length 462, total state size = 397.043 MiB (draft: 0.000 MiB)
1.05.321.037 I srv          load:  - looking for better prompt, base f_keep = 0.097, sim = 0.634
1.05.321.044 I srv        update:  - cache state: 3 prompts, 920.031 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
1.05.321.045 I srv        update:    - prompt 0x57480c865720:     374 tokens, checkpoints:  1,   354.230 MiB
1.05.321.046 I srv        update:    - prompt 0x57480cb2c330:     120 tokens, checkpoints:  1,   135.943 MiB
1.05.321.047 I srv        update:    - prompt 0x57480c8313d0:     462 tokens, checkpoints:  1,   429.857 MiB
1.05.321.048 I srv  get_availabl: prompt cache update took 518.68 ms
1.05.321.106 I slot launch_slot_: id  3 | task 744 | processing task, is_child = 0
1.05.321.107 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.05.321.108 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.05.321.128 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.05.321.128 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.05.321.144 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.05.321.144 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.05.321.167 I slot update_slots: id  3 | task 744 | Checking checkpoint with [0, 41] against 0...
1.05.333.729 W slot update_slots: id  3 | task 744 | restored context checkpoint (pos_min = 0, pos_max = 41, n_tokens = 42, n_past = 41, size = 32.814 MiB)
1.11.532.050 I slot print_timing: id  3 | task 744 | n_decoded =    100, tg =  17.40 t/s, tg_3s =  17.40 t/s
1.14.548.047 I slot print_timing: id  3 | task 744 | n_decoded =    152, tg =  17.35 t/s, tg_3s =  17.24 t/s
1.17.579.929 I slot print_timing: id  3 | task 744 | n_decoded =    204, tg =  17.30 t/s, tg_3s =  17.15 t/s
1.20.609.160 I slot print_timing: id  3 | task 744 | n_decoded =    256, tg =  17.27 t/s, tg_3s =  17.17 t/s
1.23.638.273 I slot print_timing: id  3 | task 744 | n_decoded =    308, tg =  17.25 t/s, tg_3s =  17.17 t/s
1.26.672.671 I slot print_timing: id  3 | task 744 | n_decoded =    360, tg =  17.24 t/s, tg_3s =  17.14 t/s
1.29.691.799 I slot print_timing: id  3 | task 744 | n_decoded =    412, tg =  17.23 t/s, tg_3s =  17.22 t/s
1.32.732.765 I slot print_timing: id  3 | task 744 | n_decoded =    464, tg =  17.22 t/s, tg_3s =  17.10 t/s
1.35.786.803 I slot print_timing: id  3 | task 744 | n_decoded =    516, tg =  17.20 t/s, tg_3s =  17.03 t/s
1.38.834.966 I slot print_timing: id  3 | task 744 | n_decoded =    568, tg =  17.19 t/s, tg_3s =  17.06 t/s
1.41.886.704 I slot print_timing: id  3 | task 744 | n_decoded =    620, tg =  17.17 t/s, tg_3s =  17.04 t/s
1.44.891.957 I slot print_timing: id  3 | task 744 | n_decoded =    671, tg =  17.16 t/s, tg_3s =  16.97 t/s
1.45.303.580 I slot print_timing: id  3 | task 744 | prompt eval time =     464.28 ms /    30 tokens (   15.48 ms per token,    64.62 tokens per second)
1.45.303.583 I slot print_timing: id  3 | task 744 |        eval time =   39518.13 ms /   678 tokens (   58.29 ms per token,    17.16 tokens per second)
1.45.303.584 I slot print_timing: id  3 | task 744 |       total time =   39982.41 ms /   708 tokens
1.45.303.584 I slot print_timing: id  3 | task 744 |    graphs reused =       1402
1.45.303.616 I slot      release: id  3 | task 744 | stop processing: n_tokens = 748, truncated = 0
1.45.303.627 I srv  update_slots: all slots are idle
1.45.306.270 I srv    operator(): Chat format: peg-gemma4
1.45.306.565 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.692 (> 0.100 thold), f_keep = 0.060
1.45.306.567 I srv  get_availabl: updating prompt cache
1.45.306.633 W srv   prompt_save:  - saving prompt with length 748, total state size = 642.831 MiB (draft: 0.000 MiB)
1.45.777.846 I srv          load:  - looking for better prompt, base f_keep = 0.060, sim = 0.692
1.45.777.853 I srv        update:  - cache state: 4 prompts, 1595.676 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
1.45.777.855 I srv        update:    - prompt 0x57480c865720:     374 tokens, checkpoints:  1,   354.230 MiB
1.45.777.855 I srv        update:    - prompt 0x57480cb2c330:     120 tokens, checkpoints:  1,   135.943 MiB
1.45.777.856 I srv        update:    - prompt 0x57480c8313d0:     462 tokens, checkpoints:  1,   429.857 MiB
1.45.777.856 I srv        update:    - prompt 0x57480ca3d420:     748 tokens, checkpoints:  1,   675.645 MiB
1.45.777.858 I srv  get_availabl: prompt cache update took 471.29 ms
1.45.777.918 I slot launch_slot_: id  3 | task 1425 | processing task, is_child = 0
1.45.777.918 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.45.777.919 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.45.777.941 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.45.777.942 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.45.777.957 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.45.777.958 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.45.777.981 I slot update_slots: id  3 | task 1425 | Checking checkpoint with [0, 41] against 0...
1.45.790.441 W slot update_slots: id  3 | task 1425 | restored context checkpoint (pos_min = 0, pos_max = 41, n_tokens = 42, n_past = 41, size = 32.814 MiB)
1.51.951.531 I slot print_timing: id  3 | task 1425 | n_decoded =    100, tg =  17.38 t/s, tg_3s =  17.38 t/s
1.54.974.496 I slot print_timing: id  3 | task 1425 | n_decoded =    152, tg =  17.32 t/s, tg_3s =  17.20 t/s
1.57.176.823 I slot print_timing: id  3 | task 1425 | prompt eval time =     420.04 ms /    24 tokens (   17.50 ms per token,    57.14 tokens per second)
1.57.176.826 I slot print_timing: id  3 | task 1425 |        eval time =   10978.80 ms /   190 tokens (   57.78 ms per token,    17.31 tokens per second)
1.57.176.827 I slot print_timing: id  3 | task 1425 |       total time =   11398.84 ms /   214 tokens
1.57.176.828 I slot print_timing: id  3 | task 1425 |    graphs reused =       1590
1.57.176.858 I slot      release: id  3 | task 1425 | stop processing: n_tokens = 254, truncated = 0
1.57.176.867 I srv  update_slots: all slots are idle
1.57.179.228 I srv    operator(): Chat format: peg-gemma4
1.57.179.498 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.549 (> 0.100 thold), f_keep = 0.177
1.57.179.501 I srv  get_availabl: updating prompt cache
1.57.179.550 W srv   prompt_save:  - saving prompt with length 254, total state size = 218.288 MiB (draft: 0.000 MiB)
1.57.444.327 I srv          load:  - looking for better prompt, base f_keep = 0.177, sim = 0.549
1.57.444.338 I srv        update:  - cache state: 5 prompts, 1846.779 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
1.57.444.340 I srv        update:    - prompt 0x57480c865720:     374 tokens, checkpoints:  1,   354.230 MiB
1.57.444.340 I srv        update:    - prompt 0x57480cb2c330:     120 tokens, checkpoints:  1,   135.943 MiB
1.57.444.342 I srv        update:    - prompt 0x57480c8313d0:     462 tokens, checkpoints:  1,   429.857 MiB
1.57.444.344 I srv        update:    - prompt 0x57480ca3d420:     748 tokens, checkpoints:  1,   675.645 MiB
1.57.444.344 I srv        update:    - prompt 0x57480c85f390:     254 tokens, checkpoints:  1,   251.103 MiB
1.57.444.346 I srv  get_availabl: prompt cache update took 264.84 ms
1.57.444.429 I slot launch_slot_: id  3 | task 1618 | processing task, is_child = 0
1.57.444.430 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.57.444.430 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.57.444.450 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.57.444.451 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.57.444.466 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.57.444.466 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.57.444.493 I slot update_slots: id  3 | task 1618 | Checking checkpoint with [0, 41] against 0...
1.57.456.788 W slot update_slots: id  3 | task 1618 | restored context checkpoint (pos_min = 0, pos_max = 41, n_tokens = 42, n_past = 41, size = 32.814 MiB)
2.09.826.351 I slot print_timing: id  3 | task 1618 | n_decoded =    100, tg =   8.40 t/s, tg_3s =   8.40 t/s
2.12.845.472 I slot print_timing: id  3 | task 1618 | n_decoded =    152, tg =  10.19 t/s, tg_3s =  17.21 t/s
2.15.857.100 I slot print_timing: id  3 | task 1618 | n_decoded =    203, tg =  11.32 t/s, tg_3s =  16.93 t/s
2.18.897.811 I slot print_timing: id  3 | task 1618 | n_decoded =    255, tg =  12.16 t/s, tg_3s =  17.10 t/s
2.21.925.306 I slot print_timing: id  3 | task 1618 | n_decoded =    307, tg =  12.79 t/s, tg_3s =  17.18 t/s
2.24.970.760 I slot print_timing: id  3 | task 1618 | n_decoded =    359, tg =  13.27 t/s, tg_3s =  17.07 t/s
2.27.992.287 I slot print_timing: id  3 | task 1618 | n_decoded =    411, tg =  13.67 t/s, tg_3s =  17.21 t/s
2.30.342.897 I slot print_timing: id  3 | task 1618 | prompt eval time =     481.85 ms /    41 tokens (   11.75 ms per token,    85.09 tokens per second)
2.30.342.901 I slot print_timing: id  3 | task 1618 |        eval time =   32416.55 ms /   451 tokens (   71.88 ms per token,    13.91 tokens per second)
2.30.342.902 I slot print_timing: id  3 | task 1618 |       total time =   32898.40 ms /   492 tokens
2.30.342.911 I slot print_timing: id  3 | task 1618 |    graphs reused =       2037
2.30.345.223 I slot      release: id  3 | task 1618 | stop processing: n_tokens = 532, truncated = 0
2.30.345.753 I srv  update_slots: all slots are idle
2.30.386.990 I srv    operator(): Chat format: peg-gemma4
2.30.387.713 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.529 (> 0.100 thold), f_keep = 0.085
2.30.387.715 I srv  get_availabl: updating prompt cache
2.30.387.993 W srv   prompt_save:  - saving prompt with length 532, total state size = 457.201 MiB (draft: 0.000 MiB)
2.30.961.959 I srv          load:  - looking for better prompt, base f_keep = 0.085, sim = 0.529
2.30.962.027 I srv        update:  - cache state: 6 prompts, 2336.794 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
2.30.962.029 I srv        update:    - prompt 0x57480c865720:     374 tokens, checkpoints:  1,   354.230 MiB
2.30.962.037 I srv        update:    - prompt 0x57480cb2c330:     120 tokens, checkpoints:  1,   135.943 MiB
2.30.962.039 I srv        update:    - prompt 0x57480c8313d0:     462 tokens, checkpoints:  1,   429.857 MiB
2.30.962.052 I srv        update:    - prompt 0x57480ca3d420:     748 tokens, checkpoints:  1,   675.645 MiB
2.30.962.054 I srv        update:    - prompt 0x57480c85f390:     254 tokens, checkpoints:  1,   251.103 MiB
2.30.962.054 I srv        update:    - prompt 0x57480c763b40:     532 tokens, checkpoints:  1,   490.015 MiB
2.30.962.055 I srv  get_availabl: prompt cache update took 574.34 ms
2.30.963.019 I slot launch_slot_: id  3 | task 2072 | processing task, is_child = 0
2.30.963.021 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.30.963.022 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.30.963.046 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.30.963.047 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.30.963.063 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.30.963.063 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.30.963.086 I slot update_slots: id  3 | task 2072 | Checking checkpoint with [0, 41] against 0...
2.30.976.271 W slot update_slots: id  3 | task 2072 | restored context checkpoint (pos_min = 0, pos_max = 41, n_tokens = 42, n_past = 41, size = 32.814 MiB)
2.37.207.830 I slot print_timing: id  3 | task 2072 | n_decoded =    100, tg =  17.35 t/s, tg_3s =  17.35 t/s
2.40.219.137 I slot print_timing: id  3 | task 2072 | n_decoded =    152, tg =  17.32 t/s, tg_3s =  17.27 t/s
2.43.253.399 I slot print_timing: id  3 | task 2072 | n_decoded =    204, tg =  17.27 t/s, tg_3s =  17.14 t/s
2.46.307.399 I slot print_timing: id  3 | task 2072 | n_decoded =    256, tg =  17.22 t/s, tg_3s =  17.03 t/s
2.49.346.051 I slot print_timing: id  3 | task 2072 | n_decoded =    308, tg =  17.20 t/s, tg_3s =  17.11 t/s
2.52.386.546 I slot print_timing: id  3 | task 2072 | n_decoded =    360, tg =  17.19 t/s, tg_3s =  17.10 t/s
2.55.388.509 I slot print_timing: id  3 | task 2072 | n_decoded =    411, tg =  17.16 t/s, tg_3s =  16.99 t/s
2.58.399.216 I slot print_timing: id  3 | task 2072 | n_decoded =    462, tg =  17.14 t/s, tg_3s =  16.94 t/s
3.01.406.029 I slot print_timing: id  3 | task 2072 | n_decoded =    513, tg =  17.12 t/s, tg_3s =  16.96 t/s
3.04.433.505 I slot print_timing: id  3 | task 2072 | n_decoded =    564, tg =  17.10 t/s, tg_3s =  16.85 t/s
3.07.433.919 I slot print_timing: id  3 | task 2072 | n_decoded =    615, tg =  17.09 t/s, tg_3s =  17.00 t/s
3.10.475.870 I slot print_timing: id  3 | task 2072 | n_decoded =    667, tg =  17.09 t/s, tg_3s =  17.09 t/s
3.13.502.600 I slot print_timing: id  3 | task 2072 | n_decoded =    718, tg =  17.07 t/s, tg_3s =  16.85 t/s
3.16.542.639 I slot print_timing: id  3 | task 2072 | n_decoded =    769, tg =  17.05 t/s, tg_3s =  16.78 t/s
3.19.574.353 I slot print_timing: id  3 | task 2072 | n_decoded =    820, tg =  17.04 t/s, tg_3s =  16.82 t/s
3.22.608.304 I slot print_timing: id  3 | task 2072 | n_decoded =    871, tg =  17.02 t/s, tg_3s =  16.81 t/s
3.25.654.365 I slot print_timing: id  3 | task 2072 | n_decoded =    922, tg =  17.01 t/s, tg_3s =  16.74 t/s
3.28.656.445 I slot print_timing: id  3 | task 2072 | n_decoded =    972, tg =  16.99 t/s, tg_3s =  16.66 t/s
3.31.713.379 I slot print_timing: id  3 | task 2072 | n_decoded =   1023, tg =  16.97 t/s, tg_3s =  16.68 t/s
3.34.772.556 I slot print_timing: id  3 | task 2072 | n_decoded =   1074, tg =  16.96 t/s, tg_3s =  16.67 t/s
3.37.782.594 I slot print_timing: id  3 | task 2072 | n_decoded =   1124, tg =  16.94 t/s, tg_3s =  16.61 t/s
3.38.202.422 I slot print_timing: id  3 | task 2072 | prompt eval time =     481.05 ms /    44 tokens (   10.93 ms per token,    91.47 tokens per second)
3.38.202.425 I slot print_timing: id  3 | task 2072 |        eval time =   66758.28 ms /  1131 tokens (   59.03 ms per token,    16.94 tokens per second)
3.38.202.426 I slot print_timing: id  3 | task 2072 |       total time =   67239.33 ms /  1175 tokens
3.38.202.426 I slot print_timing: id  3 | task 2072 |    graphs reused =       3162
3.38.202.502 I slot      release: id  3 | task 2072 | stop processing: n_tokens = 1215, truncated = 0
3.38.202.515 I srv  update_slots: all slots are idle
3.38.209.914 I srv    operator(): Chat format: peg-gemma4
3.38.210.198 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.652 (> 0.100 thold), f_keep = 0.037
3.38.210.200 I srv  get_availabl: updating prompt cache
3.38.210.325 W srv   prompt_save:  - saving prompt with length 1215, total state size = 894.949 MiB (draft: 0.000 MiB)
3.38.908.501 I srv          load:  - looking for better prompt, base f_keep = 0.037, sim = 0.652
3.38.908.509 I srv        update:  - cache state: 7 prompts, 3264.557 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
3.38.908.510 I srv        update:    - prompt 0x57480c865720:     374 tokens, checkpoints:  1,   354.230 MiB
3.38.908.511 I srv        update:    - prompt 0x57480cb2c330:     120 tokens, checkpoints:  1,   135.943 MiB
3.38.908.515 I srv        update:    - prompt 0x57480c8313d0:     462 tokens, checkpoints:  1,   429.857 MiB
3.38.908.515 I srv        update:    - prompt 0x57480ca3d420:     748 tokens, checkpoints:  1,   675.645 MiB
3.38.908.516 I srv        update:    - prompt 0x57480c85f390:     254 tokens, checkpoints:  1,   251.103 MiB
3.38.908.516 I srv        update:    - prompt 0x57480c763b40:     532 tokens, checkpoints:  1,   490.015 MiB
3.38.908.517 I srv        update:    - prompt 0x57480d20d5a0:    1215 tokens, checkpoints:  1,   927.763 MiB
3.38.908.519 I srv  get_availabl: prompt cache update took 698.32 ms
3.38.908.583 I slot launch_slot_: id  3 | task 3206 | processing task, is_child = 0
3.38.908.584 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
3.38.908.584 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
3.38.908.608 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
3.38.908.638 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
3.38.908.655 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
3.38.908.655 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
3.38.908.680 I slot update_slots: id  3 | task 3206 | Checking checkpoint with [0, 41] against 0...
3.38.920.884 W slot update_slots: id  3 | task 3206 | restored context checkpoint (pos_min = 0, pos_max = 41, n_tokens = 42, n_past = 41, size = 32.814 MiB)
3.45.079.756 I slot print_timing: id  3 | task 3206 | n_decoded =    100, tg =  17.39 t/s, tg_3s =  17.39 t/s
3.48.099.664 I slot print_timing: id  3 | task 3206 | n_decoded =    152, tg =  17.33 t/s, tg_3s =  17.22 t/s
3.51.132.065 I slot print_timing: id  3 | task 3206 | n_decoded =    204, tg =  17.28 t/s, tg_3s =  17.15 t/s
3.54.174.046 I slot print_timing: id  3 | task 3206 | n_decoded =    256, tg =  17.25 t/s, tg_3s =  17.09 t/s
3.57.176.110 I slot print_timing: id  3 | task 3206 | n_decoded =    307, tg =  17.20 t/s, tg_3s =  16.99 t/s
4.00.184.256 I slot print_timing: id  3 | task 3206 | n_decoded =    358, tg =  17.17 t/s, tg_3s =  16.95 t/s
4.03.226.944 I slot print_timing: id  3 | task 3206 | n_decoded =    410, tg =  17.16 t/s, tg_3s =  17.09 t/s
4.06.269.297 I slot print_timing: id  3 | task 3206 | n_decoded =    462, tg =  17.15 t/s, tg_3s =  17.09 t/s
4.09.318.013 I slot print_timing: id  3 | task 3206 | n_decoded =    514, tg =  17.14 t/s, tg_3s =  17.06 t/s
4.12.369.242 I slot print_timing: id  3 | task 3206 | n_decoded =    566, tg =  17.13 t/s, tg_3s =  17.04 t/s
4.15.425.261 I slot print_timing: id  3 | task 3206 | n_decoded =    618, tg =  17.12 t/s, tg_3s =  17.02 t/s
4.18.481.142 I slot print_timing: id  3 | task 3206 | n_decoded =    670, tg =  17.11 t/s, tg_3s =  17.02 t/s
4.21.504.036 I slot print_timing: id  3 | task 3206 | n_decoded =    721, tg =  17.10 t/s, tg_3s =  16.87 t/s
4.24.541.042 I slot print_timing: id  3 | task 3206 | n_decoded =    772, tg =  17.08 t/s, tg_3s =  16.79 t/s
4.27.587.793 I slot print_timing: id  3 | task 3206 | n_decoded =    823, tg =  17.05 t/s, tg_3s =  16.74 t/s
4.30.638.600 I slot print_timing: id  3 | task 3206 | n_decoded =    874, tg =  17.03 t/s, tg_3s =  16.72 t/s
4.33.683.080 I slot print_timing: id  3 | task 3206 | n_decoded =    925, tg =  17.02 t/s, tg_3s =  16.75 t/s
4.36.684.898 I slot print_timing: id  3 | task 3206 | n_decoded =    975, tg =  17.00 t/s, tg_3s =  16.66 t/s
4.39.688.919 I slot print_timing: id  3 | task 3206 | n_decoded =   1025, tg =  16.98 t/s, tg_3s =  16.64 t/s
4.42.693.968 I slot print_timing: id  3 | task 3206 | n_decoded =   1075, tg =  16.97 t/s, tg_3s =  16.64 t/s
4.45.696.933 I slot print_timing: id  3 | task 3206 | n_decoded =   1125, tg =  16.95 t/s, tg_3s =  16.65 t/s
4.47.738.596 I slot print_timing: id  3 | task 3206 | prompt eval time =     420.65 ms /    28 tokens (   15.02 ms per token,    66.56 tokens per second)
4.47.738.601 I slot print_timing: id  3 | task 3206 |        eval time =   68409.26 ms /  1159 tokens (   59.02 ms per token,    16.94 tokens per second)
4.47.738.629 I slot print_timing: id  3 | task 3206 |       total time =   68829.91 ms /  1187 tokens
4.47.738.631 I slot print_timing: id  3 | task 3206 |    graphs reused =       4315
4.47.738.672 I slot      release: id  3 | task 3206 | stop processing: n_tokens = 1227, truncated = 0
4.47.738.694 I srv  update_slots: all slots are idle
4.47.756.960 I srv    operator(): Chat format: peg-gemma4
4.47.757.335 I slot get_availabl: id  2 | task -1 | selected slot by LRU, t_last = -1
4.47.757.337 I srv  get_availabl: updating prompt cache
4.47.757.340 I srv          load:  - looking for better prompt, base f_keep = -1.000, sim = 0.000
4.47.757.344 I srv        update:  - cache state: 7 prompts, 3264.557 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
4.47.757.345 I srv        update:    - prompt 0x57480c865720:     374 tokens, checkpoints:  1,   354.230 MiB
4.47.757.345 I srv        update:    - prompt 0x57480cb2c330:     120 tokens, checkpoints:  1,   135.943 MiB
4.47.757.346 I srv        update:    - prompt 0x57480c8313d0:     462 tokens, checkpoints:  1,   429.857 MiB
4.47.757.346 I srv        update:    - prompt 0x57480ca3d420:     748 tokens, checkpoints:  1,   675.645 MiB
4.47.757.347 I srv        update:    - prompt 0x57480c85f390:     254 tokens, checkpoints:  1,   251.103 MiB
4.47.757.348 I srv        update:    - prompt 0x57480c763b40:     532 tokens, checkpoints:  1,   490.015 MiB
4.47.757.348 I srv        update:    - prompt 0x57480d20d5a0:    1215 tokens, checkpoints:  1,   927.763 MiB
4.47.757.349 I srv  get_availabl: prompt cache update took 0.01 ms
4.47.757.386 I slot launch_slot_: id  2 | task 4368 | processing task, is_child = 0
4.47.757.398 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
4.47.757.398 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
4.47.757.421 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
4.47.757.421 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
4.47.757.440 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
4.47.757.547 W srv   prompt_save:  - saving prompt with length 1227, total state size = 895.887 MiB (draft: 0.000 MiB)
4.48.387.009 I srv        update:  - cache state: 8 prompts, 4193.258 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
4.48.387.013 I srv        update:    - prompt 0x57480c865720:     374 tokens, checkpoints:  1,   354.230 MiB
4.48.387.014 I srv        update:    - prompt 0x57480cb2c330:     120 tokens, checkpoints:  1,   135.943 MiB
4.48.387.014 I srv        update:    - prompt 0x57480c8313d0:     462 tokens, checkpoints:  1,   429.857 MiB
4.48.387.015 I srv        update:    - prompt 0x57480ca3d420:     748 tokens, checkpoints:  1,   675.645 MiB
4.48.387.015 I srv        update:    - prompt 0x57480c85f390:     254 tokens, checkpoints:  1,   251.103 MiB
4.48.387.016 I srv        update:    - prompt 0x57480c763b40:     532 tokens, checkpoints:  1,   490.015 MiB
4.48.387.017 I srv        update:    - prompt 0x57480d20d5a0:    1215 tokens, checkpoints:  1,   927.763 MiB
4.48.387.017 I srv        update:    - prompt 0x57480c9d3d70:    1227 tokens, checkpoints:  1,   928.701 MiB
4.48.387.046 I slot prompt_clear: id  3 | task -1 | clearing prompt with 1227 tokens
4.48.836.680 I slot create_check: id  2 | task 4368 | created context checkpoint 1 of 32 (pos_min = 0, pos_max = 61, n_tokens = 62, size = 48.439 MiB)
4.55.017.440 I slot print_timing: id  2 | task 4368 | n_decoded =    100, tg =  17.41 t/s, tg_3s =  17.41 t/s
4.58.035.488 I slot print_timing: id  2 | task 4368 | n_decoded =    152, tg =  17.35 t/s, tg_3s =  17.23 t/s
5.01.062.066 I slot print_timing: id  2 | task 4368 | n_decoded =    204, tg =  17.30 t/s, tg_3s =  17.18 t/s
5.04.080.970 I slot print_timing: id  2 | task 4368 | n_decoded =    256, tg =  17.29 t/s, tg_3s =  17.22 t/s
5.07.105.784 I slot print_timing: id  2 | task 4368 | n_decoded =    308, tg =  17.27 t/s, tg_3s =  17.19 t/s
5.10.135.925 I slot print_timing: id  2 | task 4368 | n_decoded =    360, tg =  17.25 t/s, tg_3s =  17.16 t/s
5.13.166.079 I slot print_timing: id  2 | task 4368 | n_decoded =    412, tg =  17.24 t/s, tg_3s =  17.16 t/s
5.16.172.075 I slot print_timing: id  2 | task 4368 | n_decoded =    463, tg =  17.21 t/s, tg_3s =  16.97 t/s
5.19.172.224 I slot print_timing: id  2 | task 4368 | n_decoded =    514, tg =  17.19 t/s, tg_3s =  17.00 t/s
5.22.227.144 I slot print_timing: id  2 | task 4368 | n_decoded =    566, tg =  17.17 t/s, tg_3s =  17.02 t/s
5.25.286.124 I slot print_timing: id  2 | task 4368 | n_decoded =    618, tg =  17.16 t/s, tg_3s =  17.00 t/s
5.28.287.089 I slot print_timing: id  2 | task 4368 | n_decoded =    669, tg =  17.15 t/s, tg_3s =  16.99 t/s
5.31.297.351 I slot print_timing: id  2 | task 4368 | n_decoded =    719, tg =  17.11 t/s, tg_3s =  16.61 t/s
5.34.301.420 I slot print_timing: id  2 | task 4368 | n_decoded =    769, tg =  17.08 t/s, tg_3s =  16.64 t/s
5.37.359.485 I slot print_timing: id  2 | task 4368 | n_decoded =    820, tg =  17.05 t/s, tg_3s =  16.68 t/s
5.40.418.969 I slot print_timing: id  2 | task 4368 | n_decoded =    871, tg =  17.03 t/s, tg_3s =  16.67 t/s
5.43.455.091 I slot print_timing: id  2 | task 4368 | n_decoded =    922, tg =  17.02 t/s, tg_3s =  16.80 t/s
5.46.461.926 I slot print_timing: id  2 | task 4368 | n_decoded =    972, tg =  17.00 t/s, tg_3s =  16.63 t/s
5.49.518.523 I slot print_timing: id  2 | task 4368 | n_decoded =   1023, tg =  16.98 t/s, tg_3s =  16.69 t/s
5.52.524.427 I slot print_timing: id  2 | task 4368 | n_decoded =   1073, tg =  16.96 t/s, tg_3s =  16.63 t/s
5.55.583.591 I slot print_timing: id  2 | task 4368 | n_decoded =   1124, tg =  16.95 t/s, tg_3s =  16.67 t/s
5.58.642.585 I slot print_timing: id  2 | task 4368 | n_decoded =   1175, tg =  16.94 t/s, tg_3s =  16.67 t/s
6.01.662.131 I slot print_timing: id  2 | task 4368 | n_decoded =   1225, tg =  16.92 t/s, tg_3s =  16.56 t/s
6.03.884.211 I slot print_timing: id  2 | task 4368 | prompt eval time =     884.67 ms /   100 tokens (    8.85 ms per token,   113.04 tokens per second)
6.03.884.215 I slot print_timing: id  2 | task 4368 |        eval time =   74611.95 ms /  1262 tokens (   59.12 ms per token,    16.91 tokens per second)
6.03.884.216 I slot print_timing: id  2 | task 4368 |       total time =   75496.63 ms /  1362 tokens
6.03.884.217 I slot print_timing: id  2 | task 4368 |    graphs reused =       5570
6.03.884.405 I slot      release: id  2 | task 4368 | stop processing: n_tokens = 1361, truncated = 0
6.03.884.421 I srv  update_slots: all slots are idle
6.03.893.926 I srv    operator(): Chat format: peg-gemma4
6.03.894.273 I slot get_availabl: id  2 | task -1 | selected slot by LCP similarity, sim_best = 0.489 (> 0.100 thold), f_keep = 0.048
6.03.894.274 I srv  get_availabl: updating prompt cache
6.03.894.373 W srv   prompt_save:  - saving prompt with length 1361, total state size = 906.357 MiB (draft: 0.000 MiB)
6.04.511.896 I srv          load:  - looking for better prompt, base f_keep = 0.048, sim = 0.489
6.04.511.905 I srv        update:  - cache state: 9 prompts, 5148.054 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
6.04.511.906 I srv        update:    - prompt 0x57480c865720:     374 tokens, checkpoints:  1,   354.230 MiB
6.04.511.907 I srv        update:    - prompt 0x57480cb2c330:     120 tokens, checkpoints:  1,   135.943 MiB
6.04.511.907 I srv        update:    - prompt 0x57480c8313d0:     462 tokens, checkpoints:  1,   429.857 MiB
6.04.511.908 I srv        update:    - prompt 0x57480ca3d420:     748 tokens, checkpoints:  1,   675.645 MiB
6.04.511.908 I srv        update:    - prompt 0x57480c85f390:     254 tokens, checkpoints:  1,   251.103 MiB
6.04.511.909 I srv        update:    - prompt 0x57480c763b40:     532 tokens, checkpoints:  1,   490.015 MiB
6.04.511.910 I srv        update:    - prompt 0x57480d20d5a0:    1215 tokens, checkpoints:  1,   927.763 MiB
6.04.511.910 I srv        update:    - prompt 0x57480c9d3d70:    1227 tokens, checkpoints:  1,   928.701 MiB
6.04.511.939 I srv        update:    - prompt 0x57480d5a8130:    1361 tokens, checkpoints:  1,   954.796 MiB
6.04.511.940 I srv  get_availabl: prompt cache update took 617.66 ms
6.04.512.005 I slot launch_slot_: id  2 | task 5633 | processing task, is_child = 0
6.04.512.006 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
6.04.512.006 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
6.04.512.035 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
6.04.512.036 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
6.04.512.090 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
6.04.512.090 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
6.04.512.134 I slot update_slots: id  2 | task 5633 | Checking checkpoint with [0, 61] against 0...
6.04.528.774 W slot update_slots: id  2 | task 5633 | restored context checkpoint (pos_min = 0, pos_max = 61, n_tokens = 62, n_past = 61, size = 48.439 MiB)
6.11.007.134 I slot print_timing: id  2 | task 5633 | n_decoded =    100, tg =  17.38 t/s, tg_3s =  17.38 t/s
6.14.045.353 I slot print_timing: id  2 | task 5633 | n_decoded =    152, tg =  17.29 t/s, tg_3s =  17.12 t/s
6.17.083.502 I slot print_timing: id  2 | task 5633 | n_decoded =    204, tg =  17.24 t/s, tg_3s =  17.12 t/s
6.20.123.866 I slot print_timing: id  2 | task 5633 | n_decoded =    256, tg =  17.21 t/s, tg_3s =  17.10 t/s
6.23.149.114 I slot print_timing: id  2 | task 5633 | n_decoded =    308, tg =  17.21 t/s, tg_3s =  17.19 t/s
6.26.172.159 I slot print_timing: id  2 | task 5633 | n_decoded =    360, tg =  17.21 t/s, tg_3s =  17.20 t/s
6.29.216.188 I slot print_timing: id  2 | task 5633 | n_decoded =    412, tg =  17.19 t/s, tg_3s =  17.08 t/s
6.32.258.867 I slot print_timing: id  2 | task 5633 | n_decoded =    464, tg =  17.18 t/s, tg_3s =  17.09 t/s
6.35.307.379 I slot print_timing: id  2 | task 5633 | n_decoded =    516, tg =  17.17 t/s, tg_3s =  17.06 t/s
6.38.350.861 I slot print_timing: id  2 | task 5633 | n_decoded =    568, tg =  17.16 t/s, tg_3s =  17.09 t/s
6.41.394.339 I slot print_timing: id  2 | task 5633 | n_decoded =    620, tg =  17.15 t/s, tg_3s =  17.09 t/s
6.44.424.448 I slot print_timing: id  2 | task 5633 | n_decoded =    671, tg =  17.13 t/s, tg_3s =  16.83 t/s
6.47.465.346 I slot print_timing: id  2 | task 5633 | n_decoded =    722, tg =  17.10 t/s, tg_3s =  16.77 t/s
6.50.509.737 I slot print_timing: id  2 | task 5633 | n_decoded =    773, tg =  17.08 t/s, tg_3s =  16.75 t/s
6.53.554.877 I slot print_timing: id  2 | task 5633 | n_decoded =    824, tg =  17.06 t/s, tg_3s =  16.75 t/s
6.56.602.246 I slot print_timing: id  2 | task 5633 | n_decoded =    875, tg =  17.04 t/s, tg_3s =  16.74 t/s
6.59.485.762 I slot print_timing: id  2 | task 5633 | prompt eval time =     740.28 ms /    72 tokens (   10.28 ms per token,    97.26 tokens per second)
6.59.485.765 I slot print_timing: id  2 | task 5633 |        eval time =   54233.35 ms /   923 tokens (   58.76 ms per token,    17.02 tokens per second)
6.59.485.766 I slot print_timing: id  2 | task 5633 |       total time =   54973.62 ms /   995 tokens
6.59.485.781 I slot print_timing: id  2 | task 5633 |    graphs reused =       6487
6.59.485.837 I slot      release: id  2 | task 5633 | stop processing: n_tokens = 1055, truncated = 0
6.59.485.852 I srv  update_slots: all slots are idle
6.59.494.119 I srv    operator(): Chat format: peg-gemma4
6.59.494.453 I slot get_availabl: id  2 | task -1 | selected slot by LCP similarity, sim_best = 0.520 (> 0.100 thold), f_keep = 0.062
6.59.494.455 I srv  get_availabl: updating prompt cache
6.59.494.544 W srv   prompt_save:  - saving prompt with length 1055, total state size = 882.447 MiB (draft: 0.000 MiB)
7.00.094.263 I srv          load:  - looking for better prompt, base f_keep = 0.062, sim = 0.520
7.00.094.275 I srv        update:  - cache state: 10 prompts, 6078.941 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
7.00.094.276 I srv        update:    - prompt 0x57480c865720:     374 tokens, checkpoints:  1,   354.230 MiB
7.00.094.276 I srv        update:    - prompt 0x57480cb2c330:     120 tokens, checkpoints:  1,   135.943 MiB
7.00.094.277 I srv        update:    - prompt 0x57480c8313d0:     462 tokens, checkpoints:  1,   429.857 MiB
7.00.094.277 I srv        update:    - prompt 0x57480ca3d420:     748 tokens, checkpoints:  1,   675.645 MiB
7.00.094.278 I srv        update:    - prompt 0x57480c85f390:     254 tokens, checkpoints:  1,   251.103 MiB
7.00.094.279 I srv        update:    - prompt 0x57480c763b40:     532 tokens, checkpoints:  1,   490.015 MiB
7.00.094.313 I srv        update:    - prompt 0x57480d20d5a0:    1215 tokens, checkpoints:  1,   927.763 MiB
7.00.094.313 I srv        update:    - prompt 0x57480c9d3d70:    1227 tokens, checkpoints:  1,   928.701 MiB
7.00.094.314 I srv        update:    - prompt 0x57480d5a8130:    1361 tokens, checkpoints:  1,   954.796 MiB
7.00.094.315 I srv        update:    - prompt 0x57480d5ca250:    1055 tokens, checkpoints:  1,   930.886 MiB
7.00.094.316 I srv  get_availabl: prompt cache update took 599.86 ms
7.00.094.375 I slot launch_slot_: id  2 | task 6559 | processing task, is_child = 0
7.00.094.376 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
7.00.094.377 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
7.00.094.403 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
7.00.094.404 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
7.00.094.439 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
7.00.094.439 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
7.00.094.482 I slot update_slots: id  2 | task 6559 | Checking checkpoint with [0, 61] against 0...
7.00.110.887 W slot update_slots: id  2 | task 6559 | restored context checkpoint (pos_min = 0, pos_max = 61, n_tokens = 62, n_past = 61, size = 48.439 MiB)
7.06.400.068 I slot print_timing: id  2 | task 6559 | n_decoded =    100, tg =  17.39 t/s, tg_3s =  17.39 t/s
7.09.434.958 I slot print_timing: id  2 | task 6559 | n_decoded =    152, tg =  17.30 t/s, tg_3s =  17.13 t/s
7.12.475.945 I slot print_timing: id  2 | task 6559 | n_decoded =    204, tg =  17.25 t/s, tg_3s =  17.10 t/s
7.15.506.775 I slot print_timing: id  2 | task 6559 | n_decoded =    256, tg =  17.23 t/s, tg_3s =  17.16 t/s
7.18.542.752 I slot print_timing: id  2 | task 6559 | n_decoded =    308, tg =  17.21 t/s, tg_3s =  17.13 t/s
7.21.571.319 I slot print_timing: id  2 | task 6559 | n_decoded =    360, tg =  17.21 t/s, tg_3s =  17.17 t/s
7.24.612.381 I slot print_timing: id  2 | task 6559 | n_decoded =    412, tg =  17.19 t/s, tg_3s =  17.10 t/s
7.27.659.463 I slot print_timing: id  2 | task 6559 | n_decoded =    464, tg =  17.18 t/s, tg_3s =  17.07 t/s
7.30.707.065 I slot print_timing: id  2 | task 6559 | n_decoded =    516, tg =  17.17 t/s, tg_3s =  17.06 t/s
7.33.758.555 I slot print_timing: id  2 | task 6559 | n_decoded =    568, tg =  17.16 t/s, tg_3s =  17.04 t/s
7.36.812.050 I slot print_timing: id  2 | task 6559 | n_decoded =    620, tg =  17.14 t/s, tg_3s =  17.03 t/s
7.39.841.449 I slot print_timing: id  2 | task 6559 | n_decoded =    671, tg =  17.12 t/s, tg_3s =  16.84 t/s
7.42.891.949 I slot print_timing: id  2 | task 6559 | n_decoded =    722, tg =  17.09 t/s, tg_3s =  16.72 t/s
7.45.941.544 I slot print_timing: id  2 | task 6559 | n_decoded =    773, tg =  17.07 t/s, tg_3s =  16.72 t/s
7.48.988.416 I slot print_timing: id  2 | task 6559 | n_decoded =    824, tg =  17.05 t/s, tg_3s =  16.74 t/s
7.52.033.743 I slot print_timing: id  2 | task 6559 | n_decoded =    875, tg =  17.03 t/s, tg_3s =  16.75 t/s
7.55.040.980 I slot print_timing: id  2 | task 6559 | n_decoded =    925, tg =  17.01 t/s, tg_3s =  16.63 t/s
7.58.042.061 I slot print_timing: id  2 | task 6559 | n_decoded =    975, tg =  16.99 t/s, tg_3s =  16.66 t/s
8.01.102.018 I slot print_timing: id  2 | task 6559 | n_decoded =   1026, tg =  16.97 t/s, tg_3s =  16.67 t/s
8.04.102.026 I slot print_timing: id  2 | task 6559 | n_decoded =   1076, tg =  16.96 t/s, tg_3s =  16.67 t/s
8.07.158.844 I slot print_timing: id  2 | task 6559 | n_decoded =   1127, tg =  16.94 t/s, tg_3s =  16.68 t/s
8.08.233.611 I slot print_timing: id  2 | task 6559 | prompt eval time =     554.20 ms /    64 tokens (    8.66 ms per token,   115.48 tokens per second)
8.08.233.614 I slot print_timing: id  2 | task 6559 |        eval time =   67584.92 ms /  1145 tokens (   59.03 ms per token,    16.94 tokens per second)
8.08.233.615 I slot print_timing: id  2 | task 6559 |       total time =   68139.12 ms /  1209 tokens
8.08.233.616 I slot print_timing: id  2 | task 6559 |    graphs reused =       7626
8.08.233.653 I slot      release: id  2 | task 6559 | stop processing: n_tokens = 1269, truncated = 0
8.08.233.665 I srv  update_slots: all slots are idle
8.08.241.870 I srv    operator(): Chat format: peg-gemma4
8.08.242.203 I slot get_availabl: id  2 | task -1 | selected slot by LCP similarity, sim_best = 0.492 (> 0.100 thold), f_keep = 0.051
8.08.242.205 I srv  get_availabl: updating prompt cache
8.08.242.301 W srv   prompt_save:  - saving prompt with length 1269, total state size = 899.168 MiB (draft: 0.000 MiB)
8.08.862.504 I srv          load:  - looking for better prompt, base f_keep = 0.051, sim = 0.492
8.08.862.516 I srv        update:  - cache state: 11 prompts, 7026.548 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
8.08.862.538 I srv        update:    - prompt 0x57480c865720:     374 tokens, checkpoints:  1,   354.230 MiB
8.08.862.539 I srv        update:    - prompt 0x57480cb2c330:     120 tokens, checkpoints:  1,   135.943 MiB
8.08.862.540 I srv        update:    - prompt 0x57480c8313d0:     462 tokens, checkpoints:  1,   429.857 MiB
8.08.862.540 I srv        update:    - prompt 0x57480ca3d420:     748 tokens, checkpoints:  1,   675.645 MiB
8.08.862.541 I srv        update:    - prompt 0x57480c85f390:     254 tokens, checkpoints:  1,   251.103 MiB
8.08.862.542 I srv        update:    - prompt 0x57480c763b40:     532 tokens, checkpoints:  1,   490.015 MiB
8.08.862.542 I srv        update:    - prompt 0x57480d20d5a0:    1215 tokens, checkpoints:  1,   927.763 MiB
8.08.862.543 I srv        update:    - prompt 0x57480c9d3d70:    1227 tokens, checkpoints:  1,   928.701 MiB
8.08.862.544 I srv        update:    - prompt 0x57480d5a8130:    1361 tokens, checkpoints:  1,   954.796 MiB
8.08.862.545 I srv        update:    - prompt 0x57480d5ca250:    1055 tokens, checkpoints:  1,   930.886 MiB
8.08.862.545 I srv        update:    - prompt 0x57480ca49f90:    1269 tokens, checkpoints:  1,   947.608 MiB
8.08.862.546 I srv  get_availabl: prompt cache update took 620.34 ms
8.08.862.616 I slot launch_slot_: id  2 | task 7707 | processing task, is_child = 0
8.08.862.623 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
8.08.862.624 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
8.08.862.658 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
8.08.862.658 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
8.08.862.677 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
8.08.862.677 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
8.08.862.710 I slot update_slots: id  2 | task 7707 | Checking checkpoint with [0, 61] against 0...
8.08.879.104 W slot update_slots: id  2 | task 7707 | restored context checkpoint (pos_min = 0, pos_max = 61, n_tokens = 62, n_past = 61, size = 48.439 MiB)
8.15.341.963 I slot print_timing: id  2 | task 7707 | n_decoded =    100, tg =  17.42 t/s, tg_3s =  17.42 t/s
8.18.372.989 I slot print_timing: id  2 | task 7707 | n_decoded =    152, tg =  17.33 t/s, tg_3s =  17.16 t/s
8.21.406.241 I slot print_timing: id  2 | task 7707 | n_decoded =    204, tg =  17.28 t/s, tg_3s =  17.14 t/s
8.24.447.132 I slot print_timing: id  2 | task 7707 | n_decoded =    256, tg =  17.25 t/s, tg_3s =  17.10 t/s
8.27.484.611 I slot print_timing: id  2 | task 7707 | n_decoded =    308, tg =  17.22 t/s, tg_3s =  17.12 t/s
8.30.523.028 I slot print_timing: id  2 | task 7707 | n_decoded =    360, tg =  17.21 t/s, tg_3s =  17.11 t/s
8.33.525.822 I slot print_timing: id  2 | task 7707 | n_decoded =    411, tg =  17.18 t/s, tg_3s =  16.98 t/s
8.36.537.045 I slot print_timing: id  2 | task 7707 | n_decoded =    462, tg =  17.15 t/s, tg_3s =  16.94 t/s
8.39.545.943 I slot print_timing: id  2 | task 7707 | n_decoded =    513, tg =  17.13 t/s, tg_3s =  16.95 t/s
8.42.553.895 I slot print_timing: id  2 | task 7707 | n_decoded =    564, tg =  17.12 t/s, tg_3s =  16.96 t/s
8.45.561.931 I slot print_timing: id  2 | task 7707 | n_decoded =    615, tg =  17.10 t/s, tg_3s =  16.95 t/s
8.48.601.579 I slot print_timing: id  2 | task 7707 | n_decoded =    666, tg =  17.08 t/s, tg_3s =  16.78 t/s
8.51.651.652 I slot print_timing: id  2 | task 7707 | n_decoded =    717, tg =  17.05 t/s, tg_3s =  16.72 t/s
8.54.701.601 I slot print_timing: id  2 | task 7707 | n_decoded =    768, tg =  17.03 t/s, tg_3s =  16.72 t/s
8.57.756.962 I slot print_timing: id  2 | task 7707 | n_decoded =    819, tg =  17.01 t/s, tg_3s =  16.69 t/s
9.00.809.443 I slot print_timing: id  2 | task 7707 | n_decoded =    870, tg =  16.99 t/s, tg_3s =  16.71 t/s
9.03.864.645 I slot print_timing: id  2 | task 7707 | n_decoded =    921, tg =  16.97 t/s, tg_3s =  16.69 t/s
9.06.918.707 I slot print_timing: id  2 | task 7707 | n_decoded =    972, tg =  16.96 t/s, tg_3s =  16.70 t/s
9.09.972.988 I slot print_timing: id  2 | task 7707 | n_decoded =   1023, tg =  16.95 t/s, tg_3s =  16.70 t/s
9.13.030.765 I slot print_timing: id  2 | task 7707 | n_decoded =   1074, tg =  16.93 t/s, tg_3s =  16.68 t/s
9.16.089.990 I slot print_timing: id  2 | task 7707 | n_decoded =   1125, tg =  16.92 t/s, tg_3s =  16.67 t/s
9.19.100.316 I slot print_timing: id  2 | task 7707 | n_decoded =   1175, tg =  16.91 t/s, tg_3s =  16.61 t/s
9.22.110.833 I slot print_timing: id  2 | task 7707 | n_decoded =   1225, tg =  16.89 t/s, tg_3s =  16.61 t/s
9.25.119.299 I slot print_timing: id  2 | task 7707 | n_decoded =   1275, tg =  16.88 t/s, tg_3s =  16.62 t/s
9.28.129.406 I slot print_timing: id  2 | task 7707 | n_decoded =   1325, tg =  16.87 t/s, tg_3s =  16.61 t/s
9.31.140.902 I slot print_timing: id  2 | task 7707 | n_decoded =   1375, tg =  16.86 t/s, tg_3s =  16.60 t/s
9.34.175.067 I slot print_timing: id  2 | task 7707 | n_decoded =   1425, tg =  16.85 t/s, tg_3s =  16.48 t/s
9.37.213.047 I slot print_timing: id  2 | task 7707 | n_decoded =   1475, tg =  16.84 t/s, tg_3s =  16.46 t/s
9.40.261.027 I slot print_timing: id  2 | task 7707 | n_decoded =   1525, tg =  16.82 t/s, tg_3s =  16.40 t/s
9.43.315.983 I slot print_timing: id  2 | task 7707 | n_decoded =   1575, tg =  16.81 t/s, tg_3s =  16.37 t/s
9.46.366.024 I slot print_timing: id  2 | task 7707 | n_decoded =   1625, tg =  16.79 t/s, tg_3s =  16.39 t/s
9.49.393.364 I slot print_timing: id  2 | task 7707 | n_decoded =   1674, tg =  16.78 t/s, tg_3s =  16.19 t/s
9.52.402.404 I slot print_timing: id  2 | task 7707 | n_decoded =   1721, tg =  16.74 t/s, tg_3s =  15.62 t/s
9.55.414.141 I slot print_timing: id  2 | task 7707 | n_decoded =   1768, tg =  16.71 t/s, tg_3s =  15.61 t/s
9.58.422.418 I slot print_timing: id  2 | task 7707 | n_decoded =   1815, tg =  16.68 t/s, tg_3s =  15.62 t/s
10.01.429.389 I slot print_timing: id  2 | task 7707 | n_decoded =   1862, tg =  16.65 t/s, tg_3s =  15.63 t/s
10.04.437.474 I slot print_timing: id  2 | task 7707 | n_decoded =   1909, tg =  16.62 t/s, tg_3s =  15.62 t/s
10.07.494.261 I slot print_timing: id  2 | task 7707 | n_decoded =   1956, tg =  16.59 t/s, tg_3s =  15.38 t/s
10.10.549.231 I slot print_timing: id  2 | task 7707 | n_decoded =   2003, tg =  16.56 t/s, tg_3s =  15.38 t/s
10.13.604.335 I slot print_timing: id  2 | task 7707 | n_decoded =   2050, tg =  16.53 t/s, tg_3s =  15.38 t/s
10.16.660.928 I slot print_timing: id  2 | task 7707 | n_decoded =   2097, tg =  16.50 t/s, tg_3s =  15.38 t/s
10.19.717.306 I slot print_timing: id  2 | task 7707 | n_decoded =   2144, tg =  16.48 t/s, tg_3s =  15.38 t/s
10.22.732.198 I slot print_timing: id  2 | task 7707 | n_decoded =   2190, tg =  16.45 t/s, tg_3s =  15.26 t/s
10.25.769.204 I slot print_timing: id  2 | task 7707 | n_decoded =   2236, tg =  16.42 t/s, tg_3s =  15.15 t/s
10.28.805.050 I slot print_timing: id  2 | task 7707 | n_decoded =   2282, tg =  16.39 t/s, tg_3s =  15.15 t/s
10.31.116.107 I slot print_timing: id  2 | task 7707 | prompt eval time =     739.82 ms /    71 tokens (   10.42 ms per token,    95.97 tokens per second)
10.31.116.110 I slot print_timing: id  2 | task 7707 |        eval time =  141513.57 ms /  2317 tokens (   61.08 ms per token,    16.37 tokens per second)
10.31.116.111 I slot print_timing: id  2 | task 7707 |       total time =  142253.39 ms /  2388 tokens
10.31.116.111 I slot print_timing: id  2 | task 7707 |    graphs reused =       9932
10.31.116.208 I slot      release: id  2 | task 7707 | stop processing: n_tokens = 2448, truncated = 0
10.31.116.225 I srv  update_slots: all slots are idle
10.31.122.882 I srv    operator(): Chat format: peg-gemma4
10.31.123.222 I slot get_availabl: id  2 | task -1 | selected slot by LCP similarity, sim_best = 0.637 (> 0.100 thold), f_keep = 0.027
10.31.123.224 I srv  get_availabl: updating prompt cache
10.31.123.368 W srv   prompt_save:  - saving prompt with length 2448, total state size = 991.291 MiB (draft: 0.000 MiB)
10.31.793.418 I srv          load:  - looking for better prompt, base f_keep = 0.027, sim = 0.637
10.31.793.426 I srv        update:  - cache state: 12 prompts, 8066.279 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
10.31.793.427 I srv        update:    - prompt 0x57480c865720:     374 tokens, checkpoints:  1,   354.230 MiB
10.31.793.428 I srv        update:    - prompt 0x57480cb2c330:     120 tokens, checkpoints:  1,   135.943 MiB
10.31.793.428 I srv        update:    - prompt 0x57480c8313d0:     462 tokens, checkpoints:  1,   429.857 MiB
10.31.793.429 I srv        update:    - prompt 0x57480ca3d420:     748 tokens, checkpoints:  1,   675.645 MiB
10.31.793.429 I srv        update:    - prompt 0x57480c85f390:     254 tokens, checkpoints:  1,   251.103 MiB
10.31.793.430 I srv        update:    - prompt 0x57480c763b40:     532 tokens, checkpoints:  1,   490.015 MiB
10.31.793.430 I srv        update:    - prompt 0x57480d20d5a0:    1215 tokens, checkpoints:  1,   927.763 MiB
10.31.793.431 I srv        update:    - prompt 0x57480c9d3d70:    1227 tokens, checkpoints:  1,   928.701 MiB
10.31.793.468 I srv        update:    - prompt 0x57480d5a8130:    1361 tokens, checkpoints:  1,   954.796 MiB
10.31.793.469 I srv        update:    - prompt 0x57480d5ca250:    1055 tokens, checkpoints:  1,   930.886 MiB
10.31.793.483 I srv        update:    - prompt 0x57480ca49f90:    1269 tokens, checkpoints:  1,   947.608 MiB
10.31.793.484 I srv        update:    - prompt 0x57480a8143e0:    2448 tokens, checkpoints:  1,  1039.731 MiB
10.31.793.485 I srv  get_availabl: prompt cache update took 670.26 ms
10.31.793.543 I slot launch_slot_: id  2 | task 10027 | processing task, is_child = 0
10.31.793.544 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
10.31.793.545 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
10.31.793.571 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
10.31.793.572 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
10.31.793.588 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
10.31.793.588 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
10.31.793.613 I slot update_slots: id  2 | task 10027 | Checking checkpoint with [0, 61] against 0...
10.31.810.121 W slot update_slots: id  2 | task 10027 | restored context checkpoint (pos_min = 0, pos_max = 61, n_tokens = 62, n_past = 61, size = 48.439 MiB)
10.38.040.711 I slot print_timing: id  2 | task 10027 | n_decoded =    100, tg =  17.35 t/s, tg_3s =  17.35 t/s
10.41.055.885 I slot print_timing: id  2 | task 10027 | n_decoded =    152, tg =  17.32 t/s, tg_3s =  17.25 t/s
10.44.090.426 I slot print_timing: id  2 | task 10027 | n_decoded =    204, tg =  17.27 t/s, tg_3s =  17.14 t/s
10.47.117.981 I slot print_timing: id  2 | task 10027 | n_decoded =    256, tg =  17.25 t/s, tg_3s =  17.18 t/s
10.50.156.867 I slot print_timing: id  2 | task 10027 | n_decoded =    308, tg =  17.23 t/s, tg_3s =  17.11 t/s
10.53.191.391 I slot print_timing: id  2 | task 10027 | n_decoded =    360, tg =  17.21 t/s, tg_3s =  17.14 t/s
10.56.232.455 I slot print_timing: id  2 | task 10027 | n_decoded =    412, tg =  17.20 t/s, tg_3s =  17.10 t/s
10.59.251.042 I slot print_timing: id  2 | task 10027 | n_decoded =    463, tg =  17.17 t/s, tg_3s =  16.90 t/s
11.02.259.112 I slot print_timing: id  2 | task 10027 | n_decoded =    514, tg =  17.14 t/s, tg_3s =  16.95 t/s
11.05.268.221 I slot print_timing: id  2 | task 10027 | n_decoded =    565, tg =  17.13 t/s, tg_3s =  16.95 t/s
11.08.280.140 I slot print_timing: id  2 | task 10027 | n_decoded =    616, tg =  17.11 t/s, tg_3s =  16.93 t/s
11.11.288.152 I slot print_timing: id  2 | task 10027 | n_decoded =    667, tg =  17.10 t/s, tg_3s =  16.95 t/s
11.14.340.734 I slot print_timing: id  2 | task 10027 | n_decoded =    718, tg =  17.07 t/s, tg_3s =  16.71 t/s
11.17.383.601 I slot print_timing: id  2 | task 10027 | n_decoded =    769, tg =  17.05 t/s, tg_3s =  16.76 t/s
11.20.428.585 I slot print_timing: id  2 | task 10027 | n_decoded =    820, tg =  17.03 t/s, tg_3s =  16.75 t/s
11.23.471.441 I slot print_timing: id  2 | task 10027 | n_decoded =    871, tg =  17.01 t/s, tg_3s =  16.76 t/s
11.26.520.484 I slot print_timing: id  2 | task 10027 | n_decoded =    922, tg =  17.00 t/s, tg_3s =  16.73 t/s
11.29.576.827 I slot print_timing: id  2 | task 10027 | n_decoded =    973, tg =  16.98 t/s, tg_3s =  16.69 t/s
11.32.619.836 I slot print_timing: id  2 | task 10027 | n_decoded =   1024, tg =  16.97 t/s, tg_3s =  16.76 t/s
11.35.669.441 I slot print_timing: id  2 | task 10027 | n_decoded =   1075, tg =  16.96 t/s, tg_3s =  16.72 t/s
11.38.726.447 I slot print_timing: id  2 | task 10027 | n_decoded =   1126, tg =  16.95 t/s, tg_3s =  16.68 t/s
11.41.786.441 I slot print_timing: id  2 | task 10027 | n_decoded =   1177, tg =  16.93 t/s, tg_3s =  16.67 t/s
11.42.696.701 I slot print_timing: id  2 | task 10027 | prompt eval time =     484.53 ms /    41 tokens (   11.82 ms per token,    84.62 tokens per second)
11.42.696.705 I slot print_timing: id  2 | task 10027 |        eval time =   70418.56 ms /  1192 tokens (   59.08 ms per token,    16.93 tokens per second)
11.42.696.705 I slot print_timing: id  2 | task 10027 |       total time =   70903.08 ms /  1233 tokens
11.42.696.706 I slot print_timing: id  2 | task 10027 |    graphs reused =      11117
11.42.696.785 I slot      release: id  2 | task 10027 | stop processing: n_tokens = 1293, truncated = 0
11.42.696.800 I srv  update_slots: all slots are idle
11.42.703.108 I srv    operator(): Chat format: peg-gemma4
11.42.703.654 I slot get_availabl: id  2 | task -1 | selected slot by LCP similarity, sim_best = 0.551 (> 0.100 thold), f_keep = 0.050
11.42.703.656 I srv  get_availabl: updating prompt cache
11.42.703.767 W srv   prompt_save:  - saving prompt with length 1293, total state size = 901.044 MiB (draft: 0.000 MiB)
11.43.734.050 I srv          load:  - looking for better prompt, base f_keep = 0.050, sim = 0.551
11.43.734.061 W srv        update:  - cache size limit reached, removing oldest entry (size = 354.230 MiB)
11.43.774.771 W srv        update:  - cache size limit reached, removing oldest entry (size = 135.943 MiB)
11.43.791.448 W srv        update:  - cache size limit reached, removing oldest entry (size = 429.857 MiB)
11.43.839.842 I srv        update:  - cache state: 10 prompts, 8095.731 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
11.43.839.845 I srv        update:    - prompt 0x57480ca3d420:     748 tokens, checkpoints:  1,   675.645 MiB
11.43.839.846 I srv        update:    - prompt 0x57480c85f390:     254 tokens, checkpoints:  1,   251.103 MiB
11.43.839.847 I srv        update:    - prompt 0x57480c763b40:     532 tokens, checkpoints:  1,   490.015 MiB
11.43.839.847 I srv        update:    - prompt 0x57480d20d5a0:    1215 tokens, checkpoints:  1,   927.763 MiB
11.43.839.848 I srv        update:    - prompt 0x57480c9d3d70:    1227 tokens, checkpoints:  1,   928.701 MiB
11.43.839.848 I srv        update:    - prompt 0x57480d5a8130:    1361 tokens, checkpoints:  1,   954.796 MiB
11.43.839.849 I srv        update:    - prompt 0x57480d5ca250:    1055 tokens, checkpoints:  1,   930.886 MiB
11.43.839.849 I srv        update:    - prompt 0x57480ca49f90:    1269 tokens, checkpoints:  1,   947.608 MiB
11.43.839.850 I srv        update:    - prompt 0x57480a8143e0:    2448 tokens, checkpoints:  1,  1039.731 MiB
11.43.839.850 I srv        update:    - prompt 0x57480cab3e70:    1293 tokens, checkpoints:  1,   949.483 MiB
11.43.839.852 I srv  get_availabl: prompt cache update took 1136.20 ms
11.43.839.922 I slot launch_slot_: id  2 | task 11222 | processing task, is_child = 0
11.43.839.959 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
11.43.839.959 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
11.43.839.984 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
11.43.839.985 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
11.43.840.000 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
11.43.840.001 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
11.43.840.025 I slot update_slots: id  2 | task 11222 | Checking checkpoint with [0, 61] against 0...
11.43.858.772 W slot update_slots: id  2 | task 11222 | restored context checkpoint (pos_min = 0, pos_max = 61, n_tokens = 62, n_past = 61, size = 48.439 MiB)
11.50.102.756 I slot print_timing: id  2 | task 11222 | n_decoded =    100, tg =  17.39 t/s, tg_3s =  17.39 t/s
11.53.136.635 I slot print_timing: id  2 | task 11222 | n_decoded =    152, tg =  17.31 t/s, tg_3s =  17.14 t/s
11.56.170.173 I slot print_timing: id  2 | task 11222 | n_decoded =    204, tg =  17.26 t/s, tg_3s =  17.14 t/s
11.59.206.192 I slot print_timing: id  2 | task 11222 | n_decoded =    256, tg =  17.24 t/s, tg_3s =  17.13 t/s
12.02.245.792 I slot print_timing: id  2 | task 11222 | n_decoded =    308, tg =  17.21 t/s, tg_3s =  17.11 t/s
12.05.285.814 I slot print_timing: id  2 | task 11222 | n_decoded =    360, tg =  17.20 t/s, tg_3s =  17.11 t/s
12.08.342.075 I slot print_timing: id  2 | task 11222 | n_decoded =    412, tg =  17.17 t/s, tg_3s =  17.01 t/s
12.11.349.134 I slot print_timing: id  2 | task 11222 | n_decoded =    463, tg =  17.15 t/s, tg_3s =  16.96 t/s
12.14.358.152 I slot print_timing: id  2 | task 11222 | n_decoded =    514, tg =  17.13 t/s, tg_3s =  16.95 t/s
12.17.364.283 I slot print_timing: id  2 | task 11222 | n_decoded =    565, tg =  17.12 t/s, tg_3s =  16.97 t/s
12.20.373.012 I slot print_timing: id  2 | task 11222 | n_decoded =    616, tg =  17.10 t/s, tg_3s =  16.95 t/s
12.23.384.853 I slot print_timing: id  2 | task 11222 | n_decoded =    667, tg =  17.09 t/s, tg_3s =  16.93 t/s
12.26.425.383 I slot print_timing: id  2 | task 11222 | n_decoded =    718, tg =  17.07 t/s, tg_3s =  16.77 t/s
12.29.460.850 I slot print_timing: id  2 | task 11222 | n_decoded =    769, tg =  17.05 t/s, tg_3s =  16.80 t/s
12.32.498.388 I slot print_timing: id  2 | task 11222 | n_decoded =    820, tg =  17.03 t/s, tg_3s =  16.79 t/s
12.35.535.992 I slot print_timing: id  2 | task 11222 | n_decoded =    871, tg =  17.02 t/s, tg_3s =  16.79 t/s
12.38.588.579 I slot print_timing: id  2 | task 11222 | n_decoded =    922, tg =  17.00 t/s, tg_3s =  16.71 t/s
12.41.648.519 I slot print_timing: id  2 | task 11222 | n_decoded =    973, tg =  16.98 t/s, tg_3s =  16.67 t/s
12.44.346.604 I slot print_timing: id  2 | task 11222 | prompt eval time =     513.22 ms /    57 tokens (    9.00 ms per token,   111.06 tokens per second)
12.44.346.607 I slot print_timing: id  2 | task 11222 |        eval time =   59993.35 ms /  1018 tokens (   58.93 ms per token,    16.97 tokens per second)
12.44.346.607 I slot print_timing: id  2 | task 11222 |       total time =   60506.57 ms /  1075 tokens
12.44.346.608 I slot print_timing: id  2 | task 11222 |    graphs reused =      12129
12.44.346.709 I slot      release: id  2 | task 11222 | stop processing: n_tokens = 1135, truncated = 0
12.44.346.719 I srv  update_slots: all slots are idle
12.44.358.331 I srv    operator(): Chat format: peg-gemma4
12.44.358.701 I slot get_availabl: id  1 | task -1 | selected slot by LRU, t_last = -1
12.44.358.704 I srv  get_availabl: updating prompt cache
12.44.358.708 I srv          load:  - looking for better prompt, base f_keep = -1.000, sim = 0.000
12.44.358.715 I srv        update:  - cache state: 10 prompts, 8095.731 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
12.44.358.716 I srv        update:    - prompt 0x57480ca3d420:     748 tokens, checkpoints:  1,   675.645 MiB
12.44.358.717 I srv        update:    - prompt 0x57480c85f390:     254 tokens, checkpoints:  1,   251.103 MiB
12.44.358.718 I srv        update:    - prompt 0x57480c763b40:     532 tokens, checkpoints:  1,   490.015 MiB
12.44.358.718 I srv        update:    - prompt 0x57480d20d5a0:    1215 tokens, checkpoints:  1,   927.763 MiB
12.44.358.719 I srv        update:    - prompt 0x57480c9d3d70:    1227 tokens, checkpoints:  1,   928.701 MiB
12.44.358.720 I srv        update:    - prompt 0x57480d5a8130:    1361 tokens, checkpoints:  1,   954.796 MiB
12.44.358.721 I srv        update:    - prompt 0x57480d5ca250:    1055 tokens, checkpoints:  1,   930.886 MiB
12.44.358.721 I srv        update:    - prompt 0x57480ca49f90:    1269 tokens, checkpoints:  1,   947.608 MiB
12.44.358.759 I srv        update:    - prompt 0x57480a8143e0:    2448 tokens, checkpoints:  1,  1039.731 MiB
12.44.358.761 I srv        update:    - prompt 0x57480cab3e70:    1293 tokens, checkpoints:  1,   949.483 MiB
12.44.358.762 I srv  get_availabl: prompt cache update took 0.06 ms
12.44.358.816 I slot launch_slot_: id  1 | task 12243 | processing task, is_child = 0
12.44.358.817 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
12.44.358.818 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
12.44.358.852 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
12.44.359.009 W srv   prompt_save:  - saving prompt with length 1135, total state size = 888.698 MiB (draft: 0.000 MiB)
12.45.227.428 W srv        update:  - cache size limit reached, removing oldest entry (size = 675.645 MiB)
12.45.296.476 W srv        update:  - cache size limit reached, removing oldest entry (size = 251.103 MiB)
12.45.326.984 I srv        update:  - cache state: 9 prompts, 8106.120 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
12.45.326.990 I srv        update:    - prompt 0x57480c763b40:     532 tokens, checkpoints:  1,   490.015 MiB
12.45.326.991 I srv        update:    - prompt 0x57480d20d5a0:    1215 tokens, checkpoints:  1,   927.763 MiB
12.45.326.992 I srv        update:    - prompt 0x57480c9d3d70:    1227 tokens, checkpoints:  1,   928.701 MiB
12.45.326.993 I srv        update:    - prompt 0x57480d5a8130:    1361 tokens, checkpoints:  1,   954.796 MiB
12.45.327.030 I srv        update:    - prompt 0x57480d5ca250:    1055 tokens, checkpoints:  1,   930.886 MiB
12.45.327.032 I srv        update:    - prompt 0x57480ca49f90:    1269 tokens, checkpoints:  1,   947.608 MiB
12.45.327.032 I srv        update:    - prompt 0x57480a8143e0:    2448 tokens, checkpoints:  1,  1039.731 MiB
12.45.327.033 I srv        update:    - prompt 0x57480cab3e70:    1293 tokens, checkpoints:  1,   949.483 MiB
12.45.327.034 I srv        update:    - prompt 0x57480d9093b0:    1135 tokens, checkpoints:  1,   937.137 MiB
12.45.327.036 I slot prompt_clear: id  2 | task -1 | clearing prompt with 1135 tokens
12.45.327.392 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
12.45.327.395 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
12.45.771.806 I slot create_check: id  1 | task 12243 | created context checkpoint 1 of 32 (pos_min = 0, pos_max = 58, n_tokens = 59, size = 46.096 MiB)
12.52.217.845 I slot print_timing: id  1 | task 12243 | n_decoded =    100, tg =  17.38 t/s, tg_3s =  17.38 t/s
12.55.255.151 I slot print_timing: id  1 | task 12243 | n_decoded =    152, tg =  17.29 t/s, tg_3s =  17.12 t/s
12.58.297.310 I slot print_timing: id  1 | task 12243 | n_decoded =    204, tg =  17.24 t/s, tg_3s =  17.09 t/s
13.01.343.033 I slot print_timing: id  1 | task 12243 | n_decoded =    256, tg =  17.21 t/s, tg_3s =  17.07 t/s
13.04.384.115 I slot print_timing: id  1 | task 12243 | n_decoded =    308, tg =  17.19 t/s, tg_3s =  17.10 t/s
13.07.410.960 I slot print_timing: id  1 | task 12243 | n_decoded =    360, tg =  17.19 t/s, tg_3s =  17.18 t/s
13.09.695.117 I slot print_timing: id  1 | task 12243 | prompt eval time =    1136.33 ms /   132 tokens (    8.61 ms per token,   116.16 tokens per second)
13.09.695.120 I slot print_timing: id  1 | task 12243 |        eval time =   23231.24 ms /   399 tokens (   58.22 ms per token,    17.18 tokens per second)
13.09.695.121 I slot print_timing: id  1 | task 12243 |       total time =   24367.56 ms /   531 tokens
13.09.695.122 I slot print_timing: id  1 | task 12243 |    graphs reused =      12524
13.09.695.239 I slot      release: id  1 | task 12243 | stop processing: n_tokens = 530, truncated = 0
13.09.695.246 I srv  update_slots: all slots are idle
13.09.763.765 I srv    operator(): Chat format: peg-gemma4
13.09.764.217 I slot get_availabl: id  1 | task -1 | selected slot by LCP similarity, sim_best = 0.698 (> 0.100 thold), f_keep = 0.126
13.09.764.219 I srv  get_availabl: updating prompt cache
13.09.764.283 W srv   prompt_save:  - saving prompt with length 530, total state size = 455.482 MiB (draft: 0.000 MiB)
13.10.264.464 I srv          load:  - looking for better prompt, base f_keep = 0.126, sim = 0.698
13.10.264.472 W srv        update:  - cache size limit reached, removing oldest entry (size = 490.015 MiB)
13.10.311.462 I srv        update:  - cache state: 9 prompts, 8117.683 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
13.10.311.465 I srv        update:    - prompt 0x57480d20d5a0:    1215 tokens, checkpoints:  1,   927.763 MiB
13.10.311.466 I srv        update:    - prompt 0x57480c9d3d70:    1227 tokens, checkpoints:  1,   928.701 MiB
13.10.311.467 I srv        update:    - prompt 0x57480d5a8130:    1361 tokens, checkpoints:  1,   954.796 MiB
13.10.311.467 I srv        update:    - prompt 0x57480d5ca250:    1055 tokens, checkpoints:  1,   930.886 MiB
13.10.311.468 I srv        update:    - prompt 0x57480ca49f90:    1269 tokens, checkpoints:  1,   947.608 MiB
13.10.311.468 I srv        update:    - prompt 0x57480a8143e0:    2448 tokens, checkpoints:  1,  1039.731 MiB
13.10.311.469 I srv        update:    - prompt 0x57480cab3e70:    1293 tokens, checkpoints:  1,   949.483 MiB
13.10.311.469 I srv        update:    - prompt 0x57480d9093b0:    1135 tokens, checkpoints:  1,   937.137 MiB
13.10.311.470 I srv        update:    - prompt 0x57480c85f390:     530 tokens, checkpoints:  1,   501.578 MiB
13.10.311.471 I srv  get_availabl: prompt cache update took 547.25 ms
13.10.311.539 I slot launch_slot_: id  1 | task 12645 | processing task, is_child = 0
13.10.311.540 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
13.10.311.541 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
13.10.311.562 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
13.10.311.563 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
13.10.311.578 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
13.10.311.578 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
13.10.311.602 I slot update_slots: id  1 | task 12645 | Checking checkpoint with [0, 58] against 0...
13.10.329.446 W slot update_slots: id  1 | task 12645 | restored context checkpoint (pos_min = 0, pos_max = 58, n_tokens = 59, n_past = 58, size = 46.096 MiB)
13.16.543.403 I slot print_timing: id  1 | task 12645 | n_decoded =    100, tg =  17.40 t/s, tg_3s =  17.40 t/s
13.19.561.583 I slot print_timing: id  1 | task 12645 | n_decoded =    152, tg =  17.34 t/s, tg_3s =  17.23 t/s
13.22.597.917 I slot print_timing: id  1 | task 12645 | n_decoded =    204, tg =  17.28 t/s, tg_3s =  17.13 t/s
13.25.628.062 I slot print_timing: id  1 | task 12645 | n_decoded =    256, tg =  17.26 t/s, tg_3s =  17.16 t/s
13.28.660.079 I slot print_timing: id  1 | task 12645 | n_decoded =    308, tg =  17.24 t/s, tg_3s =  17.15 t/s
13.29.300.910 I slot print_timing: id  1 | task 12645 | prompt eval time =     483.75 ms /    38 tokens (   12.73 ms per token,    78.55 tokens per second)
13.29.300.913 I slot print_timing: id  1 | task 12645 |        eval time =   18505.55 ms /   319 tokens (   58.01 ms per token,    17.24 tokens per second)
13.29.300.913 I slot print_timing: id  1 | task 12645 |       total time =   18989.30 ms /   357 tokens
13.29.300.914 I slot print_timing: id  1 | task 12645 |    graphs reused =      12840
13.29.300.992 I slot      release: id  1 | task 12645 | stop processing: n_tokens = 414, truncated = 0
13.29.301.001 I srv  update_slots: all slots are idle
13.29.351.834 I srv    operator(): Chat format: peg-gemma4
13.29.352.336 I slot get_availabl: id  1 | task -1 | selected slot by LCP similarity, sim_best = 0.657 (> 0.100 thold), f_keep = 0.162
13.29.352.338 I srv  get_availabl: updating prompt cache
13.29.352.397 W srv   prompt_save:  - saving prompt with length 414, total state size = 355.792 MiB (draft: 0.000 MiB)
13.29.791.666 I srv          load:  - looking for better prompt, base f_keep = 0.162, sim = 0.657
13.29.791.676 W srv        update:  - cache size limit reached, removing oldest entry (size = 927.763 MiB)
13.29.874.093 I srv        update:  - cache state: 9 prompts, 7591.807 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
13.29.874.098 I srv        update:    - prompt 0x57480c9d3d70:    1227 tokens, checkpoints:  1,   928.701 MiB
13.29.874.099 I srv        update:    - prompt 0x57480d5a8130:    1361 tokens, checkpoints:  1,   954.796 MiB
13.29.874.099 I srv        update:    - prompt 0x57480d5ca250:    1055 tokens, checkpoints:  1,   930.886 MiB
13.29.874.100 I srv        update:    - prompt 0x57480ca49f90:    1269 tokens, checkpoints:  1,   947.608 MiB
13.29.874.101 I srv        update:    - prompt 0x57480a8143e0:    2448 tokens, checkpoints:  1,  1039.731 MiB
13.29.874.102 I srv        update:    - prompt 0x57480cab3e70:    1293 tokens, checkpoints:  1,   949.483 MiB
13.29.874.102 I srv        update:    - prompt 0x57480d9093b0:    1135 tokens, checkpoints:  1,   937.137 MiB
13.29.874.103 I srv        update:    - prompt 0x57480c85f390:     530 tokens, checkpoints:  1,   501.578 MiB
13.29.874.103 I srv        update:    - prompt 0x57480d4bd790:     414 tokens, checkpoints:  1,   401.888 MiB
13.29.874.105 I srv  get_availabl: prompt cache update took 521.77 ms
13.29.874.191 I slot launch_slot_: id  1 | task 12967 | processing task, is_child = 0
13.29.874.192 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
13.29.874.193 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
13.29.874.216 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
13.29.874.216 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
13.29.874.234 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
13.29.874.234 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
13.29.874.264 I slot update_slots: id  1 | task 12967 | Checking checkpoint with [0, 58] against 0...
13.29.893.916 W slot update_slots: id  1 | task 12967 | restored context checkpoint (pos_min = 0, pos_max = 58, n_tokens = 59, n_past = 58, size = 46.096 MiB)
13.36.111.556 I slot print_timing: id  1 | task 12967 | n_decoded =    100, tg =  17.39 t/s, tg_3s =  17.39 t/s
13.39.127.584 I slot print_timing: id  1 | task 12967 | n_decoded =    152, tg =  17.34 t/s, tg_3s =  17.24 t/s
13.42.168.921 I slot print_timing: id  1 | task 12967 | n_decoded =    204, tg =  17.28 t/s, tg_3s =  17.10 t/s
13.45.205.702 I slot print_timing: id  1 | task 12967 | n_decoded =    256, tg =  17.25 t/s, tg_3s =  17.12 t/s
13.45.498.132 I slot print_timing: id  1 | task 12967 | prompt eval time =     487.94 ms /    44 tokens (   11.09 ms per token,    90.18 tokens per second)
13.45.498.135 I slot print_timing: id  1 | task 12967 |        eval time =   15135.93 ms /   261 tokens (   57.99 ms per token,    17.24 tokens per second)
13.45.498.136 I slot print_timing: id  1 | task 12967 |       total time =   15623.86 ms /   305 tokens
13.45.498.137 I slot print_timing: id  1 | task 12967 |    graphs reused =      13098
13.45.498.226 I slot      release: id  1 | task 12967 | stop processing: n_tokens = 362, truncated = 0
13.45.498.240 I srv  update_slots: all slots are idle
13.45.579.058 I srv    operator(): Chat format: peg-gemma4
13.45.579.455 I slot get_availabl: id  1 | task -1 | selected slot by LCP similarity, sim_best = 0.500 (> 0.100 thold), f_keep = 0.185
13.45.579.458 I srv  get_availabl: updating prompt cache
13.45.579.526 W srv   prompt_save:  - saving prompt with length 362, total state size = 311.103 MiB (draft: 0.000 MiB)
13.45.841.876 I srv          load:  - looking for better prompt, base f_keep = 0.185, sim = 0.500
13.45.841.886 I srv        update:  - cache state: 10 prompts, 7949.006 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
13.45.841.887 I srv        update:    - prompt 0x57480c9d3d70:    1227 tokens, checkpoints:  1,   928.701 MiB
13.45.841.887 I srv        update:    - prompt 0x57480d5a8130:    1361 tokens, checkpoints:  1,   954.796 MiB
13.45.841.891 I srv        update:    - prompt 0x57480d5ca250:    1055 tokens, checkpoints:  1,   930.886 MiB
13.45.841.891 I srv        update:    - prompt 0x57480ca49f90:    1269 tokens, checkpoints:  1,   947.608 MiB
13.45.841.892 I srv        update:    - prompt 0x57480a8143e0:    2448 tokens, checkpoints:  1,  1039.731 MiB
13.45.841.893 I srv        update:    - prompt 0x57480cab3e70:    1293 tokens, checkpoints:  1,   949.483 MiB
13.45.841.893 I srv        update:    - prompt 0x57480d9093b0:    1135 tokens, checkpoints:  1,   937.137 MiB
13.45.841.895 I srv        update:    - prompt 0x57480c85f390:     530 tokens, checkpoints:  1,   501.578 MiB
13.45.841.896 I srv        update:    - prompt 0x57480d4bd790:     414 tokens, checkpoints:  1,   401.888 MiB
13.45.841.896 I srv        update:    - prompt 0x57480c713e60:     362 tokens, checkpoints:  1,   357.199 MiB
13.45.841.897 I srv  get_availabl: prompt cache update took 262.44 ms
13.45.841.963 I slot launch_slot_: id  1 | task 13231 | processing task, is_child = 0
13.45.841.964 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
13.45.841.964 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
13.45.841.985 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
13.45.841.985 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
13.45.842.000 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
13.45.842.001 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
13.45.842.024 I slot update_slots: id  1 | task 13231 | Checking checkpoint with [0, 58] against 0...
13.45.857.792 W slot update_slots: id  1 | task 13231 | restored context checkpoint (pos_min = 0, pos_max = 58, n_tokens = 59, n_past = 58, size = 46.096 MiB)
13.52.334.799 I slot print_timing: id  1 | task 13231 | n_decoded =    100, tg =  17.38 t/s, tg_3s =  17.38 t/s
13.55.369.253 I slot print_timing: id  1 | task 13231 | n_decoded =    152, tg =  17.30 t/s, tg_3s =  17.14 t/s
13.58.401.222 I slot print_timing: id  1 | task 13231 | n_decoded =    204, tg =  17.26 t/s, tg_3s =  17.15 t/s
14.01.432.821 I slot print_timing: id  1 | task 13231 | n_decoded =    256, tg =  17.24 t/s, tg_3s =  17.15 t/s
14.04.453.832 I slot print_timing: id  1 | task 13231 | n_decoded =    308, tg =  17.23 t/s, tg_3s =  17.21 t/s
14.07.483.245 I slot print_timing: id  1 | task 13231 | n_decoded =    360, tg =  17.22 t/s, tg_3s =  17.17 t/s
14.10.541.134 I slot print_timing: id  1 | task 13231 | n_decoded =    412, tg =  17.20 t/s, tg_3s =  17.01 t/s
14.13.592.168 I slot print_timing: id  1 | task 13231 | n_decoded =    464, tg =  17.18 t/s, tg_3s =  17.04 t/s
14.16.642.205 I slot print_timing: id  1 | task 13231 | n_decoded =    516, tg =  17.17 t/s, tg_3s =  17.05 t/s
14.19.696.708 I slot print_timing: id  1 | task 13231 | n_decoded =    568, tg =  17.15 t/s, tg_3s =  17.02 t/s
14.22.697.977 I slot print_timing: id  1 | task 13231 | n_decoded =    619, tg =  17.14 t/s, tg_3s =  16.99 t/s
14.25.744.591 I slot print_timing: id  1 | task 13231 | n_decoded =    670, tg =  17.11 t/s, tg_3s =  16.74 t/s
14.28.798.493 I slot print_timing: id  1 | task 13231 | n_decoded =    721, tg =  17.08 t/s, tg_3s =  16.70 t/s
14.31.855.530 I slot print_timing: id  1 | task 13231 | n_decoded =    772, tg =  17.05 t/s, tg_3s =  16.68 t/s
14.32.575.508 I slot print_timing: id  1 | task 13231 | prompt eval time =     740.14 ms /    76 tokens (    9.74 ms per token,   102.68 tokens per second)
14.32.575.512 I slot print_timing: id  1 | task 13231 |        eval time =   45993.34 ms /   784 tokens (   58.66 ms per token,    17.05 tokens per second)
14.32.575.513 I slot print_timing: id  1 | task 13231 |       total time =   46733.48 ms /   860 tokens
14.32.575.513 I slot print_timing: id  1 | task 13231 |    graphs reused =      13877
14.32.575.605 I slot      release: id  1 | task 13231 | stop processing: n_tokens = 917, truncated = 0
14.32.575.618 I srv  update_slots: all slots are idle
14.32.653.335 I srv    operator(): Chat format: peg-gemma4
14.32.653.644 I slot get_availabl: id  1 | task -1 | selected slot by LCP similarity, sim_best = 0.620 (> 0.100 thold), f_keep = 0.073
14.32.653.646 I srv  get_availabl: updating prompt cache
14.32.653.758 W srv   prompt_save:  - saving prompt with length 917, total state size = 788.069 MiB (draft: 0.000 MiB)
14.33.270.267 I srv          load:  - looking for better prompt, base f_keep = 0.073, sim = 0.620
14.33.270.277 W srv        update:  - cache size limit reached, removing oldest entry (size = 928.701 MiB)
14.33.349.053 I srv        update:  - cache state: 10 prompts, 7854.471 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
14.33.349.057 I srv        update:    - prompt 0x57480d5a8130:    1361 tokens, checkpoints:  1,   954.796 MiB
14.33.349.058 I srv        update:    - prompt 0x57480d5ca250:    1055 tokens, checkpoints:  1,   930.886 MiB
14.33.349.058 I srv        update:    - prompt 0x57480ca49f90:    1269 tokens, checkpoints:  1,   947.608 MiB
14.33.349.059 I srv        update:    - prompt 0x57480a8143e0:    2448 tokens, checkpoints:  1,  1039.731 MiB
14.33.349.060 I srv        update:    - prompt 0x57480cab3e70:    1293 tokens, checkpoints:  1,   949.483 MiB
14.33.349.060 I srv        update:    - prompt 0x57480d9093b0:    1135 tokens, checkpoints:  1,   937.137 MiB
14.33.349.061 I srv        update:    - prompt 0x57480c85f390:     530 tokens, checkpoints:  1,   501.578 MiB
14.33.349.062 I srv        update:    - prompt 0x57480d4bd790:     414 tokens, checkpoints:  1,   401.888 MiB
14.33.349.062 I srv        update:    - prompt 0x57480c713e60:     362 tokens, checkpoints:  1,   357.199 MiB
14.33.349.063 I srv        update:    - prompt 0x57480c5c5410:     917 tokens, checkpoints:  1,   834.165 MiB
14.33.349.065 I srv  get_availabl: prompt cache update took 695.42 ms
14.33.349.141 I slot launch_slot_: id  1 | task 14018 | processing task, is_child = 0
14.33.349.142 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
14.33.349.143 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
14.33.349.169 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
14.33.349.170 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
14.33.349.188 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
14.33.349.188 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
14.33.349.215 I slot update_slots: id  1 | task 14018 | Checking checkpoint with [0, 58] against 0...
14.33.369.567 W slot update_slots: id  1 | task 14018 | restored context checkpoint (pos_min = 0, pos_max = 58, n_tokens = 59, n_past = 58, size = 46.096 MiB)
14.39.561.971 I slot print_timing: id  1 | task 14018 | n_decoded =    100, tg =  17.39 t/s, tg_3s =  17.39 t/s
14.42.592.040 I slot print_timing: id  1 | task 14018 | n_decoded =    152, tg =  17.31 t/s, tg_3s =  17.16 t/s
14.45.626.050 I slot print_timing: id  1 | task 14018 | n_decoded =    204, tg =  17.27 t/s, tg_3s =  17.14 t/s
14.48.652.990 I slot print_timing: id  1 | task 14018 | n_decoded =    256, tg =  17.25 t/s, tg_3s =  17.18 t/s
14.51.678.366 I slot print_timing: id  1 | task 14018 | n_decoded =    308, tg =  17.24 t/s, tg_3s =  17.19 t/s
14.54.707.919 I slot print_timing: id  1 | task 14018 | n_decoded =    360, tg =  17.23 t/s, tg_3s =  17.16 t/s
14.57.749.791 I slot print_timing: id  1 | task 14018 | n_decoded =    412, tg =  17.21 t/s, tg_3s =  17.09 t/s
15.00.804.293 I slot print_timing: id  1 | task 14018 | n_decoded =    464, tg =  17.19 t/s, tg_3s =  17.02 t/s
15.03.852.858 I slot print_timing: id  1 | task 14018 | n_decoded =    516, tg =  17.18 t/s, tg_3s =  17.06 t/s
15.06.905.704 I slot print_timing: id  1 | task 14018 | n_decoded =    568, tg =  17.16 t/s, tg_3s =  17.03 t/s
15.09.909.699 I slot print_timing: id  1 | task 14018 | n_decoded =    619, tg =  17.15 t/s, tg_3s =  16.98 t/s
15.12.933.370 I slot print_timing: id  1 | task 14018 | n_decoded =    670, tg =  17.13 t/s, tg_3s =  16.87 t/s
15.15.981.458 I slot print_timing: id  1 | task 14018 | n_decoded =    721, tg =  17.10 t/s, tg_3s =  16.73 t/s
15.19.033.707 I slot print_timing: id  1 | task 14018 | n_decoded =    772, tg =  17.07 t/s, tg_3s =  16.71 t/s
15.22.080.458 I slot print_timing: id  1 | task 14018 | n_decoded =    823, tg =  17.05 t/s, tg_3s =  16.74 t/s
15.25.134.373 I slot print_timing: id  1 | task 14018 | n_decoded =    874, tg =  17.03 t/s, tg_3s =  16.70 t/s
15.28.139.766 I slot print_timing: id  1 | task 14018 | n_decoded =    924, tg =  17.01 t/s, tg_3s =  16.64 t/s
15.31.143.930 I slot print_timing: id  1 | task 14018 | n_decoded =    974, tg =  16.99 t/s, tg_3s =  16.64 t/s
15.34.145.638 I slot print_timing: id  1 | task 14018 | n_decoded =   1024, tg =  16.97 t/s, tg_3s =  16.66 t/s
15.37.148.885 I slot print_timing: id  1 | task 14018 | n_decoded =   1074, tg =  16.96 t/s, tg_3s =  16.65 t/s
15.40.150.032 I slot print_timing: id  1 | task 14018 | n_decoded =   1124, tg =  16.94 t/s, tg_3s =  16.66 t/s
15.43.214.663 I slot print_timing: id  1 | task 14018 | n_decoded =   1175, tg =  16.93 t/s, tg_3s =  16.64 t/s
15.46.215.110 I slot print_timing: id  1 | task 14018 | n_decoded =   1225, tg =  16.92 t/s, tg_3s =  16.66 t/s
15.49.217.983 I slot print_timing: id  1 | task 14018 | n_decoded =   1275, tg =  16.91 t/s, tg_3s =  16.65 t/s
15.52.219.140 I slot print_timing: id  1 | task 14018 | n_decoded =   1325, tg =  16.90 t/s, tg_3s =  16.66 t/s
15.55.224.257 I slot print_timing: id  1 | task 14018 | n_decoded =   1375, tg =  16.89 t/s, tg_3s =  16.64 t/s
15.58.227.316 I slot print_timing: id  1 | task 14018 | n_decoded =   1425, tg =  16.88 t/s, tg_3s =  16.65 t/s
16.01.260.334 I slot print_timing: id  1 | task 14018 | n_decoded =   1475, tg =  16.87 t/s, tg_3s =  16.49 t/s
16.04.287.204 I slot print_timing: id  1 | task 14018 | n_decoded =   1525, tg =  16.86 t/s, tg_3s =  16.52 t/s
16.07.319.825 I slot print_timing: id  1 | task 14018 | n_decoded =   1575, tg =  16.84 t/s, tg_3s =  16.49 t/s
16.10.348.475 I slot print_timing: id  1 | task 14018 | n_decoded =   1625, tg =  16.83 t/s, tg_3s =  16.51 t/s
16.11.925.810 I slot print_timing: id  1 | task 14018 | prompt eval time =     462.04 ms /    50 tokens (    9.24 ms per token,   108.22 tokens per second)
16.11.925.813 I slot print_timing: id  1 | task 14018 |        eval time =   98114.55 ms /  1651 tokens (   59.43 ms per token,    16.83 tokens per second)
16.11.925.813 I slot print_timing: id  1 | task 14018 |       total time =   98576.59 ms /  1701 tokens
16.11.925.814 I slot print_timing: id  1 | task 14018 |    graphs reused =      15520
16.11.925.850 I slot      release: id  1 | task 14018 | stop processing: n_tokens = 1758, truncated = 0
16.11.925.865 I srv  update_slots: all slots are idle
16.11.977.418 I srv    operator(): Chat format: peg-gemma4
16.11.977.903 I slot get_availabl: id  1 | task -1 | selected slot by LCP similarity, sim_best = 0.539 (> 0.100 thold), f_keep = 0.035
16.11.977.906 I srv  get_availabl: updating prompt cache
16.11.978.028 W srv   prompt_save:  - saving prompt with length 1758, total state size = 937.377 MiB (draft: 0.000 MiB)
16.12.673.047 I srv          load:  - looking for better prompt, base f_keep = 0.035, sim = 0.539
16.12.673.055 W srv        update:  - cache size limit reached, removing oldest entry (size = 954.796 MiB)
16.12.761.631 I srv        update:  - cache state: 10 prompts, 7883.147 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
16.12.761.635 I srv        update:    - prompt 0x57480d5ca250:    1055 tokens, checkpoints:  1,   930.886 MiB
16.12.761.636 I srv        update:    - prompt 0x57480ca49f90:    1269 tokens, checkpoints:  1,   947.608 MiB
16.12.761.637 I srv        update:    - prompt 0x57480a8143e0:    2448 tokens, checkpoints:  1,  1039.731 MiB
16.12.761.638 I srv        update:    - prompt 0x57480cab3e70:    1293 tokens, checkpoints:  1,   949.483 MiB
16.12.761.639 I srv        update:    - prompt 0x57480d9093b0:    1135 tokens, checkpoints:  1,   937.137 MiB
16.12.761.639 I srv        update:    - prompt 0x57480c85f390:     530 tokens, checkpoints:  1,   501.578 MiB
16.12.761.640 I srv        update:    - prompt 0x57480d4bd790:     414 tokens, checkpoints:  1,   401.888 MiB
16.12.761.641 I srv        update:    - prompt 0x57480c713e60:     362 tokens, checkpoints:  1,   357.199 MiB
16.12.761.642 I srv        update:    - prompt 0x57480c5c5410:     917 tokens, checkpoints:  1,   834.165 MiB
16.12.761.642 I srv        update:    - prompt 0x57480c763b40:    1758 tokens, checkpoints:  1,   983.473 MiB
16.12.761.644 I srv  get_availabl: prompt cache update took 783.74 ms
16.12.761.740 I slot launch_slot_: id  1 | task 15672 | processing task, is_child = 0
16.12.761.741 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
16.12.761.742 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
16.12.761.775 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
16.12.761.775 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
16.12.761.796 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
16.12.761.796 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
16.12.761.835 I slot update_slots: id  1 | task 15672 | Checking checkpoint with [0, 58] against 0...
16.12.778.201 W slot update_slots: id  1 | task 15672 | restored context checkpoint (pos_min = 0, pos_max = 58, n_tokens = 59, n_past = 58, size = 46.096 MiB)
16.19.027.133 I slot print_timing: id  1 | task 15672 | n_decoded =    100, tg =  17.38 t/s, tg_3s =  17.38 t/s
16.22.058.839 I slot print_timing: id  1 | task 15672 | n_decoded =    152, tg =  17.30 t/s, tg_3s =  17.15 t/s
16.25.099.029 I slot print_timing: id  1 | task 15672 | n_decoded =    204, tg =  17.25 t/s, tg_3s =  17.10 t/s
16.25.449.817 I slot print_timing: id  1 | task 15672 | prompt eval time =     511.25 ms /    57 tokens (    8.97 ms per token,   111.49 tokens per second)
16.25.449.821 I slot print_timing: id  1 | task 15672 |        eval time =   12176.73 ms /   210 tokens (   57.98 ms per token,    17.25 tokens per second)
16.25.449.821 I slot print_timing: id  1 | task 15672 |       total time =   12687.98 ms /   267 tokens
16.25.449.822 I slot print_timing: id  1 | task 15672 |    graphs reused =      15727
16.25.449.911 I slot      release: id  1 | task 15672 | stop processing: n_tokens = 324, truncated = 0
16.25.449.923 I srv  update_slots: all slots are idle
16.25.453.921 I srv    operator(): Chat format: peg-gemma4
16.25.454.234 I slot get_availabl: id  1 | task -1 | selected slot by LCP similarity, sim_best = 0.579 (> 0.100 thold), f_keep = 0.191
16.25.454.236 I srv  get_availabl: updating prompt cache
16.25.454.283 W srv   prompt_save:  - saving prompt with length 324, total state size = 278.446 MiB (draft: 0.000 MiB)
16.25.684.190 I srv          load:  - looking for better prompt, base f_keep = 0.191, sim = 0.579
16.25.684.199 W srv        update:  - cache size limit reached, removing oldest entry (size = 930.886 MiB)
16.25.766.734 I srv        update:  - cache state: 10 prompts, 7276.803 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
16.25.766.740 I srv        update:    - prompt 0x57480ca49f90:    1269 tokens, checkpoints:  1,   947.608 MiB
16.25.766.741 I srv        update:    - prompt 0x57480a8143e0:    2448 tokens, checkpoints:  1,  1039.731 MiB
16.25.766.742 I srv        update:    - prompt 0x57480cab3e70:    1293 tokens, checkpoints:  1,   949.483 MiB
16.25.766.742 I srv        update:    - prompt 0x57480d9093b0:    1135 tokens, checkpoints:  1,   937.137 MiB
16.25.766.743 I srv        update:    - prompt 0x57480c85f390:     530 tokens, checkpoints:  1,   501.578 MiB
16.25.766.744 I srv        update:    - prompt 0x57480d4bd790:     414 tokens, checkpoints:  1,   401.888 MiB
16.25.766.744 I srv        update:    - prompt 0x57480c713e60:     362 tokens, checkpoints:  1,   357.199 MiB
16.25.766.745 I srv        update:    - prompt 0x57480c5c5410:     917 tokens, checkpoints:  1,   834.165 MiB
16.25.766.747 I srv        update:    - prompt 0x57480c763b40:    1758 tokens, checkpoints:  1,   983.473 MiB
16.25.766.748 I srv        update:    - prompt 0x57480d3c2b70:     324 tokens, checkpoints:  1,   324.542 MiB
16.25.766.749 I srv  get_availabl: prompt cache update took 312.51 ms
16.25.766.830 I slot launch_slot_: id  1 | task 15885 | processing task, is_child = 0
16.25.766.831 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
16.25.766.833 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
16.25.766.860 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
16.25.766.861 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
16.25.766.879 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
16.25.766.880 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
16.25.766.909 I slot update_slots: id  1 | task 15885 | Checking checkpoint with [0, 58] against 0...
16.25.782.852 W slot update_slots: id  1 | task 15885 | restored context checkpoint (pos_min = 0, pos_max = 58, n_tokens = 59, n_past = 58, size = 46.096 MiB)
16.31.960.770 I slot print_timing: id  1 | task 15885 | n_decoded =    100, tg =  17.43 t/s, tg_3s =  17.43 t/s
16.34.985.335 I slot print_timing: id  1 | task 15885 | n_decoded =    152, tg =  17.35 t/s, tg_3s =  17.19 t/s
16.38.018.945 I slot print_timing: id  1 | task 15885 | n_decoded =    204, tg =  17.30 t/s, tg_3s =  17.14 t/s
16.41.051.508 I slot print_timing: id  1 | task 15885 | n_decoded =    256, tg =  17.27 t/s, tg_3s =  17.15 t/s
16.44.081.670 I slot print_timing: id  1 | task 15885 | n_decoded =    308, tg =  17.25 t/s, tg_3s =  17.16 t/s
16.47.121.979 I slot print_timing: id  1 | task 15885 | n_decoded =    360, tg =  17.23 t/s, tg_3s =  17.10 t/s
16.50.170.740 I slot print_timing: id  1 | task 15885 | n_decoded =    412, tg =  17.20 t/s, tg_3s =  17.06 t/s
16.53.181.838 I slot print_timing: id  1 | task 15885 | n_decoded =    463, tg =  17.17 t/s, tg_3s =  16.94 t/s
16.56.192.918 I slot print_timing: id  1 | task 15885 | n_decoded =    514, tg =  17.15 t/s, tg_3s =  16.94 t/s
16.59.201.716 I slot print_timing: id  1 | task 15885 | n_decoded =    565, tg =  17.13 t/s, tg_3s =  16.95 t/s
17.02.210.910 I slot print_timing: id  1 | task 15885 | n_decoded =    616, tg =  17.12 t/s, tg_3s =  16.95 t/s
17.05.232.794 I slot print_timing: id  1 | task 15885 | n_decoded =    667, tg =  17.10 t/s, tg_3s =  16.88 t/s
17.08.105.624 I slot print_timing: id  1 | task 15885 | prompt eval time =     456.97 ms /    49 tokens (    9.33 ms per token,   107.23 tokens per second)
17.08.105.627 I slot print_timing: id  1 | task 15885 |        eval time =   41881.75 ms /   715 tokens (   58.58 ms per token,    17.07 tokens per second)
17.08.105.628 I slot print_timing: id  1 | task 15885 |       total time =   42338.71 ms /   764 tokens
17.08.105.629 I slot print_timing: id  1 | task 15885 |    graphs reused =      16437
17.08.105.672 I slot      release: id  1 | task 15885 | stop processing: n_tokens = 821, truncated = 0
17.08.105.689 I srv  update_slots: all slots are idle
17.08.170.524 I srv    operator(): Chat format: peg-gemma4
17.08.170.841 I slot get_availabl: id  1 | task -1 | selected slot by LCP similarity, sim_best = 0.644 (> 0.100 thold), f_keep = 0.082
17.08.170.843 I srv  get_availabl: updating prompt cache
17.08.170.940 W srv   prompt_save:  - saving prompt with length 821, total state size = 705.567 MiB (draft: 0.000 MiB)
17.08.661.102 I srv          load:  - looking for better prompt, base f_keep = 0.082, sim = 0.644
17.08.661.112 I srv        update:  - cache state: 11 prompts, 8028.465 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
17.08.661.113 I srv        update:    - prompt 0x57480ca49f90:    1269 tokens, checkpoints:  1,   947.608 MiB
17.08.661.115 I srv        update:    - prompt 0x57480a8143e0:    2448 tokens, checkpoints:  1,  1039.731 MiB
17.08.661.117 I srv        update:    - prompt 0x57480cab3e70:    1293 tokens, checkpoints:  1,   949.483 MiB
17.08.661.117 I srv        update:    - prompt 0x57480d9093b0:    1135 tokens, checkpoints:  1,   937.137 MiB
17.08.661.118 I srv        update:    - prompt 0x57480c85f390:     530 tokens, checkpoints:  1,   501.578 MiB
17.08.661.118 I srv        update:    - prompt 0x57480d4bd790:     414 tokens, checkpoints:  1,   401.888 MiB
17.08.661.119 I srv        update:    - prompt 0x57480c713e60:     362 tokens, checkpoints:  1,   357.199 MiB
17.08.661.119 I srv        update:    - prompt 0x57480c5c5410:     917 tokens, checkpoints:  1,   834.165 MiB
17.08.661.120 I srv        update:    - prompt 0x57480c763b40:    1758 tokens, checkpoints:  1,   983.473 MiB
17.08.661.120 I srv        update:    - prompt 0x57480d3c2b70:     324 tokens, checkpoints:  1,   324.542 MiB
17.08.661.121 I srv        update:    - prompt 0x57480c6d2640:     821 tokens, checkpoints:  1,   751.663 MiB
17.08.661.122 I srv  get_availabl: prompt cache update took 490.28 ms
17.08.661.183 I slot launch_slot_: id  1 | task 16603 | processing task, is_child = 0
17.08.661.184 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
17.08.661.185 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
17.08.661.211 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
17.08.661.212 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
17.08.661.233 I slot process_sing: id  3 | task -1 | saving idle slot to prompt cache
17.08.661.234 I slot prompt_clear: id  3 | task -1 | clearing prompt with 0 tokens
17.08.661.264 I slot update_slots: id  1 | task 16603 | Checking checkpoint with [0, 58] against 0...
17.08.676.945 W slot update_slots: id  1 | task 16603 | restored context checkpoint (pos_min = 0, pos_max = 58, n_tokens = 59, n_past = 58, size = 46.096 MiB)
17.14.868.929 I slot print_timing: id  1 | task 16603 | n_decoded =    100, tg =  17.39 t/s, tg_3s =  17.39 t/s
17.17.885.329 I slot print_timing: id  1 | task 16603 | n_decoded =    152, tg =  17.34 t/s, tg_3s =  17.24 t/s
17.20.939.176 I slot print_timing: id  1 | task 16603 | n_decoded =    204, tg =  17.26 t/s, tg_3s =  17.03 t/s
17.23.965.235 I slot print_timing: id  1 | task 16603 | n_decoded =    256, tg =  17.24 t/s, tg_3s =  17.18 t/s
17.26.999.691 I slot print_timing: id  1 | task 16603 | n_decoded =    308, tg =  17.22 t/s, tg_3s =  17.14 t/s
17.30.036.120 I slot print_timing: id  1 | task 16603 | n_decoded =    360, tg =  17.21 t/s, tg_3s =  17.13 t/s
17.33.079.859 I slot print_timing: id  1 | task 16603 | n_decoded =    412, tg =  17.19 t/s, tg_3s =  17.08 t/s
17.36.135.927 I slot print_timing: id  1 | task 16603 | n_decoded =    464, tg =  17.17 t/s, tg_3s =  17.02 t/s
17.39.194.118 I slot print_timing: id  1 | task 16603 | n_decoded =    516, tg =  17.16 t/s, tg_3s =  17.00 t/s
17.42.198.899 I slot print_timing: id  1 | task 16603 | prompt eval time =     456.04 ms /    46 tokens (    9.91 ms per token,   100.87 tokens per second)
17.42.198.903 I slot print_timing: id  1 | task 16603 |        eval time =   33081.60 ms /   567 tokens (   58.34 ms per token,    17.14 tokens per second)
17.42.198.903 I slot print_timing: id  1 | task 16603 |       total time =   33537.63 ms /   613 tokens
17.42.198.904 I slot print_timing: id  1 | task 16603 |    graphs reused =      17000
17.42.198.997 I slot      release: id  1 | task 16603 | stop processing: n_tokens = 670, truncated = 0
17.42.199.007 I srv  update_slots: all slots are idle
17.42.261.410 I srv    operator(): operator(): cleaning up before exit...