qoherent/experiments-07-07-12-local-llm-knowledge-2
23
0
Fork 0
Code Issues Pull Requests Workflows Packages Projects Releases Wiki Activity
Push Tracker
experiments-07-07-12-local-.../results_hard/gemma4-31b.server.log

1161 lines
117 KiB
Plaintext
Raw Permalink Normal View History

G
readme report
2026-07-12 21:35:10 -04:00
0.00.064.489 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg)
0.00.064.493 I device_info:
0.00.064.512 I - ROCm0 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.064.516 I - ROCm1 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.064.523 I - CPU : AMD Ryzen 9 3900X 12-Core Processor (128730 MiB, 128730 MiB free)
0.00.064.584 I system_info: n_threads = 12 (n_threads_batch = 12) / 24 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 |
0.00.064.587 I srv llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true
0.00.064.630 I srv init: running without SSL
0.00.064.695 I srv init: using 23 threads for HTTP server
0.00.065.031 I srv start: binding port with default address family
0.00.066.233 I srv llama_server: loading model
0.00.066.241 I srv load_model: loading model '/home/qrf/.cache/llama.cpp/google_gemma-4-31B-it-Q4_K_M.gguf'
0.00.066.293 I common_init_result: fitting params to device memory ...
0.00.066.294 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on)
0.01.848.213 W load: control-looking token: 212 '</s>' was not control-type; this is probably a bug in the model. its type will be overridden
0.01.848.755 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden
0.01.876.328 W load: special_eog_ids contains '<|tool_response>', removing '</s>' token from EOG list
0.14.507.928 W llama_context: n_ctx_seq (16384) < n_ctx_train (262144) -- the full capacity of the model will not be utilized
0.14.615.052 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
0.14.802.775 I srv load_model: initializing slots, n_slots = 4
0.14.920.324 W common_speculative_init: no implementations specified for speculative decoding
0.14.920.330 I slot load_model: id 0 | task -1 | new slot, n_ctx = 16384
0.14.920.334 I slot load_model: id 1 | task -1 | new slot, n_ctx = 16384
0.14.920.335 I slot load_model: id 2 | task -1 | new slot, n_ctx = 16384
0.14.920.335 I slot load_model: id 3 | task -1 | new slot, n_ctx = 16384
0.14.920.378 I srv load_model: prompt cache is enabled, size limit: 8192 MiB
0.14.920.378 I srv load_model: use `--cache-ram 0` to disable the prompt cache
0.14.920.379 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391
0.14.920.379 I srv load_model: context checkpoints enabled, max = 32, min spacing = 256
0.14.920.396 I srv init: idle slots will be saved to prompt cache and cleared upon starting a new task
0.14.927.975 I init: chat template, example_format: '<|turn>system
<|think|>
You are a helpful assistant<turn|>
<|turn>user
Hello<turn|>
<|turn>model
Hi there<turn|>
<|turn>user
How are you?<turn|>
<|turn>model
'
0.14.928.716 I srv init: init: chat template, thinking = 1
0.14.928.751 I srv llama_server: model loaded
0.14.928.755 I srv llama_server: server is listening on http://127.0.0.1:8090
0.14.928.761 I srv update_slots: all slots are idle
0.14.966.166 I srv operator(): Chat format: peg-gemma4
0.14.966.547 I slot get_availabl: id 3 | task -1 | selected slot by LRU, t_last = -1
0.14.966.549 I srv get_availabl: updating prompt cache
0.14.966.555 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000
0.14.966.559 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 16384 tokens, 8589934592 est)
0.14.966.560 I srv get_availabl: prompt cache update took 0.01 ms
0.14.966.603 I slot launch_slot_: id 3 | task 0 | processing task, is_child = 0
0.14.966.604 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.14.966.605 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.14.966.621 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.14.966.622 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.14.966.635 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.14.966.635 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.15.626.552 I slot create_check: id 3 | task 0 | created context checkpoint 1 of 32 (pos_min = 0, pos_max = 72, n_tokens = 73, size = 57.033 MiB)
0.21.730.980 I slot print_timing: id 3 | task 0 | n_decoded = 100, tg = 17.46 t/s, tg_3s = 17.46 t/s
0.24.732.762 I slot print_timing: id 3 | task 0 | n_decoded = 152, tg = 17.41 t/s, tg_3s = 17.32 t/s
0.27.756.063 I slot print_timing: id 3 | task 0 | n_decoded = 204, tg = 17.36 t/s, tg_3s = 17.20 t/s
0.30.772.139 I slot print_timing: id 3 | task 0 | n_decoded = 256, tg = 17.33 t/s, tg_3s = 17.24 t/s
0.33.793.420 I slot print_timing: id 3 | task 0 | n_decoded = 308, tg = 17.31 t/s, tg_3s = 17.21 t/s
0.36.813.637 I slot print_timing: id 3 | task 0 | n_decoded = 360, tg = 17.30 t/s, tg_3s = 17.22 t/s
0.39.837.581 I slot print_timing: id 3 | task 0 | n_decoded = 412, tg = 17.29 t/s, tg_3s = 17.20 t/s
0.42.895.121 I slot print_timing: id 3 | task 0 | n_decoded = 464, tg = 17.25 t/s, tg_3s = 17.01 t/s
0.45.949.180 I slot print_timing: id 3 | task 0 | n_decoded = 516, tg = 17.23 t/s, tg_3s = 17.03 t/s
0.48.951.181 I slot print_timing: id 3 | task 0 | n_decoded = 567, tg = 17.21 t/s, tg_3s = 16.99 t/s
0.51.952.357 I slot print_timing: id 3 | task 0 | n_decoded = 618, tg = 17.19 t/s, tg_3s = 16.99 t/s
0.54.955.255 I slot print_timing: id 3 | task 0 | n_decoded = 669, tg = 17.18 t/s, tg_3s = 16.98 t/s
0.58.009.799 I slot print_timing: id 3 | task 0 | n_decoded = 720, tg = 17.14 t/s, tg_3s = 16.70 t/s
1.01.012.400 I slot print_timing: id 3 | task 0 | n_decoded = 770, tg = 17.11 t/s, tg_3s = 16.65 t/s
1.04.061.660 I slot print_timing: id 3 | task 0 | n_decoded = 821, tg = 17.08 t/s, tg_3s = 16.73 t/s
1.07.104.314 I slot print_timing: id 3 | task 0 | n_decoded = 872, tg = 17.06 t/s, tg_3s = 16.76 t/s
1.10.150.258 I slot print_timing: id 3 | task 0 | n_decoded = 923, tg = 17.05 t/s, tg_3s = 16.74 t/s
1.13.159.295 I slot print_timing: id 3 | task 0 | n_decoded = 973, tg = 17.02 t/s, tg_3s = 16.62 t/s
1.16.205.572 I slot print_timing: id 3 | task 0 | n_decoded = 1024, tg = 17.01 t/s, tg_3s = 16.74 t/s
1.19.250.466 I slot print_timing: id 3 | task 0 | n_decoded = 1075, tg = 17.00 t/s, tg_3s = 16.75 t/s
1.22.299.398 I slot print_timing: id 3 | task 0 | n_decoded = 1126, tg = 16.98 t/s, tg_3s = 16.73 t/s
1.25.350.284 I slot print_timing: id 3 | task 0 | n_decoded = 1177, tg = 16.97 t/s, tg_3s = 16.72 t/s
1.28.368.672 I slot print_timing: id 3 | task 0 | n_decoded = 1227, tg = 16.96 t/s, tg_3s = 16.57 t/s
1.31.378.374 I slot print_timing: id 3 | task 0 | n_decoded = 1277, tg = 16.94 t/s, tg_3s = 16.61 t/s
1.34.390.292 I slot print_timing: id 3 | task 0 | n_decoded = 1327, tg = 16.93 t/s, tg_3s = 16.60 t/s
1.37.407.265 I slot print_timing: id 3 | task 0 | n_decoded = 1377, tg = 16.92 t/s, tg_3s = 16.57 t/s
1.40.420.285 I slot print_timing: id 3 | task 0 | n_decoded = 1427, tg = 16.90 t/s, tg_3s = 16.59 t/s
1.43.458.252 I slot print_timing: id 3 | task 0 | n_decoded = 1477, tg = 16.89 t/s, tg_3s = 16.46 t/s
1.46.493.302 I slot print_timing: id 3 | task 0 | n_decoded = 1527, tg = 16.87 t/s, tg_3s = 16.47 t/s
1.49.529.480 I slot print_timing: id 3 | task 0 | n_decoded = 1577, tg = 16.86 t/s, tg_3s = 16.47 t/s
1.52.570.778 I slot print_timing: id 3 | task 0 | n_decoded = 1627, tg = 16.85 t/s, tg_3s = 16.44 t/s
1.55.614.559 I slot print_timing: id 3 | task 0 | n_decoded = 1677, tg = 16.84 t/s, tg_3s = 16.43 t/s
1.58.648.755 I slot print_timing: id 3 | task 0 | n_decoded = 1725, tg = 16.81 t/s, tg_3s = 15.82 t/s
1.59.032.761 I slot print_timing: id 3 | task 0 | prompt eval time = 1036.98 ms / 99 tokens ( 10.47 ms per token, 95.47 tokens per second)
1.59.032.765 I slot print_timing: id 3 | task 0 | eval time = 103029.12 ms / 1731 tokens ( 59.52 ms per token, 16.80 tokens per second)
1.59.032.766 I slot print_timing: id 3 | task 0 | total time = 104066.10 ms / 1830 tokens
1.59.032.770 I slot print_timing: id 3 | task 0 | graphs reused = 1723
1.59.032.824 I slot release: id 3 | task 0 | stop processing: n_tokens = 1829, truncated = 0
1.59.032.835 I srv update_slots: all slots are idle
1.59.035.572 I srv operator(): Chat format: peg-gemma4
1.59.035.905 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.817 (> 0.100 thold), f_keep = 0.042
1.59.035.906 I srv get_availabl: updating prompt cache
1.59.036.017 W srv prompt_save: - saving prompt with length 1829, total state size = 942.925 MiB (draft: 0.000 MiB)
2.00.251.092 I srv load: - looking for better prompt, base f_keep = 0.042, sim = 0.817
2.00.251.098 I srv update: - cache state: 1 prompts, 999.958 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
2.00.251.099 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB
2.00.251.100 I srv get_availabl: prompt cache update took 1215.19 ms
2.00.251.168 I slot launch_slot_: id 3 | task 1734 | processing task, is_child = 0
2.00.251.169 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
2.00.251.169 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
2.00.251.196 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
2.00.251.196 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
2.00.251.219 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
2.00.251.219 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
2.00.251.239 I slot update_slots: id 3 | task 1734 | Checking checkpoint with [0, 72] against 0...
2.00.270.218 W slot update_slots: id 3 | task 1734 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
2.06.323.887 I slot print_timing: id 3 | task 1734 | n_decoded = 100, tg = 17.40 t/s, tg_3s = 17.40 t/s
2.09.338.883 I slot print_timing: id 3 | task 1734 | n_decoded = 152, tg = 17.35 t/s, tg_3s = 17.25 t/s
2.12.365.340 I slot print_timing: id 3 | task 1734 | n_decoded = 204, tg = 17.31 t/s, tg_3s = 17.18 t/s
2.15.388.370 I slot print_timing: id 3 | task 1734 | n_decoded = 256, tg = 17.28 t/s, tg_3s = 17.20 t/s
2.18.414.463 I slot print_timing: id 3 | task 1734 | n_decoded = 308, tg = 17.27 t/s, tg_3s = 17.18 t/s
2.21.446.517 I slot print_timing: id 3 | task 1734 | n_decoded = 360, tg = 17.25 t/s, tg_3s = 17.15 t/s
2.24.477.097 I slot print_timing: id 3 | task 1734 | n_decoded = 412, tg = 17.24 t/s, tg_3s = 17.16 t/s
2.27.480.458 I slot print_timing: id 3 | task 1734 | n_decoded = 463, tg = 17.21 t/s, tg_3s = 16.98 t/s
2.30.481.462 I slot print_timing: id 3 | task 1734 | n_decoded = 514, tg = 17.19 t/s, tg_3s = 16.99 t/s
2.33.483.477 I slot print_timing: id 3 | task 1734 | n_decoded = 565, tg = 17.17 t/s, tg_3s = 16.99 t/s
2.36.487.828 I slot print_timing: id 3 | task 1734 | n_decoded = 616, tg = 17.15 t/s, tg_3s = 16.98 t/s
2.39.491.291 I slot print_timing: id 3 | task 1734 | n_decoded = 667, tg = 17.14 t/s, tg_3s = 16.98 t/s
2.42.547.696 I slot print_timing: id 3 | task 1734 | n_decoded = 718, tg = 17.11 t/s, tg_3s = 16.69 t/s
2.45.604.734 I slot print_timing: id 3 | task 1734 | n_decoded = 769, tg = 17.08 t/s, tg_3s = 16.68 t/s
2.47.524.807 I slot print_timing: id 3 | task 1734 | prompt eval time = 326.14 ms / 21 tokens ( 15.53 ms per token, 64.39 tokens per second)
2.47.524.810 I slot print_timing: id 3 | task 1734 | eval time = 46947.42 ms / 801 tokens ( 58.61 ms per token, 17.06 tokens per second)
2.47.524.811 I slot print_timing: id 3 | task 1734 | total time = 47273.56 ms / 822 tokens
2.47.524.812 I slot print_timing: id 3 | task 1734 | graphs reused = 2519
2.47.524.843 I slot release: id 3 | task 1734 | stop processing: n_tokens = 893, truncated = 0
2.47.524.855 I srv update_slots: all slots are idle
2.47.527.500 I srv operator(): Chat format: peg-gemma4
2.47.527.836 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.809 (> 0.100 thold), f_keep = 0.085
2.47.527.837 I srv get_availabl: updating prompt cache
2.47.527.920 W srv prompt_save: - saving prompt with length 893, total state size = 767.444 MiB (draft: 0.000 MiB)
2.48.212.915 I srv load: - looking for better prompt, base f_keep = 0.085, sim = 0.809
2.48.212.921 I srv update: - cache state: 2 prompts, 1824.435 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
2.48.212.922 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB
2.48.212.923 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB
2.48.212.924 I srv get_availabl: prompt cache update took 685.09 ms
2.48.212.984 I slot launch_slot_: id 3 | task 2538 | processing task, is_child = 0
2.48.212.987 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
2.48.212.988 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
2.48.213.008 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
2.48.213.009 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
2.48.213.020 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
2.48.213.020 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
2.48.213.039 I slot update_slots: id 3 | task 2538 | Checking checkpoint with [0, 72] against 0...
2.48.231.785 W slot update_slots: id 3 | task 2538 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
2.54.381.907 I slot print_timing: id 3 | task 2538 | n_decoded = 100, tg = 17.41 t/s, tg_3s = 17.41 t/s
2.57.395.104 I slot print_timing: id 3 | task 2538 | n_decoded = 152, tg = 17.36 t/s, tg_3s = 17.26 t/s
3.00.435.656 I slot print_timing: id 3 | task 2538 | n_decoded = 204, tg = 17.29 t/s, tg_3s = 17.10 t/s
3.03.475.503 I slot print_timing: id 3 | task 2538 | n_decoded = 256, tg = 17.25 t/s, tg_3s = 17.11 t/s
3.06.510.259 I slot print_timing: id 3 | task 2538 | n_decoded = 308, tg = 17.23 t/s, tg_3s = 17.13 t/s
3.09.543.474 I slot print_timing: id 3 | task 2538 | n_decoded = 360, tg = 17.22 t/s, tg_3s = 17.14 t/s
3.12.576.515 I slot print_timing: id 3 | task 2538 | n_decoded = 412, tg = 17.21 t/s, tg_3s = 17.14 t/s
3.15.581.605 I slot print_timing: id 3 | task 2538 | n_decoded = 463, tg = 17.18 t/s, tg_3s = 16.97 t/s
3.18.583.857 I slot print_timing: id 3 | task 2538 | n_decoded = 514, tg = 17.16 t/s, tg_3s = 16.99 t/s
3.20.998.535 I slot print_timing: id 3 | task 2538 | prompt eval time = 424.78 ms / 22 tokens ( 19.31 ms per token, 51.79 tokens per second)
3.20.998.539 I slot print_timing: id 3 | task 2538 | eval time = 32360.71 ms / 555 tokens ( 58.31 ms per token, 17.15 tokens per second)
3.20.998.539 I slot print_timing: id 3 | task 2538 | total time = 32785.49 ms / 577 tokens
3.20.998.540 I slot print_timing: id 3 | task 2538 | graphs reused = 3070
3.20.998.575 I slot release: id 3 | task 2538 | stop processing: n_tokens = 648, truncated = 0
3.20.998.583 I srv update_slots: all slots are idle
3.21.001.203 I srv operator(): Chat format: peg-gemma4
3.21.001.534 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.817 (> 0.100 thold), f_keep = 0.117
3.21.001.537 I srv get_availabl: updating prompt cache
3.21.001.603 W srv prompt_save: - saving prompt with length 648, total state size = 556.891 MiB (draft: 0.000 MiB)
3.21.439.602 I srv load: - looking for better prompt, base f_keep = 0.117, sim = 0.817
3.21.439.609 I srv update: - cache state: 3 prompts, 2438.359 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
3.21.439.610 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB
3.21.439.610 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB
3.21.439.611 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB
3.21.439.612 I srv get_availabl: prompt cache update took 438.07 ms
3.21.439.670 I slot launch_slot_: id 3 | task 3096 | processing task, is_child = 0
3.21.439.671 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
3.21.439.672 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
3.21.439.694 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
3.21.439.694 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
3.21.439.720 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
3.21.439.720 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
3.21.439.750 I slot update_slots: id 3 | task 3096 | Checking checkpoint with [0, 72] against 0...
3.21.458.546 W slot update_slots: id 3 | task 3096 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
3.27.516.280 I slot print_timing: id 3 | task 3096 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s
3.30.532.270 I slot print_timing: id 3 | task 3096 | n_decoded = 152, tg = 17.34 t/s, tg_3s = 17.24 t/s
3.33.576.662 I slot print_timing: id 3 | task 3096 | n_decoded = 204, tg = 17.27 t/s, tg_3s = 17.08 t/s
3.36.615.438 I slot print_timing: id 3 | task 3096 | n_decoded = 256, tg = 17.24 t/s, tg_3s = 17.11 t/s
3.39.640.275 I slot print_timing: id 3 | task 3096 | n_decoded = 308, tg = 17.23 t/s, tg_3s = 17.19 t/s
3.42.662.343 I slot print_timing: id 3 | task 3096 | n_decoded = 360, tg = 17.23 t/s, tg_3s = 17.21 t/s
3.45.678.415 I slot print_timing: id 3 | task 3096 | n_decoded = 412, tg = 17.23 t/s, tg_3s = 17.24 t/s
3.48.725.336 I slot print_timing: id 3 | task 3096 | n_decoded = 464, tg = 17.21 t/s, tg_3s = 17.07 t/s
3.51.769.121 I slot print_timing: id 3 | task 3096 | n_decoded = 516, tg = 17.20 t/s, tg_3s = 17.08 t/s
3.54.818.283 I slot print_timing: id 3 | task 3096 | n_decoded = 568, tg = 17.18 t/s, tg_3s = 17.05 t/s
3.57.870.583 I slot print_timing: id 3 | task 3096 | n_decoded = 620, tg = 17.17 t/s, tg_3s = 17.04 t/s
4.00.923.196 I slot print_timing: id 3 | task 3096 | n_decoded = 672, tg = 17.16 t/s, tg_3s = 17.03 t/s
4.03.977.176 I slot print_timing: id 3 | task 3096 | n_decoded = 723, tg = 17.13 t/s, tg_3s = 16.70 t/s
4.07.029.671 I slot print_timing: id 3 | task 3096 | n_decoded = 774, tg = 17.10 t/s, tg_3s = 16.71 t/s
4.10.083.998 I slot print_timing: id 3 | task 3096 | n_decoded = 825, tg = 17.07 t/s, tg_3s = 16.70 t/s
4.13.091.905 I slot print_timing: id 3 | task 3096 | n_decoded = 875, tg = 17.05 t/s, tg_3s = 16.62 t/s
4.16.149.731 I slot print_timing: id 3 | task 3096 | n_decoded = 926, tg = 17.03 t/s, tg_3s = 16.68 t/s
4.19.160.939 I slot print_timing: id 3 | task 3096 | n_decoded = 976, tg = 17.00 t/s, tg_3s = 16.60 t/s
4.22.161.265 I slot print_timing: id 3 | task 3096 | n_decoded = 1026, tg = 16.99 t/s, tg_3s = 16.66 t/s
4.25.163.271 I slot print_timing: id 3 | task 3096 | n_decoded = 1076, tg = 16.97 t/s, tg_3s = 16.66 t/s
4.28.163.381 I slot print_timing: id 3 | task 3096 | n_decoded = 1126, tg = 16.96 t/s, tg_3s = 16.67 t/s
4.31.223.296 I slot print_timing: id 3 | task 3096 | n_decoded = 1177, tg = 16.95 t/s, tg_3s = 16.67 t/s
4.34.232.315 I slot print_timing: id 3 | task 3096 | n_decoded = 1227, tg = 16.93 t/s, tg_3s = 16.62 t/s
4.36.095.257 I slot print_timing: id 3 | task 3096 | prompt eval time = 326.08 ms / 21 tokens ( 15.53 ms per token, 64.40 tokens per second)
4.36.095.260 I slot print_timing: id 3 | task 3096 | eval time = 74329.42 ms / 1258 tokens ( 59.09 ms per token, 16.92 tokens per second)
4.36.095.261 I slot print_timing: id 3 | task 3096 | total time = 74655.50 ms / 1279 tokens
4.36.095.262 I slot print_timing: id 3 | task 3096 | graphs reused = 4321
4.36.095.301 I slot release: id 3 | task 3096 | stop processing: n_tokens = 1350, truncated = 0
4.36.095.314 I srv update_slots: all slots are idle
4.36.098.387 I srv operator(): Chat format: peg-gemma4
4.36.098.726 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.717 (> 0.100 thold), f_keep = 0.056
4.36.098.728 I srv get_availabl: updating prompt cache
4.36.098.821 W srv prompt_save: - saving prompt with length 1350, total state size = 905.497 MiB (draft: 0.000 MiB)
4.36.726.543 I srv load: - looking for better prompt, base f_keep = 0.056, sim = 0.717
4.36.726.550 I srv update: - cache state: 4 prompts, 3400.890 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
4.36.726.551 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB
4.36.726.552 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB
4.36.726.552 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB
4.36.726.553 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB
4.36.726.554 I srv get_availabl: prompt cache update took 627.83 ms
4.36.726.613 I slot launch_slot_: id 3 | task 4357 | processing task, is_child = 0
4.36.726.614 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
4.36.726.615 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
4.36.726.634 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
4.36.726.634 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
4.36.726.646 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
4.36.726.646 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
4.36.726.664 I slot update_slots: id 3 | task 4357 | Checking checkpoint with [0, 72] against 0...
4.36.745.738 W slot update_slots: id 3 | task 4357 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
4.42.949.040 I slot print_timing: id 3 | task 4357 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s
4.45.966.629 I slot print_timing: id 3 | task 4357 | n_decoded = 152, tg = 17.34 t/s, tg_3s = 17.23 t/s
4.48.999.262 I slot print_timing: id 3 | task 4357 | n_decoded = 204, tg = 17.29 t/s, tg_3s = 17.15 t/s
4.52.033.412 I slot print_timing: id 3 | task 4357 | n_decoded = 256, tg = 17.26 t/s, tg_3s = 17.14 t/s
4.55.064.692 I slot print_timing: id 3 | task 4357 | n_decoded = 308, tg = 17.24 t/s, tg_3s = 17.15 t/s
4.58.100.715 I slot print_timing: id 3 | task 4357 | n_decoded = 360, tg = 17.22 t/s, tg_3s = 17.13 t/s
5.01.149.940 I slot print_timing: id 3 | task 4357 | n_decoded = 412, tg = 17.20 t/s, tg_3s = 17.05 t/s
5.04.204.546 I slot print_timing: id 3 | task 4357 | n_decoded = 464, tg = 17.18 t/s, tg_3s = 17.02 t/s
5.07.262.908 I slot print_timing: id 3 | task 4357 | n_decoded = 516, tg = 17.16 t/s, tg_3s = 17.00 t/s
5.10.266.002 I slot print_timing: id 3 | task 4357 | n_decoded = 567, tg = 17.15 t/s, tg_3s = 16.98 t/s
5.13.271.508 I slot print_timing: id 3 | task 4357 | n_decoded = 618, tg = 17.13 t/s, tg_3s = 16.97 t/s
5.16.287.016 I slot print_timing: id 3 | task 4357 | n_decoded = 669, tg = 17.12 t/s, tg_3s = 16.91 t/s
5.19.337.934 I slot print_timing: id 3 | task 4357 | n_decoded = 720, tg = 17.09 t/s, tg_3s = 16.72 t/s
5.22.375.615 I slot print_timing: id 3 | task 4357 | n_decoded = 771, tg = 17.07 t/s, tg_3s = 16.79 t/s
5.25.410.651 I slot print_timing: id 3 | task 4357 | n_decoded = 822, tg = 17.05 t/s, tg_3s = 16.80 t/s
5.28.445.978 I slot print_timing: id 3 | task 4357 | n_decoded = 873, tg = 17.04 t/s, tg_3s = 16.80 t/s
5.31.492.878 I slot print_timing: id 3 | task 4357 | n_decoded = 924, tg = 17.02 t/s, tg_3s = 16.74 t/s
5.34.550.811 I slot print_timing: id 3 | task 4357 | n_decoded = 975, tg = 17.00 t/s, tg_3s = 16.68 t/s
5.37.610.835 I slot print_timing: id 3 | task 4357 | n_decoded = 1026, tg = 16.98 t/s, tg_3s = 16.67 t/s
5.40.611.009 I slot print_timing: id 3 | task 4357 | n_decoded = 1076, tg = 16.97 t/s, tg_3s = 16.67 t/s
5.43.669.837 I slot print_timing: id 3 | task 4357 | n_decoded = 1127, tg = 16.95 t/s, tg_3s = 16.67 t/s
5.46.679.825 I slot print_timing: id 3 | task 4357 | n_decoded = 1177, tg = 16.94 t/s, tg_3s = 16.61 t/s
5.49.695.207 I slot print_timing: id 3 | task 4357 | n_decoded = 1227, tg = 16.93 t/s, tg_3s = 16.58 t/s
5.52.712.281 I slot print_timing: id 3 | task 4357 | n_decoded = 1277, tg = 16.91 t/s, tg_3s = 16.57 t/s
5.55.730.387 I slot print_timing: id 3 | task 4357 | n_decoded = 1327, tg = 16.90 t/s, tg_3s = 16.57 t/s
5.58.747.343 I slot print_timing: id 3 | task 4357 | n_decoded = 1377, tg = 16.89 t/s, tg_3s = 16.57 t/s
6.01.769.637 I slot print_timing: id 3 | task 4357 | n_decoded = 1427, tg = 16.87 t/s, tg_3s = 16.54 t/s
6.04.812.628 I slot print_timing: id 3 | task 4357 | n_decoded = 1477, tg = 16.86 t/s, tg_3s = 16.43 t/s
6.07.856.101 I slot print_timing: id 3 | task 4357 | n_decoded = 1527, tg = 16.84 t/s, tg_3s = 16.43 t/s
6.10.890.004 I slot print_timing: id 3 | task 4357 | n_decoded = 1577, tg = 16.83 t/s, tg_3s = 16.48 t/s
6.13.915.034 I slot print_timing: id 3 | task 4357 | n_decoded = 1627, tg = 16.82 t/s, tg_3s = 16.53 t/s
6.16.813.577 I slot print_timing: id 3 | task 4357 | prompt eval time = 472.57 ms / 34 tokens ( 13.90 ms per token, 71.95 tokens per second)
6.16.813.580 I slot print_timing: id 3 | task 4357 | eval time = 99614.34 ms / 1675 tokens ( 59.47 ms per token, 16.81 tokens per second)
6.16.813.581 I slot print_timing: id 3 | task 4357 | total time = 100086.91 ms / 1709 tokens
6.16.813.582 I slot print_timing: id 3 | task 4357 | graphs reused = 5988
6.16.813.620 I slot release: id 3 | task 4357 | stop processing: n_tokens = 1780, truncated = 0
6.16.813.635 I srv update_slots: all slots are idle
6.16.816.293 I srv operator(): Chat format: peg-gemma4
6.16.816.633 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.800 (> 0.100 thold), f_keep = 0.043
6.16.816.635 I srv get_availabl: updating prompt cache
6.16.816.762 W srv prompt_save: - saving prompt with length 1780, total state size = 939.096 MiB (draft: 0.000 MiB)
6.17.467.166 I srv load: - looking for better prompt, base f_keep = 0.043, sim = 0.800
6.17.467.173 I srv update: - cache state: 5 prompts, 4397.019 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
6.17.467.174 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB
6.17.467.174 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB
6.17.467.175 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB
6.17.467.176 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB
6.17.467.176 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB
6.17.467.178 I srv get_availabl: prompt cache update took 650.54 ms
6.17.467.241 I slot launch_slot_: id 3 | task 6035 | processing task, is_child = 0
6.17.467.242 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
6.17.467.242 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
6.17.467.265 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
6.17.467.265 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
6.17.467.277 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
6.17.467.277 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
6.17.467.298 I slot update_slots: id 3 | task 6035 | Checking checkpoint with [0, 72] against 0...
6.17.486.209 W slot update_slots: id 3 | task 6035 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
6.23.639.141 I slot print_timing: id 3 | task 6035 | n_decoded = 100, tg = 17.40 t/s, tg_3s = 17.40 t/s
6.26.653.061 I slot print_timing: id 3 | task 6035 | n_decoded = 152, tg = 17.35 t/s, tg_3s = 17.25 t/s
6.29.682.664 I slot print_timing: id 3 | task 6035 | n_decoded = 204, tg = 17.30 t/s, tg_3s = 17.16 t/s
6.32.709.166 I slot print_timing: id 3 | task 6035 | n_decoded = 256, tg = 17.28 t/s, tg_3s = 17.18 t/s
6.35.734.709 I slot print_timing: id 3 | task 6035 | n_decoded = 308, tg = 17.26 t/s, tg_3s = 17.19 t/s
6.38.763.551 I slot print_timing: id 3 | task 6035 | n_decoded = 360, tg = 17.25 t/s, tg_3s = 17.17 t/s
6.41.801.113 I slot print_timing: id 3 | task 6035 | n_decoded = 412, tg = 17.23 t/s, tg_3s = 17.12 t/s
6.44.806.412 I slot print_timing: id 3 | task 6035 | n_decoded = 463, tg = 17.20 t/s, tg_3s = 16.97 t/s
6.47.811.419 I slot print_timing: id 3 | task 6035 | n_decoded = 514, tg = 17.18 t/s, tg_3s = 16.97 t/s
6.50.825.419 I slot print_timing: id 3 | task 6035 | n_decoded = 565, tg = 17.16 t/s, tg_3s = 16.92 t/s
6.53.836.452 I slot print_timing: id 3 | task 6035 | n_decoded = 616, tg = 17.14 t/s, tg_3s = 16.94 t/s
6.56.848.527 I slot print_timing: id 3 | task 6035 | n_decoded = 667, tg = 17.12 t/s, tg_3s = 16.93 t/s
6.59.892.588 I slot print_timing: id 3 | task 6035 | n_decoded = 718, tg = 17.10 t/s, tg_3s = 16.75 t/s
7.02.923.604 I slot print_timing: id 3 | task 6035 | n_decoded = 769, tg = 17.08 t/s, tg_3s = 16.83 t/s
7.05.957.888 I slot print_timing: id 3 | task 6035 | n_decoded = 820, tg = 17.06 t/s, tg_3s = 16.81 t/s
7.08.991.635 I slot print_timing: id 3 | task 6035 | n_decoded = 871, tg = 17.05 t/s, tg_3s = 16.81 t/s
7.12.032.691 I slot print_timing: id 3 | task 6035 | n_decoded = 922, tg = 17.03 t/s, tg_3s = 16.77 t/s
7.15.033.158 I slot print_timing: id 3 | task 6035 | n_decoded = 972, tg = 17.01 t/s, tg_3s = 16.66 t/s
7.18.084.039 I slot print_timing: id 3 | task 6035 | n_decoded = 1023, tg = 17.00 t/s, tg_3s = 16.72 t/s
7.21.085.576 I slot print_timing: id 3 | task 6035 | n_decoded = 1073, tg = 16.98 t/s, tg_3s = 16.66 t/s
7.21.265.598 I slot print_timing: id 3 | task 6035 | prompt eval time = 425.41 ms / 23 tokens ( 18.50 ms per token, 54.07 tokens per second)
7.21.265.602 I slot print_timing: id 3 | task 6035 | eval time = 63372.88 ms / 1076 tokens ( 58.90 ms per token, 16.98 tokens per second)
7.21.265.602 I slot print_timing: id 3 | task 6035 | total time = 63798.29 ms / 1099 tokens
7.21.265.603 I slot print_timing: id 3 | task 6035 | graphs reused = 7058
7.21.265.639 I slot release: id 3 | task 6035 | stop processing: n_tokens = 1170, truncated = 0
7.21.265.656 I srv update_slots: all slots are idle
7.21.268.349 I srv operator(): Chat format: peg-gemma4
7.21.268.676 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.846 (> 0.100 thold), f_keep = 0.066
7.21.268.678 I srv get_availabl: updating prompt cache
7.21.268.762 W srv prompt_save: - saving prompt with length 1170, total state size = 891.433 MiB (draft: 0.000 MiB)
7.21.878.086 I srv load: - looking for better prompt, base f_keep = 0.066, sim = 0.846
7.21.878.094 I srv update: - cache state: 6 prompts, 5345.485 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
7.21.878.095 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB
7.21.878.095 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB
7.21.878.096 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB
7.21.878.097 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB
7.21.878.097 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB
7.21.878.098 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB
7.21.878.099 I srv get_availabl: prompt cache update took 609.42 ms
7.21.878.160 I slot launch_slot_: id 3 | task 7114 | processing task, is_child = 0
7.21.878.161 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
7.21.878.162 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
7.21.878.179 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
7.21.878.180 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
7.21.878.191 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
7.21.878.192 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
7.21.878.210 I slot update_slots: id 3 | task 7114 | Checking checkpoint with [0, 72] against 0...
7.21.896.853 W slot update_slots: id 3 | task 7114 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
7.27.948.017 I slot print_timing: id 3 | task 7114 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s
7.30.965.064 I slot print_timing: id 3 | task 7114 | n_decoded = 152, tg = 17.34 t/s, tg_3s = 17.24 t/s
7.34.011.139 I slot print_timing: id 3 | task 7114 | n_decoded = 204, tg = 17.27 t/s, tg_3s = 17.07 t/s
7.37.057.334 I slot print_timing: id 3 | task 7114 | n_decoded = 256, tg = 17.23 t/s, tg_3s = 17.07 t/s
7.40.098.158 I slot print_timing: id 3 | task 7114 | n_decoded = 308, tg = 17.21 t/s, tg_3s = 17.10 t/s
7.43.140.431 I slot print_timing: id 3 | task 7114 | n_decoded = 360, tg = 17.19 t/s, tg_3s = 17.09 t/s
7.46.186.036 I slot print_timing: id 3 | task 7114 | n_decoded = 412, tg = 17.18 t/s, tg_3s = 17.07 t/s
7.49.202.254 I slot print_timing: id 3 | task 7114 | n_decoded = 463, tg = 17.15 t/s, tg_3s = 16.91 t/s
7.52.209.234 I slot print_timing: id 3 | task 7114 | n_decoded = 514, tg = 17.13 t/s, tg_3s = 16.96 t/s
7.55.253.745 I slot print_timing: id 3 | task 7114 | n_decoded = 566, tg = 17.12 t/s, tg_3s = 17.08 t/s
7.58.296.322 I slot print_timing: id 3 | task 7114 | n_decoded = 618, tg = 17.12 t/s, tg_3s = 17.09 t/s
8.01.349.679 I slot print_timing: id 3 | task 7114 | n_decoded = 670, tg = 17.11 t/s, tg_3s = 17.03 t/s
8.04.389.768 I slot print_timing: id 3 | task 7114 | n_decoded = 721, tg = 17.09 t/s, tg_3s = 16.78 t/s
8.07.424.704 I slot print_timing: id 3 | task 7114 | n_decoded = 772, tg = 17.07 t/s, tg_3s = 16.80 t/s
8.10.466.861 I slot print_timing: id 3 | task 7114 | n_decoded = 823, tg = 17.05 t/s, tg_3s = 16.76 t/s
8.13.505.693 I slot print_timing: id 3 | task 7114 | n_decoded = 874, tg = 17.03 t/s, tg_3s = 16.78 t/s
8.16.546.166 I slot print_timing: id 3 | task 7114 | n_decoded = 925, tg = 17.02 t/s, tg_3s = 16.77 t/s
8.19.552.166 I slot print_timing: id 3 | task 7114 | n_decoded = 975, tg = 17.00 t/s, tg_3s = 16.63 t/s
8.22.552.258 I slot print_timing: id 3 | task 7114 | n_decoded = 1025, tg = 16.98 t/s, tg_3s = 16.67 t/s
8.25.554.307 I slot print_timing: id 3 | task 7114 | n_decoded = 1075, tg = 16.97 t/s, tg_3s = 16.66 t/s
8.28.613.292 I slot print_timing: id 3 | task 7114 | n_decoded = 1126, tg = 16.95 t/s, tg_3s = 16.67 t/s
8.31.618.166 I slot print_timing: id 3 | task 7114 | n_decoded = 1176, tg = 16.94 t/s, tg_3s = 16.64 t/s
8.34.631.545 I slot print_timing: id 3 | task 7114 | n_decoded = 1226, tg = 16.93 t/s, tg_3s = 16.59 t/s
8.34.993.139 I slot print_timing: id 3 | task 7114 | prompt eval time = 320.89 ms / 19 tokens ( 16.89 ms per token, 59.21 tokens per second)
8.34.993.142 I slot print_timing: id 3 | task 7114 | eval time = 72794.03 ms / 1232 tokens ( 59.09 ms per token, 16.92 tokens per second)
8.34.993.144 I slot print_timing: id 3 | task 7114 | total time = 73114.92 ms / 1251 tokens
8.34.993.144 I slot print_timing: id 3 | task 7114 | graphs reused = 8283
8.34.993.181 I slot release: id 3 | task 7114 | stop processing: n_tokens = 1322, truncated = 0
8.34.993.193 I srv update_slots: all slots are idle
8.34.995.973 I srv operator(): Chat format: peg-gemma4
8.34.996.297 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.828 (> 0.100 thold), f_keep = 0.058
8.34.996.299 I srv get_availabl: updating prompt cache
8.34.996.389 W srv prompt_save: - saving prompt with length 1322, total state size = 903.310 MiB (draft: 0.000 MiB)
8.35.614.159 I srv load: - looking for better prompt, base f_keep = 0.058, sim = 0.828
8.35.614.170 I srv update: - cache state: 7 prompts, 6305.828 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
8.35.614.171 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB
8.35.614.172 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB
8.35.614.172 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB
8.35.614.173 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB
8.35.614.173 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB
8.35.614.174 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB
8.35.614.174 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB
8.35.614.175 I srv get_availabl: prompt cache update took 617.88 ms
8.35.614.232 I slot launch_slot_: id 3 | task 8349 | processing task, is_child = 0
8.35.614.233 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
8.35.614.234 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
8.35.614.254 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
8.35.614.254 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
8.35.614.266 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
8.35.614.266 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
8.35.614.285 I slot update_slots: id 3 | task 8349 | Checking checkpoint with [0, 72] against 0...
8.35.633.164 W slot update_slots: id 3 | task 8349 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
8.41.683.553 I slot print_timing: id 3 | task 8349 | n_decoded = 100, tg = 17.41 t/s, tg_3s = 17.41 t/s
8.44.689.539 I slot print_timing: id 3 | task 8349 | n_decoded = 152, tg = 17.37 t/s, tg_3s = 17.30 t/s
8.47.719.671 I slot print_timing: id 3 | task 8349 | n_decoded = 204, tg = 17.32 t/s, tg_3s = 17.16 t/s
8.50.748.165 I slot print_timing: id 3 | task 8349 | n_decoded = 256, tg = 17.29 t/s, tg_3s = 17.17 t/s
8.53.778.158 I slot print_timing: id 3 | task 8349 | n_decoded = 308, tg = 17.27 t/s, tg_3s = 17.16 t/s
8.56.812.744 I slot print_timing: id 3 | task 8349 | n_decoded = 360, tg = 17.25 t/s, tg_3s = 17.14 t/s
8.59.843.945 I slot print_timing: id 3 | task 8349 | n_decoded = 412, tg = 17.24 t/s, tg_3s = 17.15 t/s
9.02.853.083 I slot print_timing: id 3 | task 8349 | n_decoded = 463, tg = 17.20 t/s, tg_3s = 16.95 t/s
9.05.855.084 I slot print_timing: id 3 | task 8349 | n_decoded = 514, tg = 17.18 t/s, tg_3s = 16.99 t/s
9.08.862.087 I slot print_timing: id 3 | task 8349 | n_decoded = 565, tg = 17.16 t/s, tg_3s = 16.96 t/s
9.11.870.079 I slot print_timing: id 3 | task 8349 | n_decoded = 616, tg = 17.14 t/s, tg_3s = 16.95 t/s
9.14.878.199 I slot print_timing: id 3 | task 8349 | n_decoded = 667, tg = 17.13 t/s, tg_3s = 16.95 t/s
9.17.928.064 I slot print_timing: id 3 | task 8349 | n_decoded = 718, tg = 17.10 t/s, tg_3s = 16.72 t/s
9.20.976.933 I slot print_timing: id 3 | task 8349 | n_decoded = 769, tg = 17.08 t/s, tg_3s = 16.73 t/s
9.24.028.107 I slot print_timing: id 3 | task 8349 | n_decoded = 820, tg = 17.05 t/s, tg_3s = 16.71 t/s
9.27.075.381 I slot print_timing: id 3 | task 8349 | n_decoded = 871, tg = 17.03 t/s, tg_3s = 16.74 t/s
9.30.075.423 I slot print_timing: id 3 | task 8349 | n_decoded = 921, tg = 17.01 t/s, tg_3s = 16.67 t/s
9.33.080.147 I slot print_timing: id 3 | task 8349 | n_decoded = 971, tg = 16.99 t/s, tg_3s = 16.64 t/s
9.36.127.216 I slot print_timing: id 3 | task 8349 | n_decoded = 1022, tg = 16.98 t/s, tg_3s = 16.74 t/s
9.39.175.833 I slot print_timing: id 3 | task 8349 | n_decoded = 1073, tg = 16.97 t/s, tg_3s = 16.73 t/s
9.42.228.561 I slot print_timing: id 3 | task 8349 | n_decoded = 1124, tg = 16.96 t/s, tg_3s = 16.71 t/s
9.42.826.238 I slot print_timing: id 3 | task 8349 | prompt eval time = 326.31 ms / 21 tokens ( 15.54 ms per token, 64.36 tokens per second)
9.42.826.241 I slot print_timing: id 3 | task 8349 | eval time = 66885.64 ms / 1134 tokens ( 58.98 ms per token, 16.95 tokens per second)
9.42.826.241 I slot print_timing: id 3 | task 8349 | total time = 67211.95 ms / 1155 tokens
9.42.826.242 I slot print_timing: id 3 | task 8349 | graphs reused = 9411
9.42.826.279 I slot release: id 3 | task 8349 | stop processing: n_tokens = 1226, truncated = 0
9.42.826.290 I srv update_slots: all slots are idle
9.42.829.021 I srv operator(): Chat format: peg-gemma4
9.42.829.360 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.613 (> 0.100 thold), f_keep = 0.062
9.42.829.362 I srv get_availabl: updating prompt cache
9.42.829.447 W srv prompt_save: - saving prompt with length 1226, total state size = 895.808 MiB (draft: 0.000 MiB)
9.43.447.532 I srv load: - looking for better prompt, base f_keep = 0.062, sim = 0.613
9.43.447.544 I srv update: - cache state: 8 prompts, 7258.670 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
9.43.447.545 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB
9.43.447.546 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB
9.43.447.547 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB
9.43.447.548 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB
9.43.447.549 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB
9.43.447.550 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB
9.43.447.550 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB
9.43.447.551 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB
9.43.447.552 I srv get_availabl: prompt cache update took 618.19 ms
9.43.447.618 I slot launch_slot_: id 3 | task 9486 | processing task, is_child = 0
9.43.447.619 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
9.43.447.620 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
9.43.447.651 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
9.43.447.651 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
9.43.447.672 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
9.43.447.673 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
9.43.447.702 I slot update_slots: id 3 | task 9486 | Checking checkpoint with [0, 72] against 0...
9.43.466.658 W slot update_slots: id 3 | task 9486 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
9.49.662.812 I slot print_timing: id 3 | task 9486 | n_decoded = 100, tg = 17.38 t/s, tg_3s = 17.38 t/s
9.52.692.402 I slot print_timing: id 3 | task 9486 | n_decoded = 152, tg = 17.30 t/s, tg_3s = 17.16 t/s
9.55.725.975 I slot print_timing: id 3 | task 9486 | n_decoded = 204, tg = 17.26 t/s, tg_3s = 17.14 t/s
9.58.766.177 I slot print_timing: id 3 | task 9486 | n_decoded = 256, tg = 17.23 t/s, tg_3s = 17.10 t/s
10.01.804.164 I slot print_timing: id 3 | task 9486 | n_decoded = 308, tg = 17.21 t/s, tg_3s = 17.12 t/s
10.04.845.486 I slot print_timing: id 3 | task 9486 | n_decoded = 360, tg = 17.19 t/s, tg_3s = 17.10 t/s
10.07.849.324 I slot print_timing: id 3 | task 9486 | n_decoded = 411, tg = 17.17 t/s, tg_3s = 16.98 t/s
10.10.861.267 I slot print_timing: id 3 | task 9486 | n_decoded = 462, tg = 17.14 t/s, tg_3s = 16.93 t/s
10.13.871.462 I slot print_timing: id 3 | task 9486 | n_decoded = 513, tg = 17.12 t/s, tg_3s = 16.94 t/s
10.16.880.466 I slot print_timing: id 3 | task 9486 | n_decoded = 564, tg = 17.11 t/s, tg_3s = 16.95 t/s
10.19.937.896 I slot print_timing: id 3 | task 9486 | n_decoded = 616, tg = 17.10 t/s, tg_3s = 17.01 t/s
10.22.777.687 I slot print_timing: id 3 | task 9486 | prompt eval time = 460.47 ms / 52 tokens ( 8.86 ms per token, 112.93 tokens per second)
10.22.777.690 I slot print_timing: id 3 | task 9486 | eval time = 38869.51 ms / 664 tokens ( 58.54 ms per token, 17.08 tokens per second)
10.22.777.691 I slot print_timing: id 3 | task 9486 | total time = 39329.98 ms / 716 tokens
10.22.777.692 I slot print_timing: id 3 | task 9486 | graphs reused = 10070
10.22.777.735 I slot release: id 3 | task 9486 | stop processing: n_tokens = 787, truncated = 0
10.22.777.747 I srv update_slots: all slots are idle
10.22.780.564 I srv operator(): Chat format: peg-gemma4
10.22.780.898 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.538 (> 0.100 thold), f_keep = 0.098
10.22.780.899 I srv get_availabl: updating prompt cache
10.22.780.974 W srv prompt_save: - saving prompt with length 787, total state size = 676.348 MiB (draft: 0.000 MiB)
10.23.258.403 I srv load: - looking for better prompt, base f_keep = 0.098, sim = 0.538
10.23.258.414 I srv update: - cache state: 9 prompts, 7992.050 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
10.23.258.415 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB
10.23.258.416 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB
10.23.258.417 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB
10.23.258.417 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB
10.23.258.418 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB
10.23.258.419 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB
10.23.258.419 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB
10.23.258.420 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB
10.23.258.421 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB
10.23.258.422 I srv get_availabl: prompt cache update took 477.52 ms
10.23.258.491 I slot launch_slot_: id 3 | task 10153 | processing task, is_child = 0
10.23.258.492 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
10.23.258.493 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
10.23.258.521 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
10.23.258.522 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
10.23.258.550 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
10.23.258.551 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
10.23.258.588 I slot update_slots: id 3 | task 10153 | Checking checkpoint with [0, 72] against 0...
10.23.277.379 W slot update_slots: id 3 | task 10153 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
10.29.741.510 I slot print_timing: id 3 | task 10153 | n_decoded = 100, tg = 17.42 t/s, tg_3s = 17.42 t/s
10.32.771.906 I slot print_timing: id 3 | task 10153 | n_decoded = 152, tg = 17.33 t/s, tg_3s = 17.16 t/s
10.35.794.733 I slot print_timing: id 3 | task 10153 | n_decoded = 204, tg = 17.30 t/s, tg_3s = 17.20 t/s
10.38.822.701 I slot print_timing: id 3 | task 10153 | n_decoded = 256, tg = 17.27 t/s, tg_3s = 17.17 t/s
10.41.854.994 I slot print_timing: id 3 | task 10153 | n_decoded = 308, tg = 17.25 t/s, tg_3s = 17.15 t/s
10.44.884.095 I slot print_timing: id 3 | task 10153 | n_decoded = 360, tg = 17.24 t/s, tg_3s = 17.17 t/s
10.47.885.759 I slot print_timing: id 3 | task 10153 | n_decoded = 411, tg = 17.21 t/s, tg_3s = 16.99 t/s
10.50.889.101 I slot print_timing: id 3 | task 10153 | n_decoded = 462, tg = 17.18 t/s, tg_3s = 16.98 t/s
10.53.896.124 I slot print_timing: id 3 | task 10153 | n_decoded = 513, tg = 17.16 t/s, tg_3s = 16.96 t/s
10.56.902.188 I slot print_timing: id 3 | task 10153 | n_decoded = 564, tg = 17.14 t/s, tg_3s = 16.97 t/s
10.59.908.913 I slot print_timing: id 3 | task 10153 | n_decoded = 615, tg = 17.13 t/s, tg_3s = 16.96 t/s
11.02.964.312 I slot print_timing: id 3 | task 10153 | n_decoded = 666, tg = 17.09 t/s, tg_3s = 16.69 t/s
11.05.964.367 I slot print_timing: id 3 | task 10153 | n_decoded = 716, tg = 17.06 t/s, tg_3s = 16.67 t/s
11.08.969.369 I slot print_timing: id 3 | task 10153 | n_decoded = 766, tg = 17.03 t/s, tg_3s = 16.64 t/s
11.12.027.457 I slot print_timing: id 3 | task 10153 | n_decoded = 817, tg = 17.01 t/s, tg_3s = 16.68 t/s
11.15.061.405 I slot print_timing: id 3 | task 10153 | n_decoded = 868, tg = 17.00 t/s, tg_3s = 16.81 t/s
11.18.114.457 I slot print_timing: id 3 | task 10153 | n_decoded = 919, tg = 16.98 t/s, tg_3s = 16.70 t/s
11.21.170.099 I slot print_timing: id 3 | task 10153 | n_decoded = 970, tg = 16.97 t/s, tg_3s = 16.69 t/s
11.21.289.803 I slot print_timing: id 3 | task 10153 | prompt eval time = 741.65 ms / 71 tokens ( 10.45 ms per token, 95.73 tokens per second)
11.21.289.806 I slot print_timing: id 3 | task 10153 | eval time = 57289.56 ms / 972 tokens ( 58.94 ms per token, 16.97 tokens per second)
11.21.289.807 I slot print_timing: id 3 | task 10153 | total time = 58031.21 ms / 1043 tokens
11.21.289.808 I slot print_timing: id 3 | task 10153 | graphs reused = 11036
11.21.289.850 I slot release: id 3 | task 10153 | stop processing: n_tokens = 1114, truncated = 0
11.21.289.862 I srv update_slots: all slots are idle
11.21.292.582 I srv operator(): Chat format: peg-gemma4
11.21.292.916 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.667 (> 0.100 thold), f_keep = 0.068
11.21.292.918 I srv get_availabl: updating prompt cache
11.21.293.005 W srv prompt_save: - saving prompt with length 1114, total state size = 887.057 MiB (draft: 0.000 MiB)
11.21.900.031 I srv load: - looking for better prompt, base f_keep = 0.068, sim = 0.667
11.21.900.042 W srv update: - cache size limit reached, removing oldest entry (size = 999.958 MiB)
11.21.997.934 I srv update: - cache state: 9 prompts, 7936.183 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
11.21.997.940 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB
11.21.997.940 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB
11.21.997.941 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB
11.21.997.942 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB
11.21.997.943 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB
11.21.997.944 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB
11.21.997.945 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB
11.21.997.945 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB
11.21.997.946 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB
11.21.997.948 I srv get_availabl: prompt cache update took 705.03 ms
11.21.998.024 I slot launch_slot_: id 3 | task 11128 | processing task, is_child = 0
11.21.998.025 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
11.21.998.025 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
11.21.998.046 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
11.21.998.046 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
11.21.998.061 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
11.21.998.061 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
11.21.998.085 I slot update_slots: id 3 | task 11128 | Checking checkpoint with [0, 72] against 0...
11.22.017.469 W slot update_slots: id 3 | task 11128 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
11.28.234.769 I slot print_timing: id 3 | task 11128 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s
11.31.261.236 I slot print_timing: id 3 | task 11128 | n_decoded = 152, tg = 17.32 t/s, tg_3s = 17.18 t/s
11.34.297.302 I slot print_timing: id 3 | task 11128 | n_decoded = 204, tg = 17.27 t/s, tg_3s = 17.13 t/s
11.37.332.101 I slot print_timing: id 3 | task 11128 | n_decoded = 256, tg = 17.24 t/s, tg_3s = 17.13 t/s
11.40.372.127 I slot print_timing: id 3 | task 11128 | n_decoded = 308, tg = 17.22 t/s, tg_3s = 17.11 t/s
11.43.413.001 I slot print_timing: id 3 | task 11128 | n_decoded = 360, tg = 17.20 t/s, tg_3s = 17.10 t/s
11.46.469.122 I slot print_timing: id 3 | task 11128 | n_decoded = 412, tg = 17.18 t/s, tg_3s = 17.02 t/s
11.49.476.201 I slot print_timing: id 3 | task 11128 | n_decoded = 463, tg = 17.15 t/s, tg_3s = 16.96 t/s
11.52.484.188 I slot print_timing: id 3 | task 11128 | n_decoded = 514, tg = 17.13 t/s, tg_3s = 16.95 t/s
11.55.493.334 I slot print_timing: id 3 | task 11128 | n_decoded = 565, tg = 17.12 t/s, tg_3s = 16.95 t/s
11.58.497.185 I slot print_timing: id 3 | task 11128 | n_decoded = 616, tg = 17.10 t/s, tg_3s = 16.98 t/s
12.01.498.221 I slot print_timing: id 3 | task 11128 | n_decoded = 667, tg = 17.10 t/s, tg_3s = 16.99 t/s
12.04.531.641 I slot print_timing: id 3 | task 11128 | n_decoded = 718, tg = 17.08 t/s, tg_3s = 16.81 t/s
12.07.565.272 I slot print_timing: id 3 | task 11128 | n_decoded = 769, tg = 17.06 t/s, tg_3s = 16.81 t/s
12.10.599.423 I slot print_timing: id 3 | task 11128 | n_decoded = 820, tg = 17.04 t/s, tg_3s = 16.81 t/s
12.13.640.084 I slot print_timing: id 3 | task 11128 | n_decoded = 871, tg = 17.03 t/s, tg_3s = 16.77 t/s
12.16.689.346 I slot print_timing: id 3 | task 11128 | n_decoded = 922, tg = 17.01 t/s, tg_3s = 16.73 t/s
12.19.690.368 I slot print_timing: id 3 | task 11128 | n_decoded = 972, tg = 16.99 t/s, tg_3s = 16.66 t/s
12.22.747.653 I slot print_timing: id 3 | task 11128 | n_decoded = 1023, tg = 16.98 t/s, tg_3s = 16.68 t/s
12.25.805.502 I slot print_timing: id 3 | task 11128 | n_decoded = 1074, tg = 16.96 t/s, tg_3s = 16.68 t/s
12.28.864.503 I slot print_timing: id 3 | task 11128 | n_decoded = 1125, tg = 16.95 t/s, tg_3s = 16.67 t/s
12.31.874.430 I slot print_timing: id 3 | task 11128 | n_decoded = 1175, tg = 16.93 t/s, tg_3s = 16.61 t/s
12.34.823.805 I slot print_timing: id 3 | task 11128 | prompt eval time = 485.94 ms / 42 tokens ( 11.57 ms per token, 86.43 tokens per second)
12.34.823.809 I slot print_timing: id 3 | task 11128 | eval time = 72339.77 ms / 1224 tokens ( 59.10 ms per token, 16.92 tokens per second)
12.34.823.810 I slot print_timing: id 3 | task 11128 | total time = 72825.72 ms / 1266 tokens
12.34.823.810 I slot print_timing: id 3 | task 11128 | graphs reused = 12253
12.34.823.843 I slot release: id 3 | task 11128 | stop processing: n_tokens = 1337, truncated = 0
12.34.823.855 I srv update_slots: all slots are idle
12.34.826.441 I srv operator(): Chat format: peg-gemma4
12.34.826.774 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.547 (> 0.100 thold), f_keep = 0.057
12.34.826.777 I srv get_availabl: updating prompt cache
12.34.826.882 W srv prompt_save: - saving prompt with length 1337, total state size = 904.482 MiB (draft: 0.000 MiB)
12.35.993.430 I srv load: - looking for better prompt, base f_keep = 0.057, sim = 0.547
12.35.993.439 W srv update: - cache size limit reached, removing oldest entry (size = 824.477 MiB)
12.36.068.956 I srv update: - cache state: 9 prompts, 8073.221 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
12.36.068.961 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB
12.36.068.962 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB
12.36.068.963 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB
12.36.068.964 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB
12.36.068.965 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB
12.36.068.965 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB
12.36.068.966 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB
12.36.068.967 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB
12.36.068.968 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB
12.36.068.970 I srv get_availabl: prompt cache update took 1242.19 ms
12.36.069.053 I slot launch_slot_: id 3 | task 12355 | processing task, is_child = 0
12.36.069.054 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
12.36.069.056 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
12.36.069.081 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
12.36.069.082 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
12.36.069.097 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
12.36.069.097 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
12.36.069.124 I slot update_slots: id 3 | task 12355 | Checking checkpoint with [0, 72] against 0...
12.36.088.407 W slot update_slots: id 3 | task 12355 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
12.42.382.716 I slot print_timing: id 3 | task 12355 | n_decoded = 100, tg = 17.38 t/s, tg_3s = 17.38 t/s
12.45.419.030 I slot print_timing: id 3 | task 12355 | n_decoded = 152, tg = 17.30 t/s, tg_3s = 17.13 t/s
12.48.449.940 I slot print_timing: id 3 | task 12355 | n_decoded = 204, tg = 17.26 t/s, tg_3s = 17.16 t/s
12.51.481.992 I slot print_timing: id 3 | task 12355 | n_decoded = 256, tg = 17.24 t/s, tg_3s = 17.15 t/s
12.54.504.055 I slot print_timing: id 3 | task 12355 | n_decoded = 308, tg = 17.23 t/s, tg_3s = 17.21 t/s
12.57.521.132 I slot print_timing: id 3 | task 12355 | n_decoded = 360, tg = 17.23 t/s, tg_3s = 17.24 t/s
13.00.569.028 I slot print_timing: id 3 | task 12355 | n_decoded = 412, tg = 17.21 t/s, tg_3s = 17.06 t/s
13.03.613.366 I slot print_timing: id 3 | task 12355 | n_decoded = 464, tg = 17.20 t/s, tg_3s = 17.08 t/s
13.06.662.815 I slot print_timing: id 3 | task 12355 | n_decoded = 516, tg = 17.18 t/s, tg_3s = 17.05 t/s
13.09.712.375 I slot print_timing: id 3 | task 12355 | n_decoded = 568, tg = 17.17 t/s, tg_3s = 17.05 t/s
13.12.765.012 I slot print_timing: id 3 | task 12355 | n_decoded = 620, tg = 17.16 t/s, tg_3s = 17.03 t/s
13.15.809.509 I slot print_timing: id 3 | task 12355 | n_decoded = 671, tg = 17.13 t/s, tg_3s = 16.75 t/s
13.18.862.370 I slot print_timing: id 3 | task 12355 | n_decoded = 722, tg = 17.10 t/s, tg_3s = 16.71 t/s
13.21.019.344 I slot print_timing: id 3 | task 12355 | prompt eval time = 561.29 ms / 67 tokens ( 8.38 ms per token, 119.37 tokens per second)
13.21.019.348 I slot print_timing: id 3 | task 12355 | eval time = 44388.93 ms / 758 tokens ( 58.56 ms per token, 17.08 tokens per second)
13.21.019.349 I slot print_timing: id 3 | task 12355 | total time = 44950.22 ms / 825 tokens
13.21.019.350 I slot print_timing: id 3 | task 12355 | graphs reused = 13006
13.21.019.387 I slot release: id 3 | task 12355 | stop processing: n_tokens = 896, truncated = 0
13.21.019.398 I srv update_slots: all slots are idle
13.21.022.059 I srv operator(): Chat format: peg-gemma4
13.21.022.395 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.571 (> 0.100 thold), f_keep = 0.085
13.21.022.397 I srv get_availabl: updating prompt cache
13.21.022.477 W srv prompt_save: - saving prompt with length 896, total state size = 770.022 MiB (draft: 0.000 MiB)
13.21.723.288 I srv load: - looking for better prompt, base f_keep = 0.085, sim = 0.571
13.21.723.298 W srv update: - cache size limit reached, removing oldest entry (size = 613.924 MiB)
13.21.781.760 W srv update: - cache size limit reached, removing oldest entry (size = 962.531 MiB)
13.21.871.128 I srv update: - cache state: 8 prompts, 7323.821 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
13.21.871.132 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB
13.21.871.133 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB
13.21.871.134 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB
13.21.871.135 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB
13.21.871.135 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB
13.21.871.136 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB
13.21.871.137 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB
13.21.871.137 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB
13.21.871.139 I srv get_availabl: prompt cache update took 848.74 ms
13.21.871.213 I slot launch_slot_: id 3 | task 13116 | processing task, is_child = 0
13.21.871.214 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
13.21.871.214 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
13.21.871.233 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
13.21.871.233 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
13.21.871.244 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
13.21.871.245 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
13.21.871.264 I slot update_slots: id 3 | task 13116 | Checking checkpoint with [0, 72] against 0...
13.21.893.902 W slot update_slots: id 3 | task 13116 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
13.28.146.743 I slot print_timing: id 3 | task 13116 | n_decoded = 100, tg = 17.37 t/s, tg_3s = 17.37 t/s
13.31.185.244 I slot print_timing: id 3 | task 13116 | n_decoded = 152, tg = 17.28 t/s, tg_3s = 17.11 t/s
13.34.215.713 I slot print_timing: id 3 | task 13116 | n_decoded = 204, tg = 17.25 t/s, tg_3s = 17.16 t/s
13.37.239.978 I slot print_timing: id 3 | task 13116 | n_decoded = 256, tg = 17.24 t/s, tg_3s = 17.19 t/s
13.40.258.929 I slot print_timing: id 3 | task 13116 | n_decoded = 308, tg = 17.24 t/s, tg_3s = 17.22 t/s
13.43.277.395 I slot print_timing: id 3 | task 13116 | n_decoded = 360, tg = 17.23 t/s, tg_3s = 17.23 t/s
13.46.324.617 I slot print_timing: id 3 | task 13116 | n_decoded = 412, tg = 17.21 t/s, tg_3s = 17.06 t/s
13.49.368.762 I slot print_timing: id 3 | task 13116 | n_decoded = 464, tg = 17.20 t/s, tg_3s = 17.08 t/s
13.52.412.651 I slot print_timing: id 3 | task 13116 | n_decoded = 516, tg = 17.19 t/s, tg_3s = 17.08 t/s
13.55.456.612 I slot print_timing: id 3 | task 13116 | n_decoded = 568, tg = 17.18 t/s, tg_3s = 17.08 t/s
13.58.499.686 I slot print_timing: id 3 | task 13116 | n_decoded = 620, tg = 17.17 t/s, tg_3s = 17.09 t/s
14.01.532.223 I slot print_timing: id 3 | task 13116 | n_decoded = 671, tg = 17.14 t/s, tg_3s = 16.82 t/s
14.02.960.539 I slot print_timing: id 3 | task 13116 | prompt eval time = 517.59 ms / 61 tokens ( 8.49 ms per token, 117.85 tokens per second)
14.02.960.542 I slot print_timing: id 3 | task 13116 | eval time = 40571.68 ms / 695 tokens ( 58.38 ms per token, 17.13 tokens per second)
14.02.960.543 I slot print_timing: id 3 | task 13116 | total time = 41089.27 ms / 756 tokens
14.02.960.544 I slot print_timing: id 3 | task 13116 | graphs reused = 13696
14.02.960.583 I slot release: id 3 | task 13116 | stop processing: n_tokens = 827, truncated = 0
14.02.960.593 I srv update_slots: all slots are idle
14.02.963.437 I srv operator(): Chat format: peg-gemma4
14.02.963.769 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.631 (> 0.100 thold), f_keep = 0.093
14.02.963.771 I srv get_availabl: updating prompt cache
14.02.963.841 W srv prompt_save: - saving prompt with length 827, total state size = 710.723 MiB (draft: 0.000 MiB)
14.03.501.978 I srv load: - looking for better prompt, base f_keep = 0.093, sim = 0.631
14.03.501.988 I srv update: - cache state: 9 prompts, 8091.578 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
14.03.501.989 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB
14.03.501.990 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB
14.03.501.990 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB
14.03.501.991 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB
14.03.501.991 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB
14.03.501.992 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB
14.03.501.992 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB
14.03.501.993 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB
14.03.501.993 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB
14.03.501.994 I srv get_availabl: prompt cache update took 538.22 ms
14.03.502.056 I slot launch_slot_: id 3 | task 13814 | processing task, is_child = 0
14.03.502.057 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
14.03.502.058 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
14.03.502.077 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
14.03.502.077 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
14.03.502.088 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
14.03.502.089 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
14.03.502.108 I slot update_slots: id 3 | task 13814 | Checking checkpoint with [0, 72] against 0...
14.03.520.940 W slot update_slots: id 3 | task 13814 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
14.09.711.494 I slot print_timing: id 3 | task 13814 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s
14.12.744.005 I slot print_timing: id 3 | task 13814 | n_decoded = 152, tg = 17.31 t/s, tg_3s = 17.15 t/s
14.15.779.888 I slot print_timing: id 3 | task 13814 | n_decoded = 204, tg = 17.26 t/s, tg_3s = 17.13 t/s
14.18.819.432 I slot print_timing: id 3 | task 13814 | n_decoded = 256, tg = 17.23 t/s, tg_3s = 17.11 t/s
14.21.861.485 I slot print_timing: id 3 | task 13814 | n_decoded = 308, tg = 17.21 t/s, tg_3s = 17.09 t/s
14.24.904.410 I slot print_timing: id 3 | task 13814 | n_decoded = 360, tg = 17.19 t/s, tg_3s = 17.09 t/s
14.27.908.756 I slot print_timing: id 3 | task 13814 | n_decoded = 411, tg = 17.16 t/s, tg_3s = 16.98 t/s
14.30.919.749 I slot print_timing: id 3 | task 13814 | n_decoded = 462, tg = 17.14 t/s, tg_3s = 16.94 t/s
14.33.969.139 I slot print_timing: id 3 | task 13814 | n_decoded = 514, tg = 17.13 t/s, tg_3s = 17.05 t/s
14.37.015.199 I slot print_timing: id 3 | task 13814 | n_decoded = 566, tg = 17.12 t/s, tg_3s = 17.07 t/s
14.40.058.755 I slot print_timing: id 3 | task 13814 | n_decoded = 618, tg = 17.12 t/s, tg_3s = 17.09 t/s
14.43.077.627 I slot print_timing: id 3 | task 13814 | n_decoded = 669, tg = 17.10 t/s, tg_3s = 16.89 t/s
14.46.116.251 I slot print_timing: id 3 | task 13814 | n_decoded = 720, tg = 17.08 t/s, tg_3s = 16.78 t/s
14.49.169.611 I slot print_timing: id 3 | task 13814 | n_decoded = 771, tg = 17.05 t/s, tg_3s = 16.70 t/s
14.52.212.507 I slot print_timing: id 3 | task 13814 | n_decoded = 822, tg = 17.04 t/s, tg_3s = 16.76 t/s
14.55.195.343 I slot print_timing: id 3 | task 13814 | prompt eval time = 459.29 ms / 50 tokens ( 9.19 ms per token, 108.86 tokens per second)
14.55.195.347 I slot print_timing: id 3 | task 13814 | eval time = 51233.94 ms / 872 tokens ( 58.75 ms per token, 17.02 tokens per second)
14.55.195.348 I slot print_timing: id 3 | task 13814 | total time = 51693.23 ms / 922 tokens
14.55.195.348 I slot print_timing: id 3 | task 13814 | graphs reused = 14563
14.55.195.394 I slot release: id 3 | task 13814 | stop processing: n_tokens = 993, truncated = 0
14.55.195.406 I srv update_slots: all slots are idle
14.55.198.191 I srv operator(): Chat format: peg-gemma4
14.55.198.519 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.613 (> 0.100 thold), f_keep = 0.077
14.55.198.521 I srv get_availabl: updating prompt cache
14.55.198.603 W srv prompt_save: - saving prompt with length 993, total state size = 853.384 MiB (draft: 0.000 MiB)
14.55.799.331 I srv load: - looking for better prompt, base f_keep = 0.077, sim = 0.613
14.55.799.340 W srv update: - cache size limit reached, removing oldest entry (size = 996.129 MiB)
14.55.883.145 I srv update: - cache state: 9 prompts, 8005.865 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
14.55.883.149 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB
14.55.883.150 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB
14.55.883.150 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB
14.55.883.151 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB
14.55.883.151 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB
14.55.883.152 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB
14.55.883.152 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB
14.55.883.153 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB
14.55.883.153 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB
14.55.883.155 I srv get_availabl: prompt cache update took 684.63 ms
14.55.883.223 I slot launch_slot_: id 3 | task 14689 | processing task, is_child = 0
14.55.883.224 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
14.55.883.225 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
14.55.883.243 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
14.55.883.244 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
14.55.883.255 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
14.55.883.255 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
14.55.883.274 I slot update_slots: id 3 | task 14689 | Checking checkpoint with [0, 72] against 0...
14.55.902.444 W slot update_slots: id 3 | task 14689 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
15.02.094.924 I slot print_timing: id 3 | task 14689 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s
15.05.131.216 I slot print_timing: id 3 | task 14689 | n_decoded = 152, tg = 17.30 t/s, tg_3s = 17.13 t/s
15.08.173.066 I slot print_timing: id 3 | task 14689 | n_decoded = 204, tg = 17.25 t/s, tg_3s = 17.09 t/s
15.11.212.779 I slot print_timing: id 3 | task 14689 | n_decoded = 256, tg = 17.22 t/s, tg_3s = 17.11 t/s
15.14.249.814 I slot print_timing: id 3 | task 14689 | n_decoded = 308, tg = 17.20 t/s, tg_3s = 17.12 t/s
15.17.288.893 I slot print_timing: id 3 | task 14689 | n_decoded = 360, tg = 17.19 t/s, tg_3s = 17.11 t/s
15.20.333.974 I slot print_timing: id 3 | task 14689 | n_decoded = 412, tg = 17.17 t/s, tg_3s = 17.08 t/s
15.23.378.541 I slot print_timing: id 3 | task 14689 | n_decoded = 464, tg = 17.16 t/s, tg_3s = 17.08 t/s
15.26.426.634 I slot print_timing: id 3 | task 14689 | n_decoded = 516, tg = 17.15 t/s, tg_3s = 17.06 t/s
15.29.483.068 I slot print_timing: id 3 | task 14689 | n_decoded = 568, tg = 17.14 t/s, tg_3s = 17.01 t/s
15.32.528.808 I slot print_timing: id 3 | task 14689 | n_decoded = 620, tg = 17.13 t/s, tg_3s = 17.07 t/s
15.35.552.460 I slot print_timing: id 3 | task 14689 | n_decoded = 671, tg = 17.11 t/s, tg_3s = 16.87 t/s
15.38.587.156 I slot print_timing: id 3 | task 14689 | n_decoded = 722, tg = 17.09 t/s, tg_3s = 16.81 t/s
15.41.621.486 I slot print_timing: id 3 | task 14689 | n_decoded = 773, tg = 17.07 t/s, tg_3s = 16.81 t/s
15.44.664.250 I slot print_timing: id 3 | task 14689 | n_decoded = 824, tg = 17.05 t/s, tg_3s = 16.76 t/s
15.47.705.543 I slot print_timing: id 3 | task 14689 | n_decoded = 875, tg = 17.04 t/s, tg_3s = 16.77 t/s
15.50.765.078 I slot print_timing: id 3 | task 14689 | n_decoded = 926, tg = 17.02 t/s, tg_3s = 16.67 t/s
15.53.824.085 I slot print_timing: id 3 | task 14689 | n_decoded = 977, tg = 17.00 t/s, tg_3s = 16.67 t/s
15.56.826.570 I slot print_timing: id 3 | task 14689 | prompt eval time = 460.28 ms / 52 tokens ( 8.85 ms per token, 112.97 tokens per second)
15.56.826.573 I slot print_timing: id 3 | task 14689 | eval time = 60483.01 ms / 1027 tokens ( 58.89 ms per token, 16.98 tokens per second)
15.56.826.574 I slot print_timing: id 3 | task 14689 | total time = 60943.29 ms / 1079 tokens
15.56.826.575 I slot print_timing: id 3 | task 14689 | graphs reused = 15584
15.56.826.660 I slot release: id 3 | task 14689 | stop processing: n_tokens = 1150, truncated = 0
15.56.826.675 I srv update_slots: all slots are idle
15.56.829.291 I srv operator(): Chat format: peg-gemma4
15.56.829.623 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.655 (> 0.100 thold), f_keep = 0.066
15.56.829.625 I srv get_availabl: updating prompt cache
15.56.829.711 W srv prompt_save: - saving prompt with length 1150, total state size = 889.870 MiB (draft: 0.000 MiB)
15.57.435.704 I srv load: - looking for better prompt, base f_keep = 0.066, sim = 0.655
15.57.435.714 W srv update: - cache size limit reached, removing oldest entry (size = 948.466 MiB)
15.57.516.379 I srv update: - cache state: 9 prompts, 8004.302 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
15.57.516.383 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB
15.57.516.384 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB
15.57.516.385 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB
15.57.516.385 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB
15.57.516.386 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB
15.57.516.386 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB
15.57.516.387 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB
15.57.516.387 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB
15.57.516.388 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB
15.57.516.390 I srv get_availabl: prompt cache update took 686.76 ms
15.57.516.462 I slot launch_slot_: id 3 | task 15719 | processing task, is_child = 0
15.57.516.463 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
15.57.516.464 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
15.57.516.484 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
15.57.516.484 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
15.57.516.496 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
15.57.516.496 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
15.57.516.515 I slot update_slots: id 3 | task 15719 | Checking checkpoint with [0, 72] against 0...
15.57.536.147 W slot update_slots: id 3 | task 15719 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
16.03.753.489 I slot print_timing: id 3 | task 15719 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s
16.06.787.615 I slot print_timing: id 3 | task 15719 | n_decoded = 152, tg = 17.30 t/s, tg_3s = 17.14 t/s
16.09.834.403 I slot print_timing: id 3 | task 15719 | n_decoded = 204, tg = 17.24 t/s, tg_3s = 17.07 t/s
16.12.874.008 I slot print_timing: id 3 | task 15719 | n_decoded = 256, tg = 17.21 t/s, tg_3s = 17.11 t/s
16.15.896.961 I slot print_timing: id 3 | task 15719 | n_decoded = 308, tg = 17.21 t/s, tg_3s = 17.20 t/s
16.18.919.857 I slot print_timing: id 3 | task 15719 | n_decoded = 360, tg = 17.21 t/s, tg_3s = 17.20 t/s
16.21.966.937 I slot print_timing: id 3 | task 15719 | n_decoded = 412, tg = 17.19 t/s, tg_3s = 17.07 t/s
16.25.014.747 I slot print_timing: id 3 | task 15719 | n_decoded = 464, tg = 17.18 t/s, tg_3s = 17.06 t/s
16.28.015.597 I slot print_timing: id 3 | task 15719 | n_decoded = 515, tg = 17.16 t/s, tg_3s = 17.00 t/s
16.31.017.800 I slot print_timing: id 3 | task 15719 | n_decoded = 566, tg = 17.14 t/s, tg_3s = 16.99 t/s
16.34.073.610 I slot print_timing: id 3 | task 15719 | n_decoded = 618, tg = 17.13 t/s, tg_3s = 17.02 t/s
16.37.097.505 I slot print_timing: id 3 | task 15719 | n_decoded = 669, tg = 17.11 t/s, tg_3s = 16.87 t/s
16.40.137.302 I slot print_timing: id 3 | task 15719 | n_decoded = 720, tg = 17.09 t/s, tg_3s = 16.78 t/s
16.43.182.479 I slot print_timing: id 3 | task 15719 | n_decoded = 771, tg = 17.07 t/s, tg_3s = 16.75 t/s
16.45.516.731 I slot print_timing: id 3 | task 15719 | prompt eval time = 486.15 ms / 44 tokens ( 11.05 ms per token, 90.51 tokens per second)
16.45.516.735 I slot print_timing: id 3 | task 15719 | eval time = 47514.06 ms / 810 tokens ( 58.66 ms per token, 17.05 tokens per second)
16.45.516.736 I slot print_timing: id 3 | task 15719 | total time = 48000.21 ms / 854 tokens
16.45.516.736 I slot print_timing: id 3 | task 15719 | graphs reused = 16389
16.45.516.784 I slot release: id 3 | task 15719 | stop processing: n_tokens = 925, truncated = 0
16.45.516.797 I srv update_slots: all slots are idle
16.45.519.577 I srv operator(): Chat format: peg-gemma4
16.45.519.908 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.655 (> 0.100 thold), f_keep = 0.082
16.45.519.910 I srv get_availabl: updating prompt cache
16.45.520.001 W srv prompt_save: - saving prompt with length 925, total state size = 794.944 MiB (draft: 0.000 MiB)
16.46.096.182 I srv load: - looking for better prompt, base f_keep = 0.082, sim = 0.655
16.46.096.192 W srv update: - cache size limit reached, removing oldest entry (size = 960.343 MiB)
16.46.182.077 I srv update: - cache state: 9 prompts, 7895.937 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
16.46.182.081 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB
16.46.182.082 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB
16.46.182.082 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB
16.46.182.083 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB
16.46.182.084 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB
16.46.182.084 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB
16.46.182.085 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB
16.46.182.085 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB
16.46.182.086 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB
16.46.182.087 I srv get_availabl: prompt cache update took 662.18 ms
16.46.182.169 I slot launch_slot_: id 3 | task 16532 | processing task, is_child = 0
16.46.182.170 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
16.46.182.171 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
16.46.182.191 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
16.46.182.192 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
16.46.182.203 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
16.46.182.203 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
16.46.182.223 I slot update_slots: id 3 | task 16532 | Checking checkpoint with [0, 72] against 0...
16.46.201.843 W slot update_slots: id 3 | task 16532 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
16.52.426.424 I slot print_timing: id 3 | task 16532 | n_decoded = 100, tg = 17.37 t/s, tg_3s = 17.37 t/s
16.55.457.405 I slot print_timing: id 3 | task 16532 | n_decoded = 152, tg = 17.29 t/s, tg_3s = 17.16 t/s
16.58.505.727 I slot print_timing: id 3 | task 16532 | n_decoded = 204, tg = 17.23 t/s, tg_3s = 17.06 t/s
17.01.528.143 I slot print_timing: id 3 | task 16532 | n_decoded = 256, tg = 17.23 t/s, tg_3s = 17.20 t/s
17.04.550.358 I slot print_timing: id 3 | task 16532 | n_decoded = 308, tg = 17.22 t/s, tg_3s = 17.21 t/s
17.07.578.370 I slot print_timing: id 3 | task 16532 | n_decoded = 360, tg = 17.22 t/s, tg_3s = 17.17 t/s
17.10.623.513 I slot print_timing: id 3 | task 16532 | n_decoded = 412, tg = 17.20 t/s, tg_3s = 17.08 t/s
17.13.624.450 I slot print_timing: id 3 | task 16532 | n_decoded = 463, tg = 17.18 t/s, tg_3s = 16.99 t/s
17.16.676.521 I slot print_timing: id 3 | task 16532 | n_decoded = 515, tg = 17.16 t/s, tg_3s = 17.04 t/s
17.19.732.489 I slot print_timing: id 3 | task 16532 | n_decoded = 567, tg = 17.15 t/s, tg_3s = 17.02 t/s
17.22.787.428 I slot print_timing: id 3 | task 16532 | n_decoded = 619, tg = 17.14 t/s, tg_3s = 17.02 t/s
17.25.810.292 I slot print_timing: id 3 | task 16532 | n_decoded = 670, tg = 17.12 t/s, tg_3s = 16.87 t/s
17.28.849.918 I slot print_timing: id 3 | task 16532 | n_decoded = 721, tg = 17.09 t/s, tg_3s = 16.78 t/s
17.31.895.144 I slot print_timing: id 3 | task 16532 | n_decoded = 772, tg = 17.07 t/s, tg_3s = 16.75 t/s
17.34.943.966 I slot print_timing: id 3 | task 16532 | n_decoded = 823, tg = 17.05 t/s, tg_3s = 16.73 t/s
17.37.991.524 I slot print_timing: id 3 | task 16532 | n_decoded = 874, tg = 17.03 t/s, tg_3s = 16.73 t/s
17.40.812.568 I slot print_timing: id 3 | task 16532 | prompt eval time = 486.21 ms / 44 tokens ( 11.05 ms per token, 90.50 tokens per second)
17.40.812.573 I slot print_timing: id 3 | task 16532 | eval time = 54144.13 ms / 921 tokens ( 58.79 ms per token, 17.01 tokens per second)
17.40.812.573 I slot print_timing: id 3 | task 16532 | total time = 54630.34 ms / 965 tokens
17.40.812.574 I slot print_timing: id 3 | task 16532 | graphs reused = 17304
17.40.812.613 I slot release: id 3 | task 16532 | stop processing: n_tokens = 1036, truncated = 0
17.40.812.626 I srv update_slots: all slots are idle
17.40.815.256 I srv operator(): Chat format: peg-gemma4
17.40.815.603 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.710 (> 0.100 thold), f_keep = 0.073
17.40.815.605 I srv get_availabl: updating prompt cache
17.40.815.705 W srv prompt_save: - saving prompt with length 1036, total state size = 880.962 MiB (draft: 0.000 MiB)
17.41.421.354 I srv load: - looking for better prompt, base f_keep = 0.073, sim = 0.710
17.41.421.364 W srv update: - cache size limit reached, removing oldest entry (size = 952.842 MiB)
17.41.506.906 I srv update: - cache state: 9 prompts, 7881.091 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
17.41.506.912 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB
17.41.506.913 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB
17.41.506.914 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB
17.41.506.915 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB
17.41.506.916 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB
17.41.506.917 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB
17.41.506.918 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB
17.41.506.919 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB
17.41.506.919 I srv update: - prompt 0x641daf784c00: 1036 tokens, checkpoints: 1, 937.996 MiB
17.41.506.939 I srv get_availabl: prompt cache update took 691.32 ms
17.41.507.018 I slot launch_slot_: id 3 | task 17456 | processing task, is_child = 0
17.41.507.019 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
17.41.507.020 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
17.41.507.041 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
17.41.507.042 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
17.41.507.053 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
17.41.507.053 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
17.41.507.073 I slot update_slots: id 3 | task 17456 | Checking checkpoint with [0, 72] against 0...
17.41.528.276 W slot update_slots: id 3 | task 17456 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
17.47.741.320 I slot print_timing: id 3 | task 17456 | n_decoded = 100, tg = 17.36 t/s, tg_3s = 17.36 t/s
17.50.767.308 I slot print_timing: id 3 | task 17456 | n_decoded = 152, tg = 17.30 t/s, tg_3s = 17.18 t/s
17.53.795.859 I slot print_timing: id 3 | task 17456 | n_decoded = 204, tg = 17.27 t/s, tg_3s = 17.17 t/s
17.56.824.361 I slot print_timing: id 3 | task 17456 | n_decoded = 256, tg = 17.25 t/s, tg_3s = 17.17 t/s
17.59.854.340 I slot print_timing: id 3 | task 17456 | n_decoded = 308, tg = 17.23 t/s, tg_3s = 17.16 t/s
18.02.883.503 I slot print_timing: id 3 | task 17456 | n_decoded = 360, tg = 17.22 t/s, tg_3s = 17.17 t/s
18.05.926.565 I slot print_timing: id 3 | task 17456 | n_decoded = 412, tg = 17.21 t/s, tg_3s = 17.09 t/s
18.08.983.525 I slot print_timing: id 3 | task 17456 | n_decoded = 464, tg = 17.18 t/s, tg_3s = 17.01 t/s
18.11.985.567 I slot print_timing: id 3 | task 17456 | n_decoded = 515, tg = 17.16 t/s, tg_3s = 16.99 t/s
18.14.991.706 I slot print_timing: id 3 | task 17456 | n_decoded = 566, tg = 17.15 t/s, tg_3s = 16.97 t/s
18.17.994.125 I slot print_timing: id 3 | task 17456 | n_decoded = 617, tg = 17.13 t/s, tg_3s = 16.99 t/s
18.21.014.065 I slot print_timing: id 3 | task 17456 | n_decoded = 668, tg = 17.11 t/s, tg_3s = 16.89 t/s
18.22.564.461 I slot print_timing: id 3 | task 17456 | prompt eval time = 474.99 ms / 35 tokens ( 13.57 ms per token, 73.69 tokens per second)
18.22.564.464 I slot print_timing: id 3 | task 17456 | eval time = 40582.39 ms / 694 tokens ( 58.48 ms per token, 17.10 tokens per second)
18.22.564.465 I slot print_timing: id 3 | task 17456 | total time = 41057.38 ms / 729 tokens
18.22.564.465 I slot print_timing: id 3 | task 17456 | graphs reused = 17993
18.22.564.509 I slot release: id 3 | task 17456 | stop processing: n_tokens = 800, truncated = 0
18.22.564.520 I srv update_slots: all slots are idle
18.22.567.132 I srv operator(): Chat format: peg-gemma4
18.22.567.459 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.792 (> 0.100 thold), f_keep = 0.095
18.22.567.460 I srv get_availabl: updating prompt cache
18.22.567.531 W srv prompt_save: - saving prompt with length 800, total state size = 687.520 MiB (draft: 0.000 MiB)
18.23.052.074 I srv load: - looking for better prompt, base f_keep = 0.095, sim = 0.792
18.23.052.082 W srv update: - cache size limit reached, removing oldest entry (size = 733.381 MiB)
18.23.119.684 I srv update: - cache state: 9 prompts, 7892.264 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
18.23.119.687 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB
18.23.119.688 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB
18.23.119.688 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB
18.23.119.689 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB
18.23.119.689 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB
18.23.119.690 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB
18.23.119.691 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB
18.23.119.691 I srv update: - prompt 0x641daf784c00: 1036 tokens, checkpoints: 1, 937.996 MiB
18.23.119.691 I srv update: - prompt 0x641daed5fa30: 800 tokens, checkpoints: 1, 744.553 MiB
18.23.119.693 I srv get_availabl: prompt cache update took 552.23 ms
18.23.119.766 I slot launch_slot_: id 3 | task 18153 | processing task, is_child = 0
18.23.119.767 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
18.23.119.767 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
18.23.119.785 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
18.23.119.785 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
18.23.119.797 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
18.23.119.797 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
18.23.119.816 I slot update_slots: id 3 | task 18153 | Checking checkpoint with [0, 72] against 0...
18.23.139.115 W slot update_slots: id 3 | task 18153 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
18.29.300.443 I slot print_timing: id 3 | task 18153 | n_decoded = 100, tg = 17.38 t/s, tg_3s = 17.38 t/s
18.32.316.229 I slot print_timing: id 3 | task 18153 | n_decoded = 152, tg = 17.33 t/s, tg_3s = 17.24 t/s
18.35.368.420 I slot print_timing: id 3 | task 18153 | n_decoded = 204, tg = 17.26 t/s, tg_3s = 17.04 t/s
18.38.419.353 I slot print_timing: id 3 | task 18153 | n_decoded = 256, tg = 17.21 t/s, tg_3s = 17.04 t/s
18.41.443.326 I slot print_timing: id 3 | task 18153 | n_decoded = 308, tg = 17.21 t/s, tg_3s = 17.20 t/s
18.44.459.403 I slot print_timing: id 3 | task 18153 | n_decoded = 360, tg = 17.21 t/s, tg_3s = 17.24 t/s
18.47.483.449 I slot print_timing: id 3 | task 18153 | n_decoded = 412, tg = 17.21 t/s, tg_3s = 17.20 t/s
18.50.530.788 I slot print_timing: id 3 | task 18153 | n_decoded = 464, tg = 17.20 t/s, tg_3s = 17.06 t/s
18.53.573.575 I slot print_timing: id 3 | task 18153 | n_decoded = 516, tg = 17.18 t/s, tg_3s = 17.09 t/s
18.54.977.761 I slot print_timing: id 3 | task 18153 | prompt eval time = 426.79 ms / 24 tokens ( 17.78 ms per token, 56.23 tokens per second)
18.54.977.765 I slot print_timing: id 3 | task 18153 | eval time = 31431.15 ms / 540 tokens ( 58.21 ms per token, 17.18 tokens per second)
18.54.977.766 I slot print_timing: id 3 | task 18153 | total time = 31857.94 ms / 564 tokens
18.54.977.767 I slot print_timing: id 3 | task 18153 | graphs reused = 18529
18.54.977.811 I slot release: id 3 | task 18153 | stop processing: n_tokens = 635, truncated = 0
18.54.977.822 I srv update_slots: all slots are idle
18.54.980.486 I srv operator(): Chat format: peg-gemma4
18.54.981.071 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.650 (> 0.100 thold), f_keep = 0.120
18.54.981.074 I srv get_availabl: updating prompt cache
18.54.981.150 W srv prompt_save: - saving prompt with length 635, total state size = 545.719 MiB (draft: 0.000 MiB)
18.55.374.947 I srv load: - looking for better prompt, base f_keep = 0.120, sim = 0.650
18.55.374.957 W srv update: - cache size limit reached, removing oldest entry (size = 944.090 MiB)
18.55.461.941 I srv update: - cache state: 9 prompts, 7550.926 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
18.55.461.949 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB
18.55.461.950 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB
18.55.461.951 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB
18.55.461.951 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB
18.55.461.952 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB
18.55.461.957 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB
18.55.461.958 I srv update: - prompt 0x641daf784c00: 1036 tokens, checkpoints: 1, 937.996 MiB
18.55.461.958 I srv update: - prompt 0x641daed5fa30: 800 tokens, checkpoints: 1, 744.553 MiB
18.55.461.959 I srv update: - prompt 0x641dae8852a0: 635 tokens, checkpoints: 1, 602.752 MiB
18.55.461.961 I srv get_availabl: prompt cache update took 480.89 ms
18.55.462.037 I slot launch_slot_: id 3 | task 18696 | processing task, is_child = 0
18.55.462.038 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
18.55.462.038 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
18.55.462.056 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
18.55.462.057 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
18.55.462.068 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
18.55.462.068 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
18.55.462.087 I slot update_slots: id 3 | task 18696 | Checking checkpoint with [0, 72] against 0...
18.55.481.398 W slot update_slots: id 3 | task 18696 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
19.01.698.993 I slot print_timing: id 3 | task 18696 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s
19.04.725.510 I slot print_timing: id 3 | task 18696 | n_decoded = 152, tg = 17.32 t/s, tg_3s = 17.18 t/s
19.07.755.171 I slot print_timing: id 3 | task 18696 | n_decoded = 204, tg = 17.28 t/s, tg_3s = 17.16 t/s
19.10.786.170 I slot print_timing: id 3 | task 18696 | n_decoded = 256, tg = 17.25 t/s, tg_3s = 17.16 t/s
19.13.821.270 I slot print_timing: id 3 | task 18696 | n_decoded = 308, tg = 17.23 t/s, tg_3s = 17.13 t/s
19.16.857.336 I slot print_timing: id 3 | task 18696 | n_decoded = 360, tg = 17.22 t/s, tg_3s = 17.13 t/s
19.19.911.386 I slot print_timing: id 3 | task 18696 | n_decoded = 412, tg = 17.19 t/s, tg_3s = 17.03 t/s
19.22.914.761 I slot print_timing: id 3 | task 18696 | n_decoded = 463, tg = 17.17 t/s, tg_3s = 16.98 t/s
19.25.925.582 I slot print_timing: id 3 | task 18696 | n_decoded = 514, tg = 17.15 t/s, tg_3s = 16.94 t/s
19.28.926.593 I slot print_timing: id 3 | task 18696 | n_decoded = 565, tg = 17.13 t/s, tg_3s = 16.99 t/s
19.30.399.647 I slot print_timing: id 3 | task 18696 | prompt eval time = 486.00 ms / 45 tokens ( 10.80 ms per token, 92.59 tokens per second)
19.30.399.651 I slot print_timing: id 3 | task 18696 | eval time = 34451.55 ms / 590 tokens ( 58.39 ms per token, 17.13 tokens per second)
19.30.399.652 I slot print_timing: id 3 | task 18696 | total time = 34937.55 ms / 635 tokens
19.30.399.652 I slot print_timing: id 3 | task 18696 | graphs reused = 19115
19.30.399.695 I slot release: id 3 | task 18696 | stop processing: n_tokens = 706, truncated = 0
19.30.399.707 I srv update_slots: all slots are idle
19.30.402.266 I srv operator(): Chat format: peg-gemma4
19.30.402.600 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.717 (> 0.100 thold), f_keep = 0.108
19.30.402.602 I srv get_availabl: updating prompt cache
19.30.402.674 W srv prompt_save: - saving prompt with length 706, total state size = 606.736 MiB (draft: 0.000 MiB)
19.30.832.711 I srv load: - looking for better prompt, base f_keep = 0.108, sim = 0.717
19.30.832.720 W srv update: - cache size limit reached, removing oldest entry (size = 961.515 MiB)
19.30.922.295 I srv update: - cache state: 9 prompts, 7253.180 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
19.30.922.298 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB
19.30.922.299 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB
19.30.922.300 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB
19.30.922.300 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB
19.30.922.301 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB
19.30.922.301 I srv update: - prompt 0x641daf784c00: 1036 tokens, checkpoints: 1, 937.996 MiB
19.30.922.302 I srv update: - prompt 0x641daed5fa30: 800 tokens, checkpoints: 1, 744.553 MiB
19.30.922.302 I srv update: - prompt 0x641dae8852a0: 635 tokens, checkpoints: 1, 602.752 MiB
19.30.922.303 I srv update: - prompt 0x641daee5bef0: 706 tokens, checkpoints: 1, 663.770 MiB
19.30.922.304 I srv get_availabl: prompt cache update took 519.70 ms
19.30.922.381 I slot launch_slot_: id 3 | task 19289 | processing task, is_child = 0
19.30.922.382 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
19.30.922.382 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
19.30.922.402 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
19.30.922.402 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
19.30.922.413 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
19.30.922.414 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
19.30.922.434 I slot update_slots: id 3 | task 19289 | Checking checkpoint with [0, 72] against 0...
19.30.941.465 W slot update_slots: id 3 | task 19289 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
19.37.135.028 I slot print_timing: id 3 | task 19289 | n_decoded = 100, tg = 17.42 t/s, tg_3s = 17.42 t/s
19.40.148.485 I slot print_timing: id 3 | task 19289 | n_decoded = 152, tg = 17.36 t/s, tg_3s = 17.26 t/s
19.43.187.733 I slot print_timing: id 3 | task 19289 | n_decoded = 204, tg = 17.30 t/s, tg_3s = 17.11 t/s
19.46.212.780 I slot print_timing: id 3 | task 19289 | n_decoded = 256, tg = 17.28 t/s, tg_3s = 17.19 t/s
19.49.244.220 I slot print_timing: id 3 | task 19289 | n_decoded = 308, tg = 17.26 t/s, tg_3s = 17.15 t/s
19.52.268.594 I slot print_timing: id 3 | task 19289 | n_decoded = 360, tg = 17.25 t/s, tg_3s = 17.19 t/s
19.55.316.658 I slot print_timing: id 3 | task 19289 | n_decoded = 412, tg = 17.22 t/s, tg_3s = 17.06 t/s
19.58.375.614 I slot print_timing: id 3 | task 19289 | n_decoded = 464, tg = 17.20 t/s, tg_3s = 17.00 t/s
20.01.377.986 I slot print_timing: id 3 | task 19289 | n_decoded = 515, tg = 17.18 t/s, tg_3s = 16.99 t/s
20.04.380.696 I slot print_timing: id 3 | task 19289 | n_decoded = 566, tg = 17.16 t/s, tg_3s = 16.98 t/s
20.07.384.622 I slot print_timing: id 3 | task 19289 | n_decoded = 617, tg = 17.14 t/s, tg_3s = 16.98 t/s
20.10.400.963 I slot print_timing: id 3 | task 19289 | n_decoded = 668, tg = 17.13 t/s, tg_3s = 16.91 t/s
20.13.447.627 I slot print_timing: id 3 | task 19289 | n_decoded = 719, tg = 17.10 t/s, tg_3s = 16.74 t/s
20.16.495.122 I slot print_timing: id 3 | task 19289 | n_decoded = 770, tg = 17.07 t/s, tg_3s = 16.74 t/s
20.19.532.823 I slot print_timing: id 3 | task 19289 | n_decoded = 821, tg = 17.06 t/s, tg_3s = 16.79 t/s
20.22.563.847 I slot print_timing: id 3 | task 19289 | n_decoded = 872, tg = 17.04 t/s, tg_3s = 16.83 t/s
20.25.604.928 I slot print_timing: id 3 | task 19289 | n_decoded = 923, tg = 17.03 t/s, tg_3s = 16.77 t/s
20.25.664.875 I slot print_timing: id 3 | task 19289 | prompt eval time = 472.60 ms / 34 tokens ( 13.90 ms per token, 71.94 tokens per second)
20.25.664.878 I slot print_timing: id 3 | task 19289 | eval time = 54269.83 ms / 924 tokens ( 58.73 ms per token, 17.03 tokens per second)
20.25.664.879 I slot print_timing: id 3 | task 19289 | total time = 54742.42 ms / 958 tokens
20.25.664.879 I slot print_timing: id 3 | task 19289 | graphs reused = 20033
20.25.664.928 I slot release: id 3 | task 19289 | stop processing: n_tokens = 1029, truncated = 0
20.25.664.942 I srv update_slots: all slots are idle
20.25.667.488 I srv operator(): Chat format: peg-gemma4
20.25.667.818 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.673 (> 0.100 thold), f_keep = 0.074
20.25.667.819 I srv get_availabl: updating prompt cache
20.25.667.914 W srv prompt_save: - saving prompt with length 1029, total state size = 880.416 MiB (draft: 0.000 MiB)
20.26.543.314 I srv load: - looking for better prompt, base f_keep = 0.074, sim = 0.673
20.26.543.325 I srv update: - cache state: 10 prompts, 8190.629 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
20.26.543.326 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB
20.26.543.332 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB
20.26.543.333 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB
20.26.543.333 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB
20.26.543.334 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB
20.26.543.334 I srv update: - prompt 0x641daf784c00: 1036 tokens, checkpoints: 1, 937.996 MiB
20.26.543.335 I srv update: - prompt 0x641daed5fa30: 800 tokens, checkpoints: 1, 744.553 MiB
20.26.543.335 I srv update: - prompt 0x641dae8852a0: 635 tokens, checkpoints: 1, 602.752 MiB
20.26.543.337 I srv update: - prompt 0x641daee5bef0: 706 tokens, checkpoints: 1, 663.770 MiB
20.26.543.338 I srv update: - prompt 0x641daec2ff50: 1029 tokens, checkpoints: 1, 937.449 MiB
20.26.543.339 I srv get_availabl: prompt cache update took 875.52 ms
20.26.543.408 I slot launch_slot_: id 3 | task 20216 | processing task, is_child = 0
20.26.543.408 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
20.26.543.409 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
20.26.543.427 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
20.26.543.427 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
20.26.543.438 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
20.26.543.438 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
20.26.543.457 I slot update_slots: id 3 | task 20216 | Checking checkpoint with [0, 72] against 0...
20.26.562.368 W slot update_slots: id 3 | task 20216 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
20.32.779.996 I slot print_timing: id 3 | task 20216 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s
20.35.804.507 I slot print_timing: id 3 | task 20216 | n_decoded = 152, tg = 17.32 t/s, tg_3s = 17.19 t/s
20.38.821.381 I slot print_timing: id 3 | task 20216 | n_decoded = 204, tg = 17.30 t/s, tg_3s = 17.24 t/s
20.41.837.471 I slot print_timing: id 3 | task 20216 | n_decoded = 256, tg = 17.29 t/s, tg_3s = 17.24 t/s
20.44.861.532 I slot print_timing: id 3 | task 20216 | n_decoded = 308, tg = 17.27 t/s, tg_3s = 17.20 t/s
20.47.894.818 I slot print_timing: id 3 | task 20216 | n_decoded = 360, tg = 17.25 t/s, tg_3s = 17.14 t/s
20.50.941.772 I slot print_timing: id 3 | task 20216 | n_decoded = 412, tg = 17.23 t/s, tg_3s = 17.07 t/s
20.53.994.208 I slot print_timing: id 3 | task 20216 | n_decoded = 464, tg = 17.21 t/s, tg_3s = 17.04 t/s
20.56.996.236 I slot print_timing: id 3 | task 20216 | n_decoded = 515, tg = 17.18 t/s, tg_3s = 16.99 t/s
21.00.051.239 I slot print_timing: id 3 | task 20216 | n_decoded = 567, tg = 17.17 t/s, tg_3s = 17.02 t/s
21.03.052.278 I slot print_timing: id 3 | task 20216 | n_decoded = 618, tg = 17.16 t/s, tg_3s = 16.99 t/s
21.06.079.820 I slot print_timing: id 3 | task 20216 | n_decoded = 669, tg = 17.13 t/s, tg_3s = 16.85 t/s
21.09.138.914 I slot print_timing: id 3 | task 20216 | n_decoded = 720, tg = 17.10 t/s, tg_3s = 16.67 t/s
21.11.118.906 I slot print_timing: id 3 | task 20216 | prompt eval time = 484.68 ms / 41 tokens ( 11.82 ms per token, 84.59 tokens per second)
21.11.118.910 I slot print_timing: id 3 | task 20216 | eval time = 44090.76 ms / 753 tokens ( 58.55 ms per token, 17.08 tokens per second)
21.11.118.910 I slot print_timing: id 3 | task 20216 | total time = 44575.44 ms / 794 tokens
21.11.118.911 I slot print_timing: id 3 | task 20216 | graphs reused = 20781
21.11.118.956 I slot release: id 3 | task 20216 | stop processing: n_tokens = 865, truncated = 0
21.11.118.967 I srv update_slots: all slots are idle
21.11.121.708 I srv operator(): Chat format: peg-gemma4
21.11.122.041 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.633 (> 0.100 thold), f_keep = 0.088
21.11.122.042 I srv get_availabl: updating prompt cache
21.11.122.117 W srv prompt_save: - saving prompt with length 865, total state size = 743.381 MiB (draft: 0.000 MiB)
21.11.646.012 I srv load: - looking for better prompt, base f_keep = 0.088, sim = 0.633
21.11.646.021 W srv update: - cache size limit reached, removing oldest entry (size = 827.055 MiB)
21.11.722.338 I srv update: - cache state: 10 prompts, 8163.988 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
21.11.722.342 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB
21.11.722.343 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB
21.11.722.344 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB
21.11.722.344 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB
21.11.722.345 I srv update: - prompt 0x641daf784c00: 1036 tokens, checkpoints: 1, 937.996 MiB
21.11.722.345 I srv update: - prompt 0x641daed5fa30: 800 tokens, checkpoints: 1, 744.553 MiB
21.11.722.346 I srv update: - prompt 0x641dae8852a0: 635 tokens, checkpoints: 1, 602.752 MiB
21.11.722.346 I srv update: - prompt 0x641daee5bef0: 706 tokens, checkpoints: 1, 663.770 MiB
21.11.722.347 I srv update: - prompt 0x641daec2ff50: 1029 tokens, checkpoints: 1, 937.449 MiB
21.11.722.347 I srv update: - prompt 0x641daea70bf0: 865 tokens, checkpoints: 1, 800.414 MiB
21.11.722.349 I srv get_availabl: prompt cache update took 600.31 ms
21.11.722.419 I slot launch_slot_: id 3 | task 20972 | processing task, is_child = 0
21.11.722.419 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
21.11.722.421 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
21.11.722.439 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
21.11.722.439 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
21.11.722.451 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
21.11.722.451 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
21.11.722.470 I slot update_slots: id 3 | task 20972 | Checking checkpoint with [0, 72] against 0...
21.11.744.747 W slot update_slots: id 3 | task 20972 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
21.17.941.018 I slot print_timing: id 3 | task 20972 | n_decoded = 100, tg = 17.37 t/s, tg_3s = 17.37 t/s
21.20.968.920 I slot print_timing: id 3 | task 20972 | n_decoded = 152, tg = 17.30 t/s, tg_3s = 17.17 t/s
21.23.994.539 I slot print_timing: id 3 | task 20972 | n_decoded = 204, tg = 17.27 t/s, tg_3s = 17.19 t/s
21.27.017.313 I slot print_timing: id 3 | task 20972 | n_decoded = 256, tg = 17.26 t/s, tg_3s = 17.20 t/s
21.30.043.585 I slot print_timing: id 3 | task 20972 | n_decoded = 308, tg = 17.25 t/s, tg_3s = 17.18 t/s
21.33.064.744 I slot print_timing: id 3 | task 20972 | n_decoded = 360, tg = 17.24 t/s, tg_3s = 17.21 t/s
21.36.113.912 I slot print_timing: id 3 | task 20972 | n_decoded = 412, tg = 17.22 t/s, tg_3s = 17.05 t/s
21.39.164.862 I slot print_timing: id 3 | task 20972 | n_decoded = 464, tg = 17.20 t/s, tg_3s = 17.04 t/s
21.42.216.453 I slot print_timing: id 3 | task 20972 | n_decoded = 516, tg = 17.18 t/s, tg_3s = 17.04 t/s
21.45.271.827 I slot print_timing: id 3 | task 20972 | n_decoded = 568, tg = 17.17 t/s, tg_3s = 17.02 t/s
21.48.274.412 I slot print_timing: id 3 | task 20972 | n_decoded = 619, tg = 17.15 t/s, tg_3s = 16.99 t/s
21.51.307.917 I slot print_timing: id 3 | task 20972 | n_decoded = 670, tg = 17.13 t/s, tg_3s = 16.81 t/s
21.54.366.982 I slot print_timing: id 3 | task 20972 | n_decoded = 721, tg = 17.09 t/s, tg_3s = 16.67 t/s
21.54.787.077 I slot print_timing: id 3 | task 20972 | prompt eval time = 462.46 ms / 48 tokens ( 9.63 ms per token, 103.79 tokens per second)
21.54.787.080 I slot print_timing: id 3 | task 20972 | eval time = 42602.14 ms / 728 tokens ( 58.52 ms per token, 17.09 tokens per second)
21.54.787.080 I slot print_timing: id 3 | task 20972 | total time = 43064.60 ms / 776 tokens
21.54.787.081 I slot print_timing: id 3 | task 20972 | graphs reused = 21504
21.54.787.122 I slot release: id 3 | task 20972 | stop processing: n_tokens = 847, truncated = 0
21.54.787.132 I srv update_slots: all slots are idle
21.54.789.792 I srv operator(): Chat format: peg-gemma4
21.54.790.126 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.724 (> 0.100 thold), f_keep = 0.090
21.54.790.128 I srv get_availabl: updating prompt cache
21.54.790.196 W srv prompt_save: - saving prompt with length 847, total state size = 727.911 MiB (draft: 0.000 MiB)
21.55.416.023 I srv load: - looking for better prompt, base f_keep = 0.090, sim = 0.724
21.55.416.032 W srv update: - cache size limit reached, removing oldest entry (size = 767.757 MiB)
21.55.489.108 I srv update: - cache state: 10 prompts, 8181.176 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est)
21.55.489.112 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB
21.55.489.113 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB
21.55.489.113 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB
21.55.489.114 I srv update: - prompt 0x641daf784c00: 1036 tokens, checkpoints: 1, 937.996 MiB
21.55.489.115 I srv update: - prompt 0x641daed5fa30: 800 tokens, checkpoints: 1, 744.553 MiB
21.55.489.115 I srv update: - prompt 0x641dae8852a0: 635 tokens, checkpoints: 1, 602.752 MiB
21.55.489.116 I srv update: - prompt 0x641daee5bef0: 706 tokens, checkpoints: 1, 663.770 MiB
21.55.489.116 I srv update: - prompt 0x641daec2ff50: 1029 tokens, checkpoints: 1, 937.449 MiB
21.55.489.117 I srv update: - prompt 0x641daea70bf0: 865 tokens, checkpoints: 1, 800.414 MiB
21.55.489.117 I srv update: - prompt 0x641dae875750: 847 tokens, checkpoints: 1, 784.945 MiB
21.55.489.118 I srv get_availabl: prompt cache update took 698.99 ms
21.55.489.157 I slot launch_slot_: id 3 | task 21703 | processing task, is_child = 0
21.55.489.158 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
21.55.489.159 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
21.55.489.177 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
21.55.489.178 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
21.55.489.191 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
21.55.489.191 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
21.55.489.210 I slot update_slots: id 3 | task 21703 | Checking checkpoint with [0, 72] against 0...
21.55.508.581 W slot update_slots: id 3 | task 21703 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB)
22.01.708.914 I slot print_timing: id 3 | task 21703 | n_decoded = 100, tg = 17.40 t/s, tg_3s = 17.40 t/s
22.04.721.883 I slot print_timing: id 3 | task 21703 | n_decoded = 152, tg = 17.35 t/s, tg_3s = 17.26 t/s
22.07.753.173 I slot print_timing: id 3 | task 21703 | n_decoded = 204, tg = 17.30 t/s, tg_3s = 17.15 t/s
22.10.776.463 I slot print_timing: id 3 | task 21703 | n_decoded = 256, tg = 17.28 t/s, tg_3s = 17.20 t/s
22.13.802.844 I slot print_timing: id 3 | task 21703 | n_decoded = 308, tg = 17.26 t/s, tg_3s = 17.18 t/s
22.16.824.344 I slot print_timing: id 3 | task 21703 | n_decoded = 360, tg = 17.26 t/s, tg_3s = 17.21 t/s
22.19.860.029 I slot print_timing: id 3 | task 21703 | n_decoded = 412, tg = 17.24 t/s, tg_3s = 17.13 t/s
22.22.908.318 I slot print_timing: id 3 | task 21703 | n_decoded = 464, tg = 17.22 t/s, tg_3s = 17.06 t/s
22.25.967.115 I slot print_timing: id 3 | task 21703 | n_decoded = 516, tg = 17.20 t/s, tg_3s = 17.00 t/s
22.29.022.393 I slot print_timing: id 3 | task 21703 | n_decoded = 568, tg = 17.18 t/s, tg_3s = 17.02 t/s
22.32.075.655 I slot print_timing: id 3 | task 21703 | n_decoded = 620, tg = 17.17 t/s, tg_3s = 17.03 t/s
22.35.089.849 I slot print_timing: id 3 | task 21703 | n_decoded = 671, tg = 17.15 t/s, tg_3s = 16.92 t/s
22.38.132.918 I slot print_timing: id 3 | task 21703 | n_decoded = 722, tg = 17.12 t/s, tg_3s = 16.76 t/s
22.41.179.220 I slot print_timing: id 3 | task 21703 | n_decoded = 773, tg = 17.09 t/s, tg_3s = 16.74 t/s
22.44.229.947 I slot print_timing: id 3 | task 21703 | n_decoded = 824, tg = 17.07 t/s, tg_3s = 16.72 t/s
22.47.217.027 I slot print_timing: id 3 | task 21703 | prompt eval time = 472.07 ms / 33 tokens ( 14.31 ms per token, 69.90 tokens per second)
22.47.217.032 I slot print_timing: id 3 | task 21703 | eval time = 51255.74 ms / 874 tokens ( 58.65 ms per token, 17.05 tokens per second)
22.47.217.032 I slot print_timing: id 3 | task 21703 | total time = 51727.81 ms / 907 tokens
22.47.217.033 I slot print_timing: id 3 | task 21703 | graphs reused = 22373
22.47.217.071 I slot release: id 3 | task 21703 | stop processing: n_tokens = 978, truncated = 0
22.47.217.086 I srv update_slots: all slots are idle
22.47.217.676 I srv operator(): operator(): cleaning up before exit...
Reference in New Issue Copy Permalink