0.00.064.489 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg) 0.00.064.493 I device_info: 0.00.064.512 I - ROCm0 : AMD Radeon Graphics (32752 MiB, 32728 MiB free) 0.00.064.516 I - ROCm1 : AMD Radeon Graphics (32752 MiB, 32728 MiB free) 0.00.064.523 I - CPU : AMD Ryzen 9 3900X 12-Core Processor (128730 MiB, 128730 MiB free) 0.00.064.584 I system_info: n_threads = 12 (n_threads_batch = 12) / 24 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | 0.00.064.587 I srv llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true 0.00.064.630 I srv init: running without SSL 0.00.064.695 I srv init: using 23 threads for HTTP server 0.00.065.031 I srv start: binding port with default address family 0.00.066.233 I srv llama_server: loading model 0.00.066.241 I srv load_model: loading model '/home/qrf/.cache/llama.cpp/google_gemma-4-31B-it-Q4_K_M.gguf' 0.00.066.293 I common_init_result: fitting params to device memory ... 0.00.066.294 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.01.848.213 W load: control-looking token: 212 '' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.848.755 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden 0.01.876.328 W load: special_eog_ids contains '<|tool_response>', removing '' token from EOG list 0.14.507.928 W llama_context: n_ctx_seq (16384) < n_ctx_train (262144) -- the full capacity of the model will not be utilized 0.14.615.052 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.14.802.775 I srv load_model: initializing slots, n_slots = 4 0.14.920.324 W common_speculative_init: no implementations specified for speculative decoding 0.14.920.330 I slot load_model: id 0 | task -1 | new slot, n_ctx = 16384 0.14.920.334 I slot load_model: id 1 | task -1 | new slot, n_ctx = 16384 0.14.920.335 I slot load_model: id 2 | task -1 | new slot, n_ctx = 16384 0.14.920.335 I slot load_model: id 3 | task -1 | new slot, n_ctx = 16384 0.14.920.378 I srv load_model: prompt cache is enabled, size limit: 8192 MiB 0.14.920.378 I srv load_model: use `--cache-ram 0` to disable the prompt cache 0.14.920.379 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391 0.14.920.379 I srv load_model: context checkpoints enabled, max = 32, min spacing = 256 0.14.920.396 I srv init: idle slots will be saved to prompt cache and cleared upon starting a new task 0.14.927.975 I init: chat template, example_format: '<|turn>system <|think|> You are a helpful assistant <|turn>user Hello <|turn>model Hi there <|turn>user How are you? <|turn>model ' 0.14.928.716 I srv init: init: chat template, thinking = 1 0.14.928.751 I srv llama_server: model loaded 0.14.928.755 I srv llama_server: server is listening on http://127.0.0.1:8090 0.14.928.761 I srv update_slots: all slots are idle 0.14.966.166 I srv operator(): Chat format: peg-gemma4 0.14.966.547 I slot get_availabl: id 3 | task -1 | selected slot by LRU, t_last = -1 0.14.966.549 I srv get_availabl: updating prompt cache 0.14.966.555 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000 0.14.966.559 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 16384 tokens, 8589934592 est) 0.14.966.560 I srv get_availabl: prompt cache update took 0.01 ms 0.14.966.603 I slot launch_slot_: id 3 | task 0 | processing task, is_child = 0 0.14.966.604 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.14.966.605 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.14.966.621 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.14.966.622 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.14.966.635 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.14.966.635 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.15.626.552 I slot create_check: id 3 | task 0 | created context checkpoint 1 of 32 (pos_min = 0, pos_max = 72, n_tokens = 73, size = 57.033 MiB) 0.21.730.980 I slot print_timing: id 3 | task 0 | n_decoded = 100, tg = 17.46 t/s, tg_3s = 17.46 t/s 0.24.732.762 I slot print_timing: id 3 | task 0 | n_decoded = 152, tg = 17.41 t/s, tg_3s = 17.32 t/s 0.27.756.063 I slot print_timing: id 3 | task 0 | n_decoded = 204, tg = 17.36 t/s, tg_3s = 17.20 t/s 0.30.772.139 I slot print_timing: id 3 | task 0 | n_decoded = 256, tg = 17.33 t/s, tg_3s = 17.24 t/s 0.33.793.420 I slot print_timing: id 3 | task 0 | n_decoded = 308, tg = 17.31 t/s, tg_3s = 17.21 t/s 0.36.813.637 I slot print_timing: id 3 | task 0 | n_decoded = 360, tg = 17.30 t/s, tg_3s = 17.22 t/s 0.39.837.581 I slot print_timing: id 3 | task 0 | n_decoded = 412, tg = 17.29 t/s, tg_3s = 17.20 t/s 0.42.895.121 I slot print_timing: id 3 | task 0 | n_decoded = 464, tg = 17.25 t/s, tg_3s = 17.01 t/s 0.45.949.180 I slot print_timing: id 3 | task 0 | n_decoded = 516, tg = 17.23 t/s, tg_3s = 17.03 t/s 0.48.951.181 I slot print_timing: id 3 | task 0 | n_decoded = 567, tg = 17.21 t/s, tg_3s = 16.99 t/s 0.51.952.357 I slot print_timing: id 3 | task 0 | n_decoded = 618, tg = 17.19 t/s, tg_3s = 16.99 t/s 0.54.955.255 I slot print_timing: id 3 | task 0 | n_decoded = 669, tg = 17.18 t/s, tg_3s = 16.98 t/s 0.58.009.799 I slot print_timing: id 3 | task 0 | n_decoded = 720, tg = 17.14 t/s, tg_3s = 16.70 t/s 1.01.012.400 I slot print_timing: id 3 | task 0 | n_decoded = 770, tg = 17.11 t/s, tg_3s = 16.65 t/s 1.04.061.660 I slot print_timing: id 3 | task 0 | n_decoded = 821, tg = 17.08 t/s, tg_3s = 16.73 t/s 1.07.104.314 I slot print_timing: id 3 | task 0 | n_decoded = 872, tg = 17.06 t/s, tg_3s = 16.76 t/s 1.10.150.258 I slot print_timing: id 3 | task 0 | n_decoded = 923, tg = 17.05 t/s, tg_3s = 16.74 t/s 1.13.159.295 I slot print_timing: id 3 | task 0 | n_decoded = 973, tg = 17.02 t/s, tg_3s = 16.62 t/s 1.16.205.572 I slot print_timing: id 3 | task 0 | n_decoded = 1024, tg = 17.01 t/s, tg_3s = 16.74 t/s 1.19.250.466 I slot print_timing: id 3 | task 0 | n_decoded = 1075, tg = 17.00 t/s, tg_3s = 16.75 t/s 1.22.299.398 I slot print_timing: id 3 | task 0 | n_decoded = 1126, tg = 16.98 t/s, tg_3s = 16.73 t/s 1.25.350.284 I slot print_timing: id 3 | task 0 | n_decoded = 1177, tg = 16.97 t/s, tg_3s = 16.72 t/s 1.28.368.672 I slot print_timing: id 3 | task 0 | n_decoded = 1227, tg = 16.96 t/s, tg_3s = 16.57 t/s 1.31.378.374 I slot print_timing: id 3 | task 0 | n_decoded = 1277, tg = 16.94 t/s, tg_3s = 16.61 t/s 1.34.390.292 I slot print_timing: id 3 | task 0 | n_decoded = 1327, tg = 16.93 t/s, tg_3s = 16.60 t/s 1.37.407.265 I slot print_timing: id 3 | task 0 | n_decoded = 1377, tg = 16.92 t/s, tg_3s = 16.57 t/s 1.40.420.285 I slot print_timing: id 3 | task 0 | n_decoded = 1427, tg = 16.90 t/s, tg_3s = 16.59 t/s 1.43.458.252 I slot print_timing: id 3 | task 0 | n_decoded = 1477, tg = 16.89 t/s, tg_3s = 16.46 t/s 1.46.493.302 I slot print_timing: id 3 | task 0 | n_decoded = 1527, tg = 16.87 t/s, tg_3s = 16.47 t/s 1.49.529.480 I slot print_timing: id 3 | task 0 | n_decoded = 1577, tg = 16.86 t/s, tg_3s = 16.47 t/s 1.52.570.778 I slot print_timing: id 3 | task 0 | n_decoded = 1627, tg = 16.85 t/s, tg_3s = 16.44 t/s 1.55.614.559 I slot print_timing: id 3 | task 0 | n_decoded = 1677, tg = 16.84 t/s, tg_3s = 16.43 t/s 1.58.648.755 I slot print_timing: id 3 | task 0 | n_decoded = 1725, tg = 16.81 t/s, tg_3s = 15.82 t/s 1.59.032.761 I slot print_timing: id 3 | task 0 | prompt eval time = 1036.98 ms / 99 tokens ( 10.47 ms per token, 95.47 tokens per second) 1.59.032.765 I slot print_timing: id 3 | task 0 | eval time = 103029.12 ms / 1731 tokens ( 59.52 ms per token, 16.80 tokens per second) 1.59.032.766 I slot print_timing: id 3 | task 0 | total time = 104066.10 ms / 1830 tokens 1.59.032.770 I slot print_timing: id 3 | task 0 | graphs reused = 1723 1.59.032.824 I slot release: id 3 | task 0 | stop processing: n_tokens = 1829, truncated = 0 1.59.032.835 I srv update_slots: all slots are idle 1.59.035.572 I srv operator(): Chat format: peg-gemma4 1.59.035.905 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.817 (> 0.100 thold), f_keep = 0.042 1.59.035.906 I srv get_availabl: updating prompt cache 1.59.036.017 W srv prompt_save: - saving prompt with length 1829, total state size = 942.925 MiB (draft: 0.000 MiB) 2.00.251.092 I srv load: - looking for better prompt, base f_keep = 0.042, sim = 0.817 2.00.251.098 I srv update: - cache state: 1 prompts, 999.958 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 2.00.251.099 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB 2.00.251.100 I srv get_availabl: prompt cache update took 1215.19 ms 2.00.251.168 I slot launch_slot_: id 3 | task 1734 | processing task, is_child = 0 2.00.251.169 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 2.00.251.169 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 2.00.251.196 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 2.00.251.196 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 2.00.251.219 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 2.00.251.219 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 2.00.251.239 I slot update_slots: id 3 | task 1734 | Checking checkpoint with [0, 72] against 0... 2.00.270.218 W slot update_slots: id 3 | task 1734 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 2.06.323.887 I slot print_timing: id 3 | task 1734 | n_decoded = 100, tg = 17.40 t/s, tg_3s = 17.40 t/s 2.09.338.883 I slot print_timing: id 3 | task 1734 | n_decoded = 152, tg = 17.35 t/s, tg_3s = 17.25 t/s 2.12.365.340 I slot print_timing: id 3 | task 1734 | n_decoded = 204, tg = 17.31 t/s, tg_3s = 17.18 t/s 2.15.388.370 I slot print_timing: id 3 | task 1734 | n_decoded = 256, tg = 17.28 t/s, tg_3s = 17.20 t/s 2.18.414.463 I slot print_timing: id 3 | task 1734 | n_decoded = 308, tg = 17.27 t/s, tg_3s = 17.18 t/s 2.21.446.517 I slot print_timing: id 3 | task 1734 | n_decoded = 360, tg = 17.25 t/s, tg_3s = 17.15 t/s 2.24.477.097 I slot print_timing: id 3 | task 1734 | n_decoded = 412, tg = 17.24 t/s, tg_3s = 17.16 t/s 2.27.480.458 I slot print_timing: id 3 | task 1734 | n_decoded = 463, tg = 17.21 t/s, tg_3s = 16.98 t/s 2.30.481.462 I slot print_timing: id 3 | task 1734 | n_decoded = 514, tg = 17.19 t/s, tg_3s = 16.99 t/s 2.33.483.477 I slot print_timing: id 3 | task 1734 | n_decoded = 565, tg = 17.17 t/s, tg_3s = 16.99 t/s 2.36.487.828 I slot print_timing: id 3 | task 1734 | n_decoded = 616, tg = 17.15 t/s, tg_3s = 16.98 t/s 2.39.491.291 I slot print_timing: id 3 | task 1734 | n_decoded = 667, tg = 17.14 t/s, tg_3s = 16.98 t/s 2.42.547.696 I slot print_timing: id 3 | task 1734 | n_decoded = 718, tg = 17.11 t/s, tg_3s = 16.69 t/s 2.45.604.734 I slot print_timing: id 3 | task 1734 | n_decoded = 769, tg = 17.08 t/s, tg_3s = 16.68 t/s 2.47.524.807 I slot print_timing: id 3 | task 1734 | prompt eval time = 326.14 ms / 21 tokens ( 15.53 ms per token, 64.39 tokens per second) 2.47.524.810 I slot print_timing: id 3 | task 1734 | eval time = 46947.42 ms / 801 tokens ( 58.61 ms per token, 17.06 tokens per second) 2.47.524.811 I slot print_timing: id 3 | task 1734 | total time = 47273.56 ms / 822 tokens 2.47.524.812 I slot print_timing: id 3 | task 1734 | graphs reused = 2519 2.47.524.843 I slot release: id 3 | task 1734 | stop processing: n_tokens = 893, truncated = 0 2.47.524.855 I srv update_slots: all slots are idle 2.47.527.500 I srv operator(): Chat format: peg-gemma4 2.47.527.836 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.809 (> 0.100 thold), f_keep = 0.085 2.47.527.837 I srv get_availabl: updating prompt cache 2.47.527.920 W srv prompt_save: - saving prompt with length 893, total state size = 767.444 MiB (draft: 0.000 MiB) 2.48.212.915 I srv load: - looking for better prompt, base f_keep = 0.085, sim = 0.809 2.48.212.921 I srv update: - cache state: 2 prompts, 1824.435 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 2.48.212.922 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB 2.48.212.923 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB 2.48.212.924 I srv get_availabl: prompt cache update took 685.09 ms 2.48.212.984 I slot launch_slot_: id 3 | task 2538 | processing task, is_child = 0 2.48.212.987 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 2.48.212.988 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 2.48.213.008 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 2.48.213.009 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 2.48.213.020 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 2.48.213.020 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 2.48.213.039 I slot update_slots: id 3 | task 2538 | Checking checkpoint with [0, 72] against 0... 2.48.231.785 W slot update_slots: id 3 | task 2538 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 2.54.381.907 I slot print_timing: id 3 | task 2538 | n_decoded = 100, tg = 17.41 t/s, tg_3s = 17.41 t/s 2.57.395.104 I slot print_timing: id 3 | task 2538 | n_decoded = 152, tg = 17.36 t/s, tg_3s = 17.26 t/s 3.00.435.656 I slot print_timing: id 3 | task 2538 | n_decoded = 204, tg = 17.29 t/s, tg_3s = 17.10 t/s 3.03.475.503 I slot print_timing: id 3 | task 2538 | n_decoded = 256, tg = 17.25 t/s, tg_3s = 17.11 t/s 3.06.510.259 I slot print_timing: id 3 | task 2538 | n_decoded = 308, tg = 17.23 t/s, tg_3s = 17.13 t/s 3.09.543.474 I slot print_timing: id 3 | task 2538 | n_decoded = 360, tg = 17.22 t/s, tg_3s = 17.14 t/s 3.12.576.515 I slot print_timing: id 3 | task 2538 | n_decoded = 412, tg = 17.21 t/s, tg_3s = 17.14 t/s 3.15.581.605 I slot print_timing: id 3 | task 2538 | n_decoded = 463, tg = 17.18 t/s, tg_3s = 16.97 t/s 3.18.583.857 I slot print_timing: id 3 | task 2538 | n_decoded = 514, tg = 17.16 t/s, tg_3s = 16.99 t/s 3.20.998.535 I slot print_timing: id 3 | task 2538 | prompt eval time = 424.78 ms / 22 tokens ( 19.31 ms per token, 51.79 tokens per second) 3.20.998.539 I slot print_timing: id 3 | task 2538 | eval time = 32360.71 ms / 555 tokens ( 58.31 ms per token, 17.15 tokens per second) 3.20.998.539 I slot print_timing: id 3 | task 2538 | total time = 32785.49 ms / 577 tokens 3.20.998.540 I slot print_timing: id 3 | task 2538 | graphs reused = 3070 3.20.998.575 I slot release: id 3 | task 2538 | stop processing: n_tokens = 648, truncated = 0 3.20.998.583 I srv update_slots: all slots are idle 3.21.001.203 I srv operator(): Chat format: peg-gemma4 3.21.001.534 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.817 (> 0.100 thold), f_keep = 0.117 3.21.001.537 I srv get_availabl: updating prompt cache 3.21.001.603 W srv prompt_save: - saving prompt with length 648, total state size = 556.891 MiB (draft: 0.000 MiB) 3.21.439.602 I srv load: - looking for better prompt, base f_keep = 0.117, sim = 0.817 3.21.439.609 I srv update: - cache state: 3 prompts, 2438.359 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 3.21.439.610 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB 3.21.439.610 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB 3.21.439.611 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB 3.21.439.612 I srv get_availabl: prompt cache update took 438.07 ms 3.21.439.670 I slot launch_slot_: id 3 | task 3096 | processing task, is_child = 0 3.21.439.671 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 3.21.439.672 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 3.21.439.694 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 3.21.439.694 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 3.21.439.720 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 3.21.439.720 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 3.21.439.750 I slot update_slots: id 3 | task 3096 | Checking checkpoint with [0, 72] against 0... 3.21.458.546 W slot update_slots: id 3 | task 3096 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 3.27.516.280 I slot print_timing: id 3 | task 3096 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s 3.30.532.270 I slot print_timing: id 3 | task 3096 | n_decoded = 152, tg = 17.34 t/s, tg_3s = 17.24 t/s 3.33.576.662 I slot print_timing: id 3 | task 3096 | n_decoded = 204, tg = 17.27 t/s, tg_3s = 17.08 t/s 3.36.615.438 I slot print_timing: id 3 | task 3096 | n_decoded = 256, tg = 17.24 t/s, tg_3s = 17.11 t/s 3.39.640.275 I slot print_timing: id 3 | task 3096 | n_decoded = 308, tg = 17.23 t/s, tg_3s = 17.19 t/s 3.42.662.343 I slot print_timing: id 3 | task 3096 | n_decoded = 360, tg = 17.23 t/s, tg_3s = 17.21 t/s 3.45.678.415 I slot print_timing: id 3 | task 3096 | n_decoded = 412, tg = 17.23 t/s, tg_3s = 17.24 t/s 3.48.725.336 I slot print_timing: id 3 | task 3096 | n_decoded = 464, tg = 17.21 t/s, tg_3s = 17.07 t/s 3.51.769.121 I slot print_timing: id 3 | task 3096 | n_decoded = 516, tg = 17.20 t/s, tg_3s = 17.08 t/s 3.54.818.283 I slot print_timing: id 3 | task 3096 | n_decoded = 568, tg = 17.18 t/s, tg_3s = 17.05 t/s 3.57.870.583 I slot print_timing: id 3 | task 3096 | n_decoded = 620, tg = 17.17 t/s, tg_3s = 17.04 t/s 4.00.923.196 I slot print_timing: id 3 | task 3096 | n_decoded = 672, tg = 17.16 t/s, tg_3s = 17.03 t/s 4.03.977.176 I slot print_timing: id 3 | task 3096 | n_decoded = 723, tg = 17.13 t/s, tg_3s = 16.70 t/s 4.07.029.671 I slot print_timing: id 3 | task 3096 | n_decoded = 774, tg = 17.10 t/s, tg_3s = 16.71 t/s 4.10.083.998 I slot print_timing: id 3 | task 3096 | n_decoded = 825, tg = 17.07 t/s, tg_3s = 16.70 t/s 4.13.091.905 I slot print_timing: id 3 | task 3096 | n_decoded = 875, tg = 17.05 t/s, tg_3s = 16.62 t/s 4.16.149.731 I slot print_timing: id 3 | task 3096 | n_decoded = 926, tg = 17.03 t/s, tg_3s = 16.68 t/s 4.19.160.939 I slot print_timing: id 3 | task 3096 | n_decoded = 976, tg = 17.00 t/s, tg_3s = 16.60 t/s 4.22.161.265 I slot print_timing: id 3 | task 3096 | n_decoded = 1026, tg = 16.99 t/s, tg_3s = 16.66 t/s 4.25.163.271 I slot print_timing: id 3 | task 3096 | n_decoded = 1076, tg = 16.97 t/s, tg_3s = 16.66 t/s 4.28.163.381 I slot print_timing: id 3 | task 3096 | n_decoded = 1126, tg = 16.96 t/s, tg_3s = 16.67 t/s 4.31.223.296 I slot print_timing: id 3 | task 3096 | n_decoded = 1177, tg = 16.95 t/s, tg_3s = 16.67 t/s 4.34.232.315 I slot print_timing: id 3 | task 3096 | n_decoded = 1227, tg = 16.93 t/s, tg_3s = 16.62 t/s 4.36.095.257 I slot print_timing: id 3 | task 3096 | prompt eval time = 326.08 ms / 21 tokens ( 15.53 ms per token, 64.40 tokens per second) 4.36.095.260 I slot print_timing: id 3 | task 3096 | eval time = 74329.42 ms / 1258 tokens ( 59.09 ms per token, 16.92 tokens per second) 4.36.095.261 I slot print_timing: id 3 | task 3096 | total time = 74655.50 ms / 1279 tokens 4.36.095.262 I slot print_timing: id 3 | task 3096 | graphs reused = 4321 4.36.095.301 I slot release: id 3 | task 3096 | stop processing: n_tokens = 1350, truncated = 0 4.36.095.314 I srv update_slots: all slots are idle 4.36.098.387 I srv operator(): Chat format: peg-gemma4 4.36.098.726 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.717 (> 0.100 thold), f_keep = 0.056 4.36.098.728 I srv get_availabl: updating prompt cache 4.36.098.821 W srv prompt_save: - saving prompt with length 1350, total state size = 905.497 MiB (draft: 0.000 MiB) 4.36.726.543 I srv load: - looking for better prompt, base f_keep = 0.056, sim = 0.717 4.36.726.550 I srv update: - cache state: 4 prompts, 3400.890 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 4.36.726.551 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB 4.36.726.552 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB 4.36.726.552 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB 4.36.726.553 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB 4.36.726.554 I srv get_availabl: prompt cache update took 627.83 ms 4.36.726.613 I slot launch_slot_: id 3 | task 4357 | processing task, is_child = 0 4.36.726.614 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 4.36.726.615 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 4.36.726.634 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 4.36.726.634 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 4.36.726.646 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 4.36.726.646 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 4.36.726.664 I slot update_slots: id 3 | task 4357 | Checking checkpoint with [0, 72] against 0... 4.36.745.738 W slot update_slots: id 3 | task 4357 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 4.42.949.040 I slot print_timing: id 3 | task 4357 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s 4.45.966.629 I slot print_timing: id 3 | task 4357 | n_decoded = 152, tg = 17.34 t/s, tg_3s = 17.23 t/s 4.48.999.262 I slot print_timing: id 3 | task 4357 | n_decoded = 204, tg = 17.29 t/s, tg_3s = 17.15 t/s 4.52.033.412 I slot print_timing: id 3 | task 4357 | n_decoded = 256, tg = 17.26 t/s, tg_3s = 17.14 t/s 4.55.064.692 I slot print_timing: id 3 | task 4357 | n_decoded = 308, tg = 17.24 t/s, tg_3s = 17.15 t/s 4.58.100.715 I slot print_timing: id 3 | task 4357 | n_decoded = 360, tg = 17.22 t/s, tg_3s = 17.13 t/s 5.01.149.940 I slot print_timing: id 3 | task 4357 | n_decoded = 412, tg = 17.20 t/s, tg_3s = 17.05 t/s 5.04.204.546 I slot print_timing: id 3 | task 4357 | n_decoded = 464, tg = 17.18 t/s, tg_3s = 17.02 t/s 5.07.262.908 I slot print_timing: id 3 | task 4357 | n_decoded = 516, tg = 17.16 t/s, tg_3s = 17.00 t/s 5.10.266.002 I slot print_timing: id 3 | task 4357 | n_decoded = 567, tg = 17.15 t/s, tg_3s = 16.98 t/s 5.13.271.508 I slot print_timing: id 3 | task 4357 | n_decoded = 618, tg = 17.13 t/s, tg_3s = 16.97 t/s 5.16.287.016 I slot print_timing: id 3 | task 4357 | n_decoded = 669, tg = 17.12 t/s, tg_3s = 16.91 t/s 5.19.337.934 I slot print_timing: id 3 | task 4357 | n_decoded = 720, tg = 17.09 t/s, tg_3s = 16.72 t/s 5.22.375.615 I slot print_timing: id 3 | task 4357 | n_decoded = 771, tg = 17.07 t/s, tg_3s = 16.79 t/s 5.25.410.651 I slot print_timing: id 3 | task 4357 | n_decoded = 822, tg = 17.05 t/s, tg_3s = 16.80 t/s 5.28.445.978 I slot print_timing: id 3 | task 4357 | n_decoded = 873, tg = 17.04 t/s, tg_3s = 16.80 t/s 5.31.492.878 I slot print_timing: id 3 | task 4357 | n_decoded = 924, tg = 17.02 t/s, tg_3s = 16.74 t/s 5.34.550.811 I slot print_timing: id 3 | task 4357 | n_decoded = 975, tg = 17.00 t/s, tg_3s = 16.68 t/s 5.37.610.835 I slot print_timing: id 3 | task 4357 | n_decoded = 1026, tg = 16.98 t/s, tg_3s = 16.67 t/s 5.40.611.009 I slot print_timing: id 3 | task 4357 | n_decoded = 1076, tg = 16.97 t/s, tg_3s = 16.67 t/s 5.43.669.837 I slot print_timing: id 3 | task 4357 | n_decoded = 1127, tg = 16.95 t/s, tg_3s = 16.67 t/s 5.46.679.825 I slot print_timing: id 3 | task 4357 | n_decoded = 1177, tg = 16.94 t/s, tg_3s = 16.61 t/s 5.49.695.207 I slot print_timing: id 3 | task 4357 | n_decoded = 1227, tg = 16.93 t/s, tg_3s = 16.58 t/s 5.52.712.281 I slot print_timing: id 3 | task 4357 | n_decoded = 1277, tg = 16.91 t/s, tg_3s = 16.57 t/s 5.55.730.387 I slot print_timing: id 3 | task 4357 | n_decoded = 1327, tg = 16.90 t/s, tg_3s = 16.57 t/s 5.58.747.343 I slot print_timing: id 3 | task 4357 | n_decoded = 1377, tg = 16.89 t/s, tg_3s = 16.57 t/s 6.01.769.637 I slot print_timing: id 3 | task 4357 | n_decoded = 1427, tg = 16.87 t/s, tg_3s = 16.54 t/s 6.04.812.628 I slot print_timing: id 3 | task 4357 | n_decoded = 1477, tg = 16.86 t/s, tg_3s = 16.43 t/s 6.07.856.101 I slot print_timing: id 3 | task 4357 | n_decoded = 1527, tg = 16.84 t/s, tg_3s = 16.43 t/s 6.10.890.004 I slot print_timing: id 3 | task 4357 | n_decoded = 1577, tg = 16.83 t/s, tg_3s = 16.48 t/s 6.13.915.034 I slot print_timing: id 3 | task 4357 | n_decoded = 1627, tg = 16.82 t/s, tg_3s = 16.53 t/s 6.16.813.577 I slot print_timing: id 3 | task 4357 | prompt eval time = 472.57 ms / 34 tokens ( 13.90 ms per token, 71.95 tokens per second) 6.16.813.580 I slot print_timing: id 3 | task 4357 | eval time = 99614.34 ms / 1675 tokens ( 59.47 ms per token, 16.81 tokens per second) 6.16.813.581 I slot print_timing: id 3 | task 4357 | total time = 100086.91 ms / 1709 tokens 6.16.813.582 I slot print_timing: id 3 | task 4357 | graphs reused = 5988 6.16.813.620 I slot release: id 3 | task 4357 | stop processing: n_tokens = 1780, truncated = 0 6.16.813.635 I srv update_slots: all slots are idle 6.16.816.293 I srv operator(): Chat format: peg-gemma4 6.16.816.633 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.800 (> 0.100 thold), f_keep = 0.043 6.16.816.635 I srv get_availabl: updating prompt cache 6.16.816.762 W srv prompt_save: - saving prompt with length 1780, total state size = 939.096 MiB (draft: 0.000 MiB) 6.17.467.166 I srv load: - looking for better prompt, base f_keep = 0.043, sim = 0.800 6.17.467.173 I srv update: - cache state: 5 prompts, 4397.019 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 6.17.467.174 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB 6.17.467.174 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB 6.17.467.175 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB 6.17.467.176 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB 6.17.467.176 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB 6.17.467.178 I srv get_availabl: prompt cache update took 650.54 ms 6.17.467.241 I slot launch_slot_: id 3 | task 6035 | processing task, is_child = 0 6.17.467.242 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 6.17.467.242 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 6.17.467.265 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 6.17.467.265 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 6.17.467.277 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 6.17.467.277 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 6.17.467.298 I slot update_slots: id 3 | task 6035 | Checking checkpoint with [0, 72] against 0... 6.17.486.209 W slot update_slots: id 3 | task 6035 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 6.23.639.141 I slot print_timing: id 3 | task 6035 | n_decoded = 100, tg = 17.40 t/s, tg_3s = 17.40 t/s 6.26.653.061 I slot print_timing: id 3 | task 6035 | n_decoded = 152, tg = 17.35 t/s, tg_3s = 17.25 t/s 6.29.682.664 I slot print_timing: id 3 | task 6035 | n_decoded = 204, tg = 17.30 t/s, tg_3s = 17.16 t/s 6.32.709.166 I slot print_timing: id 3 | task 6035 | n_decoded = 256, tg = 17.28 t/s, tg_3s = 17.18 t/s 6.35.734.709 I slot print_timing: id 3 | task 6035 | n_decoded = 308, tg = 17.26 t/s, tg_3s = 17.19 t/s 6.38.763.551 I slot print_timing: id 3 | task 6035 | n_decoded = 360, tg = 17.25 t/s, tg_3s = 17.17 t/s 6.41.801.113 I slot print_timing: id 3 | task 6035 | n_decoded = 412, tg = 17.23 t/s, tg_3s = 17.12 t/s 6.44.806.412 I slot print_timing: id 3 | task 6035 | n_decoded = 463, tg = 17.20 t/s, tg_3s = 16.97 t/s 6.47.811.419 I slot print_timing: id 3 | task 6035 | n_decoded = 514, tg = 17.18 t/s, tg_3s = 16.97 t/s 6.50.825.419 I slot print_timing: id 3 | task 6035 | n_decoded = 565, tg = 17.16 t/s, tg_3s = 16.92 t/s 6.53.836.452 I slot print_timing: id 3 | task 6035 | n_decoded = 616, tg = 17.14 t/s, tg_3s = 16.94 t/s 6.56.848.527 I slot print_timing: id 3 | task 6035 | n_decoded = 667, tg = 17.12 t/s, tg_3s = 16.93 t/s 6.59.892.588 I slot print_timing: id 3 | task 6035 | n_decoded = 718, tg = 17.10 t/s, tg_3s = 16.75 t/s 7.02.923.604 I slot print_timing: id 3 | task 6035 | n_decoded = 769, tg = 17.08 t/s, tg_3s = 16.83 t/s 7.05.957.888 I slot print_timing: id 3 | task 6035 | n_decoded = 820, tg = 17.06 t/s, tg_3s = 16.81 t/s 7.08.991.635 I slot print_timing: id 3 | task 6035 | n_decoded = 871, tg = 17.05 t/s, tg_3s = 16.81 t/s 7.12.032.691 I slot print_timing: id 3 | task 6035 | n_decoded = 922, tg = 17.03 t/s, tg_3s = 16.77 t/s 7.15.033.158 I slot print_timing: id 3 | task 6035 | n_decoded = 972, tg = 17.01 t/s, tg_3s = 16.66 t/s 7.18.084.039 I slot print_timing: id 3 | task 6035 | n_decoded = 1023, tg = 17.00 t/s, tg_3s = 16.72 t/s 7.21.085.576 I slot print_timing: id 3 | task 6035 | n_decoded = 1073, tg = 16.98 t/s, tg_3s = 16.66 t/s 7.21.265.598 I slot print_timing: id 3 | task 6035 | prompt eval time = 425.41 ms / 23 tokens ( 18.50 ms per token, 54.07 tokens per second) 7.21.265.602 I slot print_timing: id 3 | task 6035 | eval time = 63372.88 ms / 1076 tokens ( 58.90 ms per token, 16.98 tokens per second) 7.21.265.602 I slot print_timing: id 3 | task 6035 | total time = 63798.29 ms / 1099 tokens 7.21.265.603 I slot print_timing: id 3 | task 6035 | graphs reused = 7058 7.21.265.639 I slot release: id 3 | task 6035 | stop processing: n_tokens = 1170, truncated = 0 7.21.265.656 I srv update_slots: all slots are idle 7.21.268.349 I srv operator(): Chat format: peg-gemma4 7.21.268.676 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.846 (> 0.100 thold), f_keep = 0.066 7.21.268.678 I srv get_availabl: updating prompt cache 7.21.268.762 W srv prompt_save: - saving prompt with length 1170, total state size = 891.433 MiB (draft: 0.000 MiB) 7.21.878.086 I srv load: - looking for better prompt, base f_keep = 0.066, sim = 0.846 7.21.878.094 I srv update: - cache state: 6 prompts, 5345.485 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 7.21.878.095 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB 7.21.878.095 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB 7.21.878.096 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB 7.21.878.097 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB 7.21.878.097 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB 7.21.878.098 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB 7.21.878.099 I srv get_availabl: prompt cache update took 609.42 ms 7.21.878.160 I slot launch_slot_: id 3 | task 7114 | processing task, is_child = 0 7.21.878.161 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 7.21.878.162 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 7.21.878.179 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 7.21.878.180 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 7.21.878.191 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 7.21.878.192 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 7.21.878.210 I slot update_slots: id 3 | task 7114 | Checking checkpoint with [0, 72] against 0... 7.21.896.853 W slot update_slots: id 3 | task 7114 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 7.27.948.017 I slot print_timing: id 3 | task 7114 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s 7.30.965.064 I slot print_timing: id 3 | task 7114 | n_decoded = 152, tg = 17.34 t/s, tg_3s = 17.24 t/s 7.34.011.139 I slot print_timing: id 3 | task 7114 | n_decoded = 204, tg = 17.27 t/s, tg_3s = 17.07 t/s 7.37.057.334 I slot print_timing: id 3 | task 7114 | n_decoded = 256, tg = 17.23 t/s, tg_3s = 17.07 t/s 7.40.098.158 I slot print_timing: id 3 | task 7114 | n_decoded = 308, tg = 17.21 t/s, tg_3s = 17.10 t/s 7.43.140.431 I slot print_timing: id 3 | task 7114 | n_decoded = 360, tg = 17.19 t/s, tg_3s = 17.09 t/s 7.46.186.036 I slot print_timing: id 3 | task 7114 | n_decoded = 412, tg = 17.18 t/s, tg_3s = 17.07 t/s 7.49.202.254 I slot print_timing: id 3 | task 7114 | n_decoded = 463, tg = 17.15 t/s, tg_3s = 16.91 t/s 7.52.209.234 I slot print_timing: id 3 | task 7114 | n_decoded = 514, tg = 17.13 t/s, tg_3s = 16.96 t/s 7.55.253.745 I slot print_timing: id 3 | task 7114 | n_decoded = 566, tg = 17.12 t/s, tg_3s = 17.08 t/s 7.58.296.322 I slot print_timing: id 3 | task 7114 | n_decoded = 618, tg = 17.12 t/s, tg_3s = 17.09 t/s 8.01.349.679 I slot print_timing: id 3 | task 7114 | n_decoded = 670, tg = 17.11 t/s, tg_3s = 17.03 t/s 8.04.389.768 I slot print_timing: id 3 | task 7114 | n_decoded = 721, tg = 17.09 t/s, tg_3s = 16.78 t/s 8.07.424.704 I slot print_timing: id 3 | task 7114 | n_decoded = 772, tg = 17.07 t/s, tg_3s = 16.80 t/s 8.10.466.861 I slot print_timing: id 3 | task 7114 | n_decoded = 823, tg = 17.05 t/s, tg_3s = 16.76 t/s 8.13.505.693 I slot print_timing: id 3 | task 7114 | n_decoded = 874, tg = 17.03 t/s, tg_3s = 16.78 t/s 8.16.546.166 I slot print_timing: id 3 | task 7114 | n_decoded = 925, tg = 17.02 t/s, tg_3s = 16.77 t/s 8.19.552.166 I slot print_timing: id 3 | task 7114 | n_decoded = 975, tg = 17.00 t/s, tg_3s = 16.63 t/s 8.22.552.258 I slot print_timing: id 3 | task 7114 | n_decoded = 1025, tg = 16.98 t/s, tg_3s = 16.67 t/s 8.25.554.307 I slot print_timing: id 3 | task 7114 | n_decoded = 1075, tg = 16.97 t/s, tg_3s = 16.66 t/s 8.28.613.292 I slot print_timing: id 3 | task 7114 | n_decoded = 1126, tg = 16.95 t/s, tg_3s = 16.67 t/s 8.31.618.166 I slot print_timing: id 3 | task 7114 | n_decoded = 1176, tg = 16.94 t/s, tg_3s = 16.64 t/s 8.34.631.545 I slot print_timing: id 3 | task 7114 | n_decoded = 1226, tg = 16.93 t/s, tg_3s = 16.59 t/s 8.34.993.139 I slot print_timing: id 3 | task 7114 | prompt eval time = 320.89 ms / 19 tokens ( 16.89 ms per token, 59.21 tokens per second) 8.34.993.142 I slot print_timing: id 3 | task 7114 | eval time = 72794.03 ms / 1232 tokens ( 59.09 ms per token, 16.92 tokens per second) 8.34.993.144 I slot print_timing: id 3 | task 7114 | total time = 73114.92 ms / 1251 tokens 8.34.993.144 I slot print_timing: id 3 | task 7114 | graphs reused = 8283 8.34.993.181 I slot release: id 3 | task 7114 | stop processing: n_tokens = 1322, truncated = 0 8.34.993.193 I srv update_slots: all slots are idle 8.34.995.973 I srv operator(): Chat format: peg-gemma4 8.34.996.297 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.828 (> 0.100 thold), f_keep = 0.058 8.34.996.299 I srv get_availabl: updating prompt cache 8.34.996.389 W srv prompt_save: - saving prompt with length 1322, total state size = 903.310 MiB (draft: 0.000 MiB) 8.35.614.159 I srv load: - looking for better prompt, base f_keep = 0.058, sim = 0.828 8.35.614.170 I srv update: - cache state: 7 prompts, 6305.828 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 8.35.614.171 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB 8.35.614.172 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB 8.35.614.172 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB 8.35.614.173 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB 8.35.614.173 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB 8.35.614.174 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB 8.35.614.174 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB 8.35.614.175 I srv get_availabl: prompt cache update took 617.88 ms 8.35.614.232 I slot launch_slot_: id 3 | task 8349 | processing task, is_child = 0 8.35.614.233 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 8.35.614.234 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 8.35.614.254 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 8.35.614.254 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 8.35.614.266 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 8.35.614.266 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 8.35.614.285 I slot update_slots: id 3 | task 8349 | Checking checkpoint with [0, 72] against 0... 8.35.633.164 W slot update_slots: id 3 | task 8349 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 8.41.683.553 I slot print_timing: id 3 | task 8349 | n_decoded = 100, tg = 17.41 t/s, tg_3s = 17.41 t/s 8.44.689.539 I slot print_timing: id 3 | task 8349 | n_decoded = 152, tg = 17.37 t/s, tg_3s = 17.30 t/s 8.47.719.671 I slot print_timing: id 3 | task 8349 | n_decoded = 204, tg = 17.32 t/s, tg_3s = 17.16 t/s 8.50.748.165 I slot print_timing: id 3 | task 8349 | n_decoded = 256, tg = 17.29 t/s, tg_3s = 17.17 t/s 8.53.778.158 I slot print_timing: id 3 | task 8349 | n_decoded = 308, tg = 17.27 t/s, tg_3s = 17.16 t/s 8.56.812.744 I slot print_timing: id 3 | task 8349 | n_decoded = 360, tg = 17.25 t/s, tg_3s = 17.14 t/s 8.59.843.945 I slot print_timing: id 3 | task 8349 | n_decoded = 412, tg = 17.24 t/s, tg_3s = 17.15 t/s 9.02.853.083 I slot print_timing: id 3 | task 8349 | n_decoded = 463, tg = 17.20 t/s, tg_3s = 16.95 t/s 9.05.855.084 I slot print_timing: id 3 | task 8349 | n_decoded = 514, tg = 17.18 t/s, tg_3s = 16.99 t/s 9.08.862.087 I slot print_timing: id 3 | task 8349 | n_decoded = 565, tg = 17.16 t/s, tg_3s = 16.96 t/s 9.11.870.079 I slot print_timing: id 3 | task 8349 | n_decoded = 616, tg = 17.14 t/s, tg_3s = 16.95 t/s 9.14.878.199 I slot print_timing: id 3 | task 8349 | n_decoded = 667, tg = 17.13 t/s, tg_3s = 16.95 t/s 9.17.928.064 I slot print_timing: id 3 | task 8349 | n_decoded = 718, tg = 17.10 t/s, tg_3s = 16.72 t/s 9.20.976.933 I slot print_timing: id 3 | task 8349 | n_decoded = 769, tg = 17.08 t/s, tg_3s = 16.73 t/s 9.24.028.107 I slot print_timing: id 3 | task 8349 | n_decoded = 820, tg = 17.05 t/s, tg_3s = 16.71 t/s 9.27.075.381 I slot print_timing: id 3 | task 8349 | n_decoded = 871, tg = 17.03 t/s, tg_3s = 16.74 t/s 9.30.075.423 I slot print_timing: id 3 | task 8349 | n_decoded = 921, tg = 17.01 t/s, tg_3s = 16.67 t/s 9.33.080.147 I slot print_timing: id 3 | task 8349 | n_decoded = 971, tg = 16.99 t/s, tg_3s = 16.64 t/s 9.36.127.216 I slot print_timing: id 3 | task 8349 | n_decoded = 1022, tg = 16.98 t/s, tg_3s = 16.74 t/s 9.39.175.833 I slot print_timing: id 3 | task 8349 | n_decoded = 1073, tg = 16.97 t/s, tg_3s = 16.73 t/s 9.42.228.561 I slot print_timing: id 3 | task 8349 | n_decoded = 1124, tg = 16.96 t/s, tg_3s = 16.71 t/s 9.42.826.238 I slot print_timing: id 3 | task 8349 | prompt eval time = 326.31 ms / 21 tokens ( 15.54 ms per token, 64.36 tokens per second) 9.42.826.241 I slot print_timing: id 3 | task 8349 | eval time = 66885.64 ms / 1134 tokens ( 58.98 ms per token, 16.95 tokens per second) 9.42.826.241 I slot print_timing: id 3 | task 8349 | total time = 67211.95 ms / 1155 tokens 9.42.826.242 I slot print_timing: id 3 | task 8349 | graphs reused = 9411 9.42.826.279 I slot release: id 3 | task 8349 | stop processing: n_tokens = 1226, truncated = 0 9.42.826.290 I srv update_slots: all slots are idle 9.42.829.021 I srv operator(): Chat format: peg-gemma4 9.42.829.360 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.613 (> 0.100 thold), f_keep = 0.062 9.42.829.362 I srv get_availabl: updating prompt cache 9.42.829.447 W srv prompt_save: - saving prompt with length 1226, total state size = 895.808 MiB (draft: 0.000 MiB) 9.43.447.532 I srv load: - looking for better prompt, base f_keep = 0.062, sim = 0.613 9.43.447.544 I srv update: - cache state: 8 prompts, 7258.670 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 9.43.447.545 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB 9.43.447.546 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB 9.43.447.547 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB 9.43.447.548 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB 9.43.447.549 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB 9.43.447.550 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB 9.43.447.550 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB 9.43.447.551 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB 9.43.447.552 I srv get_availabl: prompt cache update took 618.19 ms 9.43.447.618 I slot launch_slot_: id 3 | task 9486 | processing task, is_child = 0 9.43.447.619 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 9.43.447.620 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 9.43.447.651 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 9.43.447.651 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 9.43.447.672 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 9.43.447.673 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 9.43.447.702 I slot update_slots: id 3 | task 9486 | Checking checkpoint with [0, 72] against 0... 9.43.466.658 W slot update_slots: id 3 | task 9486 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 9.49.662.812 I slot print_timing: id 3 | task 9486 | n_decoded = 100, tg = 17.38 t/s, tg_3s = 17.38 t/s 9.52.692.402 I slot print_timing: id 3 | task 9486 | n_decoded = 152, tg = 17.30 t/s, tg_3s = 17.16 t/s 9.55.725.975 I slot print_timing: id 3 | task 9486 | n_decoded = 204, tg = 17.26 t/s, tg_3s = 17.14 t/s 9.58.766.177 I slot print_timing: id 3 | task 9486 | n_decoded = 256, tg = 17.23 t/s, tg_3s = 17.10 t/s 10.01.804.164 I slot print_timing: id 3 | task 9486 | n_decoded = 308, tg = 17.21 t/s, tg_3s = 17.12 t/s 10.04.845.486 I slot print_timing: id 3 | task 9486 | n_decoded = 360, tg = 17.19 t/s, tg_3s = 17.10 t/s 10.07.849.324 I slot print_timing: id 3 | task 9486 | n_decoded = 411, tg = 17.17 t/s, tg_3s = 16.98 t/s 10.10.861.267 I slot print_timing: id 3 | task 9486 | n_decoded = 462, tg = 17.14 t/s, tg_3s = 16.93 t/s 10.13.871.462 I slot print_timing: id 3 | task 9486 | n_decoded = 513, tg = 17.12 t/s, tg_3s = 16.94 t/s 10.16.880.466 I slot print_timing: id 3 | task 9486 | n_decoded = 564, tg = 17.11 t/s, tg_3s = 16.95 t/s 10.19.937.896 I slot print_timing: id 3 | task 9486 | n_decoded = 616, tg = 17.10 t/s, tg_3s = 17.01 t/s 10.22.777.687 I slot print_timing: id 3 | task 9486 | prompt eval time = 460.47 ms / 52 tokens ( 8.86 ms per token, 112.93 tokens per second) 10.22.777.690 I slot print_timing: id 3 | task 9486 | eval time = 38869.51 ms / 664 tokens ( 58.54 ms per token, 17.08 tokens per second) 10.22.777.691 I slot print_timing: id 3 | task 9486 | total time = 39329.98 ms / 716 tokens 10.22.777.692 I slot print_timing: id 3 | task 9486 | graphs reused = 10070 10.22.777.735 I slot release: id 3 | task 9486 | stop processing: n_tokens = 787, truncated = 0 10.22.777.747 I srv update_slots: all slots are idle 10.22.780.564 I srv operator(): Chat format: peg-gemma4 10.22.780.898 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.538 (> 0.100 thold), f_keep = 0.098 10.22.780.899 I srv get_availabl: updating prompt cache 10.22.780.974 W srv prompt_save: - saving prompt with length 787, total state size = 676.348 MiB (draft: 0.000 MiB) 10.23.258.403 I srv load: - looking for better prompt, base f_keep = 0.098, sim = 0.538 10.23.258.414 I srv update: - cache state: 9 prompts, 7992.050 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 10.23.258.415 I srv update: - prompt 0x641dae7ffd60: 1829 tokens, checkpoints: 1, 999.958 MiB 10.23.258.416 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB 10.23.258.417 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB 10.23.258.417 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB 10.23.258.418 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB 10.23.258.419 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB 10.23.258.419 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB 10.23.258.420 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB 10.23.258.421 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB 10.23.258.422 I srv get_availabl: prompt cache update took 477.52 ms 10.23.258.491 I slot launch_slot_: id 3 | task 10153 | processing task, is_child = 0 10.23.258.492 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 10.23.258.493 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 10.23.258.521 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 10.23.258.522 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 10.23.258.550 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 10.23.258.551 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 10.23.258.588 I slot update_slots: id 3 | task 10153 | Checking checkpoint with [0, 72] against 0... 10.23.277.379 W slot update_slots: id 3 | task 10153 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 10.29.741.510 I slot print_timing: id 3 | task 10153 | n_decoded = 100, tg = 17.42 t/s, tg_3s = 17.42 t/s 10.32.771.906 I slot print_timing: id 3 | task 10153 | n_decoded = 152, tg = 17.33 t/s, tg_3s = 17.16 t/s 10.35.794.733 I slot print_timing: id 3 | task 10153 | n_decoded = 204, tg = 17.30 t/s, tg_3s = 17.20 t/s 10.38.822.701 I slot print_timing: id 3 | task 10153 | n_decoded = 256, tg = 17.27 t/s, tg_3s = 17.17 t/s 10.41.854.994 I slot print_timing: id 3 | task 10153 | n_decoded = 308, tg = 17.25 t/s, tg_3s = 17.15 t/s 10.44.884.095 I slot print_timing: id 3 | task 10153 | n_decoded = 360, tg = 17.24 t/s, tg_3s = 17.17 t/s 10.47.885.759 I slot print_timing: id 3 | task 10153 | n_decoded = 411, tg = 17.21 t/s, tg_3s = 16.99 t/s 10.50.889.101 I slot print_timing: id 3 | task 10153 | n_decoded = 462, tg = 17.18 t/s, tg_3s = 16.98 t/s 10.53.896.124 I slot print_timing: id 3 | task 10153 | n_decoded = 513, tg = 17.16 t/s, tg_3s = 16.96 t/s 10.56.902.188 I slot print_timing: id 3 | task 10153 | n_decoded = 564, tg = 17.14 t/s, tg_3s = 16.97 t/s 10.59.908.913 I slot print_timing: id 3 | task 10153 | n_decoded = 615, tg = 17.13 t/s, tg_3s = 16.96 t/s 11.02.964.312 I slot print_timing: id 3 | task 10153 | n_decoded = 666, tg = 17.09 t/s, tg_3s = 16.69 t/s 11.05.964.367 I slot print_timing: id 3 | task 10153 | n_decoded = 716, tg = 17.06 t/s, tg_3s = 16.67 t/s 11.08.969.369 I slot print_timing: id 3 | task 10153 | n_decoded = 766, tg = 17.03 t/s, tg_3s = 16.64 t/s 11.12.027.457 I slot print_timing: id 3 | task 10153 | n_decoded = 817, tg = 17.01 t/s, tg_3s = 16.68 t/s 11.15.061.405 I slot print_timing: id 3 | task 10153 | n_decoded = 868, tg = 17.00 t/s, tg_3s = 16.81 t/s 11.18.114.457 I slot print_timing: id 3 | task 10153 | n_decoded = 919, tg = 16.98 t/s, tg_3s = 16.70 t/s 11.21.170.099 I slot print_timing: id 3 | task 10153 | n_decoded = 970, tg = 16.97 t/s, tg_3s = 16.69 t/s 11.21.289.803 I slot print_timing: id 3 | task 10153 | prompt eval time = 741.65 ms / 71 tokens ( 10.45 ms per token, 95.73 tokens per second) 11.21.289.806 I slot print_timing: id 3 | task 10153 | eval time = 57289.56 ms / 972 tokens ( 58.94 ms per token, 16.97 tokens per second) 11.21.289.807 I slot print_timing: id 3 | task 10153 | total time = 58031.21 ms / 1043 tokens 11.21.289.808 I slot print_timing: id 3 | task 10153 | graphs reused = 11036 11.21.289.850 I slot release: id 3 | task 10153 | stop processing: n_tokens = 1114, truncated = 0 11.21.289.862 I srv update_slots: all slots are idle 11.21.292.582 I srv operator(): Chat format: peg-gemma4 11.21.292.916 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.667 (> 0.100 thold), f_keep = 0.068 11.21.292.918 I srv get_availabl: updating prompt cache 11.21.293.005 W srv prompt_save: - saving prompt with length 1114, total state size = 887.057 MiB (draft: 0.000 MiB) 11.21.900.031 I srv load: - looking for better prompt, base f_keep = 0.068, sim = 0.667 11.21.900.042 W srv update: - cache size limit reached, removing oldest entry (size = 999.958 MiB) 11.21.997.934 I srv update: - cache state: 9 prompts, 7936.183 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 11.21.997.940 I srv update: - prompt 0x641daec60840: 893 tokens, checkpoints: 1, 824.477 MiB 11.21.997.940 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB 11.21.997.941 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB 11.21.997.942 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB 11.21.997.943 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB 11.21.997.944 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB 11.21.997.945 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB 11.21.997.945 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB 11.21.997.946 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB 11.21.997.948 I srv get_availabl: prompt cache update took 705.03 ms 11.21.998.024 I slot launch_slot_: id 3 | task 11128 | processing task, is_child = 0 11.21.998.025 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 11.21.998.025 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 11.21.998.046 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 11.21.998.046 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 11.21.998.061 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 11.21.998.061 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 11.21.998.085 I slot update_slots: id 3 | task 11128 | Checking checkpoint with [0, 72] against 0... 11.22.017.469 W slot update_slots: id 3 | task 11128 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 11.28.234.769 I slot print_timing: id 3 | task 11128 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s 11.31.261.236 I slot print_timing: id 3 | task 11128 | n_decoded = 152, tg = 17.32 t/s, tg_3s = 17.18 t/s 11.34.297.302 I slot print_timing: id 3 | task 11128 | n_decoded = 204, tg = 17.27 t/s, tg_3s = 17.13 t/s 11.37.332.101 I slot print_timing: id 3 | task 11128 | n_decoded = 256, tg = 17.24 t/s, tg_3s = 17.13 t/s 11.40.372.127 I slot print_timing: id 3 | task 11128 | n_decoded = 308, tg = 17.22 t/s, tg_3s = 17.11 t/s 11.43.413.001 I slot print_timing: id 3 | task 11128 | n_decoded = 360, tg = 17.20 t/s, tg_3s = 17.10 t/s 11.46.469.122 I slot print_timing: id 3 | task 11128 | n_decoded = 412, tg = 17.18 t/s, tg_3s = 17.02 t/s 11.49.476.201 I slot print_timing: id 3 | task 11128 | n_decoded = 463, tg = 17.15 t/s, tg_3s = 16.96 t/s 11.52.484.188 I slot print_timing: id 3 | task 11128 | n_decoded = 514, tg = 17.13 t/s, tg_3s = 16.95 t/s 11.55.493.334 I slot print_timing: id 3 | task 11128 | n_decoded = 565, tg = 17.12 t/s, tg_3s = 16.95 t/s 11.58.497.185 I slot print_timing: id 3 | task 11128 | n_decoded = 616, tg = 17.10 t/s, tg_3s = 16.98 t/s 12.01.498.221 I slot print_timing: id 3 | task 11128 | n_decoded = 667, tg = 17.10 t/s, tg_3s = 16.99 t/s 12.04.531.641 I slot print_timing: id 3 | task 11128 | n_decoded = 718, tg = 17.08 t/s, tg_3s = 16.81 t/s 12.07.565.272 I slot print_timing: id 3 | task 11128 | n_decoded = 769, tg = 17.06 t/s, tg_3s = 16.81 t/s 12.10.599.423 I slot print_timing: id 3 | task 11128 | n_decoded = 820, tg = 17.04 t/s, tg_3s = 16.81 t/s 12.13.640.084 I slot print_timing: id 3 | task 11128 | n_decoded = 871, tg = 17.03 t/s, tg_3s = 16.77 t/s 12.16.689.346 I slot print_timing: id 3 | task 11128 | n_decoded = 922, tg = 17.01 t/s, tg_3s = 16.73 t/s 12.19.690.368 I slot print_timing: id 3 | task 11128 | n_decoded = 972, tg = 16.99 t/s, tg_3s = 16.66 t/s 12.22.747.653 I slot print_timing: id 3 | task 11128 | n_decoded = 1023, tg = 16.98 t/s, tg_3s = 16.68 t/s 12.25.805.502 I slot print_timing: id 3 | task 11128 | n_decoded = 1074, tg = 16.96 t/s, tg_3s = 16.68 t/s 12.28.864.503 I slot print_timing: id 3 | task 11128 | n_decoded = 1125, tg = 16.95 t/s, tg_3s = 16.67 t/s 12.31.874.430 I slot print_timing: id 3 | task 11128 | n_decoded = 1175, tg = 16.93 t/s, tg_3s = 16.61 t/s 12.34.823.805 I slot print_timing: id 3 | task 11128 | prompt eval time = 485.94 ms / 42 tokens ( 11.57 ms per token, 86.43 tokens per second) 12.34.823.809 I slot print_timing: id 3 | task 11128 | eval time = 72339.77 ms / 1224 tokens ( 59.10 ms per token, 16.92 tokens per second) 12.34.823.810 I slot print_timing: id 3 | task 11128 | total time = 72825.72 ms / 1266 tokens 12.34.823.810 I slot print_timing: id 3 | task 11128 | graphs reused = 12253 12.34.823.843 I slot release: id 3 | task 11128 | stop processing: n_tokens = 1337, truncated = 0 12.34.823.855 I srv update_slots: all slots are idle 12.34.826.441 I srv operator(): Chat format: peg-gemma4 12.34.826.774 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.547 (> 0.100 thold), f_keep = 0.057 12.34.826.777 I srv get_availabl: updating prompt cache 12.34.826.882 W srv prompt_save: - saving prompt with length 1337, total state size = 904.482 MiB (draft: 0.000 MiB) 12.35.993.430 I srv load: - looking for better prompt, base f_keep = 0.057, sim = 0.547 12.35.993.439 W srv update: - cache size limit reached, removing oldest entry (size = 824.477 MiB) 12.36.068.956 I srv update: - cache state: 9 prompts, 8073.221 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 12.36.068.961 I srv update: - prompt 0x641dae875750: 648 tokens, checkpoints: 1, 613.924 MiB 12.36.068.962 I srv update: - prompt 0x641dae80c1b0: 1350 tokens, checkpoints: 1, 962.531 MiB 12.36.068.963 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB 12.36.068.964 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB 12.36.068.965 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB 12.36.068.965 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB 12.36.068.966 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB 12.36.068.967 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB 12.36.068.968 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB 12.36.068.970 I srv get_availabl: prompt cache update took 1242.19 ms 12.36.069.053 I slot launch_slot_: id 3 | task 12355 | processing task, is_child = 0 12.36.069.054 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 12.36.069.056 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 12.36.069.081 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 12.36.069.082 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 12.36.069.097 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 12.36.069.097 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 12.36.069.124 I slot update_slots: id 3 | task 12355 | Checking checkpoint with [0, 72] against 0... 12.36.088.407 W slot update_slots: id 3 | task 12355 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 12.42.382.716 I slot print_timing: id 3 | task 12355 | n_decoded = 100, tg = 17.38 t/s, tg_3s = 17.38 t/s 12.45.419.030 I slot print_timing: id 3 | task 12355 | n_decoded = 152, tg = 17.30 t/s, tg_3s = 17.13 t/s 12.48.449.940 I slot print_timing: id 3 | task 12355 | n_decoded = 204, tg = 17.26 t/s, tg_3s = 17.16 t/s 12.51.481.992 I slot print_timing: id 3 | task 12355 | n_decoded = 256, tg = 17.24 t/s, tg_3s = 17.15 t/s 12.54.504.055 I slot print_timing: id 3 | task 12355 | n_decoded = 308, tg = 17.23 t/s, tg_3s = 17.21 t/s 12.57.521.132 I slot print_timing: id 3 | task 12355 | n_decoded = 360, tg = 17.23 t/s, tg_3s = 17.24 t/s 13.00.569.028 I slot print_timing: id 3 | task 12355 | n_decoded = 412, tg = 17.21 t/s, tg_3s = 17.06 t/s 13.03.613.366 I slot print_timing: id 3 | task 12355 | n_decoded = 464, tg = 17.20 t/s, tg_3s = 17.08 t/s 13.06.662.815 I slot print_timing: id 3 | task 12355 | n_decoded = 516, tg = 17.18 t/s, tg_3s = 17.05 t/s 13.09.712.375 I slot print_timing: id 3 | task 12355 | n_decoded = 568, tg = 17.17 t/s, tg_3s = 17.05 t/s 13.12.765.012 I slot print_timing: id 3 | task 12355 | n_decoded = 620, tg = 17.16 t/s, tg_3s = 17.03 t/s 13.15.809.509 I slot print_timing: id 3 | task 12355 | n_decoded = 671, tg = 17.13 t/s, tg_3s = 16.75 t/s 13.18.862.370 I slot print_timing: id 3 | task 12355 | n_decoded = 722, tg = 17.10 t/s, tg_3s = 16.71 t/s 13.21.019.344 I slot print_timing: id 3 | task 12355 | prompt eval time = 561.29 ms / 67 tokens ( 8.38 ms per token, 119.37 tokens per second) 13.21.019.348 I slot print_timing: id 3 | task 12355 | eval time = 44388.93 ms / 758 tokens ( 58.56 ms per token, 17.08 tokens per second) 13.21.019.349 I slot print_timing: id 3 | task 12355 | total time = 44950.22 ms / 825 tokens 13.21.019.350 I slot print_timing: id 3 | task 12355 | graphs reused = 13006 13.21.019.387 I slot release: id 3 | task 12355 | stop processing: n_tokens = 896, truncated = 0 13.21.019.398 I srv update_slots: all slots are idle 13.21.022.059 I srv operator(): Chat format: peg-gemma4 13.21.022.395 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.571 (> 0.100 thold), f_keep = 0.085 13.21.022.397 I srv get_availabl: updating prompt cache 13.21.022.477 W srv prompt_save: - saving prompt with length 896, total state size = 770.022 MiB (draft: 0.000 MiB) 13.21.723.288 I srv load: - looking for better prompt, base f_keep = 0.085, sim = 0.571 13.21.723.298 W srv update: - cache size limit reached, removing oldest entry (size = 613.924 MiB) 13.21.781.760 W srv update: - cache size limit reached, removing oldest entry (size = 962.531 MiB) 13.21.871.128 I srv update: - cache state: 8 prompts, 7323.821 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 13.21.871.132 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB 13.21.871.133 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB 13.21.871.134 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB 13.21.871.135 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB 13.21.871.135 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB 13.21.871.136 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB 13.21.871.137 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB 13.21.871.137 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB 13.21.871.139 I srv get_availabl: prompt cache update took 848.74 ms 13.21.871.213 I slot launch_slot_: id 3 | task 13116 | processing task, is_child = 0 13.21.871.214 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 13.21.871.214 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 13.21.871.233 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 13.21.871.233 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 13.21.871.244 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 13.21.871.245 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 13.21.871.264 I slot update_slots: id 3 | task 13116 | Checking checkpoint with [0, 72] against 0... 13.21.893.902 W slot update_slots: id 3 | task 13116 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 13.28.146.743 I slot print_timing: id 3 | task 13116 | n_decoded = 100, tg = 17.37 t/s, tg_3s = 17.37 t/s 13.31.185.244 I slot print_timing: id 3 | task 13116 | n_decoded = 152, tg = 17.28 t/s, tg_3s = 17.11 t/s 13.34.215.713 I slot print_timing: id 3 | task 13116 | n_decoded = 204, tg = 17.25 t/s, tg_3s = 17.16 t/s 13.37.239.978 I slot print_timing: id 3 | task 13116 | n_decoded = 256, tg = 17.24 t/s, tg_3s = 17.19 t/s 13.40.258.929 I slot print_timing: id 3 | task 13116 | n_decoded = 308, tg = 17.24 t/s, tg_3s = 17.22 t/s 13.43.277.395 I slot print_timing: id 3 | task 13116 | n_decoded = 360, tg = 17.23 t/s, tg_3s = 17.23 t/s 13.46.324.617 I slot print_timing: id 3 | task 13116 | n_decoded = 412, tg = 17.21 t/s, tg_3s = 17.06 t/s 13.49.368.762 I slot print_timing: id 3 | task 13116 | n_decoded = 464, tg = 17.20 t/s, tg_3s = 17.08 t/s 13.52.412.651 I slot print_timing: id 3 | task 13116 | n_decoded = 516, tg = 17.19 t/s, tg_3s = 17.08 t/s 13.55.456.612 I slot print_timing: id 3 | task 13116 | n_decoded = 568, tg = 17.18 t/s, tg_3s = 17.08 t/s 13.58.499.686 I slot print_timing: id 3 | task 13116 | n_decoded = 620, tg = 17.17 t/s, tg_3s = 17.09 t/s 14.01.532.223 I slot print_timing: id 3 | task 13116 | n_decoded = 671, tg = 17.14 t/s, tg_3s = 16.82 t/s 14.02.960.539 I slot print_timing: id 3 | task 13116 | prompt eval time = 517.59 ms / 61 tokens ( 8.49 ms per token, 117.85 tokens per second) 14.02.960.542 I slot print_timing: id 3 | task 13116 | eval time = 40571.68 ms / 695 tokens ( 58.38 ms per token, 17.13 tokens per second) 14.02.960.543 I slot print_timing: id 3 | task 13116 | total time = 41089.27 ms / 756 tokens 14.02.960.544 I slot print_timing: id 3 | task 13116 | graphs reused = 13696 14.02.960.583 I slot release: id 3 | task 13116 | stop processing: n_tokens = 827, truncated = 0 14.02.960.593 I srv update_slots: all slots are idle 14.02.963.437 I srv operator(): Chat format: peg-gemma4 14.02.963.769 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.631 (> 0.100 thold), f_keep = 0.093 14.02.963.771 I srv get_availabl: updating prompt cache 14.02.963.841 W srv prompt_save: - saving prompt with length 827, total state size = 710.723 MiB (draft: 0.000 MiB) 14.03.501.978 I srv load: - looking for better prompt, base f_keep = 0.093, sim = 0.631 14.03.501.988 I srv update: - cache state: 9 prompts, 8091.578 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 14.03.501.989 I srv update: - prompt 0x641daed799f0: 1780 tokens, checkpoints: 1, 996.129 MiB 14.03.501.990 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB 14.03.501.990 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB 14.03.501.991 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB 14.03.501.991 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB 14.03.501.992 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB 14.03.501.992 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB 14.03.501.993 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB 14.03.501.993 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB 14.03.501.994 I srv get_availabl: prompt cache update took 538.22 ms 14.03.502.056 I slot launch_slot_: id 3 | task 13814 | processing task, is_child = 0 14.03.502.057 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 14.03.502.058 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 14.03.502.077 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 14.03.502.077 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 14.03.502.088 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 14.03.502.089 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 14.03.502.108 I slot update_slots: id 3 | task 13814 | Checking checkpoint with [0, 72] against 0... 14.03.520.940 W slot update_slots: id 3 | task 13814 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 14.09.711.494 I slot print_timing: id 3 | task 13814 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s 14.12.744.005 I slot print_timing: id 3 | task 13814 | n_decoded = 152, tg = 17.31 t/s, tg_3s = 17.15 t/s 14.15.779.888 I slot print_timing: id 3 | task 13814 | n_decoded = 204, tg = 17.26 t/s, tg_3s = 17.13 t/s 14.18.819.432 I slot print_timing: id 3 | task 13814 | n_decoded = 256, tg = 17.23 t/s, tg_3s = 17.11 t/s 14.21.861.485 I slot print_timing: id 3 | task 13814 | n_decoded = 308, tg = 17.21 t/s, tg_3s = 17.09 t/s 14.24.904.410 I slot print_timing: id 3 | task 13814 | n_decoded = 360, tg = 17.19 t/s, tg_3s = 17.09 t/s 14.27.908.756 I slot print_timing: id 3 | task 13814 | n_decoded = 411, tg = 17.16 t/s, tg_3s = 16.98 t/s 14.30.919.749 I slot print_timing: id 3 | task 13814 | n_decoded = 462, tg = 17.14 t/s, tg_3s = 16.94 t/s 14.33.969.139 I slot print_timing: id 3 | task 13814 | n_decoded = 514, tg = 17.13 t/s, tg_3s = 17.05 t/s 14.37.015.199 I slot print_timing: id 3 | task 13814 | n_decoded = 566, tg = 17.12 t/s, tg_3s = 17.07 t/s 14.40.058.755 I slot print_timing: id 3 | task 13814 | n_decoded = 618, tg = 17.12 t/s, tg_3s = 17.09 t/s 14.43.077.627 I slot print_timing: id 3 | task 13814 | n_decoded = 669, tg = 17.10 t/s, tg_3s = 16.89 t/s 14.46.116.251 I slot print_timing: id 3 | task 13814 | n_decoded = 720, tg = 17.08 t/s, tg_3s = 16.78 t/s 14.49.169.611 I slot print_timing: id 3 | task 13814 | n_decoded = 771, tg = 17.05 t/s, tg_3s = 16.70 t/s 14.52.212.507 I slot print_timing: id 3 | task 13814 | n_decoded = 822, tg = 17.04 t/s, tg_3s = 16.76 t/s 14.55.195.343 I slot print_timing: id 3 | task 13814 | prompt eval time = 459.29 ms / 50 tokens ( 9.19 ms per token, 108.86 tokens per second) 14.55.195.347 I slot print_timing: id 3 | task 13814 | eval time = 51233.94 ms / 872 tokens ( 58.75 ms per token, 17.02 tokens per second) 14.55.195.348 I slot print_timing: id 3 | task 13814 | total time = 51693.23 ms / 922 tokens 14.55.195.348 I slot print_timing: id 3 | task 13814 | graphs reused = 14563 14.55.195.394 I slot release: id 3 | task 13814 | stop processing: n_tokens = 993, truncated = 0 14.55.195.406 I srv update_slots: all slots are idle 14.55.198.191 I srv operator(): Chat format: peg-gemma4 14.55.198.519 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.613 (> 0.100 thold), f_keep = 0.077 14.55.198.521 I srv get_availabl: updating prompt cache 14.55.198.603 W srv prompt_save: - saving prompt with length 993, total state size = 853.384 MiB (draft: 0.000 MiB) 14.55.799.331 I srv load: - looking for better prompt, base f_keep = 0.077, sim = 0.613 14.55.799.340 W srv update: - cache size limit reached, removing oldest entry (size = 996.129 MiB) 14.55.883.145 I srv update: - cache state: 9 prompts, 8005.865 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 14.55.883.149 I srv update: - prompt 0x641daf4b5730: 1170 tokens, checkpoints: 1, 948.466 MiB 14.55.883.150 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB 14.55.883.150 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB 14.55.883.151 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB 14.55.883.151 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB 14.55.883.152 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB 14.55.883.152 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB 14.55.883.153 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB 14.55.883.153 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB 14.55.883.155 I srv get_availabl: prompt cache update took 684.63 ms 14.55.883.223 I slot launch_slot_: id 3 | task 14689 | processing task, is_child = 0 14.55.883.224 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 14.55.883.225 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 14.55.883.243 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 14.55.883.244 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 14.55.883.255 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 14.55.883.255 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 14.55.883.274 I slot update_slots: id 3 | task 14689 | Checking checkpoint with [0, 72] against 0... 14.55.902.444 W slot update_slots: id 3 | task 14689 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 15.02.094.924 I slot print_timing: id 3 | task 14689 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s 15.05.131.216 I slot print_timing: id 3 | task 14689 | n_decoded = 152, tg = 17.30 t/s, tg_3s = 17.13 t/s 15.08.173.066 I slot print_timing: id 3 | task 14689 | n_decoded = 204, tg = 17.25 t/s, tg_3s = 17.09 t/s 15.11.212.779 I slot print_timing: id 3 | task 14689 | n_decoded = 256, tg = 17.22 t/s, tg_3s = 17.11 t/s 15.14.249.814 I slot print_timing: id 3 | task 14689 | n_decoded = 308, tg = 17.20 t/s, tg_3s = 17.12 t/s 15.17.288.893 I slot print_timing: id 3 | task 14689 | n_decoded = 360, tg = 17.19 t/s, tg_3s = 17.11 t/s 15.20.333.974 I slot print_timing: id 3 | task 14689 | n_decoded = 412, tg = 17.17 t/s, tg_3s = 17.08 t/s 15.23.378.541 I slot print_timing: id 3 | task 14689 | n_decoded = 464, tg = 17.16 t/s, tg_3s = 17.08 t/s 15.26.426.634 I slot print_timing: id 3 | task 14689 | n_decoded = 516, tg = 17.15 t/s, tg_3s = 17.06 t/s 15.29.483.068 I slot print_timing: id 3 | task 14689 | n_decoded = 568, tg = 17.14 t/s, tg_3s = 17.01 t/s 15.32.528.808 I slot print_timing: id 3 | task 14689 | n_decoded = 620, tg = 17.13 t/s, tg_3s = 17.07 t/s 15.35.552.460 I slot print_timing: id 3 | task 14689 | n_decoded = 671, tg = 17.11 t/s, tg_3s = 16.87 t/s 15.38.587.156 I slot print_timing: id 3 | task 14689 | n_decoded = 722, tg = 17.09 t/s, tg_3s = 16.81 t/s 15.41.621.486 I slot print_timing: id 3 | task 14689 | n_decoded = 773, tg = 17.07 t/s, tg_3s = 16.81 t/s 15.44.664.250 I slot print_timing: id 3 | task 14689 | n_decoded = 824, tg = 17.05 t/s, tg_3s = 16.76 t/s 15.47.705.543 I slot print_timing: id 3 | task 14689 | n_decoded = 875, tg = 17.04 t/s, tg_3s = 16.77 t/s 15.50.765.078 I slot print_timing: id 3 | task 14689 | n_decoded = 926, tg = 17.02 t/s, tg_3s = 16.67 t/s 15.53.824.085 I slot print_timing: id 3 | task 14689 | n_decoded = 977, tg = 17.00 t/s, tg_3s = 16.67 t/s 15.56.826.570 I slot print_timing: id 3 | task 14689 | prompt eval time = 460.28 ms / 52 tokens ( 8.85 ms per token, 112.97 tokens per second) 15.56.826.573 I slot print_timing: id 3 | task 14689 | eval time = 60483.01 ms / 1027 tokens ( 58.89 ms per token, 16.98 tokens per second) 15.56.826.574 I slot print_timing: id 3 | task 14689 | total time = 60943.29 ms / 1079 tokens 15.56.826.575 I slot print_timing: id 3 | task 14689 | graphs reused = 15584 15.56.826.660 I slot release: id 3 | task 14689 | stop processing: n_tokens = 1150, truncated = 0 15.56.826.675 I srv update_slots: all slots are idle 15.56.829.291 I srv operator(): Chat format: peg-gemma4 15.56.829.623 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.655 (> 0.100 thold), f_keep = 0.066 15.56.829.625 I srv get_availabl: updating prompt cache 15.56.829.711 W srv prompt_save: - saving prompt with length 1150, total state size = 889.870 MiB (draft: 0.000 MiB) 15.57.435.704 I srv load: - looking for better prompt, base f_keep = 0.066, sim = 0.655 15.57.435.714 W srv update: - cache size limit reached, removing oldest entry (size = 948.466 MiB) 15.57.516.379 I srv update: - cache state: 9 prompts, 8004.302 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 15.57.516.383 I srv update: - prompt 0x641daf765eb0: 1322 tokens, checkpoints: 1, 960.343 MiB 15.57.516.384 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB 15.57.516.385 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB 15.57.516.385 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB 15.57.516.386 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB 15.57.516.386 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB 15.57.516.387 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB 15.57.516.387 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB 15.57.516.388 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB 15.57.516.390 I srv get_availabl: prompt cache update took 686.76 ms 15.57.516.462 I slot launch_slot_: id 3 | task 15719 | processing task, is_child = 0 15.57.516.463 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 15.57.516.464 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 15.57.516.484 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 15.57.516.484 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 15.57.516.496 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 15.57.516.496 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 15.57.516.515 I slot update_slots: id 3 | task 15719 | Checking checkpoint with [0, 72] against 0... 15.57.536.147 W slot update_slots: id 3 | task 15719 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 16.03.753.489 I slot print_timing: id 3 | task 15719 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s 16.06.787.615 I slot print_timing: id 3 | task 15719 | n_decoded = 152, tg = 17.30 t/s, tg_3s = 17.14 t/s 16.09.834.403 I slot print_timing: id 3 | task 15719 | n_decoded = 204, tg = 17.24 t/s, tg_3s = 17.07 t/s 16.12.874.008 I slot print_timing: id 3 | task 15719 | n_decoded = 256, tg = 17.21 t/s, tg_3s = 17.11 t/s 16.15.896.961 I slot print_timing: id 3 | task 15719 | n_decoded = 308, tg = 17.21 t/s, tg_3s = 17.20 t/s 16.18.919.857 I slot print_timing: id 3 | task 15719 | n_decoded = 360, tg = 17.21 t/s, tg_3s = 17.20 t/s 16.21.966.937 I slot print_timing: id 3 | task 15719 | n_decoded = 412, tg = 17.19 t/s, tg_3s = 17.07 t/s 16.25.014.747 I slot print_timing: id 3 | task 15719 | n_decoded = 464, tg = 17.18 t/s, tg_3s = 17.06 t/s 16.28.015.597 I slot print_timing: id 3 | task 15719 | n_decoded = 515, tg = 17.16 t/s, tg_3s = 17.00 t/s 16.31.017.800 I slot print_timing: id 3 | task 15719 | n_decoded = 566, tg = 17.14 t/s, tg_3s = 16.99 t/s 16.34.073.610 I slot print_timing: id 3 | task 15719 | n_decoded = 618, tg = 17.13 t/s, tg_3s = 17.02 t/s 16.37.097.505 I slot print_timing: id 3 | task 15719 | n_decoded = 669, tg = 17.11 t/s, tg_3s = 16.87 t/s 16.40.137.302 I slot print_timing: id 3 | task 15719 | n_decoded = 720, tg = 17.09 t/s, tg_3s = 16.78 t/s 16.43.182.479 I slot print_timing: id 3 | task 15719 | n_decoded = 771, tg = 17.07 t/s, tg_3s = 16.75 t/s 16.45.516.731 I slot print_timing: id 3 | task 15719 | prompt eval time = 486.15 ms / 44 tokens ( 11.05 ms per token, 90.51 tokens per second) 16.45.516.735 I slot print_timing: id 3 | task 15719 | eval time = 47514.06 ms / 810 tokens ( 58.66 ms per token, 17.05 tokens per second) 16.45.516.736 I slot print_timing: id 3 | task 15719 | total time = 48000.21 ms / 854 tokens 16.45.516.736 I slot print_timing: id 3 | task 15719 | graphs reused = 16389 16.45.516.784 I slot release: id 3 | task 15719 | stop processing: n_tokens = 925, truncated = 0 16.45.516.797 I srv update_slots: all slots are idle 16.45.519.577 I srv operator(): Chat format: peg-gemma4 16.45.519.908 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.655 (> 0.100 thold), f_keep = 0.082 16.45.519.910 I srv get_availabl: updating prompt cache 16.45.520.001 W srv prompt_save: - saving prompt with length 925, total state size = 794.944 MiB (draft: 0.000 MiB) 16.46.096.182 I srv load: - looking for better prompt, base f_keep = 0.082, sim = 0.655 16.46.096.192 W srv update: - cache size limit reached, removing oldest entry (size = 960.343 MiB) 16.46.182.077 I srv update: - cache state: 9 prompts, 7895.937 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 16.46.182.081 I srv update: - prompt 0x641daeed1d00: 1226 tokens, checkpoints: 1, 952.842 MiB 16.46.182.082 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB 16.46.182.082 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB 16.46.182.083 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB 16.46.182.084 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB 16.46.182.084 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB 16.46.182.085 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB 16.46.182.085 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB 16.46.182.086 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB 16.46.182.087 I srv get_availabl: prompt cache update took 662.18 ms 16.46.182.169 I slot launch_slot_: id 3 | task 16532 | processing task, is_child = 0 16.46.182.170 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 16.46.182.171 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 16.46.182.191 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 16.46.182.192 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 16.46.182.203 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 16.46.182.203 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 16.46.182.223 I slot update_slots: id 3 | task 16532 | Checking checkpoint with [0, 72] against 0... 16.46.201.843 W slot update_slots: id 3 | task 16532 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 16.52.426.424 I slot print_timing: id 3 | task 16532 | n_decoded = 100, tg = 17.37 t/s, tg_3s = 17.37 t/s 16.55.457.405 I slot print_timing: id 3 | task 16532 | n_decoded = 152, tg = 17.29 t/s, tg_3s = 17.16 t/s 16.58.505.727 I slot print_timing: id 3 | task 16532 | n_decoded = 204, tg = 17.23 t/s, tg_3s = 17.06 t/s 17.01.528.143 I slot print_timing: id 3 | task 16532 | n_decoded = 256, tg = 17.23 t/s, tg_3s = 17.20 t/s 17.04.550.358 I slot print_timing: id 3 | task 16532 | n_decoded = 308, tg = 17.22 t/s, tg_3s = 17.21 t/s 17.07.578.370 I slot print_timing: id 3 | task 16532 | n_decoded = 360, tg = 17.22 t/s, tg_3s = 17.17 t/s 17.10.623.513 I slot print_timing: id 3 | task 16532 | n_decoded = 412, tg = 17.20 t/s, tg_3s = 17.08 t/s 17.13.624.450 I slot print_timing: id 3 | task 16532 | n_decoded = 463, tg = 17.18 t/s, tg_3s = 16.99 t/s 17.16.676.521 I slot print_timing: id 3 | task 16532 | n_decoded = 515, tg = 17.16 t/s, tg_3s = 17.04 t/s 17.19.732.489 I slot print_timing: id 3 | task 16532 | n_decoded = 567, tg = 17.15 t/s, tg_3s = 17.02 t/s 17.22.787.428 I slot print_timing: id 3 | task 16532 | n_decoded = 619, tg = 17.14 t/s, tg_3s = 17.02 t/s 17.25.810.292 I slot print_timing: id 3 | task 16532 | n_decoded = 670, tg = 17.12 t/s, tg_3s = 16.87 t/s 17.28.849.918 I slot print_timing: id 3 | task 16532 | n_decoded = 721, tg = 17.09 t/s, tg_3s = 16.78 t/s 17.31.895.144 I slot print_timing: id 3 | task 16532 | n_decoded = 772, tg = 17.07 t/s, tg_3s = 16.75 t/s 17.34.943.966 I slot print_timing: id 3 | task 16532 | n_decoded = 823, tg = 17.05 t/s, tg_3s = 16.73 t/s 17.37.991.524 I slot print_timing: id 3 | task 16532 | n_decoded = 874, tg = 17.03 t/s, tg_3s = 16.73 t/s 17.40.812.568 I slot print_timing: id 3 | task 16532 | prompt eval time = 486.21 ms / 44 tokens ( 11.05 ms per token, 90.50 tokens per second) 17.40.812.573 I slot print_timing: id 3 | task 16532 | eval time = 54144.13 ms / 921 tokens ( 58.79 ms per token, 17.01 tokens per second) 17.40.812.573 I slot print_timing: id 3 | task 16532 | total time = 54630.34 ms / 965 tokens 17.40.812.574 I slot print_timing: id 3 | task 16532 | graphs reused = 17304 17.40.812.613 I slot release: id 3 | task 16532 | stop processing: n_tokens = 1036, truncated = 0 17.40.812.626 I srv update_slots: all slots are idle 17.40.815.256 I srv operator(): Chat format: peg-gemma4 17.40.815.603 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.710 (> 0.100 thold), f_keep = 0.073 17.40.815.605 I srv get_availabl: updating prompt cache 17.40.815.705 W srv prompt_save: - saving prompt with length 1036, total state size = 880.962 MiB (draft: 0.000 MiB) 17.41.421.354 I srv load: - looking for better prompt, base f_keep = 0.073, sim = 0.710 17.41.421.364 W srv update: - cache size limit reached, removing oldest entry (size = 952.842 MiB) 17.41.506.906 I srv update: - cache state: 9 prompts, 7881.091 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 17.41.506.912 I srv update: - prompt 0x641daf96c600: 787 tokens, checkpoints: 1, 733.381 MiB 17.41.506.913 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB 17.41.506.914 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB 17.41.506.915 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB 17.41.506.916 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB 17.41.506.917 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB 17.41.506.918 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB 17.41.506.919 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB 17.41.506.919 I srv update: - prompt 0x641daf784c00: 1036 tokens, checkpoints: 1, 937.996 MiB 17.41.506.939 I srv get_availabl: prompt cache update took 691.32 ms 17.41.507.018 I slot launch_slot_: id 3 | task 17456 | processing task, is_child = 0 17.41.507.019 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 17.41.507.020 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 17.41.507.041 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 17.41.507.042 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 17.41.507.053 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 17.41.507.053 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 17.41.507.073 I slot update_slots: id 3 | task 17456 | Checking checkpoint with [0, 72] against 0... 17.41.528.276 W slot update_slots: id 3 | task 17456 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 17.47.741.320 I slot print_timing: id 3 | task 17456 | n_decoded = 100, tg = 17.36 t/s, tg_3s = 17.36 t/s 17.50.767.308 I slot print_timing: id 3 | task 17456 | n_decoded = 152, tg = 17.30 t/s, tg_3s = 17.18 t/s 17.53.795.859 I slot print_timing: id 3 | task 17456 | n_decoded = 204, tg = 17.27 t/s, tg_3s = 17.17 t/s 17.56.824.361 I slot print_timing: id 3 | task 17456 | n_decoded = 256, tg = 17.25 t/s, tg_3s = 17.17 t/s 17.59.854.340 I slot print_timing: id 3 | task 17456 | n_decoded = 308, tg = 17.23 t/s, tg_3s = 17.16 t/s 18.02.883.503 I slot print_timing: id 3 | task 17456 | n_decoded = 360, tg = 17.22 t/s, tg_3s = 17.17 t/s 18.05.926.565 I slot print_timing: id 3 | task 17456 | n_decoded = 412, tg = 17.21 t/s, tg_3s = 17.09 t/s 18.08.983.525 I slot print_timing: id 3 | task 17456 | n_decoded = 464, tg = 17.18 t/s, tg_3s = 17.01 t/s 18.11.985.567 I slot print_timing: id 3 | task 17456 | n_decoded = 515, tg = 17.16 t/s, tg_3s = 16.99 t/s 18.14.991.706 I slot print_timing: id 3 | task 17456 | n_decoded = 566, tg = 17.15 t/s, tg_3s = 16.97 t/s 18.17.994.125 I slot print_timing: id 3 | task 17456 | n_decoded = 617, tg = 17.13 t/s, tg_3s = 16.99 t/s 18.21.014.065 I slot print_timing: id 3 | task 17456 | n_decoded = 668, tg = 17.11 t/s, tg_3s = 16.89 t/s 18.22.564.461 I slot print_timing: id 3 | task 17456 | prompt eval time = 474.99 ms / 35 tokens ( 13.57 ms per token, 73.69 tokens per second) 18.22.564.464 I slot print_timing: id 3 | task 17456 | eval time = 40582.39 ms / 694 tokens ( 58.48 ms per token, 17.10 tokens per second) 18.22.564.465 I slot print_timing: id 3 | task 17456 | total time = 41057.38 ms / 729 tokens 18.22.564.465 I slot print_timing: id 3 | task 17456 | graphs reused = 17993 18.22.564.509 I slot release: id 3 | task 17456 | stop processing: n_tokens = 800, truncated = 0 18.22.564.520 I srv update_slots: all slots are idle 18.22.567.132 I srv operator(): Chat format: peg-gemma4 18.22.567.459 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.792 (> 0.100 thold), f_keep = 0.095 18.22.567.460 I srv get_availabl: updating prompt cache 18.22.567.531 W srv prompt_save: - saving prompt with length 800, total state size = 687.520 MiB (draft: 0.000 MiB) 18.23.052.074 I srv load: - looking for better prompt, base f_keep = 0.095, sim = 0.792 18.23.052.082 W srv update: - cache size limit reached, removing oldest entry (size = 733.381 MiB) 18.23.119.684 I srv update: - cache state: 9 prompts, 7892.264 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 18.23.119.687 I srv update: - prompt 0x641daec56900: 1114 tokens, checkpoints: 1, 944.090 MiB 18.23.119.688 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB 18.23.119.688 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB 18.23.119.689 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB 18.23.119.689 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB 18.23.119.690 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB 18.23.119.691 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB 18.23.119.691 I srv update: - prompt 0x641daf784c00: 1036 tokens, checkpoints: 1, 937.996 MiB 18.23.119.691 I srv update: - prompt 0x641daed5fa30: 800 tokens, checkpoints: 1, 744.553 MiB 18.23.119.693 I srv get_availabl: prompt cache update took 552.23 ms 18.23.119.766 I slot launch_slot_: id 3 | task 18153 | processing task, is_child = 0 18.23.119.767 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 18.23.119.767 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 18.23.119.785 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 18.23.119.785 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 18.23.119.797 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 18.23.119.797 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 18.23.119.816 I slot update_slots: id 3 | task 18153 | Checking checkpoint with [0, 72] against 0... 18.23.139.115 W slot update_slots: id 3 | task 18153 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 18.29.300.443 I slot print_timing: id 3 | task 18153 | n_decoded = 100, tg = 17.38 t/s, tg_3s = 17.38 t/s 18.32.316.229 I slot print_timing: id 3 | task 18153 | n_decoded = 152, tg = 17.33 t/s, tg_3s = 17.24 t/s 18.35.368.420 I slot print_timing: id 3 | task 18153 | n_decoded = 204, tg = 17.26 t/s, tg_3s = 17.04 t/s 18.38.419.353 I slot print_timing: id 3 | task 18153 | n_decoded = 256, tg = 17.21 t/s, tg_3s = 17.04 t/s 18.41.443.326 I slot print_timing: id 3 | task 18153 | n_decoded = 308, tg = 17.21 t/s, tg_3s = 17.20 t/s 18.44.459.403 I slot print_timing: id 3 | task 18153 | n_decoded = 360, tg = 17.21 t/s, tg_3s = 17.24 t/s 18.47.483.449 I slot print_timing: id 3 | task 18153 | n_decoded = 412, tg = 17.21 t/s, tg_3s = 17.20 t/s 18.50.530.788 I slot print_timing: id 3 | task 18153 | n_decoded = 464, tg = 17.20 t/s, tg_3s = 17.06 t/s 18.53.573.575 I slot print_timing: id 3 | task 18153 | n_decoded = 516, tg = 17.18 t/s, tg_3s = 17.09 t/s 18.54.977.761 I slot print_timing: id 3 | task 18153 | prompt eval time = 426.79 ms / 24 tokens ( 17.78 ms per token, 56.23 tokens per second) 18.54.977.765 I slot print_timing: id 3 | task 18153 | eval time = 31431.15 ms / 540 tokens ( 58.21 ms per token, 17.18 tokens per second) 18.54.977.766 I slot print_timing: id 3 | task 18153 | total time = 31857.94 ms / 564 tokens 18.54.977.767 I slot print_timing: id 3 | task 18153 | graphs reused = 18529 18.54.977.811 I slot release: id 3 | task 18153 | stop processing: n_tokens = 635, truncated = 0 18.54.977.822 I srv update_slots: all slots are idle 18.54.980.486 I srv operator(): Chat format: peg-gemma4 18.54.981.071 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.650 (> 0.100 thold), f_keep = 0.120 18.54.981.074 I srv get_availabl: updating prompt cache 18.54.981.150 W srv prompt_save: - saving prompt with length 635, total state size = 545.719 MiB (draft: 0.000 MiB) 18.55.374.947 I srv load: - looking for better prompt, base f_keep = 0.120, sim = 0.650 18.55.374.957 W srv update: - cache size limit reached, removing oldest entry (size = 944.090 MiB) 18.55.461.941 I srv update: - cache state: 9 prompts, 7550.926 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 18.55.461.949 I srv update: - prompt 0x641daed0c2b0: 1337 tokens, checkpoints: 1, 961.515 MiB 18.55.461.950 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB 18.55.461.951 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB 18.55.461.951 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB 18.55.461.952 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB 18.55.461.957 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB 18.55.461.958 I srv update: - prompt 0x641daf784c00: 1036 tokens, checkpoints: 1, 937.996 MiB 18.55.461.958 I srv update: - prompt 0x641daed5fa30: 800 tokens, checkpoints: 1, 744.553 MiB 18.55.461.959 I srv update: - prompt 0x641dae8852a0: 635 tokens, checkpoints: 1, 602.752 MiB 18.55.461.961 I srv get_availabl: prompt cache update took 480.89 ms 18.55.462.037 I slot launch_slot_: id 3 | task 18696 | processing task, is_child = 0 18.55.462.038 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 18.55.462.038 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 18.55.462.056 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 18.55.462.057 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 18.55.462.068 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 18.55.462.068 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 18.55.462.087 I slot update_slots: id 3 | task 18696 | Checking checkpoint with [0, 72] against 0... 18.55.481.398 W slot update_slots: id 3 | task 18696 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 19.01.698.993 I slot print_timing: id 3 | task 18696 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s 19.04.725.510 I slot print_timing: id 3 | task 18696 | n_decoded = 152, tg = 17.32 t/s, tg_3s = 17.18 t/s 19.07.755.171 I slot print_timing: id 3 | task 18696 | n_decoded = 204, tg = 17.28 t/s, tg_3s = 17.16 t/s 19.10.786.170 I slot print_timing: id 3 | task 18696 | n_decoded = 256, tg = 17.25 t/s, tg_3s = 17.16 t/s 19.13.821.270 I slot print_timing: id 3 | task 18696 | n_decoded = 308, tg = 17.23 t/s, tg_3s = 17.13 t/s 19.16.857.336 I slot print_timing: id 3 | task 18696 | n_decoded = 360, tg = 17.22 t/s, tg_3s = 17.13 t/s 19.19.911.386 I slot print_timing: id 3 | task 18696 | n_decoded = 412, tg = 17.19 t/s, tg_3s = 17.03 t/s 19.22.914.761 I slot print_timing: id 3 | task 18696 | n_decoded = 463, tg = 17.17 t/s, tg_3s = 16.98 t/s 19.25.925.582 I slot print_timing: id 3 | task 18696 | n_decoded = 514, tg = 17.15 t/s, tg_3s = 16.94 t/s 19.28.926.593 I slot print_timing: id 3 | task 18696 | n_decoded = 565, tg = 17.13 t/s, tg_3s = 16.99 t/s 19.30.399.647 I slot print_timing: id 3 | task 18696 | prompt eval time = 486.00 ms / 45 tokens ( 10.80 ms per token, 92.59 tokens per second) 19.30.399.651 I slot print_timing: id 3 | task 18696 | eval time = 34451.55 ms / 590 tokens ( 58.39 ms per token, 17.13 tokens per second) 19.30.399.652 I slot print_timing: id 3 | task 18696 | total time = 34937.55 ms / 635 tokens 19.30.399.652 I slot print_timing: id 3 | task 18696 | graphs reused = 19115 19.30.399.695 I slot release: id 3 | task 18696 | stop processing: n_tokens = 706, truncated = 0 19.30.399.707 I srv update_slots: all slots are idle 19.30.402.266 I srv operator(): Chat format: peg-gemma4 19.30.402.600 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.717 (> 0.100 thold), f_keep = 0.108 19.30.402.602 I srv get_availabl: updating prompt cache 19.30.402.674 W srv prompt_save: - saving prompt with length 706, total state size = 606.736 MiB (draft: 0.000 MiB) 19.30.832.711 I srv load: - looking for better prompt, base f_keep = 0.108, sim = 0.717 19.30.832.720 W srv update: - cache size limit reached, removing oldest entry (size = 961.515 MiB) 19.30.922.295 I srv update: - cache state: 9 prompts, 7253.180 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 19.30.922.298 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB 19.30.922.299 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB 19.30.922.300 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB 19.30.922.300 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB 19.30.922.301 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB 19.30.922.301 I srv update: - prompt 0x641daf784c00: 1036 tokens, checkpoints: 1, 937.996 MiB 19.30.922.302 I srv update: - prompt 0x641daed5fa30: 800 tokens, checkpoints: 1, 744.553 MiB 19.30.922.302 I srv update: - prompt 0x641dae8852a0: 635 tokens, checkpoints: 1, 602.752 MiB 19.30.922.303 I srv update: - prompt 0x641daee5bef0: 706 tokens, checkpoints: 1, 663.770 MiB 19.30.922.304 I srv get_availabl: prompt cache update took 519.70 ms 19.30.922.381 I slot launch_slot_: id 3 | task 19289 | processing task, is_child = 0 19.30.922.382 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 19.30.922.382 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 19.30.922.402 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 19.30.922.402 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 19.30.922.413 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 19.30.922.414 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 19.30.922.434 I slot update_slots: id 3 | task 19289 | Checking checkpoint with [0, 72] against 0... 19.30.941.465 W slot update_slots: id 3 | task 19289 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 19.37.135.028 I slot print_timing: id 3 | task 19289 | n_decoded = 100, tg = 17.42 t/s, tg_3s = 17.42 t/s 19.40.148.485 I slot print_timing: id 3 | task 19289 | n_decoded = 152, tg = 17.36 t/s, tg_3s = 17.26 t/s 19.43.187.733 I slot print_timing: id 3 | task 19289 | n_decoded = 204, tg = 17.30 t/s, tg_3s = 17.11 t/s 19.46.212.780 I slot print_timing: id 3 | task 19289 | n_decoded = 256, tg = 17.28 t/s, tg_3s = 17.19 t/s 19.49.244.220 I slot print_timing: id 3 | task 19289 | n_decoded = 308, tg = 17.26 t/s, tg_3s = 17.15 t/s 19.52.268.594 I slot print_timing: id 3 | task 19289 | n_decoded = 360, tg = 17.25 t/s, tg_3s = 17.19 t/s 19.55.316.658 I slot print_timing: id 3 | task 19289 | n_decoded = 412, tg = 17.22 t/s, tg_3s = 17.06 t/s 19.58.375.614 I slot print_timing: id 3 | task 19289 | n_decoded = 464, tg = 17.20 t/s, tg_3s = 17.00 t/s 20.01.377.986 I slot print_timing: id 3 | task 19289 | n_decoded = 515, tg = 17.18 t/s, tg_3s = 16.99 t/s 20.04.380.696 I slot print_timing: id 3 | task 19289 | n_decoded = 566, tg = 17.16 t/s, tg_3s = 16.98 t/s 20.07.384.622 I slot print_timing: id 3 | task 19289 | n_decoded = 617, tg = 17.14 t/s, tg_3s = 16.98 t/s 20.10.400.963 I slot print_timing: id 3 | task 19289 | n_decoded = 668, tg = 17.13 t/s, tg_3s = 16.91 t/s 20.13.447.627 I slot print_timing: id 3 | task 19289 | n_decoded = 719, tg = 17.10 t/s, tg_3s = 16.74 t/s 20.16.495.122 I slot print_timing: id 3 | task 19289 | n_decoded = 770, tg = 17.07 t/s, tg_3s = 16.74 t/s 20.19.532.823 I slot print_timing: id 3 | task 19289 | n_decoded = 821, tg = 17.06 t/s, tg_3s = 16.79 t/s 20.22.563.847 I slot print_timing: id 3 | task 19289 | n_decoded = 872, tg = 17.04 t/s, tg_3s = 16.83 t/s 20.25.604.928 I slot print_timing: id 3 | task 19289 | n_decoded = 923, tg = 17.03 t/s, tg_3s = 16.77 t/s 20.25.664.875 I slot print_timing: id 3 | task 19289 | prompt eval time = 472.60 ms / 34 tokens ( 13.90 ms per token, 71.94 tokens per second) 20.25.664.878 I slot print_timing: id 3 | task 19289 | eval time = 54269.83 ms / 924 tokens ( 58.73 ms per token, 17.03 tokens per second) 20.25.664.879 I slot print_timing: id 3 | task 19289 | total time = 54742.42 ms / 958 tokens 20.25.664.879 I slot print_timing: id 3 | task 19289 | graphs reused = 20033 20.25.664.928 I slot release: id 3 | task 19289 | stop processing: n_tokens = 1029, truncated = 0 20.25.664.942 I srv update_slots: all slots are idle 20.25.667.488 I srv operator(): Chat format: peg-gemma4 20.25.667.818 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.673 (> 0.100 thold), f_keep = 0.074 20.25.667.819 I srv get_availabl: updating prompt cache 20.25.667.914 W srv prompt_save: - saving prompt with length 1029, total state size = 880.416 MiB (draft: 0.000 MiB) 20.26.543.314 I srv load: - looking for better prompt, base f_keep = 0.074, sim = 0.673 20.26.543.325 I srv update: - cache state: 10 prompts, 8190.629 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 20.26.543.326 I srv update: - prompt 0x641daf986760: 896 tokens, checkpoints: 1, 827.055 MiB 20.26.543.332 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB 20.26.543.333 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB 20.26.543.333 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB 20.26.543.334 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB 20.26.543.334 I srv update: - prompt 0x641daf784c00: 1036 tokens, checkpoints: 1, 937.996 MiB 20.26.543.335 I srv update: - prompt 0x641daed5fa30: 800 tokens, checkpoints: 1, 744.553 MiB 20.26.543.335 I srv update: - prompt 0x641dae8852a0: 635 tokens, checkpoints: 1, 602.752 MiB 20.26.543.337 I srv update: - prompt 0x641daee5bef0: 706 tokens, checkpoints: 1, 663.770 MiB 20.26.543.338 I srv update: - prompt 0x641daec2ff50: 1029 tokens, checkpoints: 1, 937.449 MiB 20.26.543.339 I srv get_availabl: prompt cache update took 875.52 ms 20.26.543.408 I slot launch_slot_: id 3 | task 20216 | processing task, is_child = 0 20.26.543.408 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 20.26.543.409 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 20.26.543.427 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 20.26.543.427 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 20.26.543.438 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 20.26.543.438 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 20.26.543.457 I slot update_slots: id 3 | task 20216 | Checking checkpoint with [0, 72] against 0... 20.26.562.368 W slot update_slots: id 3 | task 20216 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 20.32.779.996 I slot print_timing: id 3 | task 20216 | n_decoded = 100, tg = 17.39 t/s, tg_3s = 17.39 t/s 20.35.804.507 I slot print_timing: id 3 | task 20216 | n_decoded = 152, tg = 17.32 t/s, tg_3s = 17.19 t/s 20.38.821.381 I slot print_timing: id 3 | task 20216 | n_decoded = 204, tg = 17.30 t/s, tg_3s = 17.24 t/s 20.41.837.471 I slot print_timing: id 3 | task 20216 | n_decoded = 256, tg = 17.29 t/s, tg_3s = 17.24 t/s 20.44.861.532 I slot print_timing: id 3 | task 20216 | n_decoded = 308, tg = 17.27 t/s, tg_3s = 17.20 t/s 20.47.894.818 I slot print_timing: id 3 | task 20216 | n_decoded = 360, tg = 17.25 t/s, tg_3s = 17.14 t/s 20.50.941.772 I slot print_timing: id 3 | task 20216 | n_decoded = 412, tg = 17.23 t/s, tg_3s = 17.07 t/s 20.53.994.208 I slot print_timing: id 3 | task 20216 | n_decoded = 464, tg = 17.21 t/s, tg_3s = 17.04 t/s 20.56.996.236 I slot print_timing: id 3 | task 20216 | n_decoded = 515, tg = 17.18 t/s, tg_3s = 16.99 t/s 21.00.051.239 I slot print_timing: id 3 | task 20216 | n_decoded = 567, tg = 17.17 t/s, tg_3s = 17.02 t/s 21.03.052.278 I slot print_timing: id 3 | task 20216 | n_decoded = 618, tg = 17.16 t/s, tg_3s = 16.99 t/s 21.06.079.820 I slot print_timing: id 3 | task 20216 | n_decoded = 669, tg = 17.13 t/s, tg_3s = 16.85 t/s 21.09.138.914 I slot print_timing: id 3 | task 20216 | n_decoded = 720, tg = 17.10 t/s, tg_3s = 16.67 t/s 21.11.118.906 I slot print_timing: id 3 | task 20216 | prompt eval time = 484.68 ms / 41 tokens ( 11.82 ms per token, 84.59 tokens per second) 21.11.118.910 I slot print_timing: id 3 | task 20216 | eval time = 44090.76 ms / 753 tokens ( 58.55 ms per token, 17.08 tokens per second) 21.11.118.910 I slot print_timing: id 3 | task 20216 | total time = 44575.44 ms / 794 tokens 21.11.118.911 I slot print_timing: id 3 | task 20216 | graphs reused = 20781 21.11.118.956 I slot release: id 3 | task 20216 | stop processing: n_tokens = 865, truncated = 0 21.11.118.967 I srv update_slots: all slots are idle 21.11.121.708 I srv operator(): Chat format: peg-gemma4 21.11.122.041 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.633 (> 0.100 thold), f_keep = 0.088 21.11.122.042 I srv get_availabl: updating prompt cache 21.11.122.117 W srv prompt_save: - saving prompt with length 865, total state size = 743.381 MiB (draft: 0.000 MiB) 21.11.646.012 I srv load: - looking for better prompt, base f_keep = 0.088, sim = 0.633 21.11.646.021 W srv update: - cache size limit reached, removing oldest entry (size = 827.055 MiB) 21.11.722.338 I srv update: - cache state: 10 prompts, 8163.988 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 21.11.722.342 I srv update: - prompt 0x641dae929e10: 827 tokens, checkpoints: 1, 767.757 MiB 21.11.722.343 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB 21.11.722.344 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB 21.11.722.344 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB 21.11.722.345 I srv update: - prompt 0x641daf784c00: 1036 tokens, checkpoints: 1, 937.996 MiB 21.11.722.345 I srv update: - prompt 0x641daed5fa30: 800 tokens, checkpoints: 1, 744.553 MiB 21.11.722.346 I srv update: - prompt 0x641dae8852a0: 635 tokens, checkpoints: 1, 602.752 MiB 21.11.722.346 I srv update: - prompt 0x641daee5bef0: 706 tokens, checkpoints: 1, 663.770 MiB 21.11.722.347 I srv update: - prompt 0x641daec2ff50: 1029 tokens, checkpoints: 1, 937.449 MiB 21.11.722.347 I srv update: - prompt 0x641daea70bf0: 865 tokens, checkpoints: 1, 800.414 MiB 21.11.722.349 I srv get_availabl: prompt cache update took 600.31 ms 21.11.722.419 I slot launch_slot_: id 3 | task 20972 | processing task, is_child = 0 21.11.722.419 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 21.11.722.421 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 21.11.722.439 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 21.11.722.439 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 21.11.722.451 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 21.11.722.451 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 21.11.722.470 I slot update_slots: id 3 | task 20972 | Checking checkpoint with [0, 72] against 0... 21.11.744.747 W slot update_slots: id 3 | task 20972 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 21.17.941.018 I slot print_timing: id 3 | task 20972 | n_decoded = 100, tg = 17.37 t/s, tg_3s = 17.37 t/s 21.20.968.920 I slot print_timing: id 3 | task 20972 | n_decoded = 152, tg = 17.30 t/s, tg_3s = 17.17 t/s 21.23.994.539 I slot print_timing: id 3 | task 20972 | n_decoded = 204, tg = 17.27 t/s, tg_3s = 17.19 t/s 21.27.017.313 I slot print_timing: id 3 | task 20972 | n_decoded = 256, tg = 17.26 t/s, tg_3s = 17.20 t/s 21.30.043.585 I slot print_timing: id 3 | task 20972 | n_decoded = 308, tg = 17.25 t/s, tg_3s = 17.18 t/s 21.33.064.744 I slot print_timing: id 3 | task 20972 | n_decoded = 360, tg = 17.24 t/s, tg_3s = 17.21 t/s 21.36.113.912 I slot print_timing: id 3 | task 20972 | n_decoded = 412, tg = 17.22 t/s, tg_3s = 17.05 t/s 21.39.164.862 I slot print_timing: id 3 | task 20972 | n_decoded = 464, tg = 17.20 t/s, tg_3s = 17.04 t/s 21.42.216.453 I slot print_timing: id 3 | task 20972 | n_decoded = 516, tg = 17.18 t/s, tg_3s = 17.04 t/s 21.45.271.827 I slot print_timing: id 3 | task 20972 | n_decoded = 568, tg = 17.17 t/s, tg_3s = 17.02 t/s 21.48.274.412 I slot print_timing: id 3 | task 20972 | n_decoded = 619, tg = 17.15 t/s, tg_3s = 16.99 t/s 21.51.307.917 I slot print_timing: id 3 | task 20972 | n_decoded = 670, tg = 17.13 t/s, tg_3s = 16.81 t/s 21.54.366.982 I slot print_timing: id 3 | task 20972 | n_decoded = 721, tg = 17.09 t/s, tg_3s = 16.67 t/s 21.54.787.077 I slot print_timing: id 3 | task 20972 | prompt eval time = 462.46 ms / 48 tokens ( 9.63 ms per token, 103.79 tokens per second) 21.54.787.080 I slot print_timing: id 3 | task 20972 | eval time = 42602.14 ms / 728 tokens ( 58.52 ms per token, 17.09 tokens per second) 21.54.787.080 I slot print_timing: id 3 | task 20972 | total time = 43064.60 ms / 776 tokens 21.54.787.081 I slot print_timing: id 3 | task 20972 | graphs reused = 21504 21.54.787.122 I slot release: id 3 | task 20972 | stop processing: n_tokens = 847, truncated = 0 21.54.787.132 I srv update_slots: all slots are idle 21.54.789.792 I srv operator(): Chat format: peg-gemma4 21.54.790.126 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.724 (> 0.100 thold), f_keep = 0.090 21.54.790.128 I srv get_availabl: updating prompt cache 21.54.790.196 W srv prompt_save: - saving prompt with length 847, total state size = 727.911 MiB (draft: 0.000 MiB) 21.55.416.023 I srv load: - looking for better prompt, base f_keep = 0.090, sim = 0.724 21.55.416.032 W srv update: - cache size limit reached, removing oldest entry (size = 767.757 MiB) 21.55.489.108 I srv update: - cache state: 10 prompts, 8181.176 MiB (limits: 8192.000 MiB, 16384 tokens, 16384 est) 21.55.489.112 I srv update: - prompt 0x641daeca7f60: 993 tokens, checkpoints: 1, 910.417 MiB 21.55.489.113 I srv update: - prompt 0x641dae971e00: 1150 tokens, checkpoints: 1, 946.903 MiB 21.55.489.113 I srv update: - prompt 0x641daec9b910: 925 tokens, checkpoints: 1, 851.978 MiB 21.55.489.114 I srv update: - prompt 0x641daf784c00: 1036 tokens, checkpoints: 1, 937.996 MiB 21.55.489.115 I srv update: - prompt 0x641daed5fa30: 800 tokens, checkpoints: 1, 744.553 MiB 21.55.489.115 I srv update: - prompt 0x641dae8852a0: 635 tokens, checkpoints: 1, 602.752 MiB 21.55.489.116 I srv update: - prompt 0x641daee5bef0: 706 tokens, checkpoints: 1, 663.770 MiB 21.55.489.116 I srv update: - prompt 0x641daec2ff50: 1029 tokens, checkpoints: 1, 937.449 MiB 21.55.489.117 I srv update: - prompt 0x641daea70bf0: 865 tokens, checkpoints: 1, 800.414 MiB 21.55.489.117 I srv update: - prompt 0x641dae875750: 847 tokens, checkpoints: 1, 784.945 MiB 21.55.489.118 I srv get_availabl: prompt cache update took 698.99 ms 21.55.489.157 I slot launch_slot_: id 3 | task 21703 | processing task, is_child = 0 21.55.489.158 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 21.55.489.159 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 21.55.489.177 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 21.55.489.178 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 21.55.489.191 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 21.55.489.191 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 21.55.489.210 I slot update_slots: id 3 | task 21703 | Checking checkpoint with [0, 72] against 0... 21.55.508.581 W slot update_slots: id 3 | task 21703 | restored context checkpoint (pos_min = 0, pos_max = 72, n_tokens = 73, n_past = 72, size = 57.033 MiB) 22.01.708.914 I slot print_timing: id 3 | task 21703 | n_decoded = 100, tg = 17.40 t/s, tg_3s = 17.40 t/s 22.04.721.883 I slot print_timing: id 3 | task 21703 | n_decoded = 152, tg = 17.35 t/s, tg_3s = 17.26 t/s 22.07.753.173 I slot print_timing: id 3 | task 21703 | n_decoded = 204, tg = 17.30 t/s, tg_3s = 17.15 t/s 22.10.776.463 I slot print_timing: id 3 | task 21703 | n_decoded = 256, tg = 17.28 t/s, tg_3s = 17.20 t/s 22.13.802.844 I slot print_timing: id 3 | task 21703 | n_decoded = 308, tg = 17.26 t/s, tg_3s = 17.18 t/s 22.16.824.344 I slot print_timing: id 3 | task 21703 | n_decoded = 360, tg = 17.26 t/s, tg_3s = 17.21 t/s 22.19.860.029 I slot print_timing: id 3 | task 21703 | n_decoded = 412, tg = 17.24 t/s, tg_3s = 17.13 t/s 22.22.908.318 I slot print_timing: id 3 | task 21703 | n_decoded = 464, tg = 17.22 t/s, tg_3s = 17.06 t/s 22.25.967.115 I slot print_timing: id 3 | task 21703 | n_decoded = 516, tg = 17.20 t/s, tg_3s = 17.00 t/s 22.29.022.393 I slot print_timing: id 3 | task 21703 | n_decoded = 568, tg = 17.18 t/s, tg_3s = 17.02 t/s 22.32.075.655 I slot print_timing: id 3 | task 21703 | n_decoded = 620, tg = 17.17 t/s, tg_3s = 17.03 t/s 22.35.089.849 I slot print_timing: id 3 | task 21703 | n_decoded = 671, tg = 17.15 t/s, tg_3s = 16.92 t/s 22.38.132.918 I slot print_timing: id 3 | task 21703 | n_decoded = 722, tg = 17.12 t/s, tg_3s = 16.76 t/s 22.41.179.220 I slot print_timing: id 3 | task 21703 | n_decoded = 773, tg = 17.09 t/s, tg_3s = 16.74 t/s 22.44.229.947 I slot print_timing: id 3 | task 21703 | n_decoded = 824, tg = 17.07 t/s, tg_3s = 16.72 t/s 22.47.217.027 I slot print_timing: id 3 | task 21703 | prompt eval time = 472.07 ms / 33 tokens ( 14.31 ms per token, 69.90 tokens per second) 22.47.217.032 I slot print_timing: id 3 | task 21703 | eval time = 51255.74 ms / 874 tokens ( 58.65 ms per token, 17.05 tokens per second) 22.47.217.032 I slot print_timing: id 3 | task 21703 | total time = 51727.81 ms / 907 tokens 22.47.217.033 I slot print_timing: id 3 | task 21703 | graphs reused = 22373 22.47.217.071 I slot release: id 3 | task 21703 | stop processing: n_tokens = 978, truncated = 0 22.47.217.086 I srv update_slots: all slots are idle 22.47.217.676 I srv operator(): operator(): cleaning up before exit...