0.00.065.648 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg) 0.00.065.653 I device_info: 0.00.065.672 I - ROCm0 : AMD Radeon Graphics (32752 MiB, 32728 MiB free) 0.00.065.676 I - ROCm1 : AMD Radeon Graphics (32752 MiB, 32728 MiB free) 0.00.065.682 I - CPU : AMD Ryzen 9 3900X 12-Core Processor (128730 MiB, 128730 MiB free) 0.00.065.739 I system_info: n_threads = 12 (n_threads_batch = 12) / 24 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | 0.00.065.745 I srv llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true 0.00.065.784 I srv init: running without SSL 0.00.065.844 I srv init: using 23 threads for HTTP server 0.00.066.172 I srv start: binding port with default address family 0.00.067.387 I srv llama_server: loading model 0.00.067.394 I srv load_model: loading model '/home/qrf/.cache/llama.cpp/Qwen_Qwen3.5-9B-Q4_K_M.gguf' 0.00.067.453 I common_init_result: fitting params to device memory ... 0.00.067.454 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.04.795.781 W llama_context: n_ctx_seq (24576) < n_ctx_train (262144) -- the full capacity of the model will not be utilized 0.04.836.437 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.05.025.921 I srv load_model: initializing slots, n_slots = 4 0.05.080.247 W srv load_model: speculative decoding will use checkpoints 0.05.080.267 W common_speculative_init: no implementations specified for speculative decoding 0.05.080.268 I slot load_model: id 0 | task -1 | new slot, n_ctx = 24576 0.05.080.273 I slot load_model: id 1 | task -1 | new slot, n_ctx = 24576 0.05.080.274 I slot load_model: id 2 | task -1 | new slot, n_ctx = 24576 0.05.080.274 I slot load_model: id 3 | task -1 | new slot, n_ctx = 24576 0.05.080.338 I srv load_model: prompt cache is enabled, size limit: 8192 MiB 0.05.080.338 I srv load_model: use `--cache-ram 0` to disable the prompt cache 0.05.080.339 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391 0.05.080.339 I srv load_model: context checkpoints enabled, max = 32, min spacing = 256 0.05.080.356 I srv init: idle slots will be saved to prompt cache and cleared upon starting a new task 0.05.098.385 I init: chat template, example_format: '<|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant ' 0.05.112.262 I srv init: init: chat template, thinking = 1 0.05.112.298 I srv llama_server: model loaded 0.05.112.301 I srv llama_server: server is listening on http://127.0.0.1:8090 0.05.112.306 I srv update_slots: all slots are idle 0.09.978.975 I srv operator(): Chat format: peg-native 0.09.979.259 I slot get_availabl: id 3 | task -1 | selected slot by LRU, t_last = -1 0.09.979.261 I srv get_availabl: updating prompt cache 0.09.979.267 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000 0.09.979.272 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 24576 tokens, 8589934592 est) 0.09.979.273 I srv get_availabl: prompt cache update took 0.01 ms 0.09.979.349 I slot launch_slot_: id 3 | task 0 | processing task, is_child = 0 0.09.979.351 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.09.979.353 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.09.979.373 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.09.979.373 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.09.979.388 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.09.979.388 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.10.583.044 I slot create_check: id 3 | task 0 | created context checkpoint 1 of 32 (pos_min = 40, pos_max = 40, n_tokens = 41, size = 50.251 MiB) 0.13.707.355 I slot print_timing: id 3 | task 0 | n_decoded = 144, tg = 47.81 t/s, tg_3s = 47.81 t/s 0.16.715.447 I slot print_timing: id 3 | task 0 | n_decoded = 287, tg = 47.67 t/s, tg_3s = 47.54 t/s 0.19.718.678 I slot print_timing: id 3 | task 0 | n_decoded = 430, tg = 47.65 t/s, tg_3s = 47.62 t/s 0.22.732.595 I slot print_timing: id 3 | task 0 | n_decoded = 573, tg = 47.60 t/s, tg_3s = 47.45 t/s 0.25.741.766 I slot print_timing: id 3 | task 0 | n_decoded = 716, tg = 47.59 t/s, tg_3s = 47.52 t/s 0.28.747.655 I slot print_timing: id 3 | task 0 | n_decoded = 859, tg = 47.58 t/s, tg_3s = 47.57 t/s 0.31.757.822 I slot print_timing: id 3 | task 0 | n_decoded = 1002, tg = 47.57 t/s, tg_3s = 47.51 t/s 0.34.767.764 I slot print_timing: id 3 | task 0 | n_decoded = 1145, tg = 47.56 t/s, tg_3s = 47.51 t/s 0.37.786.696 I slot print_timing: id 3 | task 0 | n_decoded = 1281, tg = 47.28 t/s, tg_3s = 45.05 t/s 0.40.790.606 I slot print_timing: id 3 | task 0 | n_decoded = 1424, tg = 47.32 t/s, tg_3s = 47.60 t/s 0.43.799.797 I slot print_timing: id 3 | task 0 | n_decoded = 1567, tg = 47.34 t/s, tg_3s = 47.52 t/s 0.46.802.319 I slot print_timing: id 3 | task 0 | n_decoded = 1710, tg = 47.36 t/s, tg_3s = 47.63 t/s 0.49.816.766 I slot print_timing: id 3 | task 0 | n_decoded = 1853, tg = 47.37 t/s, tg_3s = 47.44 t/s 0.52.837.738 I slot print_timing: id 3 | task 0 | n_decoded = 1996, tg = 47.36 t/s, tg_3s = 47.34 t/s 0.55.850.798 I slot print_timing: id 3 | task 0 | n_decoded = 2139, tg = 47.37 t/s, tg_3s = 47.46 t/s 0.58.870.283 I slot print_timing: id 3 | task 0 | n_decoded = 2282, tg = 47.37 t/s, tg_3s = 47.36 t/s 1.01.875.781 I slot print_timing: id 3 | task 0 | n_decoded = 2424, tg = 47.36 t/s, tg_3s = 47.25 t/s 1.04.891.482 I slot print_timing: id 3 | task 0 | n_decoded = 2566, tg = 47.35 t/s, tg_3s = 47.09 t/s 1.07.898.926 I slot print_timing: id 3 | task 0 | n_decoded = 2708, tg = 47.34 t/s, tg_3s = 47.22 t/s 1.10.915.223 I slot print_timing: id 3 | task 0 | n_decoded = 2850, tg = 47.33 t/s, tg_3s = 47.08 t/s 1.13.930.146 I slot print_timing: id 3 | task 0 | n_decoded = 2992, tg = 47.32 t/s, tg_3s = 47.10 t/s 1.16.948.217 I slot print_timing: id 3 | task 0 | n_decoded = 3134, tg = 47.30 t/s, tg_3s = 47.05 t/s 1.19.951.340 I slot print_timing: id 3 | task 0 | n_decoded = 3275, tg = 47.29 t/s, tg_3s = 46.95 t/s 1.22.961.375 I slot print_timing: id 3 | task 0 | n_decoded = 3417, tg = 47.28 t/s, tg_3s = 47.18 t/s 1.25.976.454 I slot print_timing: id 3 | task 0 | n_decoded = 3559, tg = 47.28 t/s, tg_3s = 47.10 t/s 1.28.984.553 I slot print_timing: id 3 | task 0 | n_decoded = 3701, tg = 47.27 t/s, tg_3s = 47.21 t/s 1.31.987.205 I slot print_timing: id 3 | task 0 | n_decoded = 3842, tg = 47.26 t/s, tg_3s = 46.96 t/s 1.35.006.709 I slot print_timing: id 3 | task 0 | n_decoded = 3983, tg = 47.24 t/s, tg_3s = 46.70 t/s 1.38.009.475 I slot print_timing: id 3 | task 0 | n_decoded = 4123, tg = 47.22 t/s, tg_3s = 46.62 t/s 1.41.017.487 I slot print_timing: id 3 | task 0 | n_decoded = 4266, tg = 47.23 t/s, tg_3s = 47.54 t/s 1.44.033.636 I slot print_timing: id 3 | task 0 | n_decoded = 4409, tg = 47.24 t/s, tg_3s = 47.41 t/s 1.47.043.579 I slot print_timing: id 3 | task 0 | n_decoded = 4552, tg = 47.25 t/s, tg_3s = 47.51 t/s 1.50.049.722 I slot print_timing: id 3 | task 0 | n_decoded = 4695, tg = 47.26 t/s, tg_3s = 47.57 t/s 1.53.063.567 I slot print_timing: id 3 | task 0 | n_decoded = 4838, tg = 47.26 t/s, tg_3s = 47.45 t/s 1.56.068.571 I slot print_timing: id 3 | task 0 | n_decoded = 4981, tg = 47.27 t/s, tg_3s = 47.59 t/s 1.59.081.551 I slot print_timing: id 3 | task 0 | n_decoded = 5124, tg = 47.28 t/s, tg_3s = 47.46 t/s 2.02.095.782 I slot print_timing: id 3 | task 0 | n_decoded = 5267, tg = 47.28 t/s, tg_3s = 47.44 t/s 2.05.102.707 I slot print_timing: id 3 | task 0 | n_decoded = 5409, tg = 47.28 t/s, tg_3s = 47.22 t/s 2.08.115.741 I slot print_timing: id 3 | task 0 | n_decoded = 5551, tg = 47.27 t/s, tg_3s = 47.13 t/s 2.11.127.570 I slot print_timing: id 3 | task 0 | n_decoded = 5691, tg = 47.25 t/s, tg_3s = 46.48 t/s 2.14.143.806 I slot print_timing: id 3 | task 0 | n_decoded = 5831, tg = 47.23 t/s, tg_3s = 46.42 t/s 2.17.154.589 I slot print_timing: id 3 | task 0 | n_decoded = 5971, tg = 47.22 t/s, tg_3s = 46.50 t/s 2.20.168.388 I slot print_timing: id 3 | task 0 | n_decoded = 6111, tg = 47.20 t/s, tg_3s = 46.45 t/s 2.20.877.299 I slot print_timing: id 3 | task 0 | prompt eval time = 715.98 ms / 67 tokens ( 10.69 ms per token, 93.58 tokens per second) 2.20.877.304 I slot print_timing: id 3 | task 0 | eval time = 130181.90 ms / 6144 tokens ( 21.19 ms per token, 47.20 tokens per second) 2.20.877.305 I slot print_timing: id 3 | task 0 | total time = 130897.88 ms / 6211 tokens 2.20.877.309 I slot print_timing: id 3 | task 0 | graphs reused = 6119 2.20.877.377 I slot release: id 3 | task 0 | stop processing: n_tokens = 6210, truncated = 0 2.20.877.401 I srv update_slots: all slots are idle 2.20.893.287 I srv operator(): Chat format: peg-native 2.20.893.538 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.629 (> 0.100 thold), f_keep = 0.007 2.20.893.540 I srv get_availabl: updating prompt cache 2.20.893.747 W srv prompt_save: - saving prompt with length 6210, total state size = 244.432 MiB (draft: 0.000 MiB) 2.21.203.341 I srv load: - looking for better prompt, base f_keep = 0.007, sim = 0.629 2.21.203.349 I srv update: - cache state: 1 prompts, 294.682 MiB (limits: 8192.000 MiB, 24576 tokens, 172634 est) 2.21.203.350 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 2.21.203.352 I srv get_availabl: prompt cache update took 309.81 ms 2.21.203.444 I slot launch_slot_: id 3 | task 6147 | processing task, is_child = 0 2.21.203.445 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 2.21.203.446 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 2.21.203.480 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 2.21.203.480 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 2.21.203.509 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 2.21.203.509 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 2.21.203.546 I slot update_slots: id 3 | task 6147 | Checking checkpoint with [40, 40] against 44... 2.21.216.414 W slot update_slots: id 3 | task 6147 | restored context checkpoint (pos_min = 40, pos_max = 40, n_tokens = 41, n_past = 41, size = 50.251 MiB) 2.24.357.389 I slot print_timing: id 3 | task 6147 | n_decoded = 144, tg = 47.79 t/s, tg_3s = 47.79 t/s 2.25.307.397 I slot print_timing: id 3 | task 6147 | prompt eval time = 140.56 ms / 29 tokens ( 4.85 ms per token, 206.32 tokens per second) 2.25.307.401 I slot print_timing: id 3 | task 6147 | eval time = 3963.29 ms / 189 tokens ( 20.97 ms per token, 47.69 tokens per second) 2.25.307.402 I slot print_timing: id 3 | task 6147 | total time = 4103.84 ms / 218 tokens 2.25.307.402 I slot print_timing: id 3 | task 6147 | graphs reused = 6305 2.25.307.440 I slot release: id 3 | task 6147 | stop processing: n_tokens = 258, truncated = 0 2.25.307.452 I srv update_slots: all slots are idle 2.25.323.724 I srv operator(): Chat format: peg-native 2.25.323.960 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.489 (> 0.100 thold), f_keep = 0.171 2.25.323.961 I srv get_availabl: updating prompt cache 2.25.323.998 W srv prompt_save: - saving prompt with length 258, total state size = 58.318 MiB (draft: 0.000 MiB) 2.25.395.910 I srv load: - looking for better prompt, base f_keep = 0.171, sim = 0.489 2.25.395.918 I srv update: - cache state: 2 prompts, 403.251 MiB (limits: 8192.000 MiB, 24576 tokens, 131396 est) 2.25.395.919 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 2.25.395.919 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 2.25.395.921 I srv get_availabl: prompt cache update took 71.96 ms 2.25.396.006 I slot launch_slot_: id 3 | task 6338 | processing task, is_child = 0 2.25.396.008 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 2.25.396.009 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 2.25.396.027 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 2.25.396.028 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 2.25.396.058 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 2.25.396.060 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 2.25.396.100 I slot update_slots: id 3 | task 6338 | Checking checkpoint with [40, 40] against 44... 2.25.409.129 W slot update_slots: id 3 | task 6338 | restored context checkpoint (pos_min = 40, pos_max = 40, n_tokens = 41, n_past = 41, size = 50.251 MiB) 2.28.546.260 I slot print_timing: id 3 | task 6338 | n_decoded = 144, tg = 47.86 t/s, tg_3s = 47.86 t/s 2.31.557.567 I slot print_timing: id 3 | task 6338 | n_decoded = 287, tg = 47.68 t/s, tg_3s = 47.49 t/s 2.34.562.948 I slot print_timing: id 3 | task 6338 | n_decoded = 430, tg = 47.64 t/s, tg_3s = 47.58 t/s 2.37.569.897 I slot print_timing: id 3 | task 6338 | n_decoded = 573, tg = 47.62 t/s, tg_3s = 47.56 t/s 2.40.578.893 I slot print_timing: id 3 | task 6338 | n_decoded = 716, tg = 47.60 t/s, tg_3s = 47.52 t/s 2.43.585.932 I slot print_timing: id 3 | task 6338 | n_decoded = 859, tg = 47.59 t/s, tg_3s = 47.56 t/s 2.46.595.169 I slot print_timing: id 3 | task 6338 | n_decoded = 1002, tg = 47.58 t/s, tg_3s = 47.52 t/s 2.49.600.119 I slot print_timing: id 3 | task 6338 | n_decoded = 1145, tg = 47.58 t/s, tg_3s = 47.59 t/s 2.52.613.225 I slot print_timing: id 3 | task 6338 | n_decoded = 1288, tg = 47.57 t/s, tg_3s = 47.46 t/s 2.55.616.289 I slot print_timing: id 3 | task 6338 | n_decoded = 1431, tg = 47.58 t/s, tg_3s = 47.62 t/s 2.58.626.199 I slot print_timing: id 3 | task 6338 | n_decoded = 1574, tg = 47.57 t/s, tg_3s = 47.51 t/s 3.01.639.449 I slot print_timing: id 3 | task 6338 | n_decoded = 1717, tg = 47.56 t/s, tg_3s = 47.46 t/s 3.04.652.458 I slot print_timing: id 3 | task 6338 | n_decoded = 1860, tg = 47.55 t/s, tg_3s = 47.46 t/s 3.07.672.502 I slot print_timing: id 3 | task 6338 | n_decoded = 2002, tg = 47.51 t/s, tg_3s = 47.02 t/s 3.10.691.251 I slot print_timing: id 3 | task 6338 | n_decoded = 2144, tg = 47.48 t/s, tg_3s = 47.04 t/s 3.13.694.445 I slot print_timing: id 3 | task 6338 | n_decoded = 2285, tg = 47.45 t/s, tg_3s = 46.95 t/s 3.16.714.452 I slot print_timing: id 3 | task 6338 | n_decoded = 2427, tg = 47.42 t/s, tg_3s = 47.02 t/s 3.19.720.337 I slot print_timing: id 3 | task 6338 | n_decoded = 2569, tg = 47.41 t/s, tg_3s = 47.24 t/s 3.22.725.375 I slot print_timing: id 3 | task 6338 | n_decoded = 2712, tg = 47.42 t/s, tg_3s = 47.59 t/s 3.25.737.408 I slot print_timing: id 3 | task 6338 | n_decoded = 2855, tg = 47.43 t/s, tg_3s = 47.48 t/s 3.28.755.436 I slot print_timing: id 3 | task 6338 | n_decoded = 2998, tg = 47.42 t/s, tg_3s = 47.38 t/s 3.31.758.514 I slot print_timing: id 3 | task 6338 | n_decoded = 3141, tg = 47.43 t/s, tg_3s = 47.62 t/s 3.34.770.500 I slot print_timing: id 3 | task 6338 | n_decoded = 3284, tg = 47.43 t/s, tg_3s = 47.48 t/s 3.37.777.479 I slot print_timing: id 3 | task 6338 | n_decoded = 3427, tg = 47.44 t/s, tg_3s = 47.56 t/s 3.40.794.542 I slot print_timing: id 3 | task 6338 | n_decoded = 3570, tg = 47.44 t/s, tg_3s = 47.40 t/s 3.43.799.644 I slot print_timing: id 3 | task 6338 | n_decoded = 3712, tg = 47.43 t/s, tg_3s = 47.25 t/s 3.46.816.237 I slot print_timing: id 3 | task 6338 | n_decoded = 3853, tg = 47.40 t/s, tg_3s = 46.74 t/s 3.49.832.663 I slot print_timing: id 3 | task 6338 | n_decoded = 3994, tg = 47.38 t/s, tg_3s = 46.74 t/s 3.52.843.265 I slot print_timing: id 3 | task 6338 | n_decoded = 4134, tg = 47.35 t/s, tg_3s = 46.50 t/s 3.55.843.835 I slot print_timing: id 3 | task 6338 | n_decoded = 4273, tg = 47.32 t/s, tg_3s = 46.32 t/s 3.58.853.162 I slot print_timing: id 3 | task 6338 | n_decoded = 4413, tg = 47.29 t/s, tg_3s = 46.52 t/s 4.01.868.855 I slot print_timing: id 3 | task 6338 | n_decoded = 4553, tg = 47.26 t/s, tg_3s = 46.42 t/s 4.04.888.975 I slot print_timing: id 3 | task 6338 | n_decoded = 4694, tg = 47.25 t/s, tg_3s = 46.69 t/s 4.07.906.943 I slot print_timing: id 3 | task 6338 | n_decoded = 4837, tg = 47.25 t/s, tg_3s = 47.38 t/s 4.10.916.020 I slot print_timing: id 3 | task 6338 | n_decoded = 4980, tg = 47.26 t/s, tg_3s = 47.52 t/s 4.13.931.021 I slot print_timing: id 3 | task 6338 | n_decoded = 5123, tg = 47.26 t/s, tg_3s = 47.43 t/s 4.16.942.061 I slot print_timing: id 3 | task 6338 | n_decoded = 5266, tg = 47.27 t/s, tg_3s = 47.49 t/s 4.19.945.260 I slot print_timing: id 3 | task 6338 | n_decoded = 5408, tg = 47.27 t/s, tg_3s = 47.28 t/s 4.22.960.351 I slot print_timing: id 3 | task 6338 | n_decoded = 5549, tg = 47.26 t/s, tg_3s = 46.76 t/s 4.25.979.145 I slot print_timing: id 3 | task 6338 | n_decoded = 5690, tg = 47.24 t/s, tg_3s = 46.71 t/s 4.28.984.915 I slot print_timing: id 3 | task 6338 | n_decoded = 5830, tg = 47.23 t/s, tg_3s = 46.58 t/s 4.31.988.895 I slot print_timing: id 3 | task 6338 | n_decoded = 5970, tg = 47.21 t/s, tg_3s = 46.60 t/s 4.34.990.212 I slot print_timing: id 3 | task 6338 | n_decoded = 6110, tg = 47.20 t/s, tg_3s = 46.65 t/s 4.35.716.388 I slot print_timing: id 3 | task 6338 | prompt eval time = 141.58 ms / 49 tokens ( 2.89 ms per token, 346.10 tokens per second) 4.35.716.391 I slot print_timing: id 3 | task 6338 | eval time = 130178.71 ms / 6144 tokens ( 21.19 ms per token, 47.20 tokens per second) 4.35.716.392 I slot print_timing: id 3 | task 6338 | total time = 130320.28 ms / 6193 tokens 4.35.716.393 I slot print_timing: id 3 | task 6338 | graphs reused = 12423 4.35.716.422 I slot release: id 3 | task 6338 | stop processing: n_tokens = 6233, truncated = 0 4.35.716.465 I srv update_slots: all slots are idle 4.35.733.262 I srv operator(): Chat format: peg-native 4.35.733.503 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.611 (> 0.100 thold), f_keep = 0.007 4.35.733.504 I srv get_availabl: updating prompt cache 4.35.733.710 W srv prompt_save: - saving prompt with length 6233, total state size = 245.151 MiB (draft: 0.000 MiB) 4.36.018.700 I srv load: - looking for better prompt, base f_keep = 0.007, sim = 0.611 4.36.018.707 I srv update: - cache state: 3 prompts, 698.653 MiB (limits: 8192.000 MiB, 24576 tokens, 148924 est) 4.36.018.708 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 4.36.018.709 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 4.36.018.710 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 4.36.018.711 I srv get_availabl: prompt cache update took 285.21 ms 4.36.018.793 I slot launch_slot_: id 3 | task 12484 | processing task, is_child = 0 4.36.018.793 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 4.36.018.794 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 4.36.018.822 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 4.36.018.822 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 4.36.018.851 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 4.36.018.851 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 4.36.018.888 I slot update_slots: id 3 | task 12484 | Checking checkpoint with [40, 40] against 44... 4.36.031.896 W slot update_slots: id 3 | task 12484 | restored context checkpoint (pos_min = 40, pos_max = 40, n_tokens = 41, n_past = 41, size = 50.251 MiB) 4.39.172.927 I slot print_timing: id 3 | task 12484 | n_decoded = 144, tg = 47.80 t/s, tg_3s = 47.80 t/s 4.42.192.985 I slot print_timing: id 3 | task 12484 | n_decoded = 287, tg = 47.57 t/s, tg_3s = 47.35 t/s 4.45.198.105 I slot print_timing: id 3 | task 12484 | n_decoded = 430, tg = 47.58 t/s, tg_3s = 47.59 t/s 4.48.211.022 I slot print_timing: id 3 | task 12484 | n_decoded = 573, tg = 47.55 t/s, tg_3s = 47.46 t/s 4.51.226.147 I slot print_timing: id 3 | task 12484 | n_decoded = 716, tg = 47.52 t/s, tg_3s = 47.43 t/s 4.54.243.681 I slot print_timing: id 3 | task 12484 | n_decoded = 859, tg = 47.50 t/s, tg_3s = 47.39 t/s 4.57.244.121 I slot print_timing: id 3 | task 12484 | n_decoded = 1001, tg = 47.48 t/s, tg_3s = 47.33 t/s 5.00.254.129 I slot print_timing: id 3 | task 12484 | n_decoded = 1144, tg = 47.48 t/s, tg_3s = 47.51 t/s 5.03.272.433 I slot print_timing: id 3 | task 12484 | n_decoded = 1287, tg = 47.47 t/s, tg_3s = 47.38 t/s 5.06.279.295 I slot print_timing: id 3 | task 12484 | n_decoded = 1430, tg = 47.48 t/s, tg_3s = 47.56 t/s 5.09.296.367 I slot print_timing: id 3 | task 12484 | n_decoded = 1573, tg = 47.47 t/s, tg_3s = 47.40 t/s 5.12.313.432 I slot print_timing: id 3 | task 12484 | n_decoded = 1716, tg = 47.46 t/s, tg_3s = 47.40 t/s 5.15.318.420 I slot print_timing: id 3 | task 12484 | n_decoded = 1858, tg = 47.45 t/s, tg_3s = 47.25 t/s 5.18.321.994 I slot print_timing: id 3 | task 12484 | n_decoded = 1999, tg = 47.41 t/s, tg_3s = 46.94 t/s 5.21.338.459 I slot print_timing: id 3 | task 12484 | n_decoded = 2141, tg = 47.39 t/s, tg_3s = 47.07 t/s 5.24.354.121 I slot print_timing: id 3 | task 12484 | n_decoded = 2282, tg = 47.35 t/s, tg_3s = 46.76 t/s 5.25.928.473 I slot print_timing: id 3 | task 12484 | prompt eval time = 141.20 ms / 31 tokens ( 4.55 ms per token, 219.55 tokens per second) 5.25.928.476 I slot print_timing: id 3 | task 12484 | eval time = 49768.38 ms / 2356 tokens ( 21.12 ms per token, 47.34 tokens per second) 5.25.928.477 I slot print_timing: id 3 | task 12484 | total time = 49909.58 ms / 2387 tokens 5.25.928.477 I slot print_timing: id 3 | task 12484 | graphs reused = 14768 5.25.928.502 I slot release: id 3 | task 12484 | stop processing: n_tokens = 2427, truncated = 0 5.25.928.519 I srv update_slots: all slots are idle 5.25.944.975 I srv operator(): Chat format: peg-native 5.25.945.214 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.657 (> 0.100 thold), f_keep = 0.018 5.25.945.216 I srv get_availabl: updating prompt cache 5.25.945.307 W srv prompt_save: - saving prompt with length 2427, total state size = 126.141 MiB (draft: 0.000 MiB) 5.26.067.186 I srv load: - looking for better prompt, base f_keep = 0.018, sim = 0.657 5.26.067.194 I srv update: - cache state: 4 prompts, 875.044 MiB (limits: 8192.000 MiB, 24576 tokens, 141625 est) 5.26.067.195 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 5.26.067.196 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 5.26.067.196 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 5.26.067.197 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 5.26.067.198 I srv get_availabl: prompt cache update took 121.98 ms 5.26.067.267 I slot launch_slot_: id 3 | task 14842 | processing task, is_child = 0 5.26.067.267 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 5.26.067.268 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 5.26.067.287 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 5.26.067.287 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 5.26.067.317 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 5.26.067.317 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 5.26.067.356 I slot update_slots: id 3 | task 14842 | Checking checkpoint with [40, 40] against 44... 5.26.080.246 W slot update_slots: id 3 | task 14842 | restored context checkpoint (pos_min = 40, pos_max = 40, n_tokens = 41, n_past = 41, size = 50.251 MiB) 5.29.206.927 I slot print_timing: id 3 | task 14842 | n_decoded = 144, tg = 47.78 t/s, tg_3s = 47.78 t/s 5.32.220.981 I slot print_timing: id 3 | task 14842 | n_decoded = 287, tg = 47.61 t/s, tg_3s = 47.44 t/s 5.35.223.820 I slot print_timing: id 3 | task 14842 | n_decoded = 430, tg = 47.62 t/s, tg_3s = 47.62 t/s 5.38.233.097 I slot print_timing: id 3 | task 14842 | n_decoded = 573, tg = 47.59 t/s, tg_3s = 47.52 t/s 5.41.244.912 I slot print_timing: id 3 | task 14842 | n_decoded = 716, tg = 47.57 t/s, tg_3s = 47.48 t/s 5.44.261.251 I slot print_timing: id 3 | task 14842 | n_decoded = 859, tg = 47.54 t/s, tg_3s = 47.41 t/s 5.45.965.681 I slot print_timing: id 3 | task 14842 | prompt eval time = 125.92 ms / 26 tokens ( 4.84 ms per token, 206.48 tokens per second) 5.45.965.685 I slot print_timing: id 3 | task 14842 | eval time = 19772.40 ms / 940 tokens ( 21.03 ms per token, 47.54 tokens per second) 5.45.965.686 I slot print_timing: id 3 | task 14842 | total time = 19898.32 ms / 966 tokens 5.45.965.686 I slot print_timing: id 3 | task 14842 | graphs reused = 15703 5.45.965.712 I slot release: id 3 | task 14842 | stop processing: n_tokens = 1006, truncated = 0 5.45.965.723 I srv update_slots: all slots are idle 5.45.981.679 I srv operator(): Chat format: peg-native 5.45.981.924 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.518 (> 0.100 thold), f_keep = 0.044 5.45.981.927 I srv get_availabl: updating prompt cache 5.45.981.994 W srv prompt_save: - saving prompt with length 1006, total state size = 81.707 MiB (draft: 0.000 MiB) 5.46.092.249 I srv load: - looking for better prompt, base f_keep = 0.044, sim = 0.518 5.46.092.257 I srv update: - cache state: 5 prompts, 1007.002 MiB (limits: 8192.000 MiB, 24576 tokens, 131250 est) 5.46.092.258 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 5.46.092.259 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 5.46.092.260 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 5.46.092.260 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 5.46.092.261 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 5.46.092.262 I srv get_availabl: prompt cache update took 110.33 ms 5.46.092.336 I slot launch_slot_: id 3 | task 15784 | processing task, is_child = 0 5.46.092.337 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 5.46.092.337 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 5.46.092.354 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 5.46.092.354 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 5.46.092.367 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 5.46.092.368 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 5.46.092.389 I slot update_slots: id 3 | task 15784 | Checking checkpoint with [40, 40] against 44... 5.46.105.233 W slot update_slots: id 3 | task 15784 | restored context checkpoint (pos_min = 40, pos_max = 40, n_tokens = 41, n_past = 41, size = 50.251 MiB) 5.49.263.710 I slot print_timing: id 3 | task 15784 | n_decoded = 144, tg = 47.74 t/s, tg_3s = 47.74 t/s 5.52.275.783 I slot print_timing: id 3 | task 15784 | n_decoded = 287, tg = 47.61 t/s, tg_3s = 47.48 t/s 5.55.287.741 I slot print_timing: id 3 | task 15784 | n_decoded = 430, tg = 47.57 t/s, tg_3s = 47.48 t/s 5.58.292.865 I slot print_timing: id 3 | task 15784 | n_decoded = 573, tg = 47.57 t/s, tg_3s = 47.59 t/s 6.01.304.833 I slot print_timing: id 3 | task 15784 | n_decoded = 716, tg = 47.55 t/s, tg_3s = 47.48 t/s 6.04.307.924 I slot print_timing: id 3 | task 15784 | n_decoded = 859, tg = 47.56 t/s, tg_3s = 47.62 t/s 6.07.316.998 I slot print_timing: id 3 | task 15784 | n_decoded = 1002, tg = 47.56 t/s, tg_3s = 47.52 t/s 6.10.319.995 I slot print_timing: id 3 | task 15784 | n_decoded = 1145, tg = 47.56 t/s, tg_3s = 47.62 t/s 6.13.338.974 I slot print_timing: id 3 | task 15784 | n_decoded = 1288, tg = 47.54 t/s, tg_3s = 47.37 t/s 6.15.712.049 I slot print_timing: id 3 | task 15784 | prompt eval time = 155.12 ms / 44 tokens ( 3.53 ms per token, 283.64 tokens per second) 6.15.712.053 I slot print_timing: id 3 | task 15784 | eval time = 29464.53 ms / 1401 tokens ( 21.03 ms per token, 47.55 tokens per second) 6.15.712.054 I slot print_timing: id 3 | task 15784 | total time = 29619.65 ms / 1445 tokens 6.15.712.054 I slot print_timing: id 3 | task 15784 | graphs reused = 17097 6.15.712.083 I slot release: id 3 | task 15784 | stop processing: n_tokens = 1485, truncated = 0 6.15.712.098 I srv update_slots: all slots are idle 6.15.728.085 I srv operator(): Chat format: peg-native 6.15.728.326 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.524 (> 0.100 thold), f_keep = 0.030 6.15.728.328 I srv get_availabl: updating prompt cache 6.15.728.400 W srv prompt_save: - saving prompt with length 1485, total state size = 96.685 MiB (draft: 0.000 MiB) 6.15.842.357 I srv load: - looking for better prompt, base f_keep = 0.030, sim = 0.524 6.15.842.366 I srv update: - cache state: 6 prompts, 1153.938 MiB (limits: 8192.000 MiB, 24576 tokens, 125080 est) 6.15.842.367 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 6.15.842.367 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 6.15.842.368 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 6.15.842.369 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 6.15.842.369 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 6.15.842.370 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 6.15.842.371 I srv get_availabl: prompt cache update took 114.04 ms 6.15.842.445 I slot launch_slot_: id 3 | task 17187 | processing task, is_child = 0 6.15.842.446 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 6.15.842.446 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 6.15.842.464 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 6.15.842.464 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 6.15.842.494 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 6.15.842.494 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 6.15.842.531 I slot update_slots: id 3 | task 17187 | Checking checkpoint with [40, 40] against 44... 6.15.855.406 W slot update_slots: id 3 | task 17187 | restored context checkpoint (pos_min = 40, pos_max = 40, n_tokens = 41, n_past = 41, size = 50.251 MiB) 6.19.007.022 I slot print_timing: id 3 | task 17187 | n_decoded = 144, tg = 47.85 t/s, tg_3s = 47.85 t/s 6.22.015.179 I slot print_timing: id 3 | task 17187 | n_decoded = 287, tg = 47.69 t/s, tg_3s = 47.54 t/s 6.25.022.807 I slot print_timing: id 3 | task 17187 | n_decoded = 430, tg = 47.64 t/s, tg_3s = 47.55 t/s 6.28.025.133 I slot print_timing: id 3 | task 17187 | n_decoded = 572, tg = 47.56 t/s, tg_3s = 47.30 t/s 6.31.026.245 I slot print_timing: id 3 | task 17187 | n_decoded = 714, tg = 47.51 t/s, tg_3s = 47.32 t/s 6.34.036.214 I slot print_timing: id 3 | task 17187 | n_decoded = 857, tg = 47.51 t/s, tg_3s = 47.51 t/s 6.37.050.030 I slot print_timing: id 3 | task 17187 | n_decoded = 1000, tg = 47.50 t/s, tg_3s = 47.45 t/s 6.40.053.138 I slot print_timing: id 3 | task 17187 | n_decoded = 1143, tg = 47.52 t/s, tg_3s = 47.62 t/s 6.43.061.196 I slot print_timing: id 3 | task 17187 | n_decoded = 1286, tg = 47.52 t/s, tg_3s = 47.54 t/s 6.46.076.231 I slot print_timing: id 3 | task 17187 | n_decoded = 1429, tg = 47.51 t/s, tg_3s = 47.43 t/s 6.49.083.099 I slot print_timing: id 3 | task 17187 | n_decoded = 1571, tg = 47.48 t/s, tg_3s = 47.23 t/s 6.52.086.459 I slot print_timing: id 3 | task 17187 | n_decoded = 1713, tg = 47.47 t/s, tg_3s = 47.28 t/s 6.55.097.383 I slot print_timing: id 3 | task 17187 | n_decoded = 1855, tg = 47.44 t/s, tg_3s = 47.16 t/s 6.58.105.465 I slot print_timing: id 3 | task 17187 | n_decoded = 1996, tg = 47.40 t/s, tg_3s = 46.87 t/s 7.01.111.875 I slot print_timing: id 3 | task 17187 | n_decoded = 2137, tg = 47.37 t/s, tg_3s = 46.90 t/s 7.04.122.404 I slot print_timing: id 3 | task 17187 | n_decoded = 2278, tg = 47.34 t/s, tg_3s = 46.84 t/s 7.07.132.013 I slot print_timing: id 3 | task 17187 | n_decoded = 2419, tg = 47.31 t/s, tg_3s = 46.85 t/s 7.10.134.107 I slot print_timing: id 3 | task 17187 | n_decoded = 2559, tg = 47.27 t/s, tg_3s = 46.63 t/s 7.13.149.395 I slot print_timing: id 3 | task 17187 | n_decoded = 2700, tg = 47.24 t/s, tg_3s = 46.76 t/s 7.16.166.229 I slot print_timing: id 3 | task 17187 | n_decoded = 2841, tg = 47.22 t/s, tg_3s = 46.74 t/s 7.19.186.479 I slot print_timing: id 3 | task 17187 | n_decoded = 2982, tg = 47.19 t/s, tg_3s = 46.68 t/s 7.22.205.489 I slot print_timing: id 3 | task 17187 | n_decoded = 3123, tg = 47.17 t/s, tg_3s = 46.70 t/s 7.25.210.921 I slot print_timing: id 3 | task 17187 | n_decoded = 3264, tg = 47.16 t/s, tg_3s = 46.92 t/s 7.28.221.314 I slot print_timing: id 3 | task 17187 | n_decoded = 3407, tg = 47.17 t/s, tg_3s = 47.50 t/s 7.31.235.326 I slot print_timing: id 3 | task 17187 | n_decoded = 3550, tg = 47.18 t/s, tg_3s = 47.45 t/s 7.34.245.939 I slot print_timing: id 3 | task 17187 | n_decoded = 3693, tg = 47.20 t/s, tg_3s = 47.50 t/s 7.37.261.838 I slot print_timing: id 3 | task 17187 | n_decoded = 3836, tg = 47.20 t/s, tg_3s = 47.42 t/s 7.40.262.146 I slot print_timing: id 3 | task 17187 | n_decoded = 3978, tg = 47.21 t/s, tg_3s = 47.33 t/s 7.43.270.186 I slot print_timing: id 3 | task 17187 | n_decoded = 4120, tg = 47.21 t/s, tg_3s = 47.21 t/s 7.46.291.121 I slot print_timing: id 3 | task 17187 | n_decoded = 4263, tg = 47.21 t/s, tg_3s = 47.34 t/s 7.49.310.693 I slot print_timing: id 3 | task 17187 | n_decoded = 4405, tg = 47.21 t/s, tg_3s = 47.03 t/s 7.52.319.281 I slot print_timing: id 3 | task 17187 | n_decoded = 4547, tg = 47.21 t/s, tg_3s = 47.20 t/s 7.55.320.327 I slot print_timing: id 3 | task 17187 | n_decoded = 4689, tg = 47.21 t/s, tg_3s = 47.32 t/s 7.58.341.073 I slot print_timing: id 3 | task 17187 | n_decoded = 4831, tg = 47.20 t/s, tg_3s = 47.01 t/s 8.01.349.137 I slot print_timing: id 3 | task 17187 | n_decoded = 4972, tg = 47.19 t/s, tg_3s = 46.87 t/s 8.04.361.854 I slot print_timing: id 3 | task 17187 | n_decoded = 5113, tg = 47.18 t/s, tg_3s = 46.80 t/s 8.07.371.099 I slot print_timing: id 3 | task 17187 | n_decoded = 5254, tg = 47.17 t/s, tg_3s = 46.86 t/s 8.10.372.777 I slot print_timing: id 3 | task 17187 | n_decoded = 5394, tg = 47.16 t/s, tg_3s = 46.64 t/s 8.13.373.098 I slot print_timing: id 3 | task 17187 | n_decoded = 5535, tg = 47.16 t/s, tg_3s = 46.99 t/s 8.16.390.101 I slot print_timing: id 3 | task 17187 | n_decoded = 5676, tg = 47.15 t/s, tg_3s = 46.74 t/s 8.19.398.289 I slot print_timing: id 3 | task 17187 | n_decoded = 5817, tg = 47.14 t/s, tg_3s = 46.87 t/s 8.22.417.812 I slot print_timing: id 3 | task 17187 | n_decoded = 5959, tg = 47.14 t/s, tg_3s = 47.03 t/s 8.25.427.391 I slot print_timing: id 3 | task 17187 | n_decoded = 6100, tg = 47.13 t/s, tg_3s = 46.85 t/s 8.26.358.369 I slot print_timing: id 3 | task 17187 | prompt eval time = 155.10 ms / 43 tokens ( 3.61 ms per token, 277.24 tokens per second) 8.26.358.372 I slot print_timing: id 3 | task 17187 | eval time = 130360.73 ms / 6144 tokens ( 21.22 ms per token, 47.13 tokens per second) 8.26.358.373 I slot print_timing: id 3 | task 17187 | total time = 130515.83 ms / 6187 tokens 8.26.358.373 I slot print_timing: id 3 | task 17187 | graphs reused = 23215 8.26.358.402 I slot release: id 3 | task 17187 | stop processing: n_tokens = 6227, truncated = 0 8.26.358.438 I srv update_slots: all slots are idle 8.26.374.888 I srv operator(): Chat format: peg-native 8.26.375.129 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.629 (> 0.100 thold), f_keep = 0.007 8.26.375.131 I srv get_availabl: updating prompt cache 8.26.375.357 W srv prompt_save: - saving prompt with length 6227, total state size = 244.963 MiB (draft: 0.000 MiB) 8.26.593.684 I srv load: - looking for better prompt, base f_keep = 0.007, sim = 0.629 8.26.593.693 I srv update: - cache state: 7 prompts, 1449.152 MiB (limits: 8192.000 MiB, 24576 tokens, 134800 est) 8.26.593.694 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 8.26.593.696 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 8.26.593.697 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 8.26.593.697 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 8.26.593.698 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 8.26.593.698 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 8.26.593.699 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 8.26.593.700 I srv get_availabl: prompt cache update took 218.57 ms 8.26.593.770 I slot launch_slot_: id 3 | task 23333 | processing task, is_child = 0 8.26.593.770 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 8.26.593.771 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 8.26.593.798 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 8.26.593.798 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 8.26.593.813 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 8.26.593.813 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 8.26.593.837 I slot update_slots: id 3 | task 23333 | Checking checkpoint with [40, 40] against 44... 8.26.606.585 W slot update_slots: id 3 | task 23333 | restored context checkpoint (pos_min = 40, pos_max = 40, n_tokens = 41, n_past = 41, size = 50.251 MiB) 8.29.743.047 I slot print_timing: id 3 | task 23333 | n_decoded = 144, tg = 47.86 t/s, tg_3s = 47.86 t/s 8.32.751.117 I slot print_timing: id 3 | task 23333 | n_decoded = 287, tg = 47.70 t/s, tg_3s = 47.54 t/s 8.35.758.123 I slot print_timing: id 3 | task 23333 | n_decoded = 430, tg = 47.65 t/s, tg_3s = 47.56 t/s 8.38.773.138 I slot print_timing: id 3 | task 23333 | n_decoded = 573, tg = 47.60 t/s, tg_3s = 47.43 t/s 8.41.784.283 I slot print_timing: id 3 | task 23333 | n_decoded = 716, tg = 47.58 t/s, tg_3s = 47.49 t/s 8.44.792.294 I slot print_timing: id 3 | task 23333 | n_decoded = 859, tg = 47.57 t/s, tg_3s = 47.54 t/s 8.47.802.394 I slot print_timing: id 3 | task 23333 | n_decoded = 1002, tg = 47.56 t/s, tg_3s = 47.51 t/s 8.50.819.502 I slot print_timing: id 3 | task 23333 | n_decoded = 1145, tg = 47.54 t/s, tg_3s = 47.40 t/s 8.53.825.457 I slot print_timing: id 3 | task 23333 | n_decoded = 1287, tg = 47.51 t/s, tg_3s = 47.24 t/s 8.56.828.212 I slot print_timing: id 3 | task 23333 | n_decoded = 1429, tg = 47.48 t/s, tg_3s = 47.29 t/s 8.59.847.206 I slot print_timing: id 3 | task 23333 | n_decoded = 1572, tg = 47.47 t/s, tg_3s = 47.37 t/s 9.02.850.543 I slot print_timing: id 3 | task 23333 | n_decoded = 1714, tg = 47.46 t/s, tg_3s = 47.28 t/s 9.05.853.057 I slot print_timing: id 3 | task 23333 | n_decoded = 1856, tg = 47.45 t/s, tg_3s = 47.29 t/s 9.08.862.320 I slot print_timing: id 3 | task 23333 | n_decoded = 1999, tg = 47.45 t/s, tg_3s = 47.52 t/s 9.11.867.240 I slot print_timing: id 3 | task 23333 | n_decoded = 2142, tg = 47.46 t/s, tg_3s = 47.59 t/s 9.14.880.267 I slot print_timing: id 3 | task 23333 | n_decoded = 2285, tg = 47.46 t/s, tg_3s = 47.46 t/s 9.17.880.277 I slot print_timing: id 3 | task 23333 | n_decoded = 2427, tg = 47.45 t/s, tg_3s = 47.33 t/s 9.20.884.462 I slot print_timing: id 3 | task 23333 | n_decoded = 2569, tg = 47.44 t/s, tg_3s = 47.27 t/s 9.23.905.356 I slot print_timing: id 3 | task 23333 | n_decoded = 2711, tg = 47.42 t/s, tg_3s = 47.01 t/s 9.26.921.074 I slot print_timing: id 3 | task 23333 | n_decoded = 2853, tg = 47.40 t/s, tg_3s = 47.09 t/s 9.29.939.844 I slot print_timing: id 3 | task 23333 | n_decoded = 2995, tg = 47.39 t/s, tg_3s = 47.04 t/s 9.32.955.060 I slot print_timing: id 3 | task 23333 | n_decoded = 3137, tg = 47.37 t/s, tg_3s = 47.09 t/s 9.35.974.088 I slot print_timing: id 3 | task 23333 | n_decoded = 3279, tg = 47.36 t/s, tg_3s = 47.04 t/s 9.38.990.039 I slot print_timing: id 3 | task 23333 | n_decoded = 3421, tg = 47.35 t/s, tg_3s = 47.08 t/s 9.41.999.129 I slot print_timing: id 3 | task 23333 | n_decoded = 3562, tg = 47.33 t/s, tg_3s = 46.86 t/s 9.45.000.952 I slot print_timing: id 3 | task 23333 | n_decoded = 3703, tg = 47.31 t/s, tg_3s = 46.97 t/s 9.48.012.703 I slot print_timing: id 3 | task 23333 | n_decoded = 3844, tg = 47.29 t/s, tg_3s = 46.82 t/s 9.51.023.916 I slot print_timing: id 3 | task 23333 | n_decoded = 3985, tg = 47.28 t/s, tg_3s = 46.82 t/s 9.54.044.290 I slot print_timing: id 3 | task 23333 | n_decoded = 4126, tg = 47.26 t/s, tg_3s = 46.68 t/s 9.57.058.287 I slot print_timing: id 3 | task 23333 | n_decoded = 4267, tg = 47.24 t/s, tg_3s = 46.78 t/s 10.00.067.106 I slot print_timing: id 3 | task 23333 | n_decoded = 4409, tg = 47.24 t/s, tg_3s = 47.19 t/s 10.03.078.265 I slot print_timing: id 3 | task 23333 | n_decoded = 4552, tg = 47.25 t/s, tg_3s = 47.49 t/s 10.06.087.193 I slot print_timing: id 3 | task 23333 | n_decoded = 4695, tg = 47.26 t/s, tg_3s = 47.53 t/s 10.09.090.204 I slot print_timing: id 3 | task 23333 | n_decoded = 4837, tg = 47.26 t/s, tg_3s = 47.29 t/s 10.12.094.263 I slot print_timing: id 3 | task 23333 | n_decoded = 4980, tg = 47.27 t/s, tg_3s = 47.60 t/s 10.15.113.831 I slot print_timing: id 3 | task 23333 | n_decoded = 5123, tg = 47.27 t/s, tg_3s = 47.36 t/s 10.18.127.925 I slot print_timing: id 3 | task 23333 | n_decoded = 5266, tg = 47.27 t/s, tg_3s = 47.44 t/s 10.21.146.384 I slot print_timing: id 3 | task 23333 | n_decoded = 5409, tg = 47.28 t/s, tg_3s = 47.38 t/s 10.24.160.396 I slot print_timing: id 3 | task 23333 | n_decoded = 5552, tg = 47.28 t/s, tg_3s = 47.45 t/s 10.27.167.436 I slot print_timing: id 3 | task 23333 | n_decoded = 5692, tg = 47.26 t/s, tg_3s = 46.56 t/s 10.30.175.130 I slot print_timing: id 3 | task 23333 | n_decoded = 5832, tg = 47.25 t/s, tg_3s = 46.55 t/s 10.33.181.464 I slot print_timing: id 3 | task 23333 | n_decoded = 5972, tg = 47.23 t/s, tg_3s = 46.57 t/s 10.36.194.480 I slot print_timing: id 3 | task 23333 | n_decoded = 6112, tg = 47.21 t/s, tg_3s = 46.47 t/s 10.36.880.918 I slot print_timing: id 3 | task 23333 | prompt eval time = 140.56 ms / 29 tokens ( 4.85 ms per token, 206.32 tokens per second) 10.36.880.922 I slot print_timing: id 3 | task 23333 | eval time = 130146.52 ms / 6144 tokens ( 21.18 ms per token, 47.21 tokens per second) 10.36.880.922 I slot print_timing: id 3 | task 23333 | total time = 130287.08 ms / 6173 tokens 10.36.880.923 I slot print_timing: id 3 | task 23333 | graphs reused = 29333 10.36.880.954 I slot release: id 3 | task 23333 | stop processing: n_tokens = 6213, truncated = 0 10.36.880.981 I srv update_slots: all slots are idle 10.36.897.728 I srv operator(): Chat format: peg-native 10.36.898.146 I slot get_availabl: id 2 | task -1 | selected slot by LRU, t_last = -1 10.36.898.148 I srv get_availabl: updating prompt cache 10.36.898.151 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000 10.36.898.154 I srv update: - cache state: 7 prompts, 1449.152 MiB (limits: 8192.000 MiB, 24576 tokens, 134800 est) 10.36.898.155 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 10.36.898.156 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 10.36.898.161 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 10.36.898.161 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 10.36.898.162 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 10.36.898.162 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 10.36.898.163 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 10.36.898.163 I srv get_availabl: prompt cache update took 0.01 ms 10.36.898.210 I slot launch_slot_: id 2 | task 29479 | processing task, is_child = 0 10.36.898.210 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 10.36.898.211 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 10.36.898.229 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 10.36.898.230 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 10.36.898.244 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache 10.36.898.445 W srv prompt_save: - saving prompt with length 6213, total state size = 244.526 MiB (draft: 0.000 MiB) 10.37.107.235 I srv update: - cache state: 8 prompts, 1743.928 MiB (limits: 8192.000 MiB, 24576 tokens, 141200 est) 10.37.107.238 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 10.37.107.239 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 10.37.107.240 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 10.37.107.240 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 10.37.107.241 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 10.37.107.241 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 10.37.107.242 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 10.37.107.242 I srv update: - prompt 0x5ac285e9bf00: 6213 tokens, checkpoints: 1, 294.776 MiB 10.37.107.243 I slot prompt_clear: id 3 | task -1 | clearing prompt with 6213 tokens 10.37.262.882 I slot create_check: id 2 | task 29479 | created context checkpoint 1 of 32 (pos_min = 58, pos_max = 58, n_tokens = 59, size = 50.251 MiB) 10.40.414.551 I slot print_timing: id 2 | task 29479 | n_decoded = 144, tg = 47.83 t/s, tg_3s = 47.83 t/s 10.43.423.031 I slot print_timing: id 2 | task 29479 | n_decoded = 286, tg = 47.52 t/s, tg_3s = 47.20 t/s 10.46.435.969 I slot print_timing: id 2 | task 29479 | n_decoded = 429, tg = 47.50 t/s, tg_3s = 47.46 t/s 10.49.438.089 I slot print_timing: id 2 | task 29479 | n_decoded = 572, tg = 47.53 t/s, tg_3s = 47.63 t/s 10.52.455.655 I slot print_timing: id 2 | task 29479 | n_decoded = 715, tg = 47.50 t/s, tg_3s = 47.39 t/s 10.55.458.423 I slot print_timing: id 2 | task 29479 | n_decoded = 858, tg = 47.52 t/s, tg_3s = 47.62 t/s 10.58.467.695 I slot print_timing: id 2 | task 29479 | n_decoded = 1001, tg = 47.52 t/s, tg_3s = 47.52 t/s 11.01.470.750 I slot print_timing: id 2 | task 29479 | n_decoded = 1144, tg = 47.53 t/s, tg_3s = 47.62 t/s 11.04.481.767 I slot print_timing: id 2 | task 29479 | n_decoded = 1287, tg = 47.53 t/s, tg_3s = 47.49 t/s 11.07.486.867 I slot print_timing: id 2 | task 29479 | n_decoded = 1430, tg = 47.54 t/s, tg_3s = 47.59 t/s 11.10.490.835 I slot print_timing: id 2 | task 29479 | n_decoded = 1572, tg = 47.51 t/s, tg_3s = 47.27 t/s 11.13.492.056 I slot print_timing: id 2 | task 29479 | n_decoded = 1714, tg = 47.49 t/s, tg_3s = 47.31 t/s 11.16.493.961 I slot print_timing: id 2 | task 29479 | n_decoded = 1856, tg = 47.48 t/s, tg_3s = 47.30 t/s 11.19.502.058 I slot print_timing: id 2 | task 29479 | n_decoded = 1998, tg = 47.46 t/s, tg_3s = 47.21 t/s 11.22.516.116 I slot print_timing: id 2 | task 29479 | n_decoded = 2140, tg = 47.44 t/s, tg_3s = 47.11 t/s 11.25.536.064 I slot print_timing: id 2 | task 29479 | n_decoded = 2283, tg = 47.43 t/s, tg_3s = 47.35 t/s 11.28.549.198 I slot print_timing: id 2 | task 29479 | n_decoded = 2425, tg = 47.41 t/s, tg_3s = 47.13 t/s 11.31.559.997 I slot print_timing: id 2 | task 29479 | n_decoded = 2566, tg = 47.38 t/s, tg_3s = 46.83 t/s 11.34.577.410 I slot print_timing: id 2 | task 29479 | n_decoded = 2708, tg = 47.36 t/s, tg_3s = 47.06 t/s 11.37.591.970 I slot print_timing: id 2 | task 29479 | n_decoded = 2849, tg = 47.33 t/s, tg_3s = 46.77 t/s 11.40.607.117 I slot print_timing: id 2 | task 29479 | n_decoded = 2992, tg = 47.34 t/s, tg_3s = 47.43 t/s 11.43.622.042 I slot print_timing: id 2 | task 29479 | n_decoded = 3135, tg = 47.34 t/s, tg_3s = 47.43 t/s 11.46.632.135 I slot print_timing: id 2 | task 29479 | n_decoded = 3278, tg = 47.35 t/s, tg_3s = 47.51 t/s 11.49.635.167 I slot print_timing: id 2 | task 29479 | n_decoded = 3421, tg = 47.36 t/s, tg_3s = 47.62 t/s 11.52.646.139 I slot print_timing: id 2 | task 29479 | n_decoded = 3564, tg = 47.37 t/s, tg_3s = 47.49 t/s 11.55.653.178 I slot print_timing: id 2 | task 29479 | n_decoded = 3707, tg = 47.37 t/s, tg_3s = 47.56 t/s 11.58.673.253 I slot print_timing: id 2 | task 29479 | n_decoded = 3850, tg = 47.37 t/s, tg_3s = 47.35 t/s 12.01.678.420 I slot print_timing: id 2 | task 29479 | n_decoded = 3992, tg = 47.37 t/s, tg_3s = 47.25 t/s 12.04.694.455 I slot print_timing: id 2 | task 29479 | n_decoded = 4133, tg = 47.35 t/s, tg_3s = 46.75 t/s 12.06.195.802 I slot print_timing: id 2 | task 29479 | prompt eval time = 295.61 ms / 98 tokens ( 3.02 ms per token, 331.52 tokens per second) 12.06.195.806 I slot print_timing: id 2 | task 29479 | eval time = 88791.87 ms / 4203 tokens ( 21.13 ms per token, 47.34 tokens per second) 12.06.195.807 I slot print_timing: id 2 | task 29479 | total time = 89087.48 ms / 4301 tokens 12.06.195.807 I slot print_timing: id 2 | task 29479 | graphs reused = 33518 12.06.195.838 I slot release: id 2 | task 29479 | stop processing: n_tokens = 4300, truncated = 0 12.06.195.855 I srv update_slots: all slots are idle 12.06.212.073 I srv operator(): Chat format: peg-native 12.06.212.354 I slot get_availabl: id 2 | task -1 | selected slot by LCP similarity, sim_best = 0.484 (> 0.100 thold), f_keep = 0.014 12.06.212.356 I srv get_availabl: updating prompt cache 12.06.212.520 W srv prompt_save: - saving prompt with length 4300, total state size = 184.708 MiB (draft: 0.000 MiB) 12.06.368.986 I srv load: - looking for better prompt, base f_keep = 0.014, sim = 0.484 12.06.368.994 I srv update: - cache state: 9 prompts, 1978.886 MiB (limits: 8192.000 MiB, 24576 tokens, 142236 est) 12.06.368.995 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 12.06.368.996 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 12.06.368.996 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 12.06.368.997 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 12.06.368.997 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 12.06.368.998 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 12.06.368.999 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 12.06.368.999 I srv update: - prompt 0x5ac285e9bf00: 6213 tokens, checkpoints: 1, 294.776 MiB 12.06.369.000 I srv update: - prompt 0x5ac285ef5ea0: 4300 tokens, checkpoints: 1, 234.958 MiB 12.06.369.001 I srv get_availabl: prompt cache update took 156.64 ms 12.06.369.076 I slot launch_slot_: id 2 | task 33685 | processing task, is_child = 0 12.06.369.077 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 12.06.369.078 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 12.06.369.099 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 12.06.369.099 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 12.06.369.113 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache 12.06.369.114 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens 12.06.369.135 I slot update_slots: id 2 | task 33685 | Checking checkpoint with [58, 58] against 62... 12.06.382.032 W slot update_slots: id 2 | task 33685 | restored context checkpoint (pos_min = 58, pos_max = 58, n_tokens = 59, n_past = 59, size = 50.251 MiB) 12.09.610.343 I slot print_timing: id 2 | task 33685 | n_decoded = 144, tg = 47.68 t/s, tg_3s = 47.68 t/s 12.12.611.399 I slot print_timing: id 2 | task 33685 | n_decoded = 286, tg = 47.50 t/s, tg_3s = 47.32 t/s 12.15.628.347 I slot print_timing: id 2 | task 33685 | n_decoded = 429, tg = 47.47 t/s, tg_3s = 47.40 t/s 12.18.639.665 I slot print_timing: id 2 | task 33685 | n_decoded = 572, tg = 47.47 t/s, tg_3s = 47.49 t/s 12.21.652.204 I slot print_timing: id 2 | task 33685 | n_decoded = 714, tg = 47.40 t/s, tg_3s = 47.14 t/s 12.24.657.072 I slot print_timing: id 2 | task 33685 | n_decoded = 856, tg = 47.38 t/s, tg_3s = 47.26 t/s 12.27.669.516 I slot print_timing: id 2 | task 33685 | n_decoded = 999, tg = 47.39 t/s, tg_3s = 47.47 t/s 12.30.672.522 I slot print_timing: id 2 | task 33685 | n_decoded = 1142, tg = 47.42 t/s, tg_3s = 47.62 t/s 12.33.685.577 I slot print_timing: id 2 | task 33685 | n_decoded = 1285, tg = 47.43 t/s, tg_3s = 47.46 t/s 12.36.694.517 I slot print_timing: id 2 | task 33685 | n_decoded = 1428, tg = 47.44 t/s, tg_3s = 47.53 t/s 12.39.703.656 I slot print_timing: id 2 | task 33685 | n_decoded = 1571, tg = 47.44 t/s, tg_3s = 47.52 t/s 12.42.718.662 I slot print_timing: id 2 | task 33685 | n_decoded = 1714, tg = 47.44 t/s, tg_3s = 47.43 t/s 12.45.724.696 I slot print_timing: id 2 | task 33685 | n_decoded = 1857, tg = 47.45 t/s, tg_3s = 47.57 t/s 12.48.586.721 I slot print_timing: id 2 | task 33685 | prompt eval time = 221.13 ms / 69 tokens ( 3.20 ms per token, 312.03 tokens per second) 12.48.586.724 I slot print_timing: id 2 | task 33685 | eval time = 41996.45 ms / 1993 tokens ( 21.07 ms per token, 47.46 tokens per second) 12.48.586.725 I slot print_timing: id 2 | task 33685 | total time = 42217.58 ms / 2062 tokens 12.48.586.726 I slot print_timing: id 2 | task 33685 | graphs reused = 35501 12.48.586.757 I slot release: id 2 | task 33685 | stop processing: n_tokens = 2120, truncated = 0 12.48.586.774 I srv update_slots: all slots are idle 12.48.603.378 I srv operator(): Chat format: peg-native 12.48.603.666 I slot get_availabl: id 2 | task -1 | selected slot by LCP similarity, sim_best = 0.508 (> 0.100 thold), f_keep = 0.029 12.48.603.667 I srv get_availabl: updating prompt cache 12.48.603.764 W srv prompt_save: - saving prompt with length 2120, total state size = 116.541 MiB (draft: 0.000 MiB) 12.48.717.805 I srv load: - looking for better prompt, base f_keep = 0.029, sim = 0.508 12.48.717.816 I srv update: - cache state: 10 prompts, 2145.678 MiB (limits: 8192.000 MiB, 24576 tokens, 139273 est) 12.48.717.817 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 12.48.717.818 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 12.48.717.818 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 12.48.717.819 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 12.48.717.819 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 12.48.717.820 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 12.48.717.820 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 12.48.717.821 I srv update: - prompt 0x5ac285e9bf00: 6213 tokens, checkpoints: 1, 294.776 MiB 12.48.717.821 I srv update: - prompt 0x5ac285ef5ea0: 4300 tokens, checkpoints: 1, 234.958 MiB 12.48.717.822 I srv update: - prompt 0x5ac28cda8320: 2120 tokens, checkpoints: 1, 166.792 MiB 12.48.717.823 I srv get_availabl: prompt cache update took 114.16 ms 12.48.717.897 I slot launch_slot_: id 2 | task 35680 | processing task, is_child = 0 12.48.717.898 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 12.48.717.898 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 12.48.717.917 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 12.48.717.917 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 12.48.717.930 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache 12.48.717.931 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens 12.48.717.953 I slot update_slots: id 2 | task 35680 | Checking checkpoint with [58, 58] against 62... 12.48.730.895 W slot update_slots: id 2 | task 35680 | restored context checkpoint (pos_min = 58, pos_max = 58, n_tokens = 59, n_past = 59, size = 50.251 MiB) 12.51.902.674 I slot print_timing: id 2 | task 35680 | n_decoded = 144, tg = 47.78 t/s, tg_3s = 47.78 t/s 12.54.905.784 I slot print_timing: id 2 | task 35680 | n_decoded = 287, tg = 47.70 t/s, tg_3s = 47.62 t/s 12.57.915.793 I slot print_timing: id 2 | task 35680 | n_decoded = 430, tg = 47.64 t/s, tg_3s = 47.51 t/s 13.00.921.626 I slot print_timing: id 2 | task 35680 | n_decoded = 573, tg = 47.62 t/s, tg_3s = 47.57 t/s 13.03.930.734 I slot print_timing: id 2 | task 35680 | n_decoded = 716, tg = 47.60 t/s, tg_3s = 47.52 t/s 13.06.936.978 I slot print_timing: id 2 | task 35680 | n_decoded = 859, tg = 47.60 t/s, tg_3s = 47.57 t/s 13.09.955.967 I slot print_timing: id 2 | task 35680 | n_decoded = 1002, tg = 47.56 t/s, tg_3s = 47.37 t/s 13.12.971.797 I slot print_timing: id 2 | task 35680 | n_decoded = 1145, tg = 47.54 t/s, tg_3s = 47.42 t/s 13.15.973.183 I slot print_timing: id 2 | task 35680 | n_decoded = 1286, tg = 47.48 t/s, tg_3s = 46.98 t/s 13.18.979.013 I slot print_timing: id 2 | task 35680 | n_decoded = 1428, tg = 47.46 t/s, tg_3s = 47.24 t/s 13.21.981.991 I slot print_timing: id 2 | task 35680 | n_decoded = 1571, tg = 47.47 t/s, tg_3s = 47.62 t/s 13.25.001.071 I slot print_timing: id 2 | task 35680 | n_decoded = 1714, tg = 47.46 t/s, tg_3s = 47.37 t/s 13.28.012.155 I slot print_timing: id 2 | task 35680 | n_decoded = 1857, tg = 47.47 t/s, tg_3s = 47.49 t/s 13.31.030.207 I slot print_timing: id 2 | task 35680 | n_decoded = 2000, tg = 47.46 t/s, tg_3s = 47.38 t/s 13.34.039.165 I slot print_timing: id 2 | task 35680 | n_decoded = 2143, tg = 47.46 t/s, tg_3s = 47.52 t/s 13.37.043.316 I slot print_timing: id 2 | task 35680 | n_decoded = 2285, tg = 47.45 t/s, tg_3s = 47.27 t/s 13.40.056.697 I slot print_timing: id 2 | task 35680 | n_decoded = 2427, tg = 47.43 t/s, tg_3s = 47.12 t/s 13.43.064.274 I slot print_timing: id 2 | task 35680 | n_decoded = 2568, tg = 47.40 t/s, tg_3s = 46.88 t/s 13.46.071.283 I slot print_timing: id 2 | task 35680 | n_decoded = 2709, tg = 47.37 t/s, tg_3s = 46.89 t/s 13.49.076.222 I slot print_timing: id 2 | task 35680 | n_decoded = 2850, tg = 47.35 t/s, tg_3s = 46.92 t/s 13.51.604.094 I slot print_timing: id 2 | task 35680 | prompt eval time = 171.02 ms / 63 tokens ( 2.71 ms per token, 368.39 tokens per second) 13.51.604.097 I slot print_timing: id 2 | task 35680 | eval time = 62715.12 ms / 2968 tokens ( 21.13 ms per token, 47.33 tokens per second) 13.51.604.098 I slot print_timing: id 2 | task 35680 | total time = 62886.14 ms / 3031 tokens 13.51.604.099 I slot print_timing: id 2 | task 35680 | graphs reused = 38455 13.51.604.130 I slot release: id 2 | task 35680 | stop processing: n_tokens = 3089, truncated = 0 13.51.604.150 I srv update_slots: all slots are idle 13.51.620.095 I srv operator(): Chat format: peg-native 13.51.620.376 I slot get_availabl: id 2 | task -1 | selected slot by LCP similarity, sim_best = 0.473 (> 0.100 thold), f_keep = 0.020 13.51.620.378 I srv get_availabl: updating prompt cache 13.51.620.521 W srv prompt_save: - saving prompt with length 3089, total state size = 146.841 MiB (draft: 0.000 MiB) 13.51.746.442 I srv load: - looking for better prompt, base f_keep = 0.020, sim = 0.473 13.51.746.452 I srv update: - cache state: 11 prompts, 2342.770 MiB (limits: 8192.000 MiB, 24576 tokens, 138358 est) 13.51.746.453 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 13.51.746.454 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 13.51.746.454 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 13.51.746.455 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 13.51.746.455 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 13.51.746.456 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 13.51.746.456 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 13.51.746.457 I srv update: - prompt 0x5ac285e9bf00: 6213 tokens, checkpoints: 1, 294.776 MiB 13.51.746.457 I srv update: - prompt 0x5ac285ef5ea0: 4300 tokens, checkpoints: 1, 234.958 MiB 13.51.746.458 I srv update: - prompt 0x5ac28cda8320: 2120 tokens, checkpoints: 1, 166.792 MiB 13.51.746.458 I srv update: - prompt 0x5ac285ec48a0: 3089 tokens, checkpoints: 1, 197.092 MiB 13.51.746.459 I srv get_availabl: prompt cache update took 126.08 ms 13.51.746.529 I slot launch_slot_: id 2 | task 38650 | processing task, is_child = 0 13.51.746.529 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 13.51.746.530 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 13.51.746.547 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 13.51.746.547 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 13.51.746.561 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache 13.51.746.561 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens 13.51.746.583 I slot update_slots: id 2 | task 38650 | Checking checkpoint with [58, 58] against 62... 13.51.759.507 W slot update_slots: id 2 | task 38650 | restored context checkpoint (pos_min = 58, pos_max = 58, n_tokens = 59, n_past = 59, size = 50.251 MiB) 13.54.983.752 I slot print_timing: id 2 | task 38650 | n_decoded = 144, tg = 47.76 t/s, tg_3s = 47.76 t/s 13.57.993.707 I slot print_timing: id 2 | task 38650 | n_decoded = 287, tg = 47.63 t/s, tg_3s = 47.51 t/s 14.01.003.823 I slot print_timing: id 2 | task 38650 | n_decoded = 430, tg = 47.59 t/s, tg_3s = 47.51 t/s 14.04.018.854 I slot print_timing: id 2 | task 38650 | n_decoded = 573, tg = 47.55 t/s, tg_3s = 47.43 t/s 14.07.031.541 I slot print_timing: id 2 | task 38650 | n_decoded = 716, tg = 47.53 t/s, tg_3s = 47.47 t/s 14.10.034.555 I slot print_timing: id 2 | task 38650 | n_decoded = 859, tg = 47.55 t/s, tg_3s = 47.62 t/s 14.13.044.560 I slot print_timing: id 2 | task 38650 | n_decoded = 1002, tg = 47.54 t/s, tg_3s = 47.51 t/s 14.16.047.646 I slot print_timing: id 2 | task 38650 | n_decoded = 1145, tg = 47.55 t/s, tg_3s = 47.62 t/s 14.19.056.607 I slot print_timing: id 2 | task 38650 | n_decoded = 1288, tg = 47.55 t/s, tg_3s = 47.52 t/s 14.22.064.697 I slot print_timing: id 2 | task 38650 | n_decoded = 1431, tg = 47.55 t/s, tg_3s = 47.54 t/s 14.25.072.686 I slot print_timing: id 2 | task 38650 | n_decoded = 1574, tg = 47.55 t/s, tg_3s = 47.54 t/s 14.28.082.801 I slot print_timing: id 2 | task 38650 | n_decoded = 1717, tg = 47.54 t/s, tg_3s = 47.51 t/s 14.31.094.912 I slot print_timing: id 2 | task 38650 | n_decoded = 1860, tg = 47.54 t/s, tg_3s = 47.48 t/s 14.34.105.930 I slot print_timing: id 2 | task 38650 | n_decoded = 2003, tg = 47.54 t/s, tg_3s = 47.49 t/s 14.37.115.930 I slot print_timing: id 2 | task 38650 | n_decoded = 2146, tg = 47.53 t/s, tg_3s = 47.51 t/s 14.40.127.993 I slot print_timing: id 2 | task 38650 | n_decoded = 2289, tg = 47.53 t/s, tg_3s = 47.48 t/s 14.43.129.810 I slot print_timing: id 2 | task 38650 | n_decoded = 2431, tg = 47.52 t/s, tg_3s = 47.30 t/s 14.46.144.003 I slot print_timing: id 2 | task 38650 | n_decoded = 2573, tg = 47.49 t/s, tg_3s = 47.11 t/s 14.49.153.956 I slot print_timing: id 2 | task 38650 | n_decoded = 2714, tg = 47.46 t/s, tg_3s = 46.84 t/s 14.52.160.919 I slot print_timing: id 2 | task 38650 | n_decoded = 2855, tg = 47.43 t/s, tg_3s = 46.89 t/s 14.55.168.047 I slot print_timing: id 2 | task 38650 | n_decoded = 2996, tg = 47.41 t/s, tg_3s = 46.89 t/s 14.58.179.220 I slot print_timing: id 2 | task 38650 | n_decoded = 3138, tg = 47.39 t/s, tg_3s = 47.16 t/s 15.01.199.150 I slot print_timing: id 2 | task 38650 | n_decoded = 3281, tg = 47.39 t/s, tg_3s = 47.35 t/s 15.04.201.075 I slot print_timing: id 2 | task 38650 | n_decoded = 3423, tg = 47.39 t/s, tg_3s = 47.30 t/s 15.07.203.166 I slot print_timing: id 2 | task 38650 | n_decoded = 3564, tg = 47.37 t/s, tg_3s = 46.97 t/s 15.10.203.249 I slot print_timing: id 2 | task 38650 | n_decoded = 3705, tg = 47.36 t/s, tg_3s = 47.00 t/s 15.13.222.738 I slot print_timing: id 2 | task 38650 | n_decoded = 3846, tg = 47.33 t/s, tg_3s = 46.70 t/s 15.16.240.349 I slot print_timing: id 2 | task 38650 | n_decoded = 3987, tg = 47.31 t/s, tg_3s = 46.73 t/s 15.19.258.196 I slot print_timing: id 2 | task 38650 | n_decoded = 4128, tg = 47.29 t/s, tg_3s = 46.72 t/s 15.22.264.273 I slot print_timing: id 2 | task 38650 | n_decoded = 4268, tg = 47.27 t/s, tg_3s = 46.57 t/s 15.25.270.296 I slot print_timing: id 2 | task 38650 | n_decoded = 4408, tg = 47.24 t/s, tg_3s = 46.57 t/s 15.28.286.571 I slot print_timing: id 2 | task 38650 | n_decoded = 4548, tg = 47.22 t/s, tg_3s = 46.41 t/s 15.31.287.356 I slot print_timing: id 2 | task 38650 | n_decoded = 4687, tg = 47.19 t/s, tg_3s = 46.32 t/s 15.34.303.952 I slot print_timing: id 2 | task 38650 | n_decoded = 4827, tg = 47.17 t/s, tg_3s = 46.41 t/s 15.37.317.997 I slot print_timing: id 2 | task 38650 | n_decoded = 4967, tg = 47.15 t/s, tg_3s = 46.45 t/s 15.40.331.442 I slot print_timing: id 2 | task 38650 | n_decoded = 5107, tg = 47.13 t/s, tg_3s = 46.46 t/s 15.43.338.198 I slot print_timing: id 2 | task 38650 | n_decoded = 5247, tg = 47.11 t/s, tg_3s = 46.56 t/s 15.46.345.839 I slot print_timing: id 2 | task 38650 | n_decoded = 5389, tg = 47.12 t/s, tg_3s = 47.21 t/s 15.49.358.928 I slot print_timing: id 2 | task 38650 | n_decoded = 5532, tg = 47.12 t/s, tg_3s = 47.46 t/s 15.52.361.951 I slot print_timing: id 2 | task 38650 | n_decoded = 5674, tg = 47.13 t/s, tg_3s = 47.29 t/s 15.55.380.948 I slot print_timing: id 2 | task 38650 | n_decoded = 5817, tg = 47.13 t/s, tg_3s = 47.37 t/s 15.58.385.950 I slot print_timing: id 2 | task 38650 | n_decoded = 5959, tg = 47.14 t/s, tg_3s = 47.25 t/s 16.01.402.106 I slot print_timing: id 2 | task 38650 | n_decoded = 6101, tg = 47.14 t/s, tg_3s = 47.08 t/s 16.02.316.378 I slot print_timing: id 2 | task 38650 | prompt eval time = 222.01 ms / 72 tokens ( 3.08 ms per token, 324.31 tokens per second) 16.02.316.382 I slot print_timing: id 2 | task 38650 | eval time = 130347.78 ms / 6144 tokens ( 21.22 ms per token, 47.14 tokens per second) 16.02.316.382 I slot print_timing: id 2 | task 38650 | total time = 130569.79 ms / 6216 tokens 16.02.316.383 I slot print_timing: id 2 | task 38650 | graphs reused = 44573 16.02.316.417 I slot release: id 2 | task 38650 | stop processing: n_tokens = 6274, truncated = 0 16.02.316.451 I srv update_slots: all slots are idle 16.02.333.286 I srv operator(): Chat format: peg-native 16.02.333.580 I slot get_availabl: id 2 | task -1 | selected slot by LCP similarity, sim_best = 0.614 (> 0.100 thold), f_keep = 0.010 16.02.333.582 I srv get_availabl: updating prompt cache 16.02.333.796 W srv prompt_save: - saving prompt with length 6274, total state size = 246.433 MiB (draft: 0.000 MiB) 16.02.521.975 I srv load: - looking for better prompt, base f_keep = 0.010, sim = 0.614 16.02.521.985 I srv update: - cache state: 12 prompts, 2639.453 MiB (limits: 8192.000 MiB, 24576 tokens, 142278 est) 16.02.521.986 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 16.02.521.987 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 16.02.521.987 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 16.02.521.988 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 16.02.521.988 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 16.02.521.989 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 16.02.521.989 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 16.02.521.990 I srv update: - prompt 0x5ac285e9bf00: 6213 tokens, checkpoints: 1, 294.776 MiB 16.02.521.990 I srv update: - prompt 0x5ac285ef5ea0: 4300 tokens, checkpoints: 1, 234.958 MiB 16.02.521.991 I srv update: - prompt 0x5ac28cda8320: 2120 tokens, checkpoints: 1, 166.792 MiB 16.02.521.991 I srv update: - prompt 0x5ac285ec48a0: 3089 tokens, checkpoints: 1, 197.092 MiB 16.02.521.992 I srv update: - prompt 0x5ac28cdec6e0: 6274 tokens, checkpoints: 1, 296.684 MiB 16.02.521.993 I srv get_availabl: prompt cache update took 188.41 ms 16.02.522.070 I slot launch_slot_: id 2 | task 44796 | processing task, is_child = 0 16.02.522.071 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 16.02.522.072 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 16.02.522.094 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 16.02.522.095 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 16.02.522.111 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache 16.02.522.111 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens 16.02.522.135 I slot update_slots: id 2 | task 44796 | Checking checkpoint with [58, 58] against 62... 16.02.534.984 W slot update_slots: id 2 | task 44796 | restored context checkpoint (pos_min = 58, pos_max = 58, n_tokens = 59, n_past = 59, size = 50.251 MiB) 16.05.688.630 I slot print_timing: id 2 | task 44796 | n_decoded = 144, tg = 47.83 t/s, tg_3s = 47.83 t/s 16.08.697.706 I slot print_timing: id 2 | task 44796 | n_decoded = 287, tg = 47.68 t/s, tg_3s = 47.52 t/s 16.11.706.787 I slot print_timing: id 2 | task 44796 | n_decoded = 430, tg = 47.63 t/s, tg_3s = 47.52 t/s 16.14.712.759 I slot print_timing: id 2 | task 44796 | n_decoded = 573, tg = 47.61 t/s, tg_3s = 47.57 t/s 16.17.724.928 I slot print_timing: id 2 | task 44796 | n_decoded = 716, tg = 47.58 t/s, tg_3s = 47.47 t/s 16.20.736.888 I slot print_timing: id 2 | task 44796 | n_decoded = 859, tg = 47.57 t/s, tg_3s = 47.48 t/s 16.23.739.888 I slot print_timing: id 2 | task 44796 | n_decoded = 1001, tg = 47.53 t/s, tg_3s = 47.29 t/s 16.26.747.938 I slot print_timing: id 2 | task 44796 | n_decoded = 1143, tg = 47.49 t/s, tg_3s = 47.21 t/s 16.29.757.592 I slot print_timing: id 2 | task 44796 | n_decoded = 1285, tg = 47.45 t/s, tg_3s = 47.18 t/s 16.32.764.501 I slot print_timing: id 2 | task 44796 | n_decoded = 1427, tg = 47.43 t/s, tg_3s = 47.22 t/s 16.35.774.965 I slot print_timing: id 2 | task 44796 | n_decoded = 1569, tg = 47.41 t/s, tg_3s = 47.17 t/s 16.38.785.012 I slot print_timing: id 2 | task 44796 | n_decoded = 1711, tg = 47.39 t/s, tg_3s = 47.18 t/s 16.41.800.044 I slot print_timing: id 2 | task 44796 | n_decoded = 1854, tg = 47.39 t/s, tg_3s = 47.43 t/s 16.44.815.004 I slot print_timing: id 2 | task 44796 | n_decoded = 1997, tg = 47.39 t/s, tg_3s = 47.43 t/s 16.47.818.603 I slot print_timing: id 2 | task 44796 | n_decoded = 2140, tg = 47.41 t/s, tg_3s = 47.61 t/s 16.50.829.253 I slot print_timing: id 2 | task 44796 | n_decoded = 2282, tg = 47.39 t/s, tg_3s = 47.17 t/s 16.53.845.105 I slot print_timing: id 2 | task 44796 | n_decoded = 2425, tg = 47.39 t/s, tg_3s = 47.42 t/s 16.56.855.146 I slot print_timing: id 2 | task 44796 | n_decoded = 2567, tg = 47.38 t/s, tg_3s = 47.18 t/s 16.59.865.147 I slot print_timing: id 2 | task 44796 | n_decoded = 2709, tg = 47.37 t/s, tg_3s = 47.18 t/s 17.02.875.214 I slot print_timing: id 2 | task 44796 | n_decoded = 2850, tg = 47.34 t/s, tg_3s = 46.84 t/s 17.05.731.785 I slot print_timing: id 2 | task 44796 | prompt eval time = 155.94 ms / 42 tokens ( 3.71 ms per token, 269.34 tokens per second) 17.05.731.788 I slot print_timing: id 2 | task 44796 | eval time = 63053.71 ms / 2984 tokens ( 21.13 ms per token, 47.32 tokens per second) 17.05.731.789 I slot print_timing: id 2 | task 44796 | total time = 63209.65 ms / 3026 tokens 17.05.731.789 I slot print_timing: id 2 | task 44796 | graphs reused = 47543 17.05.731.845 I slot release: id 2 | task 44796 | stop processing: n_tokens = 3084, truncated = 0 17.05.731.862 I srv update_slots: all slots are idle 17.05.748.252 I srv operator(): Chat format: peg-native 17.05.748.550 I slot get_availabl: id 2 | task -1 | selected slot by LCP similarity, sim_best = 0.525 (> 0.100 thold), f_keep = 0.020 17.05.748.553 I srv get_availabl: updating prompt cache 17.05.748.691 W srv prompt_save: - saving prompt with length 3084, total state size = 146.685 MiB (draft: 0.000 MiB) 17.05.876.629 I srv load: - looking for better prompt, base f_keep = 0.020, sim = 0.525 17.05.876.638 I srv update: - cache state: 13 prompts, 2836.388 MiB (limits: 8192.000 MiB, 24576 tokens, 141307 est) 17.05.876.639 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 17.05.876.641 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 17.05.876.645 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 17.05.876.646 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 17.05.876.646 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 17.05.876.647 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 17.05.876.647 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 17.05.876.648 I srv update: - prompt 0x5ac285e9bf00: 6213 tokens, checkpoints: 1, 294.776 MiB 17.05.876.648 I srv update: - prompt 0x5ac285ef5ea0: 4300 tokens, checkpoints: 1, 234.958 MiB 17.05.876.649 I srv update: - prompt 0x5ac28cda8320: 2120 tokens, checkpoints: 1, 166.792 MiB 17.05.876.649 I srv update: - prompt 0x5ac285ec48a0: 3089 tokens, checkpoints: 1, 197.092 MiB 17.05.876.650 I srv update: - prompt 0x5ac28cdec6e0: 6274 tokens, checkpoints: 1, 296.684 MiB 17.05.876.652 I srv update: - prompt 0x5ac28cdf1710: 3084 tokens, checkpoints: 1, 196.935 MiB 17.05.876.654 I srv get_availabl: prompt cache update took 128.10 ms 17.05.876.727 I slot launch_slot_: id 2 | task 47782 | processing task, is_child = 0 17.05.876.728 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 17.05.876.728 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 17.05.876.747 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 17.05.876.747 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 17.05.876.761 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache 17.05.876.761 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens 17.05.876.784 I slot update_slots: id 2 | task 47782 | Checking checkpoint with [58, 58] against 62... 17.05.889.717 W slot update_slots: id 2 | task 47782 | restored context checkpoint (pos_min = 58, pos_max = 58, n_tokens = 59, n_past = 59, size = 50.251 MiB) 17.09.053.228 I slot print_timing: id 2 | task 47782 | n_decoded = 144, tg = 47.74 t/s, tg_3s = 47.74 t/s 17.12.057.169 I slot print_timing: id 2 | task 47782 | n_decoded = 287, tg = 47.67 t/s, tg_3s = 47.60 t/s 17.15.067.775 I slot print_timing: id 2 | task 47782 | n_decoded = 430, tg = 47.61 t/s, tg_3s = 47.50 t/s 17.18.076.134 I slot print_timing: id 2 | task 47782 | n_decoded = 573, tg = 47.59 t/s, tg_3s = 47.53 t/s 17.21.084.860 I slot print_timing: id 2 | task 47782 | n_decoded = 715, tg = 47.51 t/s, tg_3s = 47.20 t/s 17.24.098.851 I slot print_timing: id 2 | task 47782 | n_decoded = 857, tg = 47.45 t/s, tg_3s = 47.11 t/s 17.27.115.705 I slot print_timing: id 2 | task 47782 | n_decoded = 1000, tg = 47.44 t/s, tg_3s = 47.40 t/s 17.30.118.654 I slot print_timing: id 2 | task 47782 | n_decoded = 1143, tg = 47.46 t/s, tg_3s = 47.62 t/s 17.33.127.706 I slot print_timing: id 2 | task 47782 | n_decoded = 1286, tg = 47.47 t/s, tg_3s = 47.52 t/s 17.36.138.721 I slot print_timing: id 2 | task 47782 | n_decoded = 1429, tg = 47.47 t/s, tg_3s = 47.49 t/s 17.39.141.728 I slot print_timing: id 2 | task 47782 | n_decoded = 1572, tg = 47.49 t/s, tg_3s = 47.62 t/s 17.42.152.618 I slot print_timing: id 2 | task 47782 | n_decoded = 1715, tg = 47.49 t/s, tg_3s = 47.49 t/s 17.45.166.207 I slot print_timing: id 2 | task 47782 | n_decoded = 1858, tg = 47.48 t/s, tg_3s = 47.45 t/s 17.48.187.312 I slot print_timing: id 2 | task 47782 | n_decoded = 2001, tg = 47.47 t/s, tg_3s = 47.33 t/s 17.51.198.645 I slot print_timing: id 2 | task 47782 | n_decoded = 2143, tg = 47.45 t/s, tg_3s = 47.16 t/s 17.54.202.764 I slot print_timing: id 2 | task 47782 | n_decoded = 2284, tg = 47.42 t/s, tg_3s = 46.94 t/s 17.57.217.392 I slot print_timing: id 2 | task 47782 | n_decoded = 2426, tg = 47.40 t/s, tg_3s = 47.10 t/s 18.00.221.551 I slot print_timing: id 2 | task 47782 | n_decoded = 2567, tg = 47.37 t/s, tg_3s = 46.93 t/s 18.03.227.486 I slot print_timing: id 2 | task 47782 | n_decoded = 2708, tg = 47.35 t/s, tg_3s = 46.91 t/s 18.06.233.477 I slot print_timing: id 2 | task 47782 | n_decoded = 2849, tg = 47.33 t/s, tg_3s = 46.91 t/s 18.08.556.904 I slot print_timing: id 2 | task 47782 | prompt eval time = 160.04 ms / 59 tokens ( 2.71 ms per token, 368.65 tokens per second) 18.08.556.909 I slot print_timing: id 2 | task 47782 | eval time = 62520.07 ms / 2958 tokens ( 21.14 ms per token, 47.31 tokens per second) 18.08.556.909 I slot print_timing: id 2 | task 47782 | total time = 62680.11 ms / 3017 tokens 18.08.556.910 I slot print_timing: id 2 | task 47782 | graphs reused = 50487 18.08.556.943 I slot release: id 2 | task 47782 | stop processing: n_tokens = 3075, truncated = 0 18.08.556.961 I srv update_slots: all slots are idle 18.08.572.994 I srv operator(): Chat format: peg-native 18.08.573.263 I slot get_availabl: id 1 | task -1 | selected slot by LRU, t_last = -1 18.08.573.266 I srv get_availabl: updating prompt cache 18.08.573.268 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000 18.08.573.272 I srv update: - cache state: 13 prompts, 2836.388 MiB (limits: 8192.000 MiB, 24576 tokens, 141307 est) 18.08.573.273 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 18.08.573.274 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 18.08.573.274 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 18.08.573.275 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 18.08.573.275 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 18.08.573.276 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 18.08.573.277 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 18.08.573.277 I srv update: - prompt 0x5ac285e9bf00: 6213 tokens, checkpoints: 1, 294.776 MiB 18.08.573.278 I srv update: - prompt 0x5ac285ef5ea0: 4300 tokens, checkpoints: 1, 234.958 MiB 18.08.573.278 I srv update: - prompt 0x5ac28cda8320: 2120 tokens, checkpoints: 1, 166.792 MiB 18.08.573.279 I srv update: - prompt 0x5ac285ec48a0: 3089 tokens, checkpoints: 1, 197.092 MiB 18.08.573.279 I srv update: - prompt 0x5ac28cdec6e0: 6274 tokens, checkpoints: 1, 296.684 MiB 18.08.573.280 I srv update: - prompt 0x5ac28cdf1710: 3084 tokens, checkpoints: 1, 196.935 MiB 18.08.573.281 I srv get_availabl: prompt cache update took 0.01 ms 18.08.573.331 I slot launch_slot_: id 1 | task 50742 | processing task, is_child = 0 18.08.573.331 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 18.08.573.332 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 18.08.573.351 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 18.08.573.478 W srv prompt_save: - saving prompt with length 3075, total state size = 146.403 MiB (draft: 0.000 MiB) 18.08.698.671 I srv update: - cache state: 14 prompts, 3033.042 MiB (limits: 8192.000 MiB, 24576 tokens, 140450 est) 18.08.698.675 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 18.08.698.676 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 18.08.698.676 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 18.08.698.677 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 18.08.698.677 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 18.08.698.678 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 18.08.698.678 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 18.08.698.679 I srv update: - prompt 0x5ac285e9bf00: 6213 tokens, checkpoints: 1, 294.776 MiB 18.08.698.679 I srv update: - prompt 0x5ac285ef5ea0: 4300 tokens, checkpoints: 1, 234.958 MiB 18.08.698.680 I srv update: - prompt 0x5ac28cda8320: 2120 tokens, checkpoints: 1, 166.792 MiB 18.08.698.680 I srv update: - prompt 0x5ac285ec48a0: 3089 tokens, checkpoints: 1, 197.092 MiB 18.08.698.681 I srv update: - prompt 0x5ac28cdec6e0: 6274 tokens, checkpoints: 1, 296.684 MiB 18.08.698.681 I srv update: - prompt 0x5ac28cdf1710: 3084 tokens, checkpoints: 1, 196.935 MiB 18.08.698.682 I srv update: - prompt 0x5ac28602cc00: 3075 tokens, checkpoints: 1, 196.654 MiB 18.08.698.683 I slot prompt_clear: id 2 | task -1 | clearing prompt with 3075 tokens 18.08.699.130 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache 18.08.699.132 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens 18.08.839.631 I slot create_check: id 1 | task 50742 | created context checkpoint 1 of 32 (pos_min = 53, pos_max = 53, n_tokens = 54, size = 50.251 MiB) 18.12.051.343 I slot print_timing: id 1 | task 50742 | n_decoded = 143, tg = 47.61 t/s, tg_3s = 47.61 t/s 18.15.056.782 I slot print_timing: id 1 | task 50742 | n_decoded = 286, tg = 47.59 t/s, tg_3s = 47.58 t/s 18.18.067.862 I slot print_timing: id 1 | task 50742 | n_decoded = 429, tg = 47.56 t/s, tg_3s = 47.49 t/s 18.21.070.834 I slot print_timing: id 1 | task 50742 | n_decoded = 572, tg = 47.57 t/s, tg_3s = 47.62 t/s 18.24.081.930 I slot print_timing: id 1 | task 50742 | n_decoded = 715, tg = 47.56 t/s, tg_3s = 47.49 t/s 18.27.085.018 I slot print_timing: id 1 | task 50742 | n_decoded = 858, tg = 47.57 t/s, tg_3s = 47.62 t/s 18.28.582.032 I slot print_timing: id 1 | task 50742 | prompt eval time = 348.36 ms / 128 tokens ( 2.72 ms per token, 367.44 tokens per second) 18.28.582.035 I slot print_timing: id 1 | task 50742 | eval time = 19534.36 ms / 929 tokens ( 21.03 ms per token, 47.56 tokens per second) 18.28.582.036 I slot print_timing: id 1 | task 50742 | total time = 19882.72 ms / 1057 tokens 18.28.582.037 I slot print_timing: id 1 | task 50742 | graphs reused = 51410 18.28.582.069 I slot release: id 1 | task 50742 | stop processing: n_tokens = 1056, truncated = 0 18.28.582.075 I srv update_slots: all slots are idle 18.28.658.090 I srv operator(): Chat format: peg-native 18.28.658.370 I slot get_availabl: id 1 | task -1 | selected slot by LCP similarity, sim_best = 0.681 (> 0.100 thold), f_keep = 0.059 18.28.658.372 I srv get_availabl: updating prompt cache 18.28.658.446 W srv prompt_save: - saving prompt with length 1056, total state size = 83.271 MiB (draft: 0.000 MiB) 18.28.741.570 I srv load: - looking for better prompt, base f_keep = 0.059, sim = 0.681 18.28.741.579 I srv update: - cache state: 15 prompts, 3166.563 MiB (limits: 8192.000 MiB, 24576 tokens, 137260 est) 18.28.741.580 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 18.28.741.581 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 18.28.741.581 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 18.28.741.582 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 18.28.741.582 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 18.28.741.583 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 18.28.741.583 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 18.28.741.584 I srv update: - prompt 0x5ac285e9bf00: 6213 tokens, checkpoints: 1, 294.776 MiB 18.28.741.584 I srv update: - prompt 0x5ac285ef5ea0: 4300 tokens, checkpoints: 1, 234.958 MiB 18.28.741.585 I srv update: - prompt 0x5ac28cda8320: 2120 tokens, checkpoints: 1, 166.792 MiB 18.28.741.585 I srv update: - prompt 0x5ac285ec48a0: 3089 tokens, checkpoints: 1, 197.092 MiB 18.28.741.586 I srv update: - prompt 0x5ac28cdec6e0: 6274 tokens, checkpoints: 1, 296.684 MiB 18.28.741.586 I srv update: - prompt 0x5ac28cdf1710: 3084 tokens, checkpoints: 1, 196.935 MiB 18.28.741.587 I srv update: - prompt 0x5ac28602cc00: 3075 tokens, checkpoints: 1, 196.654 MiB 18.28.741.587 I srv update: - prompt 0x5ac285ad1b70: 1056 tokens, checkpoints: 1, 133.521 MiB 18.28.741.589 I srv get_availabl: prompt cache update took 83.22 ms 18.28.741.656 I slot launch_slot_: id 1 | task 51674 | processing task, is_child = 0 18.28.741.657 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 18.28.741.658 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 18.28.741.673 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 18.28.741.673 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 18.28.741.686 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache 18.28.741.686 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens 18.28.741.706 I slot update_slots: id 1 | task 51674 | Checking checkpoint with [53, 53] against 62... 18.28.754.506 W slot update_slots: id 1 | task 51674 | restored context checkpoint (pos_min = 53, pos_max = 53, n_tokens = 54, n_past = 54, size = 50.251 MiB) 18.31.902.899 I slot print_timing: id 1 | task 51674 | n_decoded = 144, tg = 47.87 t/s, tg_3s = 47.87 t/s 18.32.475.018 I slot print_timing: id 1 | task 51674 | prompt eval time = 153.13 ms / 37 tokens ( 4.14 ms per token, 241.62 tokens per second) 18.32.475.021 I slot print_timing: id 1 | task 51674 | eval time = 3580.17 ms / 171 tokens ( 20.94 ms per token, 47.76 tokens per second) 18.32.475.022 I slot print_timing: id 1 | task 51674 | total time = 3733.31 ms / 208 tokens 18.32.475.023 I slot print_timing: id 1 | task 51674 | graphs reused = 51578 18.32.475.054 I slot release: id 1 | task 51674 | stop processing: n_tokens = 261, truncated = 0 18.32.475.062 I srv update_slots: all slots are idle 18.32.534.962 I srv operator(): Chat format: peg-native 18.32.535.235 I slot get_availabl: id 1 | task -1 | selected slot by LCP similarity, sim_best = 0.633 (> 0.100 thold), f_keep = 0.238 18.32.535.237 I srv get_availabl: updating prompt cache 18.32.535.266 W srv prompt_save: - saving prompt with length 261, total state size = 58.412 MiB (draft: 0.000 MiB) 18.32.601.289 I srv load: - looking for better prompt, base f_keep = 0.238, sim = 0.633 18.32.601.298 I srv update: - cache state: 16 prompts, 3275.226 MiB (limits: 8192.000 MiB, 24576 tokens, 133359 est) 18.32.601.299 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 18.32.601.300 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 18.32.601.301 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 18.32.601.301 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 18.32.601.302 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 18.32.601.302 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 18.32.601.303 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 18.32.601.303 I srv update: - prompt 0x5ac285e9bf00: 6213 tokens, checkpoints: 1, 294.776 MiB 18.32.601.304 I srv update: - prompt 0x5ac285ef5ea0: 4300 tokens, checkpoints: 1, 234.958 MiB 18.32.601.304 I srv update: - prompt 0x5ac28cda8320: 2120 tokens, checkpoints: 1, 166.792 MiB 18.32.601.305 I srv update: - prompt 0x5ac285ec48a0: 3089 tokens, checkpoints: 1, 197.092 MiB 18.32.601.305 I srv update: - prompt 0x5ac28cdec6e0: 6274 tokens, checkpoints: 1, 296.684 MiB 18.32.601.306 I srv update: - prompt 0x5ac28cdf1710: 3084 tokens, checkpoints: 1, 196.935 MiB 18.32.601.306 I srv update: - prompt 0x5ac28602cc00: 3075 tokens, checkpoints: 1, 196.654 MiB 18.32.601.307 I srv update: - prompt 0x5ac285ad1b70: 1056 tokens, checkpoints: 1, 133.521 MiB 18.32.601.307 I srv update: - prompt 0x5ac285eacc40: 261 tokens, checkpoints: 1, 108.663 MiB 18.32.601.309 I srv get_availabl: prompt cache update took 66.07 ms 18.32.601.383 I slot launch_slot_: id 1 | task 51847 | processing task, is_child = 0 18.32.601.385 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 18.32.601.385 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 18.32.601.403 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 18.32.601.404 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 18.32.601.417 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache 18.32.601.417 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens 18.32.601.447 I slot update_slots: id 1 | task 51847 | Checking checkpoint with [53, 53] against 62... 18.32.614.399 W slot update_slots: id 1 | task 51847 | restored context checkpoint (pos_min = 53, pos_max = 53, n_tokens = 54, n_past = 54, size = 50.251 MiB) 18.35.766.932 I slot print_timing: id 1 | task 51847 | n_decoded = 144, tg = 47.83 t/s, tg_3s = 47.83 t/s 18.38.608.016 I slot print_timing: id 1 | task 51847 | prompt eval time = 154.95 ms / 44 tokens ( 3.52 ms per token, 283.97 tokens per second) 18.38.608.020 I slot print_timing: id 1 | task 51847 | eval time = 5851.62 ms / 279 tokens ( 20.97 ms per token, 47.68 tokens per second) 18.38.608.020 I slot print_timing: id 1 | task 51847 | total time = 6006.57 ms / 323 tokens 18.38.608.021 I slot print_timing: id 1 | task 51847 | graphs reused = 51854 18.38.608.052 I slot release: id 1 | task 51847 | stop processing: n_tokens = 376, truncated = 0 18.38.608.060 I srv update_slots: all slots are idle 18.38.682.637 I srv operator(): Chat format: peg-native 18.38.682.919 I slot get_availabl: id 1 | task -1 | selected slot by LCP similarity, sim_best = 0.481 (> 0.100 thold), f_keep = 0.165 18.38.682.921 I srv get_availabl: updating prompt cache 18.38.682.969 W srv prompt_save: - saving prompt with length 376, total state size = 62.008 MiB (draft: 0.000 MiB) 18.38.751.877 I srv load: - looking for better prompt, base f_keep = 0.165, sim = 0.481 18.38.751.889 I srv update: - cache state: 17 prompts, 3387.485 MiB (limits: 8192.000 MiB, 24576 tokens, 129848 est) 18.38.751.890 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 18.38.751.891 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 18.38.751.892 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 18.38.751.892 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 18.38.751.893 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 18.38.751.893 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 18.38.751.894 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 18.38.751.894 I srv update: - prompt 0x5ac285e9bf00: 6213 tokens, checkpoints: 1, 294.776 MiB 18.38.751.895 I srv update: - prompt 0x5ac285ef5ea0: 4300 tokens, checkpoints: 1, 234.958 MiB 18.38.751.895 I srv update: - prompt 0x5ac28cda8320: 2120 tokens, checkpoints: 1, 166.792 MiB 18.38.751.896 I srv update: - prompt 0x5ac285ec48a0: 3089 tokens, checkpoints: 1, 197.092 MiB 18.38.751.896 I srv update: - prompt 0x5ac28cdec6e0: 6274 tokens, checkpoints: 1, 296.684 MiB 18.38.751.897 I srv update: - prompt 0x5ac28cdf1710: 3084 tokens, checkpoints: 1, 196.935 MiB 18.38.751.897 I srv update: - prompt 0x5ac28602cc00: 3075 tokens, checkpoints: 1, 196.654 MiB 18.38.751.898 I srv update: - prompt 0x5ac285ad1b70: 1056 tokens, checkpoints: 1, 133.521 MiB 18.38.751.898 I srv update: - prompt 0x5ac285eacc40: 261 tokens, checkpoints: 1, 108.663 MiB 18.38.751.899 I srv update: - prompt 0x5ac28cdd3900: 376 tokens, checkpoints: 1, 112.259 MiB 18.38.751.900 I srv get_availabl: prompt cache update took 68.98 ms 18.38.751.981 I slot launch_slot_: id 1 | task 52128 | processing task, is_child = 0 18.38.751.982 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 18.38.751.983 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 18.38.752.002 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 18.38.752.002 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 18.38.752.015 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache 18.38.752.015 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens 18.38.752.037 I slot update_slots: id 1 | task 52128 | Checking checkpoint with [53, 53] against 62... 18.38.764.935 W slot update_slots: id 1 | task 52128 | restored context checkpoint (pos_min = 53, pos_max = 53, n_tokens = 54, n_past = 54, size = 50.251 MiB) 18.41.992.925 I slot print_timing: id 1 | task 52128 | n_decoded = 144, tg = 47.71 t/s, tg_3s = 47.71 t/s 18.45.000.930 I slot print_timing: id 1 | task 52128 | n_decoded = 287, tg = 47.62 t/s, tg_3s = 47.54 t/s 18.48.014.256 I slot print_timing: id 1 | task 52128 | n_decoded = 430, tg = 47.57 t/s, tg_3s = 47.46 t/s 18.51.017.216 I slot print_timing: id 1 | task 52128 | n_decoded = 573, tg = 47.58 t/s, tg_3s = 47.62 t/s 18.54.026.262 I slot print_timing: id 1 | task 52128 | n_decoded = 716, tg = 47.57 t/s, tg_3s = 47.52 t/s 18.56.990.062 I slot print_timing: id 1 | task 52128 | prompt eval time = 222.43 ms / 75 tokens ( 2.97 ms per token, 337.19 tokens per second) 18.56.990.066 I slot print_timing: id 1 | task 52128 | eval time = 18015.59 ms / 857 tokens ( 21.02 ms per token, 47.57 tokens per second) 18.56.990.067 I slot print_timing: id 1 | task 52128 | total time = 18238.02 ms / 932 tokens 18.56.990.067 I slot print_timing: id 1 | task 52128 | graphs reused = 52706 18.56.990.101 I slot release: id 1 | task 52128 | stop processing: n_tokens = 985, truncated = 0 18.56.990.111 I srv update_slots: all slots are idle 18.57.079.388 I srv operator(): Chat format: peg-native 18.57.079.692 I slot get_availabl: id 1 | task -1 | selected slot by LCP similarity, sim_best = 0.614 (> 0.100 thold), f_keep = 0.063 18.57.079.695 I srv get_availabl: updating prompt cache 18.57.079.762 W srv prompt_save: - saving prompt with length 985, total state size = 81.051 MiB (draft: 0.000 MiB) 18.57.165.880 I srv load: - looking for better prompt, base f_keep = 0.063, sim = 0.614 18.57.165.890 I srv update: - cache state: 18 prompts, 3518.786 MiB (limits: 8192.000 MiB, 24576 tokens, 127296 est) 18.57.165.891 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 18.57.165.896 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 18.57.165.896 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 18.57.165.897 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 18.57.165.897 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 18.57.165.898 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 18.57.165.898 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 18.57.165.899 I srv update: - prompt 0x5ac285e9bf00: 6213 tokens, checkpoints: 1, 294.776 MiB 18.57.165.899 I srv update: - prompt 0x5ac285ef5ea0: 4300 tokens, checkpoints: 1, 234.958 MiB 18.57.165.900 I srv update: - prompt 0x5ac28cda8320: 2120 tokens, checkpoints: 1, 166.792 MiB 18.57.165.900 I srv update: - prompt 0x5ac285ec48a0: 3089 tokens, checkpoints: 1, 197.092 MiB 18.57.165.901 I srv update: - prompt 0x5ac28cdec6e0: 6274 tokens, checkpoints: 1, 296.684 MiB 18.57.165.905 I srv update: - prompt 0x5ac28cdf1710: 3084 tokens, checkpoints: 1, 196.935 MiB 18.57.165.905 I srv update: - prompt 0x5ac28602cc00: 3075 tokens, checkpoints: 1, 196.654 MiB 18.57.165.906 I srv update: - prompt 0x5ac285ad1b70: 1056 tokens, checkpoints: 1, 133.521 MiB 18.57.165.906 I srv update: - prompt 0x5ac285eacc40: 261 tokens, checkpoints: 1, 108.663 MiB 18.57.165.907 I srv update: - prompt 0x5ac28cdd3900: 376 tokens, checkpoints: 1, 112.259 MiB 18.57.165.907 I srv update: - prompt 0x5ac286141c50: 985 tokens, checkpoints: 1, 131.301 MiB 18.57.165.909 I srv get_availabl: prompt cache update took 86.21 ms 18.57.165.980 I slot launch_slot_: id 1 | task 52987 | processing task, is_child = 0 18.57.165.981 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 18.57.165.981 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 18.57.165.996 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 18.57.165.997 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 18.57.166.010 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache 18.57.166.010 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens 18.57.166.031 I slot update_slots: id 1 | task 52987 | Checking checkpoint with [53, 53] against 62... 18.57.178.814 W slot update_slots: id 1 | task 52987 | restored context checkpoint (pos_min = 53, pos_max = 53, n_tokens = 54, n_past = 54, size = 50.251 MiB) 19.00.320.846 I slot print_timing: id 1 | task 52987 | n_decoded = 144, tg = 47.79 t/s, tg_3s = 47.79 t/s 19.03.334.938 I slot print_timing: id 1 | task 52987 | n_decoded = 286, tg = 47.45 t/s, tg_3s = 47.11 t/s 19.05.840.485 I slot print_timing: id 1 | task 52987 | prompt eval time = 141.54 ms / 47 tokens ( 3.01 ms per token, 332.05 tokens per second) 19.05.840.490 I slot print_timing: id 1 | task 52987 | eval time = 8532.91 ms / 405 tokens ( 21.07 ms per token, 47.46 tokens per second) 19.05.840.490 I slot print_timing: id 1 | task 52987 | total time = 8674.45 ms / 452 tokens 19.05.840.491 I slot print_timing: id 1 | task 52987 | graphs reused = 53108 19.05.840.521 I slot release: id 1 | task 52987 | stop processing: n_tokens = 505, truncated = 0 19.05.840.530 I srv update_slots: all slots are idle 19.05.902.267 I srv operator(): Chat format: peg-native 19.05.902.559 I slot get_availabl: id 1 | task -1 | selected slot by LCP similarity, sim_best = 0.509 (> 0.100 thold), f_keep = 0.113 19.05.902.562 I srv get_availabl: updating prompt cache 19.05.902.608 W srv prompt_save: - saving prompt with length 505, total state size = 66.042 MiB (draft: 0.000 MiB) 19.05.974.429 I srv load: - looking for better prompt, base f_keep = 0.113, sim = 0.509 19.05.974.443 I srv update: - cache state: 19 prompts, 3635.078 MiB (limits: 8192.000 MiB, 24576 tokens, 124362 est) 19.05.974.444 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 19.05.974.445 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 19.05.974.446 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 19.05.974.446 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 19.05.974.447 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 19.05.974.447 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 19.05.974.448 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 19.05.974.448 I srv update: - prompt 0x5ac285e9bf00: 6213 tokens, checkpoints: 1, 294.776 MiB 19.05.974.449 I srv update: - prompt 0x5ac285ef5ea0: 4300 tokens, checkpoints: 1, 234.958 MiB 19.05.974.449 I srv update: - prompt 0x5ac28cda8320: 2120 tokens, checkpoints: 1, 166.792 MiB 19.05.974.450 I srv update: - prompt 0x5ac285ec48a0: 3089 tokens, checkpoints: 1, 197.092 MiB 19.05.974.450 I srv update: - prompt 0x5ac28cdec6e0: 6274 tokens, checkpoints: 1, 296.684 MiB 19.05.974.451 I srv update: - prompt 0x5ac28cdf1710: 3084 tokens, checkpoints: 1, 196.935 MiB 19.05.974.452 I srv update: - prompt 0x5ac28602cc00: 3075 tokens, checkpoints: 1, 196.654 MiB 19.05.974.452 I srv update: - prompt 0x5ac285ad1b70: 1056 tokens, checkpoints: 1, 133.521 MiB 19.05.974.453 I srv update: - prompt 0x5ac285eacc40: 261 tokens, checkpoints: 1, 108.663 MiB 19.05.974.455 I srv update: - prompt 0x5ac28cdd3900: 376 tokens, checkpoints: 1, 112.259 MiB 19.05.974.456 I srv update: - prompt 0x5ac286141c50: 985 tokens, checkpoints: 1, 131.301 MiB 19.05.974.456 I srv update: - prompt 0x5ac285eb26f0: 505 tokens, checkpoints: 1, 116.292 MiB 19.05.974.458 I srv get_availabl: prompt cache update took 71.89 ms 19.05.974.540 I slot launch_slot_: id 1 | task 53394 | processing task, is_child = 0 19.05.974.540 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 19.05.974.541 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 19.05.974.559 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 19.05.974.559 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 19.05.974.572 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache 19.05.974.572 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens 19.05.974.594 I slot update_slots: id 1 | task 53394 | Checking checkpoint with [53, 53] against 57... 19.05.987.533 W slot update_slots: id 1 | task 53394 | restored context checkpoint (pos_min = 53, pos_max = 53, n_tokens = 54, n_past = 54, size = 50.251 MiB) 19.09.135.924 I slot print_timing: id 1 | task 53394 | n_decoded = 144, tg = 47.96 t/s, tg_3s = 47.96 t/s 19.12.140.909 I slot print_timing: id 1 | task 53394 | n_decoded = 287, tg = 47.77 t/s, tg_3s = 47.59 t/s 19.15.149.380 I slot print_timing: id 1 | task 53394 | n_decoded = 430, tg = 47.69 t/s, tg_3s = 47.53 t/s 19.18.150.643 I slot print_timing: id 1 | task 53394 | n_decoded = 573, tg = 47.68 t/s, tg_3s = 47.65 t/s 19.18.423.630 I slot print_timing: id 1 | task 53394 | prompt eval time = 158.82 ms / 58 tokens ( 2.74 ms per token, 365.19 tokens per second) 19.18.423.634 I slot print_timing: id 1 | task 53394 | eval time = 12290.21 ms / 586 tokens ( 20.97 ms per token, 47.68 tokens per second) 19.18.423.634 I slot print_timing: id 1 | task 53394 | total time = 12449.03 ms / 644 tokens 19.18.423.635 I slot print_timing: id 1 | task 53394 | graphs reused = 53690 19.18.423.667 I slot release: id 1 | task 53394 | stop processing: n_tokens = 697, truncated = 0 19.18.423.675 I srv update_slots: all slots are idle 19.18.439.280 I srv operator(): Chat format: peg-native 19.18.439.555 I slot get_availabl: id 1 | task -1 | selected slot by LCP similarity, sim_best = 0.564 (> 0.100 thold), f_keep = 0.082 19.18.439.556 I srv get_availabl: updating prompt cache 19.18.439.599 W srv prompt_save: - saving prompt with length 697, total state size = 72.045 MiB (draft: 0.000 MiB) 19.18.516.832 I srv load: - looking for better prompt, base f_keep = 0.082, sim = 0.564 19.18.516.843 I srv update: - cache state: 20 prompts, 3757.374 MiB (limits: 8192.000 MiB, 24576 tokens, 121834 est) 19.18.516.844 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 19.18.516.845 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 19.18.516.845 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 19.18.516.846 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 19.18.516.846 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 19.18.516.847 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 19.18.516.847 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 19.18.516.848 I srv update: - prompt 0x5ac285e9bf00: 6213 tokens, checkpoints: 1, 294.776 MiB 19.18.516.848 I srv update: - prompt 0x5ac285ef5ea0: 4300 tokens, checkpoints: 1, 234.958 MiB 19.18.516.849 I srv update: - prompt 0x5ac28cda8320: 2120 tokens, checkpoints: 1, 166.792 MiB 19.18.516.849 I srv update: - prompt 0x5ac285ec48a0: 3089 tokens, checkpoints: 1, 197.092 MiB 19.18.516.850 I srv update: - prompt 0x5ac28cdec6e0: 6274 tokens, checkpoints: 1, 296.684 MiB 19.18.516.850 I srv update: - prompt 0x5ac28cdf1710: 3084 tokens, checkpoints: 1, 196.935 MiB 19.18.516.851 I srv update: - prompt 0x5ac28602cc00: 3075 tokens, checkpoints: 1, 196.654 MiB 19.18.516.851 I srv update: - prompt 0x5ac285ad1b70: 1056 tokens, checkpoints: 1, 133.521 MiB 19.18.516.852 I srv update: - prompt 0x5ac285eacc40: 261 tokens, checkpoints: 1, 108.663 MiB 19.18.516.852 I srv update: - prompt 0x5ac28cdd3900: 376 tokens, checkpoints: 1, 112.259 MiB 19.18.516.853 I srv update: - prompt 0x5ac286141c50: 985 tokens, checkpoints: 1, 131.301 MiB 19.18.516.854 I srv update: - prompt 0x5ac285eb26f0: 505 tokens, checkpoints: 1, 116.292 MiB 19.18.516.854 I srv update: - prompt 0x5ac2800d0e30: 697 tokens, checkpoints: 1, 122.296 MiB 19.18.516.855 I srv get_availabl: prompt cache update took 77.30 ms 19.18.516.927 I slot launch_slot_: id 1 | task 53982 | processing task, is_child = 0 19.18.516.928 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 19.18.516.929 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 19.18.516.943 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 19.18.516.944 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 19.18.516.956 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache 19.18.516.957 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens 19.18.516.978 I slot update_slots: id 1 | task 53982 | Checking checkpoint with [53, 53] against 57... 19.18.529.846 W slot update_slots: id 1 | task 53982 | restored context checkpoint (pos_min = 53, pos_max = 53, n_tokens = 54, n_past = 54, size = 50.251 MiB) 19.21.662.446 I slot print_timing: id 1 | task 53982 | n_decoded = 144, tg = 47.93 t/s, tg_3s = 47.93 t/s 19.24.670.462 I slot print_timing: id 1 | task 53982 | n_decoded = 287, tg = 47.74 t/s, tg_3s = 47.54 t/s 19.27.678.562 I slot print_timing: id 1 | task 53982 | n_decoded = 430, tg = 47.67 t/s, tg_3s = 47.54 t/s 19.30.681.583 I slot print_timing: id 1 | task 53982 | n_decoded = 573, tg = 47.66 t/s, tg_3s = 47.62 t/s 19.31.899.512 I slot print_timing: id 1 | task 53982 | prompt eval time = 141.33 ms / 47 tokens ( 3.01 ms per token, 332.56 tokens per second) 19.31.899.516 I slot print_timing: id 1 | task 53982 | eval time = 13241.20 ms / 631 tokens ( 20.98 ms per token, 47.65 tokens per second) 19.31.899.517 I slot print_timing: id 1 | task 53982 | total time = 13382.53 ms / 678 tokens 19.31.899.517 I slot print_timing: id 1 | task 53982 | graphs reused = 54317 19.31.899.548 I slot release: id 1 | task 53982 | stop processing: n_tokens = 731, truncated = 0 19.31.899.561 I srv update_slots: all slots are idle 19.31.977.064 I srv operator(): Chat format: peg-native 19.31.977.344 I slot get_availabl: id 1 | task -1 | selected slot by LCP similarity, sim_best = 0.620 (> 0.100 thold), f_keep = 0.085 19.31.977.346 I srv get_availabl: updating prompt cache 19.31.977.398 W srv prompt_save: - saving prompt with length 731, total state size = 73.108 MiB (draft: 0.000 MiB) 19.32.055.032 I srv load: - looking for better prompt, base f_keep = 0.085, sim = 0.620 19.32.055.044 I srv update: - cache state: 21 prompts, 3880.733 MiB (limits: 8192.000 MiB, 24576 tokens, 119504 est) 19.32.055.045 I srv update: - prompt 0x5ac28d0d2a70: 6210 tokens, checkpoints: 1, 294.682 MiB 19.32.055.046 I srv update: - prompt 0x5ac285efda20: 258 tokens, checkpoints: 1, 108.569 MiB 19.32.055.047 I srv update: - prompt 0x5ac28cdb45d0: 6233 tokens, checkpoints: 1, 295.401 MiB 19.32.055.049 I srv update: - prompt 0x5ac285fbf500: 2427 tokens, checkpoints: 1, 176.391 MiB 19.32.055.050 I srv update: - prompt 0x5ac285d3d860: 1006 tokens, checkpoints: 1, 131.958 MiB 19.32.055.051 I srv update: - prompt 0x5ac28602bf80: 1485 tokens, checkpoints: 1, 146.936 MiB 19.32.055.051 I srv update: - prompt 0x5ac285eacf60: 6227 tokens, checkpoints: 1, 295.214 MiB 19.32.055.052 I srv update: - prompt 0x5ac285e9bf00: 6213 tokens, checkpoints: 1, 294.776 MiB 19.32.055.052 I srv update: - prompt 0x5ac285ef5ea0: 4300 tokens, checkpoints: 1, 234.958 MiB 19.32.055.052 I srv update: - prompt 0x5ac28cda8320: 2120 tokens, checkpoints: 1, 166.792 MiB 19.32.055.053 I srv update: - prompt 0x5ac285ec48a0: 3089 tokens, checkpoints: 1, 197.092 MiB 19.32.055.053 I srv update: - prompt 0x5ac28cdec6e0: 6274 tokens, checkpoints: 1, 296.684 MiB 19.32.055.054 I srv update: - prompt 0x5ac28cdf1710: 3084 tokens, checkpoints: 1, 196.935 MiB 19.32.055.054 I srv update: - prompt 0x5ac28602cc00: 3075 tokens, checkpoints: 1, 196.654 MiB 19.32.055.055 I srv update: - prompt 0x5ac285ad1b70: 1056 tokens, checkpoints: 1, 133.521 MiB 19.32.055.055 I srv update: - prompt 0x5ac285eacc40: 261 tokens, checkpoints: 1, 108.663 MiB 19.32.055.056 I srv update: - prompt 0x5ac28cdd3900: 376 tokens, checkpoints: 1, 112.259 MiB 19.32.055.056 I srv update: - prompt 0x5ac286141c50: 985 tokens, checkpoints: 1, 131.301 MiB 19.32.055.057 I srv update: - prompt 0x5ac285eb26f0: 505 tokens, checkpoints: 1, 116.292 MiB 19.32.055.057 I srv update: - prompt 0x5ac2800d0e30: 697 tokens, checkpoints: 1, 122.296 MiB 19.32.055.058 I srv update: - prompt 0x5ac285fc2f10: 731 tokens, checkpoints: 1, 123.359 MiB 19.32.055.059 I srv get_availabl: prompt cache update took 77.71 ms 19.32.055.133 I slot launch_slot_: id 1 | task 54615 | processing task, is_child = 0 19.32.055.134 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 19.32.055.134 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 19.32.055.149 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 19.32.055.149 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 19.32.055.162 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache 19.32.055.163 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens 19.32.055.183 I slot update_slots: id 1 | task 54615 | Checking checkpoint with [53, 53] against 62... 19.32.067.940 W slot update_slots: id 1 | task 54615 | restored context checkpoint (pos_min = 53, pos_max = 53, n_tokens = 54, n_past = 54, size = 50.251 MiB) 19.35.207.520 I slot print_timing: id 1 | task 54615 | n_decoded = 144, tg = 47.82 t/s, tg_3s = 47.82 t/s 19.38.216.581 I slot print_timing: id 1 | task 54615 | n_decoded = 287, tg = 47.67 t/s, tg_3s = 47.52 t/s 19.41.225.672 I slot print_timing: id 1 | task 54615 | n_decoded = 430, tg = 47.62 t/s, tg_3s = 47.52 t/s 19.44.232.649 I slot print_timing: id 1 | task 54615 | n_decoded = 573, tg = 47.60 t/s, tg_3s = 47.56 t/s 19.47.244.716 I slot print_timing: id 1 | task 54615 | n_decoded = 716, tg = 47.58 t/s, tg_3s = 47.48 t/s 19.50.250.768 I slot print_timing: id 1 | task 54615 | n_decoded = 859, tg = 47.58 t/s, tg_3s = 47.57 t/s 19.50.943.759 I slot print_timing: id 1 | task 54615 | prompt eval time = 140.81 ms / 46 tokens ( 3.06 ms per token, 326.69 tokens per second) 19.50.943.763 I slot print_timing: id 1 | task 54615 | eval time = 18747.77 ms / 892 tokens ( 21.02 ms per token, 47.58 tokens per second) 19.50.943.764 I slot print_timing: id 1 | task 54615 | total time = 18888.57 ms / 938 tokens 19.50.943.764 I slot print_timing: id 1 | task 54615 | graphs reused = 55204 19.50.943.820 I slot release: id 1 | task 54615 | stop processing: n_tokens = 991, truncated = 0 19.50.943.830 I srv update_slots: all slots are idle 19.51.003.678 I srv operator(): operator(): cleaning up before exit...