0.00.064.662 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg) 0.00.064.666 I device_info: 0.00.064.685 I - ROCm0 : AMD Radeon Graphics (32752 MiB, 32728 MiB free) 0.00.064.689 I - ROCm1 : AMD Radeon Graphics (32752 MiB, 32728 MiB free) 0.00.064.696 I - CPU : AMD Ryzen 9 3900X 12-Core Processor (128730 MiB, 128730 MiB free) 0.00.064.749 I system_info: n_threads = 12 (n_threads_batch = 12) / 24 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | 0.00.064.752 I srv llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true 0.00.064.791 I srv init: running without SSL 0.00.064.851 I srv init: using 23 threads for HTTP server 0.00.065.183 I srv start: binding port with default address family 0.00.066.388 I srv llama_server: loading model 0.00.066.396 I srv load_model: loading model '/home/qrf/.cache/llama.cpp/Qwen_Qwen3.6-27B-Q4_K_M.gguf' 0.00.066.445 I common_init_result: fitting params to device memory ... 0.00.066.446 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.13.661.158 W llama_context: n_ctx_seq (8192) < n_ctx_train (262144) -- the full capacity of the model will not be utilized 0.13.743.591 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.13.994.538 I srv load_model: initializing slots, n_slots = 4 0.14.112.387 W srv load_model: speculative decoding will use checkpoints 0.14.112.403 W common_speculative_init: no implementations specified for speculative decoding 0.14.112.405 I slot load_model: id 0 | task -1 | new slot, n_ctx = 8192 0.14.112.409 I slot load_model: id 1 | task -1 | new slot, n_ctx = 8192 0.14.112.410 I slot load_model: id 2 | task -1 | new slot, n_ctx = 8192 0.14.112.410 I slot load_model: id 3 | task -1 | new slot, n_ctx = 8192 0.14.112.463 I srv load_model: prompt cache is enabled, size limit: 8192 MiB 0.14.112.464 I srv load_model: use `--cache-ram 0` to disable the prompt cache 0.14.112.465 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391 0.14.112.465 I srv load_model: context checkpoints enabled, max = 32, min spacing = 256 0.14.112.485 I srv init: idle slots will be saved to prompt cache and cleared upon starting a new task 0.14.134.320 I init: chat template, example_format: '<|im_start|>system You are a helpful assistant<|im_end|> <|im_start|>user Hello<|im_end|> <|im_start|>assistant Hi there<|im_end|> <|im_start|>user How are you?<|im_end|> <|im_start|>assistant ' 0.14.148.281 I srv init: init: chat template, thinking = 1 0.14.148.459 I srv llama_server: model loaded 0.14.148.464 I srv llama_server: server is listening on http://127.0.0.1:8090 0.14.148.470 I srv update_slots: all slots are idle 0.14.980.746 I srv operator(): Chat format: peg-native 0.14.981.021 I slot get_availabl: id 3 | task -1 | selected slot by LRU, t_last = -1 0.14.981.023 I srv get_availabl: updating prompt cache 0.14.981.028 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000 0.14.981.032 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 8192 tokens, 8589934592 est) 0.14.981.033 I srv get_availabl: prompt cache update took 0.01 ms 0.14.981.094 I slot launch_slot_: id 3 | task 0 | processing task, is_child = 0 0.14.981.098 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.14.981.099 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.14.981.110 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.14.981.111 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.14.981.116 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.14.981.116 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.15.900.068 I slot create_check: id 3 | task 0 | created context checkpoint 1 of 32 (pos_min = 45, pos_max = 45, n_tokens = 46, size = 149.626 MiB) 0.19.708.126 I slot print_timing: id 3 | task 0 | prompt eval time = 1312.16 ms / 76 tokens ( 17.27 ms per token, 57.92 tokens per second) 0.19.708.130 I slot print_timing: id 3 | task 0 | eval time = 3414.83 ms / 64 tokens ( 53.36 ms per token, 18.74 tokens per second) 0.19.708.131 I slot print_timing: id 3 | task 0 | total time = 4726.99 ms / 140 tokens 0.19.708.135 I slot print_timing: id 3 | task 0 | graphs reused = 63 0.19.708.187 I slot release: id 3 | task 0 | stop processing: n_tokens = 139, truncated = 0 0.19.708.193 I srv update_slots: all slots are idle 0.19.724.385 I srv operator(): Chat format: peg-native 0.19.724.618 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.721 (> 0.100 thold), f_keep = 0.353 0.19.724.621 I srv get_availabl: updating prompt cache 0.19.724.658 W srv prompt_save: - saving prompt with length 139, total state size = 158.317 MiB (draft: 0.000 MiB) 0.19.954.117 I srv load: - looking for better prompt, base f_keep = 0.353, sim = 0.721 0.19.954.125 I srv update: - cache state: 1 prompts, 307.943 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 0.19.954.127 I srv update: - prompt 0x5a22a45ba260: 139 tokens, checkpoints: 1, 307.943 MiB 0.19.954.128 I srv get_availabl: prompt cache update took 229.51 ms 0.19.954.218 I slot launch_slot_: id 3 | task 67 | processing task, is_child = 0 0.19.954.220 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.19.954.221 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.19.954.231 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.19.954.231 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.19.954.244 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.19.954.244 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.19.954.259 I slot update_slots: id 3 | task 67 | Checking checkpoint with [45, 45] against 49... 0.19.989.563 W slot update_slots: id 3 | task 67 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 0.23.855.884 I slot print_timing: id 3 | task 67 | prompt eval time = 385.16 ms / 22 tokens ( 17.51 ms per token, 57.12 tokens per second) 0.23.855.887 I slot print_timing: id 3 | task 67 | eval time = 3516.46 ms / 66 tokens ( 53.28 ms per token, 18.77 tokens per second) 0.23.855.888 I slot print_timing: id 3 | task 67 | total time = 3901.62 ms / 88 tokens 0.23.855.889 I slot print_timing: id 3 | task 67 | graphs reused = 127 0.23.855.921 I slot release: id 3 | task 67 | stop processing: n_tokens = 133, truncated = 0 0.23.855.929 I srv update_slots: all slots are idle 0.23.871.493 I srv operator(): Chat format: peg-native 0.23.871.726 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.700 (> 0.100 thold), f_keep = 0.368 0.23.871.728 I srv get_availabl: updating prompt cache 0.23.871.749 W srv prompt_save: - saving prompt with length 133, total state size = 157.942 MiB (draft: 0.000 MiB) 0.24.063.792 I srv load: - looking for better prompt, base f_keep = 0.368, sim = 0.700 0.24.063.796 I srv load: - found better prompt with f_keep = 0.374, sim = 0.743 0.24.133.574 I srv update: - cache state: 1 prompts, 307.568 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 0.24.133.579 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 0.24.133.581 I srv get_availabl: prompt cache update took 261.85 ms 0.24.133.671 I slot launch_slot_: id 3 | task 135 | processing task, is_child = 0 0.24.133.674 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.24.133.674 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.24.133.682 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.24.133.682 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.24.133.687 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.24.133.687 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.24.133.701 I slot update_slots: id 3 | task 135 | Checking checkpoint with [45, 45] against 52... 0.24.183.822 W slot update_slots: id 3 | task 135 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 0.27.517.067 I slot print_timing: id 3 | task 135 | prompt eval time = 400.58 ms / 24 tokens ( 16.69 ms per token, 59.91 tokens per second) 0.27.517.070 I slot print_timing: id 3 | task 135 | eval time = 2982.77 ms / 56 tokens ( 53.26 ms per token, 18.77 tokens per second) 0.27.517.071 I slot print_timing: id 3 | task 135 | total time = 3383.36 ms / 80 tokens 0.27.517.072 I slot print_timing: id 3 | task 135 | graphs reused = 181 0.27.517.105 I slot release: id 3 | task 135 | stop processing: n_tokens = 125, truncated = 0 0.27.517.115 I srv update_slots: all slots are idle 0.27.533.027 I srv operator(): Chat format: peg-native 0.27.533.266 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.725 (> 0.100 thold), f_keep = 0.400 0.27.533.268 I srv get_availabl: updating prompt cache 0.27.533.301 W srv prompt_save: - saving prompt with length 125, total state size = 157.441 MiB (draft: 0.000 MiB) 0.27.722.812 I srv load: - looking for better prompt, base f_keep = 0.400, sim = 0.725 0.27.722.821 I srv update: - cache state: 2 prompts, 614.635 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 0.27.722.823 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 0.27.722.823 I srv update: - prompt 0x5a22ab983ef0: 125 tokens, checkpoints: 1, 307.068 MiB 0.27.722.825 I srv get_availabl: prompt cache update took 189.56 ms 0.27.722.931 I slot launch_slot_: id 3 | task 193 | processing task, is_child = 0 0.27.722.933 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.27.722.933 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.27.722.947 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.27.722.947 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.27.722.959 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.27.722.959 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.27.722.976 I slot update_slots: id 3 | task 193 | Checking checkpoint with [45, 45] against 50... 0.27.758.514 W slot update_slots: id 3 | task 193 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 0.31.196.191 I slot print_timing: id 3 | task 193 | prompt eval time = 385.38 ms / 23 tokens ( 16.76 ms per token, 59.68 tokens per second) 0.31.196.195 I slot print_timing: id 3 | task 193 | eval time = 3087.82 ms / 58 tokens ( 53.24 ms per token, 18.78 tokens per second) 0.31.196.195 I slot print_timing: id 3 | task 193 | total time = 3473.21 ms / 81 tokens 0.31.196.196 I slot print_timing: id 3 | task 193 | graphs reused = 237 0.31.196.260 I slot release: id 3 | task 193 | stop processing: n_tokens = 126, truncated = 0 0.31.196.269 I srv update_slots: all slots are idle 0.31.212.155 I srv operator(): Chat format: peg-native 0.31.212.388 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.704 (> 0.100 thold), f_keep = 0.397 0.31.212.390 I srv get_availabl: updating prompt cache 0.31.212.413 W srv prompt_save: - saving prompt with length 126, total state size = 157.504 MiB (draft: 0.000 MiB) 0.31.405.399 I srv load: - looking for better prompt, base f_keep = 0.397, sim = 0.704 0.31.405.405 I srv load: - found better prompt with f_keep = 0.416, sim = 0.732 0.31.475.601 I srv update: - cache state: 2 prompts, 614.698 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 0.31.475.606 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 0.31.475.607 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 0.31.475.608 I srv get_availabl: prompt cache update took 263.22 ms 0.31.475.699 I slot launch_slot_: id 3 | task 253 | processing task, is_child = 0 0.31.475.701 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.31.475.702 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.31.475.712 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.31.475.712 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.31.475.718 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.31.475.718 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.31.475.734 I slot update_slots: id 3 | task 253 | Checking checkpoint with [45, 45] against 52... 0.31.534.011 W slot update_slots: id 3 | task 253 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 0.33.026.894 I slot print_timing: id 3 | task 253 | prompt eval time = 408.89 ms / 25 tokens ( 16.36 ms per token, 61.14 tokens per second) 0.33.026.898 I slot print_timing: id 3 | task 253 | eval time = 1142.27 ms / 22 tokens ( 51.92 ms per token, 19.26 tokens per second) 0.33.026.898 I slot print_timing: id 3 | task 253 | total time = 1551.15 ms / 47 tokens 0.33.026.899 I slot print_timing: id 3 | task 253 | graphs reused = 257 0.33.026.933 I slot release: id 3 | task 253 | stop processing: n_tokens = 92, truncated = 0 0.33.026.940 I srv update_slots: all slots are idle 0.33.042.395 I srv operator(): Chat format: peg-native 0.33.042.625 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.690 (> 0.100 thold), f_keep = 0.533 0.33.042.687 I slot launch_slot_: id 3 | task 277 | processing task, is_child = 0 0.33.042.689 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.33.042.690 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.33.042.697 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.33.042.697 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.33.042.702 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.33.042.703 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.33.042.711 I slot update_slots: id 3 | task 277 | Checking checkpoint with [45, 45] against 49... 0.33.078.248 W slot update_slots: id 3 | task 277 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 0.36.245.198 I slot print_timing: id 3 | task 277 | prompt eval time = 385.87 ms / 25 tokens ( 15.43 ms per token, 64.79 tokens per second) 0.36.245.201 I slot print_timing: id 3 | task 277 | eval time = 2816.61 ms / 53 tokens ( 53.14 ms per token, 18.82 tokens per second) 0.36.245.202 I slot print_timing: id 3 | task 277 | total time = 3202.48 ms / 78 tokens 0.36.245.203 I slot print_timing: id 3 | task 277 | graphs reused = 308 0.36.245.234 I slot release: id 3 | task 277 | stop processing: n_tokens = 123, truncated = 0 0.36.245.241 I srv update_slots: all slots are idle 0.36.261.391 I srv operator(): Chat format: peg-native 0.36.261.605 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.653 (> 0.100 thold), f_keep = 0.398 0.36.261.607 I srv get_availabl: updating prompt cache 0.36.261.627 W srv prompt_save: - saving prompt with length 123, total state size = 157.316 MiB (draft: 0.000 MiB) 0.36.446.036 I srv load: - looking for better prompt, base f_keep = 0.398, sim = 0.653 0.36.446.043 I srv update: - cache state: 3 prompts, 921.640 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 0.36.446.044 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 0.36.446.045 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 0.36.446.046 I srv update: - prompt 0x5a22ab984ae0: 123 tokens, checkpoints: 1, 306.942 MiB 0.36.446.047 I srv get_availabl: prompt cache update took 184.44 ms 0.36.446.141 I slot launch_slot_: id 3 | task 332 | processing task, is_child = 0 0.36.446.143 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.36.446.143 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.36.446.153 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.36.446.153 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.36.446.163 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.36.446.164 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.36.446.177 I slot update_slots: id 3 | task 332 | Checking checkpoint with [45, 45] against 49... 0.36.481.678 W slot update_slots: id 3 | task 332 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 0.38.865.240 I slot print_timing: id 3 | task 332 | prompt eval time = 427.67 ms / 29 tokens ( 14.75 ms per token, 67.81 tokens per second) 0.38.865.243 I slot print_timing: id 3 | task 332 | eval time = 1991.39 ms / 38 tokens ( 52.41 ms per token, 19.08 tokens per second) 0.38.865.244 I slot print_timing: id 3 | task 332 | total time = 2419.06 ms / 67 tokens 0.38.865.244 I slot print_timing: id 3 | task 332 | graphs reused = 344 0.38.865.282 I slot release: id 3 | task 332 | stop processing: n_tokens = 112, truncated = 0 0.38.865.289 I srv update_slots: all slots are idle 0.38.880.878 I srv operator(): Chat format: peg-native 0.38.881.112 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.769 (> 0.100 thold), f_keep = 0.446 0.38.881.114 I srv get_availabl: updating prompt cache 0.38.881.134 W srv prompt_save: - saving prompt with length 112, total state size = 156.629 MiB (draft: 0.000 MiB) 0.39.070.203 I srv load: - looking for better prompt, base f_keep = 0.446, sim = 0.769 0.39.070.212 I srv update: - cache state: 4 prompts, 1227.895 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 0.39.070.213 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 0.39.070.214 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 0.39.070.215 I srv update: - prompt 0x5a22ab984ae0: 123 tokens, checkpoints: 1, 306.942 MiB 0.39.070.216 I srv update: - prompt 0x5a22a43cdde0: 112 tokens, checkpoints: 1, 306.255 MiB 0.39.070.217 I srv get_availabl: prompt cache update took 189.10 ms 0.39.070.295 I slot launch_slot_: id 3 | task 372 | processing task, is_child = 0 0.39.070.296 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.39.070.297 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.39.070.303 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.39.070.303 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.39.070.308 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.39.070.308 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.39.070.320 I slot update_slots: id 3 | task 372 | Checking checkpoint with [45, 45] against 50... 0.39.105.236 W slot update_slots: id 3 | task 372 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 0.42.586.989 I slot print_timing: id 3 | task 372 | prompt eval time = 283.65 ms / 19 tokens ( 14.93 ms per token, 66.98 tokens per second) 0.42.586.992 I slot print_timing: id 3 | task 372 | eval time = 3233.01 ms / 61 tokens ( 53.00 ms per token, 18.87 tokens per second) 0.42.586.993 I slot print_timing: id 3 | task 372 | total time = 3516.66 ms / 80 tokens 0.42.586.994 I slot print_timing: id 3 | task 372 | graphs reused = 403 0.42.587.033 I slot release: id 3 | task 372 | stop processing: n_tokens = 125, truncated = 0 0.42.587.042 I srv update_slots: all slots are idle 0.42.602.740 I srv operator(): Chat format: peg-native 0.42.602.978 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.636 (> 0.100 thold), f_keep = 0.392 0.42.602.980 I srv get_availabl: updating prompt cache 0.42.603.009 W srv prompt_save: - saving prompt with length 125, total state size = 157.441 MiB (draft: 0.000 MiB) 0.42.802.003 I srv load: - looking for better prompt, base f_keep = 0.392, sim = 0.636 0.42.802.006 I srv load: - found better prompt with f_keep = 0.407, sim = 0.649 0.42.871.030 I srv update: - cache state: 4 prompts, 1228.020 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 0.42.871.034 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 0.42.871.035 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 0.42.871.036 I srv update: - prompt 0x5a22a43cdde0: 112 tokens, checkpoints: 1, 306.255 MiB 0.42.871.037 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 0.42.871.039 I srv get_availabl: prompt cache update took 268.06 ms 0.42.871.134 I slot launch_slot_: id 3 | task 435 | processing task, is_child = 0 0.42.871.137 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.42.871.137 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.42.871.148 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.42.871.148 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.42.871.161 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.42.871.162 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.42.871.184 I slot update_slots: id 3 | task 435 | Checking checkpoint with [45, 45] against 50... 0.42.931.111 W slot update_slots: id 3 | task 435 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 0.45.267.405 I slot print_timing: id 3 | task 435 | prompt eval time = 452.72 ms / 31 tokens ( 14.60 ms per token, 68.47 tokens per second) 0.45.267.408 I slot print_timing: id 3 | task 435 | eval time = 1943.49 ms / 37 tokens ( 52.53 ms per token, 19.04 tokens per second) 0.45.267.409 I slot print_timing: id 3 | task 435 | total time = 2396.22 ms / 68 tokens 0.45.267.410 I slot print_timing: id 3 | task 435 | graphs reused = 438 0.45.267.443 I slot release: id 3 | task 435 | stop processing: n_tokens = 113, truncated = 0 0.45.267.451 I srv update_slots: all slots are idle 0.45.282.940 I srv operator(): Chat format: peg-native 0.45.283.175 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.700 (> 0.100 thold), f_keep = 0.434 0.45.283.177 I srv get_availabl: updating prompt cache 0.45.283.198 W srv prompt_save: - saving prompt with length 113, total state size = 156.691 MiB (draft: 0.000 MiB) 0.45.471.305 I srv load: - looking for better prompt, base f_keep = 0.434, sim = 0.700 0.45.471.310 I srv load: - found better prompt with f_keep = 0.446, sim = 0.714 0.45.541.756 I srv update: - cache state: 4 prompts, 1228.083 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 0.45.541.759 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 0.45.541.760 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 0.45.541.761 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 0.45.541.761 I srv update: - prompt 0x5a22a464f580: 113 tokens, checkpoints: 1, 306.317 MiB 0.45.541.762 I srv get_availabl: prompt cache update took 258.58 ms 0.45.541.852 I slot launch_slot_: id 3 | task 474 | processing task, is_child = 0 0.45.541.854 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.45.541.854 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.45.541.862 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.45.541.863 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.45.541.867 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.45.541.867 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.45.541.881 I slot update_slots: id 3 | task 474 | Checking checkpoint with [45, 45] against 50... 0.45.595.212 W slot update_slots: id 3 | task 474 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 0.49.238.051 I slot print_timing: id 3 | task 474 | prompt eval time = 403.58 ms / 24 tokens ( 16.82 ms per token, 59.47 tokens per second) 0.49.238.055 I slot print_timing: id 3 | task 474 | eval time = 3292.59 ms / 62 tokens ( 53.11 ms per token, 18.83 tokens per second) 0.49.238.056 I slot print_timing: id 3 | task 474 | total time = 3696.17 ms / 86 tokens 0.49.238.056 I slot print_timing: id 3 | task 474 | graphs reused = 498 0.49.238.096 I slot release: id 3 | task 474 | stop processing: n_tokens = 131, truncated = 0 0.49.238.104 I srv update_slots: all slots are idle 0.49.253.681 I srv operator(): Chat format: peg-native 0.49.253.927 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.653 (> 0.100 thold), f_keep = 0.374 0.49.253.929 I srv get_availabl: updating prompt cache 0.49.253.957 W srv prompt_save: - saving prompt with length 131, total state size = 157.817 MiB (draft: 0.000 MiB) 0.49.443.957 I srv load: - looking for better prompt, base f_keep = 0.374, sim = 0.653 0.49.443.965 I srv update: - cache state: 5 prompts, 1535.525 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 0.49.443.966 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 0.49.443.967 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 0.49.443.968 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 0.49.443.969 I srv update: - prompt 0x5a22a464f580: 113 tokens, checkpoints: 1, 306.317 MiB 0.49.443.973 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 0.49.443.974 I srv get_availabl: prompt cache update took 190.04 ms 0.49.444.068 I slot launch_slot_: id 3 | task 538 | processing task, is_child = 0 0.49.444.070 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.49.444.070 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.49.444.078 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.49.444.079 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.49.444.083 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.49.444.083 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.49.444.095 I slot update_slots: id 3 | task 538 | Checking checkpoint with [45, 45] against 49... 0.49.479.122 W slot update_slots: id 3 | task 538 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 0.51.441.976 I slot print_timing: id 3 | task 538 | prompt eval time = 426.92 ms / 29 tokens ( 14.72 ms per token, 67.93 tokens per second) 0.51.441.979 I slot print_timing: id 3 | task 538 | eval time = 1570.95 ms / 30 tokens ( 52.37 ms per token, 19.10 tokens per second) 0.51.441.980 I slot print_timing: id 3 | task 538 | total time = 1997.87 ms / 59 tokens 0.51.441.981 I slot print_timing: id 3 | task 538 | graphs reused = 526 0.51.442.019 I slot release: id 3 | task 538 | stop processing: n_tokens = 104, truncated = 0 0.51.442.027 I srv update_slots: all slots are idle 0.51.457.520 I srv operator(): Chat format: peg-native 0.51.457.736 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.690 (> 0.100 thold), f_keep = 0.471 0.51.457.738 I srv get_availabl: updating prompt cache 0.51.457.759 W srv prompt_save: - saving prompt with length 104, total state size = 156.128 MiB (draft: 0.000 MiB) 0.51.640.097 I srv load: - looking for better prompt, base f_keep = 0.471, sim = 0.690 0.51.640.106 I srv update: - cache state: 6 prompts, 1841.280 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 0.51.640.107 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 0.51.640.108 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 0.51.640.109 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 0.51.640.110 I srv update: - prompt 0x5a22a464f580: 113 tokens, checkpoints: 1, 306.317 MiB 0.51.640.110 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 0.51.640.111 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 0.51.640.119 I srv get_availabl: prompt cache update took 182.37 ms 0.51.640.201 I slot launch_slot_: id 3 | task 570 | processing task, is_child = 0 0.51.640.203 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.51.640.204 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.51.640.212 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.51.640.213 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.51.640.223 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.51.640.223 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.51.640.242 I slot update_slots: id 3 | task 570 | Checking checkpoint with [45, 45] against 49... 0.51.675.423 W slot update_slots: id 3 | task 570 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 0.54.296.964 I slot print_timing: id 3 | task 570 | prompt eval time = 385.64 ms / 25 tokens ( 15.43 ms per token, 64.83 tokens per second) 0.54.296.967 I slot print_timing: id 3 | task 570 | eval time = 2271.07 ms / 43 tokens ( 52.82 ms per token, 18.93 tokens per second) 0.54.296.968 I slot print_timing: id 3 | task 570 | total time = 2656.72 ms / 68 tokens 0.54.296.968 I slot print_timing: id 3 | task 570 | graphs reused = 567 0.54.296.998 I slot release: id 3 | task 570 | stop processing: n_tokens = 113, truncated = 0 0.54.297.006 I srv update_slots: all slots are idle 0.54.312.141 I srv operator(): Chat format: peg-native 0.54.312.355 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.681 (> 0.100 thold), f_keep = 0.434 0.54.312.356 I srv get_availabl: updating prompt cache 0.54.312.377 W srv prompt_save: - saving prompt with length 113, total state size = 156.691 MiB (draft: 0.000 MiB) 0.54.496.000 I srv load: - looking for better prompt, base f_keep = 0.434, sim = 0.681 0.54.496.010 I srv update: - cache state: 7 prompts, 2147.597 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 0.54.496.011 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 0.54.496.012 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 0.54.496.015 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 0.54.496.016 I srv update: - prompt 0x5a22a464f580: 113 tokens, checkpoints: 1, 306.317 MiB 0.54.496.017 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 0.54.496.017 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 0.54.496.017 I srv update: - prompt 0x5a22ab972d70: 113 tokens, checkpoints: 1, 306.317 MiB 0.54.496.019 I srv get_availabl: prompt cache update took 183.66 ms 0.54.496.119 I slot launch_slot_: id 3 | task 615 | processing task, is_child = 0 0.54.496.121 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.54.496.122 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.54.496.131 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.54.496.132 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.54.496.136 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.54.496.136 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.54.496.151 I slot update_slots: id 3 | task 615 | Checking checkpoint with [45, 45] against 49... 0.54.531.272 W slot update_slots: id 3 | task 615 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 0.55.698.160 I slot print_timing: id 3 | task 615 | prompt eval time = 386.06 ms / 26 tokens ( 14.85 ms per token, 67.35 tokens per second) 0.55.698.163 I slot print_timing: id 3 | task 615 | eval time = 815.94 ms / 16 tokens ( 51.00 ms per token, 19.61 tokens per second) 0.55.698.164 I slot print_timing: id 3 | task 615 | total time = 1202.00 ms / 42 tokens 0.55.698.165 I slot print_timing: id 3 | task 615 | graphs reused = 581 0.55.698.195 I slot release: id 3 | task 615 | stop processing: n_tokens = 87, truncated = 0 0.55.698.201 I srv update_slots: all slots are idle 0.55.713.506 I srv operator(): Chat format: peg-native 0.55.713.744 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.690 (> 0.100 thold), f_keep = 0.563 0.55.713.783 I slot launch_slot_: id 3 | task 633 | processing task, is_child = 0 0.55.713.784 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.55.713.785 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.55.713.791 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.55.713.792 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.55.713.796 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.55.713.796 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.55.713.803 I slot update_slots: id 3 | task 633 | Checking checkpoint with [45, 45] against 49... 0.55.749.345 W slot update_slots: id 3 | task 633 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 0.58.807.119 I slot print_timing: id 3 | task 633 | prompt eval time = 385.85 ms / 25 tokens ( 15.43 ms per token, 64.79 tokens per second) 0.58.807.123 I slot print_timing: id 3 | task 633 | eval time = 2707.46 ms / 51 tokens ( 53.09 ms per token, 18.84 tokens per second) 0.58.807.123 I slot print_timing: id 3 | task 633 | total time = 3093.31 ms / 76 tokens 0.58.807.124 I slot print_timing: id 3 | task 633 | graphs reused = 630 0.58.807.160 I slot release: id 3 | task 633 | stop processing: n_tokens = 121, truncated = 0 0.58.807.168 I srv update_slots: all slots are idle 0.58.822.684 I srv operator(): Chat format: peg-native 0.58.822.921 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.671 (> 0.100 thold), f_keep = 0.405 0.58.822.923 I srv get_availabl: updating prompt cache 0.58.822.943 W srv prompt_save: - saving prompt with length 121, total state size = 157.191 MiB (draft: 0.000 MiB) 0.59.005.683 I srv load: - looking for better prompt, base f_keep = 0.405, sim = 0.671 0.59.005.688 I srv load: - found better prompt with f_keep = 0.442, sim = 0.685 0.59.075.147 I srv update: - cache state: 7 prompts, 2148.097 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 0.59.075.151 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 0.59.075.152 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 0.59.075.153 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 0.59.075.154 I srv update: - prompt 0x5a22a464f580: 113 tokens, checkpoints: 1, 306.317 MiB 0.59.075.154 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 0.59.075.155 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 0.59.075.156 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 0.59.075.157 I srv get_availabl: prompt cache update took 252.23 ms 0.59.075.269 I slot launch_slot_: id 3 | task 686 | processing task, is_child = 0 0.59.075.272 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.59.075.273 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.59.075.281 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.59.075.282 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.59.075.286 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.59.075.286 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.59.075.299 I slot update_slots: id 3 | task 686 | Checking checkpoint with [45, 45] against 50... 0.59.120.608 W slot update_slots: id 3 | task 686 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.00.886.020 I slot print_timing: id 3 | task 686 | prompt eval time = 397.35 ms / 27 tokens ( 14.72 ms per token, 67.95 tokens per second) 1.00.886.023 I slot print_timing: id 3 | task 686 | eval time = 1413.37 ms / 27 tokens ( 52.35 ms per token, 19.10 tokens per second) 1.00.886.024 I slot print_timing: id 3 | task 686 | total time = 1810.71 ms / 54 tokens 1.00.886.024 I slot print_timing: id 3 | task 686 | graphs reused = 655 1.00.886.056 I slot release: id 3 | task 686 | stop processing: n_tokens = 99, truncated = 0 1.00.886.071 I srv update_slots: all slots are idle 1.00.901.737 I srv operator(): Chat format: peg-native 1.00.901.967 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.710 (> 0.100 thold), f_keep = 0.495 1.00.901.967 I srv get_availabl: updating prompt cache 1.00.901.986 W srv prompt_save: - saving prompt with length 99, total state size = 155.816 MiB (draft: 0.000 MiB) 1.01.089.995 I srv load: - looking for better prompt, base f_keep = 0.495, sim = 0.710 1.01.090.005 I srv update: - cache state: 8 prompts, 2453.539 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 1.01.090.006 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 1.01.090.010 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 1.01.090.011 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 1.01.090.011 I srv update: - prompt 0x5a22a464f580: 113 tokens, checkpoints: 1, 306.317 MiB 1.01.090.012 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 1.01.090.012 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 1.01.090.014 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 1.01.090.015 I srv update: - prompt 0x5a22a45f5850: 99 tokens, checkpoints: 1, 305.442 MiB 1.01.090.016 I srv get_availabl: prompt cache update took 188.05 ms 1.01.090.104 I slot launch_slot_: id 3 | task 715 | processing task, is_child = 0 1.01.090.104 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.01.090.105 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.01.090.114 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.01.090.115 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.01.090.119 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.01.090.120 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.01.090.133 I slot update_slots: id 3 | task 715 | Checking checkpoint with [45, 45] against 49... 1.01.125.169 W slot update_slots: id 3 | task 715 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.03.590.022 I slot print_timing: id 3 | task 715 | prompt eval time = 385.20 ms / 23 tokens ( 16.75 ms per token, 59.71 tokens per second) 1.03.590.025 I slot print_timing: id 3 | task 715 | eval time = 2114.68 ms / 40 tokens ( 52.87 ms per token, 18.92 tokens per second) 1.03.590.026 I slot print_timing: id 3 | task 715 | total time = 2499.88 ms / 63 tokens 1.03.590.026 I slot print_timing: id 3 | task 715 | graphs reused = 693 1.03.590.070 I slot release: id 3 | task 715 | stop processing: n_tokens = 108, truncated = 0 1.03.590.078 I srv update_slots: all slots are idle 1.03.605.534 I srv operator(): Chat format: peg-native 1.03.605.766 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.671 (> 0.100 thold), f_keep = 0.454 1.03.605.768 I srv get_availabl: updating prompt cache 1.03.605.789 W srv prompt_save: - saving prompt with length 108, total state size = 156.379 MiB (draft: 0.000 MiB) 1.03.806.525 I srv load: - looking for better prompt, base f_keep = 0.454, sim = 0.671 1.03.806.533 I srv load: - found better prompt with f_keep = 0.505, sim = 0.685 1.03.886.596 I srv update: - cache state: 8 prompts, 2454.102 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 1.03.886.602 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 1.03.886.603 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 1.03.886.603 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 1.03.886.604 I srv update: - prompt 0x5a22a464f580: 113 tokens, checkpoints: 1, 306.317 MiB 1.03.886.604 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 1.03.886.605 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 1.03.886.606 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 1.03.886.607 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 1.03.886.608 I srv get_availabl: prompt cache update took 280.84 ms 1.03.887.732 I slot launch_slot_: id 3 | task 757 | processing task, is_child = 0 1.03.887.735 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.03.887.736 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.03.887.744 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.03.887.744 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.03.887.749 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.03.887.749 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.03.887.763 I slot update_slots: id 3 | task 757 | Checking checkpoint with [45, 45] against 50... 1.03.930.508 W slot update_slots: id 3 | task 757 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.07.673.339 I slot print_timing: id 3 | task 757 | prompt eval time = 404.34 ms / 27 tokens ( 14.98 ms per token, 66.78 tokens per second) 1.07.673.343 I slot print_timing: id 3 | task 757 | eval time = 3381.22 ms / 41 tokens ( 82.47 ms per token, 12.13 tokens per second) 1.07.673.343 I slot print_timing: id 3 | task 757 | total time = 3785.56 ms / 68 tokens 1.07.673.366 I slot print_timing: id 3 | task 757 | graphs reused = 732 1.07.673.436 I slot release: id 3 | task 757 | stop processing: n_tokens = 113, truncated = 0 1.07.673.448 I srv update_slots: all slots are idle 1.07.697.334 I srv operator(): Chat format: peg-native 1.07.697.566 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.721 (> 0.100 thold), f_keep = 0.434 1.07.697.569 I srv get_availabl: updating prompt cache 1.07.697.606 W srv prompt_save: - saving prompt with length 113, total state size = 156.691 MiB (draft: 0.000 MiB) 1.08.300.972 I srv load: - looking for better prompt, base f_keep = 0.434, sim = 0.721 1.08.300.977 I srv load: - found better prompt with f_keep = 0.442, sim = 0.735 1.08.369.438 I srv update: - cache state: 8 prompts, 2454.102 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 1.08.369.443 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 1.08.369.443 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 1.08.369.444 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 1.08.369.444 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 1.08.369.445 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 1.08.369.452 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 1.08.369.452 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 1.08.369.464 I srv update: - prompt 0x5a22a3d77230: 113 tokens, checkpoints: 1, 306.317 MiB 1.08.369.467 I srv get_availabl: prompt cache update took 671.90 ms 1.08.370.446 I slot launch_slot_: id 3 | task 800 | processing task, is_child = 0 1.08.370.449 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.08.370.450 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.08.370.461 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.08.370.461 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.08.370.468 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.08.370.468 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.08.370.486 I slot update_slots: id 3 | task 800 | Checking checkpoint with [45, 45] against 50... 1.08.440.610 W slot update_slots: id 3 | task 800 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.12.286.256 I slot print_timing: id 3 | task 800 | prompt eval time = 1137.63 ms / 22 tokens ( 51.71 ms per token, 19.34 tokens per second) 1.12.286.260 I slot print_timing: id 3 | task 800 | eval time = 2778.13 ms / 35 tokens ( 79.38 ms per token, 12.60 tokens per second) 1.12.286.284 I slot print_timing: id 3 | task 800 | total time = 3915.76 ms / 57 tokens 1.12.286.286 I slot print_timing: id 3 | task 800 | graphs reused = 765 1.12.286.321 I slot release: id 3 | task 800 | stop processing: n_tokens = 102, truncated = 0 1.12.286.360 I srv update_slots: all slots are idle 1.12.304.571 I srv operator(): Chat format: peg-native 1.12.304.809 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.731 (> 0.100 thold), f_keep = 0.480 1.12.304.812 I srv get_availabl: updating prompt cache 1.12.304.843 W srv prompt_save: - saving prompt with length 102, total state size = 156.003 MiB (draft: 0.000 MiB) 1.12.509.662 I srv load: - looking for better prompt, base f_keep = 0.480, sim = 0.731 1.12.509.673 I srv update: - cache state: 9 prompts, 2759.731 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 1.12.509.674 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 1.12.509.675 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 1.12.509.675 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 1.12.509.676 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 1.12.509.684 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 1.12.509.685 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 1.12.509.685 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 1.12.509.686 I srv update: - prompt 0x5a22a3d77230: 113 tokens, checkpoints: 1, 306.317 MiB 1.12.509.686 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 1.12.509.688 I srv get_availabl: prompt cache update took 204.87 ms 1.12.509.817 I slot launch_slot_: id 3 | task 837 | processing task, is_child = 0 1.12.509.819 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.12.509.819 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.12.509.828 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.12.509.828 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.12.509.832 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.12.509.832 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.12.509.843 I slot update_slots: id 3 | task 837 | Checking checkpoint with [45, 45] against 49... 1.12.545.269 W slot update_slots: id 3 | task 837 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.14.796.259 I slot print_timing: id 3 | task 837 | prompt eval time = 386.55 ms / 21 tokens ( 18.41 ms per token, 54.33 tokens per second) 1.14.796.264 I slot print_timing: id 3 | task 837 | eval time = 1899.86 ms / 36 tokens ( 52.77 ms per token, 18.95 tokens per second) 1.14.796.264 I slot print_timing: id 3 | task 837 | total time = 2286.41 ms / 57 tokens 1.14.796.265 I slot print_timing: id 3 | task 837 | graphs reused = 799 1.14.796.294 I slot release: id 3 | task 837 | stop processing: n_tokens = 102, truncated = 0 1.14.796.302 I srv update_slots: all slots are idle 1.14.812.910 I srv operator(): Chat format: peg-native 1.14.813.149 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.735 (> 0.100 thold), f_keep = 0.490 1.14.813.151 I srv get_availabl: updating prompt cache 1.14.813.170 W srv prompt_save: - saving prompt with length 102, total state size = 156.003 MiB (draft: 0.000 MiB) 1.15.003.984 I srv load: - looking for better prompt, base f_keep = 0.490, sim = 0.735 1.15.003.993 I srv update: - cache state: 10 prompts, 3065.361 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 1.15.003.995 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 1.15.003.995 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 1.15.003.996 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 1.15.003.996 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 1.15.003.997 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 1.15.003.998 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 1.15.003.998 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 1.15.003.999 I srv update: - prompt 0x5a22a3d77230: 113 tokens, checkpoints: 1, 306.317 MiB 1.15.004.000 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 1.15.004.001 I srv update: - prompt 0x5a22a45faa40: 102 tokens, checkpoints: 1, 305.630 MiB 1.15.004.007 I srv get_availabl: prompt cache update took 190.85 ms 1.15.004.089 I slot launch_slot_: id 3 | task 875 | processing task, is_child = 0 1.15.004.090 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.15.004.090 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.15.004.099 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.15.004.100 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.15.004.104 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.15.004.104 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.15.004.118 I slot update_slots: id 3 | task 875 | Checking checkpoint with [45, 45] against 50... 1.15.039.453 W slot update_slots: id 3 | task 875 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.16.154.181 I slot print_timing: id 3 | task 875 | prompt eval time = 385.25 ms / 22 tokens ( 17.51 ms per token, 57.11 tokens per second) 1.16.154.184 I slot print_timing: id 3 | task 875 | eval time = 764.80 ms / 15 tokens ( 50.99 ms per token, 19.61 tokens per second) 1.16.154.184 I slot print_timing: id 3 | task 875 | total time = 1150.06 ms / 37 tokens 1.16.154.185 I slot print_timing: id 3 | task 875 | graphs reused = 812 1.16.154.210 I slot release: id 3 | task 875 | stop processing: n_tokens = 82, truncated = 0 1.16.154.218 I srv update_slots: all slots are idle 1.16.170.185 I srv operator(): Chat format: peg-native 1.16.170.420 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.742 (> 0.100 thold), f_keep = 0.598 1.16.170.467 I slot launch_slot_: id 3 | task 892 | processing task, is_child = 0 1.16.170.468 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.16.170.469 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.16.170.477 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.16.170.477 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.16.170.483 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.16.170.483 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.16.170.492 I slot update_slots: id 3 | task 892 | Checking checkpoint with [45, 45] against 49... 1.16.205.907 W slot update_slots: id 3 | task 892 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.17.113.179 I slot print_timing: id 3 | task 892 | prompt eval time = 285.72 ms / 20 tokens ( 14.29 ms per token, 70.00 tokens per second) 1.17.113.183 I slot print_timing: id 3 | task 892 | eval time = 656.96 ms / 13 tokens ( 50.54 ms per token, 19.79 tokens per second) 1.17.113.183 I slot print_timing: id 3 | task 892 | total time = 942.68 ms / 33 tokens 1.17.113.184 I slot print_timing: id 3 | task 892 | graphs reused = 823 1.17.113.218 I slot release: id 3 | task 892 | stop processing: n_tokens = 78, truncated = 0 1.17.113.225 I srv update_slots: all slots are idle 1.17.129.860 I srv operator(): Chat format: peg-native 1.17.130.096 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.700 (> 0.100 thold), f_keep = 0.628 1.17.130.141 I slot launch_slot_: id 3 | task 907 | processing task, is_child = 0 1.17.130.142 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.17.130.143 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.17.130.151 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.17.130.151 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.17.130.157 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.17.130.157 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.17.130.166 I slot update_slots: id 3 | task 907 | Checking checkpoint with [45, 45] against 49... 1.17.165.533 W slot update_slots: id 3 | task 907 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.19.688.289 I slot print_timing: id 3 | task 907 | prompt eval time = 385.30 ms / 24 tokens ( 16.05 ms per token, 62.29 tokens per second) 1.19.688.292 I slot print_timing: id 3 | task 907 | eval time = 2172.82 ms / 41 tokens ( 53.00 ms per token, 18.87 tokens per second) 1.19.688.293 I slot print_timing: id 3 | task 907 | total time = 2558.12 ms / 65 tokens 1.19.688.293 I slot print_timing: id 3 | task 907 | graphs reused = 862 1.19.688.363 I slot release: id 3 | task 907 | stop processing: n_tokens = 110, truncated = 0 1.19.688.372 I srv update_slots: all slots are idle 1.19.704.621 I srv operator(): Chat format: peg-native 1.19.704.871 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.710 (> 0.100 thold), f_keep = 0.445 1.19.704.874 I srv get_availabl: updating prompt cache 1.19.704.902 W srv prompt_save: - saving prompt with length 110, total state size = 156.504 MiB (draft: 0.000 MiB) 1.19.884.996 I srv load: - looking for better prompt, base f_keep = 0.445, sim = 0.710 1.19.885.002 I srv load: - found better prompt with f_keep = 0.460, sim = 0.754 1.19.957.963 I srv update: - cache state: 10 prompts, 3065.173 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 1.19.957.967 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 1.19.957.967 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 1.19.957.968 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 1.19.957.968 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 1.19.957.969 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 1.19.957.969 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 1.19.957.970 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 1.19.957.970 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 1.19.957.971 I srv update: - prompt 0x5a22a45faa40: 102 tokens, checkpoints: 1, 305.630 MiB 1.19.957.971 I srv update: - prompt 0x5a22a444edd0: 110 tokens, checkpoints: 1, 306.130 MiB 1.19.957.973 I srv get_availabl: prompt cache update took 253.10 ms 1.19.958.056 I slot launch_slot_: id 3 | task 950 | processing task, is_child = 0 1.19.958.058 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.19.958.059 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.19.958.074 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.19.958.074 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.19.958.078 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.19.958.079 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.19.958.092 I slot update_slots: id 3 | task 950 | Checking checkpoint with [45, 45] against 52... 1.20.081.436 W slot update_slots: id 3 | task 950 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.22.286.482 I slot print_timing: id 3 | task 950 | prompt eval time = 473.74 ms / 23 tokens ( 20.60 ms per token, 48.55 tokens per second) 1.22.286.486 I slot print_timing: id 3 | task 950 | eval time = 1854.64 ms / 35 tokens ( 52.99 ms per token, 18.87 tokens per second) 1.22.286.486 I slot print_timing: id 3 | task 950 | total time = 2328.39 ms / 58 tokens 1.22.286.487 I slot print_timing: id 3 | task 950 | graphs reused = 895 1.22.286.540 I slot release: id 3 | task 950 | stop processing: n_tokens = 103, truncated = 0 1.22.286.548 I srv update_slots: all slots are idle 1.22.304.146 I srv operator(): Chat format: peg-native 1.22.304.382 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.653 (> 0.100 thold), f_keep = 0.476 1.22.304.384 I srv get_availabl: updating prompt cache 1.22.304.411 W srv prompt_save: - saving prompt with length 103, total state size = 156.066 MiB (draft: 0.000 MiB) 1.22.539.597 I srv load: - looking for better prompt, base f_keep = 0.476, sim = 0.653 1.22.539.609 I srv update: - cache state: 11 prompts, 3370.866 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 1.22.539.611 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 1.22.539.612 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 1.22.539.613 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 1.22.539.613 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 1.22.539.614 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 1.22.539.614 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 1.22.539.615 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 1.22.539.615 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 1.22.539.616 I srv update: - prompt 0x5a22a45faa40: 102 tokens, checkpoints: 1, 305.630 MiB 1.22.539.616 I srv update: - prompt 0x5a22a444edd0: 110 tokens, checkpoints: 1, 306.130 MiB 1.22.539.617 I srv update: - prompt 0x5a22a434f880: 103 tokens, checkpoints: 1, 305.692 MiB 1.22.539.618 I srv get_availabl: prompt cache update took 235.23 ms 1.22.539.700 I slot launch_slot_: id 3 | task 987 | processing task, is_child = 0 1.22.539.702 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.22.539.702 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.22.539.710 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.22.539.710 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.22.539.715 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.22.539.715 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.22.539.728 I slot update_slots: id 3 | task 987 | Checking checkpoint with [45, 45] against 49... 1.22.575.118 W slot update_slots: id 3 | task 987 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.24.320.773 I slot print_timing: id 3 | task 987 | prompt eval time = 427.37 ms / 29 tokens ( 14.74 ms per token, 67.86 tokens per second) 1.24.320.776 I slot print_timing: id 3 | task 987 | eval time = 1353.67 ms / 26 tokens ( 52.06 ms per token, 19.21 tokens per second) 1.24.320.776 I slot print_timing: id 3 | task 987 | total time = 1781.04 ms / 55 tokens 1.24.320.777 I slot print_timing: id 3 | task 987 | graphs reused = 919 1.24.320.806 I slot release: id 3 | task 987 | stop processing: n_tokens = 100, truncated = 0 1.24.320.814 I srv update_slots: all slots are idle 1.24.337.362 I srv operator(): Chat format: peg-native 1.24.337.597 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.662 (> 0.100 thold), f_keep = 0.490 1.24.337.598 I srv get_availabl: updating prompt cache 1.24.337.615 W srv prompt_save: - saving prompt with length 100, total state size = 155.878 MiB (draft: 0.000 MiB) 1.24.525.073 I srv load: - looking for better prompt, base f_keep = 0.490, sim = 0.662 1.24.525.080 I srv load: - found better prompt with f_keep = 0.490, sim = 0.676 1.24.594.110 I srv update: - cache state: 11 prompts, 3370.741 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 1.24.594.115 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 1.24.594.116 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 1.24.594.116 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 1.24.594.117 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 1.24.594.117 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 1.24.594.118 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 1.24.594.118 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 1.24.594.143 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 1.24.594.149 I srv update: - prompt 0x5a22a444edd0: 110 tokens, checkpoints: 1, 306.130 MiB 1.24.594.150 I srv update: - prompt 0x5a22a434f880: 103 tokens, checkpoints: 1, 305.692 MiB 1.24.594.153 I srv update: - prompt 0x5a22a4456d70: 100 tokens, checkpoints: 1, 305.505 MiB 1.24.594.155 I srv get_availabl: prompt cache update took 256.56 ms 1.24.594.246 I slot launch_slot_: id 3 | task 1015 | processing task, is_child = 0 1.24.594.248 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.24.594.249 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.24.594.258 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.24.594.258 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.24.594.262 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.24.594.263 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.24.594.278 I slot update_slots: id 3 | task 1015 | Checking checkpoint with [45, 45] against 50... 1.24.640.486 W slot update_slots: id 3 | task 1015 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.26.184.666 I slot print_timing: id 3 | task 1015 | prompt eval time = 398.66 ms / 28 tokens ( 14.24 ms per token, 70.23 tokens per second) 1.26.184.670 I slot print_timing: id 3 | task 1015 | eval time = 1191.72 ms / 23 tokens ( 51.81 ms per token, 19.30 tokens per second) 1.26.184.670 I slot print_timing: id 3 | task 1015 | total time = 1590.38 ms / 51 tokens 1.26.184.671 I slot print_timing: id 3 | task 1015 | graphs reused = 940 1.26.184.716 I slot release: id 3 | task 1015 | stop processing: n_tokens = 96, truncated = 0 1.26.184.725 I srv update_slots: all slots are idle 1.26.201.246 I srv operator(): Chat format: peg-native 1.26.201.479 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.742 (> 0.100 thold), f_keep = 0.510 1.26.201.523 I slot launch_slot_: id 3 | task 1040 | processing task, is_child = 0 1.26.201.525 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.26.201.526 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.26.201.534 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.26.201.534 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.26.201.540 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.26.201.540 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.26.201.550 I slot update_slots: id 3 | task 1040 | Checking checkpoint with [45, 45] against 49... 1.26.236.766 W slot update_slots: id 3 | task 1040 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.27.088.926 I slot print_timing: id 3 | task 1040 | prompt eval time = 284.66 ms / 20 tokens ( 14.23 ms per token, 70.26 tokens per second) 1.27.088.929 I slot print_timing: id 3 | task 1040 | eval time = 602.71 ms / 12 tokens ( 50.23 ms per token, 19.91 tokens per second) 1.27.088.930 I slot print_timing: id 3 | task 1040 | total time = 887.37 ms / 32 tokens 1.27.088.930 I slot print_timing: id 3 | task 1040 | graphs reused = 950 1.27.089.000 I slot release: id 3 | task 1040 | stop processing: n_tokens = 77, truncated = 0 1.27.089.010 I srv update_slots: all slots are idle 1.27.105.387 I srv operator(): Chat format: peg-native 1.27.105.625 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.710 (> 0.100 thold), f_keep = 0.636 1.27.105.669 I slot launch_slot_: id 3 | task 1054 | processing task, is_child = 0 1.27.105.671 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.27.105.671 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.27.105.678 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.27.105.679 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.27.105.684 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.27.105.685 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.27.105.694 I slot update_slots: id 3 | task 1054 | Checking checkpoint with [45, 45] against 49... 1.27.141.334 W slot update_slots: id 3 | task 1054 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.28.417.814 I slot print_timing: id 3 | task 1054 | prompt eval time = 385.46 ms / 23 tokens ( 16.76 ms per token, 59.67 tokens per second) 1.28.417.818 I slot print_timing: id 3 | task 1054 | eval time = 926.65 ms / 18 tokens ( 51.48 ms per token, 19.42 tokens per second) 1.28.417.818 I slot print_timing: id 3 | task 1054 | total time = 1312.11 ms / 41 tokens 1.28.417.819 I slot print_timing: id 3 | task 1054 | graphs reused = 966 1.28.417.900 I slot release: id 3 | task 1054 | stop processing: n_tokens = 86, truncated = 0 1.28.417.911 I srv update_slots: all slots are idle 1.28.434.697 I srv operator(): Chat format: peg-native 1.28.434.932 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.690 (> 0.100 thold), f_keep = 0.570 1.28.434.978 I slot launch_slot_: id 3 | task 1074 | processing task, is_child = 0 1.28.434.980 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.28.434.981 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.28.434.990 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.28.434.991 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.28.434.996 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.28.434.997 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.28.435.006 I slot update_slots: id 3 | task 1074 | Checking checkpoint with [45, 45] against 49... 1.28.470.644 W slot update_slots: id 3 | task 1074 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.30.285.763 I slot print_timing: id 3 | task 1074 | prompt eval time = 385.81 ms / 25 tokens ( 15.43 ms per token, 64.80 tokens per second) 1.30.285.767 I slot print_timing: id 3 | task 1074 | eval time = 1464.94 ms / 28 tokens ( 52.32 ms per token, 19.11 tokens per second) 1.30.285.767 I slot print_timing: id 3 | task 1074 | total time = 1850.75 ms / 53 tokens 1.30.285.768 I slot print_timing: id 3 | task 1074 | graphs reused = 992 1.30.285.795 I slot release: id 3 | task 1074 | stop processing: n_tokens = 98, truncated = 0 1.30.285.803 I srv update_slots: all slots are idle 1.30.302.914 I srv operator(): Chat format: peg-native 1.30.303.160 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.605 (> 0.100 thold), f_keep = 0.500 1.30.303.219 I slot launch_slot_: id 3 | task 1104 | processing task, is_child = 0 1.30.303.221 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.30.303.222 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.30.303.229 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.30.303.229 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.30.303.235 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.30.303.235 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.30.303.245 I slot update_slots: id 3 | task 1104 | Checking checkpoint with [45, 45] against 49... 1.30.338.715 W slot update_slots: id 3 | task 1104 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.34.799.995 I slot print_timing: id 3 | task 1104 | prompt eval time = 431.39 ms / 35 tokens ( 12.33 ms per token, 81.13 tokens per second) 1.34.799.998 I slot print_timing: id 3 | task 1104 | eval time = 4065.36 ms / 76 tokens ( 53.49 ms per token, 18.69 tokens per second) 1.34.799.999 I slot print_timing: id 3 | task 1104 | total time = 4496.74 ms / 111 tokens 1.34.800.000 I slot print_timing: id 3 | task 1104 | graphs reused = 1066 1.34.800.070 I slot release: id 3 | task 1104 | stop processing: n_tokens = 156, truncated = 0 1.34.800.078 I srv update_slots: all slots are idle 1.34.816.102 I srv operator(): Chat format: peg-native 1.34.816.321 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.685 (> 0.100 thold), f_keep = 0.321 1.34.816.323 I srv get_availabl: updating prompt cache 1.34.816.348 W srv prompt_save: - saving prompt with length 156, total state size = 159.379 MiB (draft: 0.000 MiB) 1.35.014.827 I srv load: - looking for better prompt, base f_keep = 0.321, sim = 0.685 1.35.014.841 I srv update: - cache state: 12 prompts, 3679.746 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 1.35.014.841 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 1.35.014.843 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 1.35.014.844 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 1.35.014.845 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 1.35.014.845 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 1.35.014.846 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 1.35.014.847 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 1.35.014.848 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 1.35.014.848 I srv update: - prompt 0x5a22a444edd0: 110 tokens, checkpoints: 1, 306.130 MiB 1.35.014.849 I srv update: - prompt 0x5a22a434f880: 103 tokens, checkpoints: 1, 305.692 MiB 1.35.014.849 I srv update: - prompt 0x5a22a4456d70: 100 tokens, checkpoints: 1, 305.505 MiB 1.35.014.850 I srv update: - prompt 0x5a22ab31edb0: 156 tokens, checkpoints: 1, 309.006 MiB 1.35.014.852 I srv get_availabl: prompt cache update took 198.53 ms 1.35.014.938 I slot launch_slot_: id 3 | task 1182 | processing task, is_child = 0 1.35.014.940 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.35.014.940 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.35.014.948 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.35.014.948 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.35.014.953 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.35.014.953 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.35.014.968 I slot update_slots: id 3 | task 1182 | Checking checkpoint with [45, 45] against 50... 1.35.050.408 W slot update_slots: id 3 | task 1182 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.39.460.020 I slot print_timing: id 3 | task 1182 | prompt eval time = 387.36 ms / 27 tokens ( 14.35 ms per token, 69.70 tokens per second) 1.39.460.024 I slot print_timing: id 3 | task 1182 | eval time = 4057.69 ms / 76 tokens ( 53.39 ms per token, 18.73 tokens per second) 1.39.460.024 I slot print_timing: id 3 | task 1182 | total time = 4445.05 ms / 103 tokens 1.39.460.025 I slot print_timing: id 3 | task 1182 | graphs reused = 1140 1.39.460.122 I slot release: id 3 | task 1182 | stop processing: n_tokens = 148, truncated = 0 1.39.460.130 I srv update_slots: all slots are idle 1.39.476.709 I srv operator(): Chat format: peg-native 1.39.476.942 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.721 (> 0.100 thold), f_keep = 0.331 1.39.476.944 I srv get_availabl: updating prompt cache 1.39.476.967 W srv prompt_save: - saving prompt with length 148, total state size = 158.879 MiB (draft: 0.000 MiB) 1.39.661.006 I srv load: - looking for better prompt, base f_keep = 0.331, sim = 0.721 1.39.661.017 I srv update: - cache state: 13 prompts, 3988.252 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 1.39.661.018 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 1.39.661.019 I srv update: - prompt 0x5a22a4628470: 126 tokens, checkpoints: 1, 307.130 MiB 1.39.661.022 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 1.39.661.023 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 1.39.661.024 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 1.39.661.024 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 1.39.661.025 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 1.39.661.025 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 1.39.661.028 I srv update: - prompt 0x5a22a444edd0: 110 tokens, checkpoints: 1, 306.130 MiB 1.39.661.029 I srv update: - prompt 0x5a22a434f880: 103 tokens, checkpoints: 1, 305.692 MiB 1.39.661.029 I srv update: - prompt 0x5a22a4456d70: 100 tokens, checkpoints: 1, 305.505 MiB 1.39.661.030 I srv update: - prompt 0x5a22ab31edb0: 156 tokens, checkpoints: 1, 309.006 MiB 1.39.661.030 I srv update: - prompt 0x5a22a3fc71d0: 148 tokens, checkpoints: 1, 308.505 MiB 1.39.661.034 I srv get_availabl: prompt cache update took 184.09 ms 1.39.661.126 I slot launch_slot_: id 3 | task 1260 | processing task, is_child = 0 1.39.661.126 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.39.661.127 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.39.661.135 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.39.661.135 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.39.661.140 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.39.661.140 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.39.661.153 I slot update_slots: id 3 | task 1260 | Checking checkpoint with [45, 45] against 49... 1.39.696.446 W slot update_slots: id 3 | task 1260 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.44.606.868 I slot print_timing: id 3 | task 1260 | prompt eval time = 385.45 ms / 22 tokens ( 17.52 ms per token, 57.08 tokens per second) 1.44.606.872 I slot print_timing: id 3 | task 1260 | eval time = 4560.26 ms / 85 tokens ( 53.65 ms per token, 18.64 tokens per second) 1.44.606.872 I slot print_timing: id 3 | task 1260 | total time = 4945.71 ms / 107 tokens 1.44.606.873 I slot print_timing: id 3 | task 1260 | graphs reused = 1223 1.44.606.925 I slot release: id 3 | task 1260 | stop processing: n_tokens = 152, truncated = 0 1.44.606.935 I srv update_slots: all slots are idle 1.44.623.629 I srv operator(): Chat format: peg-native 1.44.623.847 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.671 (> 0.100 thold), f_keep = 0.322 1.44.623.849 I srv get_availabl: updating prompt cache 1.44.623.869 W srv prompt_save: - saving prompt with length 152, total state size = 159.129 MiB (draft: 0.000 MiB) 1.44.804.435 I srv load: - looking for better prompt, base f_keep = 0.322, sim = 0.671 1.44.804.444 I srv load: - found better prompt with f_keep = 0.397, sim = 0.685 1.44.882.358 I srv update: - cache state: 13 prompts, 3989.877 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 1.44.882.361 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 1.44.882.362 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 1.44.882.363 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 1.44.882.363 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 1.44.882.364 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 1.44.882.364 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 1.44.882.365 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 1.44.882.365 I srv update: - prompt 0x5a22a444edd0: 110 tokens, checkpoints: 1, 306.130 MiB 1.44.882.366 I srv update: - prompt 0x5a22a434f880: 103 tokens, checkpoints: 1, 305.692 MiB 1.44.882.366 I srv update: - prompt 0x5a22a4456d70: 100 tokens, checkpoints: 1, 305.505 MiB 1.44.882.367 I srv update: - prompt 0x5a22ab31edb0: 156 tokens, checkpoints: 1, 309.006 MiB 1.44.882.367 I srv update: - prompt 0x5a22a3fc71d0: 148 tokens, checkpoints: 1, 308.505 MiB 1.44.882.368 I srv update: - prompt 0x5a22a43baed0: 152 tokens, checkpoints: 1, 308.756 MiB 1.44.882.370 I srv get_availabl: prompt cache update took 258.52 ms 1.44.882.458 I slot launch_slot_: id 3 | task 1347 | processing task, is_child = 0 1.44.882.460 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.44.882.461 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.44.882.469 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.44.882.470 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.44.882.474 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.44.882.474 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.44.882.489 I slot update_slots: id 3 | task 1347 | Checking checkpoint with [45, 45] against 50... 1.45.018.317 W slot update_slots: id 3 | task 1347 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.49.970.190 I slot print_timing: id 3 | task 1347 | prompt eval time = 488.02 ms / 27 tokens ( 18.07 ms per token, 55.33 tokens per second) 1.49.970.193 I slot print_timing: id 3 | task 1347 | eval time = 4599.68 ms / 86 tokens ( 53.48 ms per token, 18.70 tokens per second) 1.49.970.194 I slot print_timing: id 3 | task 1347 | total time = 5087.70 ms / 113 tokens 1.49.970.195 I slot print_timing: id 3 | task 1347 | graphs reused = 1307 1.49.970.231 I slot release: id 3 | task 1347 | stop processing: n_tokens = 158, truncated = 0 1.49.970.239 I srv update_slots: all slots are idle 1.49.986.460 I srv operator(): Chat format: peg-native 1.49.986.692 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.658 (> 0.100 thold), f_keep = 0.316 1.49.986.694 I srv get_availabl: updating prompt cache 1.49.986.720 W srv prompt_save: - saving prompt with length 158, total state size = 159.505 MiB (draft: 0.000 MiB) 1.50.178.438 I srv load: - looking for better prompt, base f_keep = 0.316, sim = 0.658 1.50.178.446 I srv load: - found better prompt with f_keep = 0.505, sim = 0.684 1.50.252.095 I srv update: - cache state: 13 prompts, 3993.316 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 1.50.252.100 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 1.50.252.100 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 1.50.252.101 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 1.50.252.101 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 1.50.252.102 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 1.50.252.102 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 1.50.252.103 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 1.50.252.103 I srv update: - prompt 0x5a22a444edd0: 110 tokens, checkpoints: 1, 306.130 MiB 1.50.252.104 I srv update: - prompt 0x5a22a4456d70: 100 tokens, checkpoints: 1, 305.505 MiB 1.50.252.105 I srv update: - prompt 0x5a22ab31edb0: 156 tokens, checkpoints: 1, 309.006 MiB 1.50.252.105 I srv update: - prompt 0x5a22a3fc71d0: 148 tokens, checkpoints: 1, 308.505 MiB 1.50.252.106 I srv update: - prompt 0x5a22a43baed0: 152 tokens, checkpoints: 1, 308.756 MiB 1.50.252.106 I srv update: - prompt 0x5a22a4422ba0: 158 tokens, checkpoints: 1, 309.131 MiB 1.50.252.108 I srv get_availabl: prompt cache update took 265.41 ms 1.50.252.204 I slot launch_slot_: id 3 | task 1435 | processing task, is_child = 0 1.50.252.206 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.50.252.207 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.50.252.217 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.50.252.217 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.50.252.228 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.50.252.228 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.50.252.243 I slot update_slots: id 3 | task 1435 | Checking checkpoint with [45, 45] against 52... 1.50.303.403 W slot update_slots: id 3 | task 1435 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.52.928.496 I slot print_timing: id 3 | task 1435 | prompt eval time = 444.00 ms / 30 tokens ( 14.80 ms per token, 67.57 tokens per second) 1.52.928.500 I slot print_timing: id 3 | task 1435 | eval time = 2232.24 ms / 42 tokens ( 53.15 ms per token, 18.82 tokens per second) 1.52.928.500 I slot print_timing: id 3 | task 1435 | total time = 2676.24 ms / 72 tokens 1.52.928.501 I slot print_timing: id 3 | task 1435 | graphs reused = 1347 1.52.928.544 I slot release: id 3 | task 1435 | stop processing: n_tokens = 117, truncated = 0 1.52.928.557 I srv update_slots: all slots are idle 1.52.945.050 I srv operator(): Chat format: peg-native 1.52.945.290 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.721 (> 0.100 thold), f_keep = 0.419 1.52.945.292 I srv get_availabl: updating prompt cache 1.52.945.312 W srv prompt_save: - saving prompt with length 117, total state size = 156.941 MiB (draft: 0.000 MiB) 1.53.162.747 I srv load: - looking for better prompt, base f_keep = 0.419, sim = 0.721 1.53.162.759 I srv update: - cache state: 14 prompts, 4299.883 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 1.53.162.763 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 1.53.162.764 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 1.53.162.764 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 1.53.162.765 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 1.53.162.765 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 1.53.162.768 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 1.53.162.769 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 1.53.162.770 I srv update: - prompt 0x5a22a444edd0: 110 tokens, checkpoints: 1, 306.130 MiB 1.53.162.770 I srv update: - prompt 0x5a22a4456d70: 100 tokens, checkpoints: 1, 305.505 MiB 1.53.162.771 I srv update: - prompt 0x5a22ab31edb0: 156 tokens, checkpoints: 1, 309.006 MiB 1.53.162.774 I srv update: - prompt 0x5a22a3fc71d0: 148 tokens, checkpoints: 1, 308.505 MiB 1.53.162.774 I srv update: - prompt 0x5a22a43baed0: 152 tokens, checkpoints: 1, 308.756 MiB 1.53.162.775 I srv update: - prompt 0x5a22a4422ba0: 158 tokens, checkpoints: 1, 309.131 MiB 1.53.162.775 I srv update: - prompt 0x5a22ab9728f0: 117 tokens, checkpoints: 1, 306.567 MiB 1.53.162.777 I srv get_availabl: prompt cache update took 217.48 ms 1.53.162.863 I slot launch_slot_: id 3 | task 1479 | processing task, is_child = 0 1.53.162.864 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.53.162.865 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.53.162.873 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.53.162.873 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.53.162.877 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.53.162.878 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.53.162.890 I slot update_slots: id 3 | task 1479 | Checking checkpoint with [45, 45] against 49... 1.53.198.462 W slot update_slots: id 3 | task 1479 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.55.394.170 I slot print_timing: id 3 | task 1479 | prompt eval time = 385.54 ms / 22 tokens ( 17.52 ms per token, 57.06 tokens per second) 1.55.394.174 I slot print_timing: id 3 | task 1479 | eval time = 1845.73 ms / 35 tokens ( 52.74 ms per token, 18.96 tokens per second) 1.55.394.175 I slot print_timing: id 3 | task 1479 | total time = 2231.27 ms / 57 tokens 1.55.394.176 I slot print_timing: id 3 | task 1479 | graphs reused = 1380 1.55.394.211 I slot release: id 3 | task 1479 | stop processing: n_tokens = 102, truncated = 0 1.55.394.221 I srv update_slots: all slots are idle 1.55.410.680 I srv operator(): Chat format: peg-native 1.55.410.916 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.766 (> 0.100 thold), f_keep = 0.480 1.55.410.918 I srv get_availabl: updating prompt cache 1.55.410.938 W srv prompt_save: - saving prompt with length 102, total state size = 156.003 MiB (draft: 0.000 MiB) 1.55.590.514 I srv load: - looking for better prompt, base f_keep = 0.480, sim = 0.766 1.55.590.527 I srv update: - cache state: 15 prompts, 4605.513 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 1.55.590.528 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 1.55.590.529 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 1.55.590.530 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 1.55.590.530 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 1.55.590.531 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 1.55.590.532 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 1.55.590.533 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 1.55.590.534 I srv update: - prompt 0x5a22a444edd0: 110 tokens, checkpoints: 1, 306.130 MiB 1.55.590.534 I srv update: - prompt 0x5a22a4456d70: 100 tokens, checkpoints: 1, 305.505 MiB 1.55.590.535 I srv update: - prompt 0x5a22ab31edb0: 156 tokens, checkpoints: 1, 309.006 MiB 1.55.590.535 I srv update: - prompt 0x5a22a3fc71d0: 148 tokens, checkpoints: 1, 308.505 MiB 1.55.590.536 I srv update: - prompt 0x5a22a43baed0: 152 tokens, checkpoints: 1, 308.756 MiB 1.55.590.536 I srv update: - prompt 0x5a22a4422ba0: 158 tokens, checkpoints: 1, 309.131 MiB 1.55.590.537 I srv update: - prompt 0x5a22ab9728f0: 117 tokens, checkpoints: 1, 306.567 MiB 1.55.590.537 I srv update: - prompt 0x5a22a467cbc0: 102 tokens, checkpoints: 1, 305.630 MiB 1.55.590.539 I srv get_availabl: prompt cache update took 179.62 ms 1.55.590.617 I slot launch_slot_: id 3 | task 1516 | processing task, is_child = 0 1.55.590.618 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.55.590.618 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.55.590.627 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.55.590.627 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.55.590.637 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.55.590.638 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.55.590.650 I slot update_slots: id 3 | task 1516 | Checking checkpoint with [45, 45] against 49... 1.55.626.213 W slot update_slots: id 3 | task 1516 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 1.58.259.861 I slot print_timing: id 3 | task 1516 | prompt eval time = 284.26 ms / 18 tokens ( 15.79 ms per token, 63.32 tokens per second) 1.58.259.866 I slot print_timing: id 3 | task 1516 | eval time = 2384.94 ms / 45 tokens ( 53.00 ms per token, 18.87 tokens per second) 1.58.259.867 I slot print_timing: id 3 | task 1516 | total time = 2669.21 ms / 63 tokens 1.58.259.867 I slot print_timing: id 3 | task 1516 | graphs reused = 1423 1.58.259.896 I slot release: id 3 | task 1516 | stop processing: n_tokens = 108, truncated = 0 1.58.259.904 I srv update_slots: all slots are idle 1.58.276.834 I srv operator(): Chat format: peg-native 1.58.277.077 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.681 (> 0.100 thold), f_keep = 0.454 1.58.277.079 I srv get_availabl: updating prompt cache 1.58.277.096 W srv prompt_save: - saving prompt with length 108, total state size = 156.379 MiB (draft: 0.000 MiB) 1.58.466.288 I srv load: - looking for better prompt, base f_keep = 0.454, sim = 0.681 1.58.466.299 I srv update: - cache state: 16 prompts, 4911.517 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 1.58.466.302 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 1.58.466.303 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 1.58.466.303 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 1.58.466.304 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 1.58.466.304 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 1.58.466.307 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 1.58.466.308 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 1.58.466.308 I srv update: - prompt 0x5a22a444edd0: 110 tokens, checkpoints: 1, 306.130 MiB 1.58.466.309 I srv update: - prompt 0x5a22a4456d70: 100 tokens, checkpoints: 1, 305.505 MiB 1.58.466.309 I srv update: - prompt 0x5a22ab31edb0: 156 tokens, checkpoints: 1, 309.006 MiB 1.58.466.310 I srv update: - prompt 0x5a22a3fc71d0: 148 tokens, checkpoints: 1, 308.505 MiB 1.58.466.313 I srv update: - prompt 0x5a22a43baed0: 152 tokens, checkpoints: 1, 308.756 MiB 1.58.466.313 I srv update: - prompt 0x5a22a4422ba0: 158 tokens, checkpoints: 1, 309.131 MiB 1.58.466.314 I srv update: - prompt 0x5a22ab9728f0: 117 tokens, checkpoints: 1, 306.567 MiB 1.58.466.314 I srv update: - prompt 0x5a22a467cbc0: 102 tokens, checkpoints: 1, 305.630 MiB 1.58.466.315 I srv update: - prompt 0x5a22a43df090: 108 tokens, checkpoints: 1, 306.005 MiB 1.58.466.316 I srv get_availabl: prompt cache update took 189.24 ms 1.58.466.399 I slot launch_slot_: id 3 | task 1563 | processing task, is_child = 0 1.58.466.401 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 1.58.466.401 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 1.58.466.410 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 1.58.466.411 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 1.58.466.415 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 1.58.466.415 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 1.58.466.427 I slot update_slots: id 3 | task 1563 | Checking checkpoint with [45, 45] against 49... 1.58.501.577 W slot update_slots: id 3 | task 1563 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 2.03.026.161 I slot print_timing: id 3 | task 1563 | prompt eval time = 386.54 ms / 26 tokens ( 14.87 ms per token, 67.26 tokens per second) 2.03.026.165 I slot print_timing: id 3 | task 1563 | eval time = 4173.19 ms / 78 tokens ( 53.50 ms per token, 18.69 tokens per second) 2.03.026.165 I slot print_timing: id 3 | task 1563 | total time = 4559.73 ms / 104 tokens 2.03.026.166 I slot print_timing: id 3 | task 1563 | graphs reused = 1499 2.03.026.204 I slot release: id 3 | task 1563 | stop processing: n_tokens = 149, truncated = 0 2.03.026.211 I srv update_slots: all slots are idle 2.03.042.580 I srv operator(): Chat format: peg-native 2.03.042.812 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.721 (> 0.100 thold), f_keep = 0.329 2.03.042.814 I srv get_availabl: updating prompt cache 2.03.042.836 W srv prompt_save: - saving prompt with length 149, total state size = 158.942 MiB (draft: 0.000 MiB) 2.03.226.234 I srv load: - looking for better prompt, base f_keep = 0.329, sim = 0.721 2.03.226.242 I srv load: - found better prompt with f_keep = 0.444, sim = 0.765 2.03.298.095 I srv update: - cache state: 16 prompts, 4913.518 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 2.03.298.099 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 2.03.298.100 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 2.03.298.101 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 2.03.298.101 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 2.03.298.102 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 2.03.298.103 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 2.03.298.104 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 2.03.298.104 I srv update: - prompt 0x5a22a444edd0: 110 tokens, checkpoints: 1, 306.130 MiB 2.03.298.105 I srv update: - prompt 0x5a22a4456d70: 100 tokens, checkpoints: 1, 305.505 MiB 2.03.298.106 I srv update: - prompt 0x5a22ab31edb0: 156 tokens, checkpoints: 1, 309.006 MiB 2.03.298.106 I srv update: - prompt 0x5a22a3fc71d0: 148 tokens, checkpoints: 1, 308.505 MiB 2.03.298.107 I srv update: - prompt 0x5a22a43baed0: 152 tokens, checkpoints: 1, 308.756 MiB 2.03.298.109 I srv update: - prompt 0x5a22a4422ba0: 158 tokens, checkpoints: 1, 309.131 MiB 2.03.298.110 I srv update: - prompt 0x5a22a467cbc0: 102 tokens, checkpoints: 1, 305.630 MiB 2.03.298.110 I srv update: - prompt 0x5a22a43df090: 108 tokens, checkpoints: 1, 306.005 MiB 2.03.298.111 I srv update: - prompt 0x5a22a4172d10: 149 tokens, checkpoints: 1, 308.568 MiB 2.03.298.112 I srv get_availabl: prompt cache update took 255.30 ms 2.03.298.200 I slot launch_slot_: id 3 | task 1643 | processing task, is_child = 0 2.03.298.200 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 2.03.298.201 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 2.03.298.212 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 2.03.298.212 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 2.03.298.217 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 2.03.298.218 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 2.03.298.232 I slot update_slots: id 3 | task 1643 | Checking checkpoint with [45, 45] against 52... 2.03.346.673 W slot update_slots: id 3 | task 1643 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 2.07.436.410 I slot print_timing: id 3 | task 1643 | prompt eval time = 398.97 ms / 22 tokens ( 18.13 ms per token, 55.14 tokens per second) 2.07.436.414 I slot print_timing: id 3 | task 1643 | eval time = 3739.21 ms / 70 tokens ( 53.42 ms per token, 18.72 tokens per second) 2.07.436.415 I slot print_timing: id 3 | task 1643 | total time = 4138.17 ms / 92 tokens 2.07.436.415 I slot print_timing: id 3 | task 1643 | graphs reused = 1567 2.07.436.483 I slot release: id 3 | task 1643 | stop processing: n_tokens = 137, truncated = 0 2.07.436.492 I srv update_slots: all slots are idle 2.07.452.784 I srv operator(): Chat format: peg-native 2.07.453.016 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.746 (> 0.100 thold), f_keep = 0.365 2.07.453.017 I srv get_availabl: updating prompt cache 2.07.453.039 W srv prompt_save: - saving prompt with length 137, total state size = 158.192 MiB (draft: 0.000 MiB) 2.07.685.145 I srv load: - looking for better prompt, base f_keep = 0.365, sim = 0.746 2.07.685.158 I srv update: - cache state: 17 prompts, 5221.336 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 2.07.685.159 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 2.07.685.160 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 2.07.685.161 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 2.07.685.165 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 2.07.685.165 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 2.07.685.166 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 2.07.685.167 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 2.07.685.167 I srv update: - prompt 0x5a22a444edd0: 110 tokens, checkpoints: 1, 306.130 MiB 2.07.685.168 I srv update: - prompt 0x5a22a4456d70: 100 tokens, checkpoints: 1, 305.505 MiB 2.07.685.169 I srv update: - prompt 0x5a22ab31edb0: 156 tokens, checkpoints: 1, 309.006 MiB 2.07.685.170 I srv update: - prompt 0x5a22a3fc71d0: 148 tokens, checkpoints: 1, 308.505 MiB 2.07.685.170 I srv update: - prompt 0x5a22a43baed0: 152 tokens, checkpoints: 1, 308.756 MiB 2.07.685.171 I srv update: - prompt 0x5a22a4422ba0: 158 tokens, checkpoints: 1, 309.131 MiB 2.07.685.171 I srv update: - prompt 0x5a22a467cbc0: 102 tokens, checkpoints: 1, 305.630 MiB 2.07.685.172 I srv update: - prompt 0x5a22a43df090: 108 tokens, checkpoints: 1, 306.005 MiB 2.07.685.172 I srv update: - prompt 0x5a22a4172d10: 149 tokens, checkpoints: 1, 308.568 MiB 2.07.685.173 I srv update: - prompt 0x5a229894b3e0: 137 tokens, checkpoints: 1, 307.818 MiB 2.07.685.174 I srv get_availabl: prompt cache update took 232.16 ms 2.07.685.258 I slot launch_slot_: id 3 | task 1715 | processing task, is_child = 0 2.07.685.259 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 2.07.685.259 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 2.07.685.268 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 2.07.685.268 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 2.07.685.279 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 2.07.685.279 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 2.07.685.298 I slot update_slots: id 3 | task 1715 | Checking checkpoint with [45, 45] against 50... 2.07.720.592 W slot update_slots: id 3 | task 1715 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 2.10.731.385 I slot print_timing: id 3 | task 1715 | prompt eval time = 385.21 ms / 21 tokens ( 18.34 ms per token, 54.52 tokens per second) 2.10.731.388 I slot print_timing: id 3 | task 1715 | eval time = 2660.87 ms / 50 tokens ( 53.22 ms per token, 18.79 tokens per second) 2.10.731.389 I slot print_timing: id 3 | task 1715 | total time = 3046.08 ms / 71 tokens 2.10.731.390 I slot print_timing: id 3 | task 1715 | graphs reused = 1615 2.10.731.456 I slot release: id 3 | task 1715 | stop processing: n_tokens = 116, truncated = 0 2.10.731.465 I srv update_slots: all slots are idle 2.10.748.438 I srv operator(): Chat format: peg-native 2.10.748.689 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.700 (> 0.100 thold), f_keep = 0.422 2.10.748.691 I srv get_availabl: updating prompt cache 2.10.748.714 W srv prompt_save: - saving prompt with length 116, total state size = 156.879 MiB (draft: 0.000 MiB) 2.10.929.851 I srv load: - looking for better prompt, base f_keep = 0.422, sim = 0.700 2.10.929.860 I srv load: - found better prompt with f_keep = 0.500, sim = 0.714 2.10.999.801 I srv update: - cache state: 17 prompts, 5222.336 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 2.10.999.804 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 2.10.999.805 I srv update: - prompt 0x5a22a42dff50: 125 tokens, checkpoints: 1, 307.068 MiB 2.10.999.805 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 2.10.999.806 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 2.10.999.806 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 2.10.999.807 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 2.10.999.807 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 2.10.999.808 I srv update: - prompt 0x5a22a444edd0: 110 tokens, checkpoints: 1, 306.130 MiB 2.10.999.808 I srv update: - prompt 0x5a22ab31edb0: 156 tokens, checkpoints: 1, 309.006 MiB 2.10.999.809 I srv update: - prompt 0x5a22a3fc71d0: 148 tokens, checkpoints: 1, 308.505 MiB 2.10.999.809 I srv update: - prompt 0x5a22a43baed0: 152 tokens, checkpoints: 1, 308.756 MiB 2.10.999.810 I srv update: - prompt 0x5a22a4422ba0: 158 tokens, checkpoints: 1, 309.131 MiB 2.10.999.810 I srv update: - prompt 0x5a22a467cbc0: 102 tokens, checkpoints: 1, 305.630 MiB 2.10.999.811 I srv update: - prompt 0x5a22a43df090: 108 tokens, checkpoints: 1, 306.005 MiB 2.10.999.811 I srv update: - prompt 0x5a22a4172d10: 149 tokens, checkpoints: 1, 308.568 MiB 2.10.999.812 I srv update: - prompt 0x5a229894b3e0: 137 tokens, checkpoints: 1, 307.818 MiB 2.10.999.812 I srv update: - prompt 0x5a22ab839450: 116 tokens, checkpoints: 1, 306.505 MiB 2.10.999.813 I srv get_availabl: prompt cache update took 251.12 ms 2.10.999.908 I slot launch_slot_: id 3 | task 1767 | processing task, is_child = 0 2.10.999.909 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 2.10.999.909 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 2.10.999.919 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 2.10.999.919 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 2.10.999.923 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 2.10.999.924 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 2.10.999.937 I slot update_slots: id 3 | task 1767 | Checking checkpoint with [45, 45] against 50... 2.11.045.355 W slot update_slots: id 3 | task 1767 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 2.14.382.236 I slot print_timing: id 3 | task 1767 | prompt eval time = 395.94 ms / 24 tokens ( 16.50 ms per token, 60.61 tokens per second) 2.14.382.241 I slot print_timing: id 3 | task 1767 | eval time = 2986.35 ms / 56 tokens ( 53.33 ms per token, 18.75 tokens per second) 2.14.382.242 I slot print_timing: id 3 | task 1767 | total time = 3382.29 ms / 80 tokens 2.14.382.242 I slot print_timing: id 3 | task 1767 | graphs reused = 1669 2.14.382.324 I slot release: id 3 | task 1767 | stop processing: n_tokens = 125, truncated = 0 2.14.382.333 I srv update_slots: all slots are idle 2.14.398.385 I srv operator(): Chat format: peg-native 2.14.398.616 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.742 (> 0.100 thold), f_keep = 0.392 2.14.398.618 I srv get_availabl: updating prompt cache 2.14.398.640 W srv prompt_save: - saving prompt with length 125, total state size = 157.441 MiB (draft: 0.000 MiB) 2.14.591.243 I srv load: - looking for better prompt, base f_keep = 0.392, sim = 0.742 2.14.591.252 I srv load: - found better prompt with f_keep = 0.408, sim = 0.773 2.14.669.343 I srv update: - cache state: 17 prompts, 5222.336 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est) 2.14.669.346 I srv update: - prompt 0x5a22a463f020: 133 tokens, checkpoints: 1, 307.568 MiB 2.14.669.347 I srv update: - prompt 0x5a22a44c3f60: 131 tokens, checkpoints: 1, 307.443 MiB 2.14.669.347 I srv update: - prompt 0x5a22a4121b10: 104 tokens, checkpoints: 1, 305.755 MiB 2.14.669.348 I srv update: - prompt 0x5a22a455bba0: 121 tokens, checkpoints: 1, 306.817 MiB 2.14.669.348 I srv update: - prompt 0x5a22ab30fd70: 108 tokens, checkpoints: 1, 306.005 MiB 2.14.669.349 I srv update: - prompt 0x5a22ab995e40: 102 tokens, checkpoints: 1, 305.630 MiB 2.14.669.349 I srv update: - prompt 0x5a22a444edd0: 110 tokens, checkpoints: 1, 306.130 MiB 2.14.669.350 I srv update: - prompt 0x5a22ab31edb0: 156 tokens, checkpoints: 1, 309.006 MiB 2.14.669.350 I srv update: - prompt 0x5a22a3fc71d0: 148 tokens, checkpoints: 1, 308.505 MiB 2.14.669.351 I srv update: - prompt 0x5a22a43baed0: 152 tokens, checkpoints: 1, 308.756 MiB 2.14.669.352 I srv update: - prompt 0x5a22a4422ba0: 158 tokens, checkpoints: 1, 309.131 MiB 2.14.669.352 I srv update: - prompt 0x5a22a467cbc0: 102 tokens, checkpoints: 1, 305.630 MiB 2.14.669.353 I srv update: - prompt 0x5a22a43df090: 108 tokens, checkpoints: 1, 306.005 MiB 2.14.669.353 I srv update: - prompt 0x5a22a4172d10: 149 tokens, checkpoints: 1, 308.568 MiB 2.14.669.354 I srv update: - prompt 0x5a229894b3e0: 137 tokens, checkpoints: 1, 307.818 MiB 2.14.669.358 I srv update: - prompt 0x5a22ab839450: 116 tokens, checkpoints: 1, 306.505 MiB 2.14.669.359 I srv update: - prompt 0x5a22a4199f00: 125 tokens, checkpoints: 1, 307.068 MiB 2.14.669.360 I srv get_availabl: prompt cache update took 270.74 ms 2.14.669.440 I slot launch_slot_: id 3 | task 1825 | processing task, is_child = 0 2.14.669.440 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 2.14.669.441 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 2.14.669.450 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 2.14.669.450 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 2.14.669.455 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 2.14.669.455 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 2.14.669.468 I slot update_slots: id 3 | task 1825 | Checking checkpoint with [45, 45] against 51... 2.14.799.433 W slot update_slots: id 3 | task 1825 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 149.626 MiB) 2.18.783.900 I slot print_timing: id 3 | task 1825 | prompt eval time = 380.50 ms / 20 tokens ( 19.03 ms per token, 52.56 tokens per second) 2.18.783.903 I slot print_timing: id 3 | task 1825 | eval time = 3733.92 ms / 70 tokens ( 53.34 ms per token, 18.75 tokens per second) 2.18.783.904 I slot print_timing: id 3 | task 1825 | total time = 4114.43 ms / 90 tokens 2.18.783.905 I slot print_timing: id 3 | task 1825 | graphs reused = 1737 2.18.783.966 I slot release: id 3 | task 1825 | stop processing: n_tokens = 135, truncated = 0 2.18.783.977 I srv update_slots: all slots are idle 2.18.785.619 I srv operator(): operator(): cleaning up before exit...