0.00.064.750 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg)
0.00.064.753 I device_info:
0.00.064.773 I   - ROCm0   : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.064.778 I   - ROCm1   : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.064.785 I   - CPU     : AMD Ryzen 9 3900X 12-Core Processor (128730 MiB, 128730 MiB free)
0.00.064.845 I system_info: n_threads = 12 (n_threads_batch = 12) / 24 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | 
0.00.064.848 I srv  llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true
0.00.064.885 I srv          init: running without SSL
0.00.064.946 I srv          init: using 23 threads for HTTP server
0.00.065.269 I srv         start: binding port with default address family
0.00.066.473 I srv  llama_server: loading model
0.00.066.480 I srv    load_model: loading model '/home/qrf/.cache/llama.cpp/nvidia_Nemotron-3-Super-120B-A12B-Q4_K_M/nvidia_Nemotron-3-Super-120B-A12B-Q4_K_M-00001-of-00003.gguf'
0.00.066.526 I common_init_result: fitting params to device memory ...
0.00.066.528 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on)
0.07.700.291 W llama_model_loader: tensor overrides to CPU are used with mmap enabled - consider using --no-mmap for better performance
1.11.831.033 W llama_context: n_ctx_seq (8192) < n_ctx_train (1048576) -- the full capacity of the model will not be utilized
1.12.053.812 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
1.12.339.090 I srv    load_model: initializing slots, n_slots = 4
1.12.482.925 W srv    load_model: speculative decoding will use checkpoints
1.12.482.944 W common_speculative_init: no implementations specified for speculative decoding
1.12.482.945 I slot   load_model: id  0 | task -1 | new slot, n_ctx = 8192
1.12.482.949 I slot   load_model: id  1 | task -1 | new slot, n_ctx = 8192
1.12.482.950 I slot   load_model: id  2 | task -1 | new slot, n_ctx = 8192
1.12.482.950 I slot   load_model: id  3 | task -1 | new slot, n_ctx = 8192
1.12.483.052 I srv    load_model: prompt cache is enabled, size limit: 8192 MiB
1.12.483.055 I srv    load_model: use `--cache-ram 0` to disable the prompt cache
1.12.483.055 I srv    load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391
1.12.483.055 I srv    load_model: context checkpoints enabled, max = 32, min spacing = 256
1.12.483.079 I srv          init: idle slots will be saved to prompt cache and cleared upon starting a new task
1.12.520.374 I init: chat template, example_format: '<|im_start|>system
You are a helpful assistant<|im_end|>
<|im_start|>user
Hello<|im_end|>
<|im_start|>assistant
<think></think>Hi there<|im_end|>
<|im_start|>user
How are you?<|im_end|>
<|im_start|>assistant
<think>
'
1.12.550.074 I srv          init: init: chat template, thinking = 1
1.12.550.684 I srv  llama_server: model loaded
1.12.550.689 I srv  llama_server: server is listening on http://127.0.0.1:8090
1.12.550.695 I srv  update_slots: all slots are idle
1.15.026.834 I srv    operator(): Chat format: peg-native
1.15.027.119 I slot get_availabl: id  3 | task -1 | selected slot by LRU, t_last = -1
1.15.027.122 I srv  get_availabl: updating prompt cache
1.15.027.130 I srv          load:  - looking for better prompt, base f_keep = -1.000, sim = 0.000
1.15.027.135 I srv        update:  - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 8192 tokens, 8589934592 est)
1.15.027.139 I srv  get_availabl: prompt cache update took 0.02 ms
1.15.027.231 I slot launch_slot_: id  3 | task 0 | processing task, is_child = 0
1.15.027.234 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.15.027.235 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.15.027.248 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.15.027.249 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.15.027.255 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.15.027.255 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.21.127.390 I slot print_timing: id  3 | task 0 | prompt processing, n_tokens =     46, progress = 0.61, t =   6.10 s / 7.54 tokens per second
1.21.293.915 I slot create_check: id  3 | task 0 | created context checkpoint 1 of 32 (pos_min = 45, pos_max = 45, n_tokens = 46, size = 164.688 MiB)
1.21.931.273 I slot print_timing: id  3 | task 0 | prompt processing, n_tokens =     71, progress = 0.95, t =   6.90 s / 10.28 tokens per second
1.25.418.628 I slot print_timing: id  3 | task 0 | prompt eval time =    7062.03 ms /    75 tokens (   94.16 ms per token,    10.62 tokens per second)
1.25.418.633 I slot print_timing: id  3 | task 0 |        eval time =    3329.31 ms /    51 tokens (   65.28 ms per token,    15.32 tokens per second)
1.25.418.634 I slot print_timing: id  3 | task 0 |       total time =   10391.34 ms /   126 tokens
1.25.418.639 I slot print_timing: id  3 | task 0 |    graphs reused =         50
1.25.418.703 I slot      release: id  3 | task 0 | stop processing: n_tokens = 125, truncated = 0
1.25.418.714 I srv  update_slots: all slots are idle
1.25.450.745 I srv    operator(): Chat format: peg-native
1.25.450.984 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.742 (> 0.100 thold), f_keep = 0.392
1.25.450.986 I srv  get_availabl: updating prompt cache
1.25.451.024 W srv   prompt_save:  - saving prompt with length 125, total state size = 165.667 MiB (draft: 0.000 MiB)
1.25.726.812 I srv          load:  - looking for better prompt, base f_keep = 0.392, sim = 0.742
1.25.726.817 I srv        update:  - cache state: 1 prompts, 330.355 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.25.726.818 I srv        update:    - prompt 0x603e552aa360:     125 tokens, checkpoints:  1,   330.355 MiB
1.25.726.820 I srv  get_availabl: prompt cache update took 275.83 ms
1.25.726.915 I slot launch_slot_: id  3 | task 54 | processing task, is_child = 0
1.25.726.917 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.25.726.918 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.25.726.926 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.25.726.926 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.25.726.935 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.25.726.936 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.25.726.947 I slot update_slots: id  3 | task 54 | Checking checkpoint with [45, 45] against 49...
1.25.757.920 W slot update_slots: id  3 | task 54 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
1.29.062.577 I slot print_timing: id  3 | task 54 | prompt eval time =     582.48 ms /    20 tokens (   29.12 ms per token,    34.34 tokens per second)
1.29.062.584 I slot print_timing: id  3 | task 54 |        eval time =    2753.14 ms /    43 tokens (   64.03 ms per token,    15.62 tokens per second)
1.29.062.585 I slot print_timing: id  3 | task 54 |       total time =    3335.62 ms /    63 tokens
1.29.062.585 I slot print_timing: id  3 | task 54 |    graphs reused =         91
1.29.062.621 I slot      release: id  3 | task 54 | stop processing: n_tokens = 108, truncated = 0
1.29.062.634 I srv  update_slots: all slots are idle
1.29.093.832 I srv    operator(): Chat format: peg-native
1.29.094.053 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.710 (> 0.100 thold), f_keep = 0.454
1.29.094.054 I srv  get_availabl: updating prompt cache
1.29.094.073 W srv   prompt_save:  - saving prompt with length 108, total state size = 165.534 MiB (draft: 0.000 MiB)
1.29.295.129 I srv          load:  - looking for better prompt, base f_keep = 0.454, sim = 0.710
1.29.295.135 I srv        update:  - cache state: 2 prompts, 660.577 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.29.295.136 I srv        update:    - prompt 0x603e552aa360:     125 tokens, checkpoints:  1,   330.355 MiB
1.29.295.137 I srv        update:    - prompt 0x603e55329c90:     108 tokens, checkpoints:  1,   330.222 MiB
1.29.295.138 I srv  get_availabl: prompt cache update took 201.08 ms
1.29.295.235 I slot launch_slot_: id  3 | task 99 | processing task, is_child = 0
1.29.295.237 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.29.295.237 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.29.295.244 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.29.295.245 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.29.295.249 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.29.295.249 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.29.295.261 I slot update_slots: id  3 | task 99 | Checking checkpoint with [45, 45] against 49...
1.29.325.997 W slot update_slots: id  3 | task 99 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
1.34.702.076 I slot print_timing: id  3 | task 99 | prompt eval time =     681.11 ms /    23 tokens (   29.61 ms per token,    33.77 tokens per second)
1.34.702.083 I slot print_timing: id  3 | task 99 |        eval time =    4725.69 ms /    73 tokens (   64.74 ms per token,    15.45 tokens per second)
1.34.702.083 I slot print_timing: id  3 | task 99 |       total time =    5406.80 ms /    96 tokens
1.34.702.084 I slot print_timing: id  3 | task 99 |    graphs reused =        162
1.34.702.115 I slot      release: id  3 | task 99 | stop processing: n_tokens = 141, truncated = 0
1.34.702.132 I srv  update_slots: all slots are idle
1.34.732.124 I srv    operator(): Chat format: peg-native
1.34.732.346 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.735 (> 0.100 thold), f_keep = 0.355
1.34.732.347 I srv  get_availabl: updating prompt cache
1.34.732.368 W srv   prompt_save:  - saving prompt with length 141, total state size = 165.792 MiB (draft: 0.000 MiB)
1.34.942.040 I srv          load:  - looking for better prompt, base f_keep = 0.355, sim = 0.735
1.34.942.048 I srv        update:  - cache state: 3 prompts, 991.057 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.34.942.049 I srv        update:    - prompt 0x603e552aa360:     125 tokens, checkpoints:  1,   330.355 MiB
1.34.942.049 I srv        update:    - prompt 0x603e55329c90:     108 tokens, checkpoints:  1,   330.222 MiB
1.34.942.050 I srv        update:    - prompt 0x603e5556f790:     141 tokens, checkpoints:  1,   330.480 MiB
1.34.942.051 I srv  get_availabl: prompt cache update took 209.70 ms
1.34.942.151 I slot launch_slot_: id  3 | task 174 | processing task, is_child = 0
1.34.942.152 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.34.942.153 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.34.942.161 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.34.942.162 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.34.942.166 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.34.942.166 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.34.942.178 I slot update_slots: id  3 | task 174 | Checking checkpoint with [45, 45] against 50...
1.34.972.706 W slot update_slots: id  3 | task 174 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
1.37.947.317 I slot print_timing: id  3 | task 174 | prompt eval time =     691.08 ms /    22 tokens (   31.41 ms per token,    31.83 tokens per second)
1.37.947.322 I slot print_timing: id  3 | task 174 |        eval time =    2314.05 ms /    36 tokens (   64.28 ms per token,    15.56 tokens per second)
1.37.947.323 I slot print_timing: id  3 | task 174 |       total time =    3005.13 ms /    58 tokens
1.37.947.324 I slot print_timing: id  3 | task 174 |    graphs reused =        196
1.37.947.351 I slot      release: id  3 | task 174 | stop processing: n_tokens = 103, truncated = 0
1.37.947.365 I srv  update_slots: all slots are idle
1.37.978.866 I srv    operator(): Chat format: peg-native
1.37.979.111 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.714 (> 0.100 thold), f_keep = 0.485
1.37.979.114 I srv  get_availabl: updating prompt cache
1.37.979.138 W srv   prompt_save:  - saving prompt with length 103, total state size = 165.495 MiB (draft: 0.000 MiB)
1.38.177.148 I srv          load:  - looking for better prompt, base f_keep = 0.485, sim = 0.714
1.38.177.156 I srv        update:  - cache state: 4 prompts, 1321.240 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.38.177.157 I srv        update:    - prompt 0x603e552aa360:     125 tokens, checkpoints:  1,   330.355 MiB
1.38.177.157 I srv        update:    - prompt 0x603e55329c90:     108 tokens, checkpoints:  1,   330.222 MiB
1.38.177.158 I srv        update:    - prompt 0x603e5556f790:     141 tokens, checkpoints:  1,   330.480 MiB
1.38.177.162 I srv        update:    - prompt 0x603e55659950:     103 tokens, checkpoints:  1,   330.183 MiB
1.38.177.163 I srv  get_availabl: prompt cache update took 198.05 ms
1.38.177.256 I slot launch_slot_: id  3 | task 212 | processing task, is_child = 0
1.38.177.258 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.38.177.259 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.38.177.266 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.38.177.267 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.38.177.271 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.38.177.271 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.38.177.283 I slot update_slots: id  3 | task 212 | Checking checkpoint with [45, 45] against 50...
1.38.207.835 W slot update_slots: id  3 | task 212 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
1.39.011.663 I slot print_timing: id  3 | task 212 | prompt eval time =     691.62 ms /    24 tokens (   28.82 ms per token,    34.70 tokens per second)
1.39.011.667 I slot print_timing: id  3 | task 212 |        eval time =     142.75 ms /     3 tokens (   47.58 ms per token,    21.02 tokens per second)
1.39.011.667 I slot print_timing: id  3 | task 212 |       total time =     834.37 ms /    27 tokens
1.39.011.668 I slot print_timing: id  3 | task 212 |    graphs reused =        197
1.39.011.703 I slot      release: id  3 | task 212 | stop processing: n_tokens = 72, truncated = 0
1.39.011.715 I srv  update_slots: all slots are idle
1.39.042.239 I srv    operator(): Chat format: peg-native
1.39.042.460 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.721 (> 0.100 thold), f_keep = 0.681
1.39.042.511 I slot launch_slot_: id  3 | task 217 | processing task, is_child = 0
1.39.042.512 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.39.042.513 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.39.042.521 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.39.042.521 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.39.042.525 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.39.042.526 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.39.042.533 I slot update_slots: id  3 | task 217 | Checking checkpoint with [45, 45] against 49...
1.39.073.463 W slot update_slots: id  3 | task 217 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
1.40.456.291 I slot print_timing: id  3 | task 217 | prompt eval time =     677.77 ms /    22 tokens (   30.81 ms per token,    32.46 tokens per second)
1.40.456.297 I slot print_timing: id  3 | task 217 |        eval time =     735.97 ms /    12 tokens (   61.33 ms per token,    16.30 tokens per second)
1.40.456.298 I slot print_timing: id  3 | task 217 |       total time =    1413.74 ms /    34 tokens
1.40.456.299 I slot print_timing: id  3 | task 217 |    graphs reused =        207
1.40.456.326 I slot      release: id  3 | task 217 | stop processing: n_tokens = 79, truncated = 0
1.40.456.342 I srv  update_slots: all slots are idle
1.40.487.110 I srv    operator(): Chat format: peg-native
1.40.487.345 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.662 (> 0.100 thold), f_keep = 0.620
1.40.487.395 I slot launch_slot_: id  3 | task 231 | processing task, is_child = 0
1.40.487.396 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.40.487.397 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.40.487.405 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.40.487.405 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.40.487.409 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.40.487.409 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.40.487.417 I slot update_slots: id  3 | task 231 | Checking checkpoint with [45, 45] against 49...
1.40.518.412 W slot update_slots: id  3 | task 231 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
1.43.232.615 I slot print_timing: id  3 | task 231 | prompt eval time =     753.28 ms /    28 tokens (   26.90 ms per token,    37.17 tokens per second)
1.43.232.622 I slot print_timing: id  3 | task 231 |        eval time =    1991.90 ms /    31 tokens (   64.25 ms per token,    15.56 tokens per second)
1.43.232.623 I slot print_timing: id  3 | task 231 |       total time =    2745.18 ms /    59 tokens
1.43.232.624 I slot print_timing: id  3 | task 231 |    graphs reused =        236
1.43.232.664 I slot      release: id  3 | task 231 | stop processing: n_tokens = 104, truncated = 0
1.43.232.679 I srv  update_slots: all slots are idle
1.43.264.454 I srv    operator(): Chat format: peg-native
1.43.264.708 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.781 (> 0.100 thold), f_keep = 0.481
1.43.264.711 I srv  get_availabl: updating prompt cache
1.43.264.742 W srv   prompt_save:  - saving prompt with length 104, total state size = 165.502 MiB (draft: 0.000 MiB)
1.43.469.537 I srv          load:  - looking for better prompt, base f_keep = 0.481, sim = 0.781
1.43.469.544 I srv        update:  - cache state: 5 prompts, 1651.431 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.43.469.545 I srv        update:    - prompt 0x603e552aa360:     125 tokens, checkpoints:  1,   330.355 MiB
1.43.469.546 I srv        update:    - prompt 0x603e55329c90:     108 tokens, checkpoints:  1,   330.222 MiB
1.43.469.546 I srv        update:    - prompt 0x603e5556f790:     141 tokens, checkpoints:  1,   330.480 MiB
1.43.469.547 I srv        update:    - prompt 0x603e55659950:     103 tokens, checkpoints:  1,   330.183 MiB
1.43.469.548 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
1.43.469.549 I srv  get_availabl: prompt cache update took 204.84 ms
1.43.469.659 I slot launch_slot_: id  3 | task 264 | processing task, is_child = 0
1.43.469.660 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.43.469.661 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.43.469.668 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.43.469.668 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.43.469.672 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.43.469.672 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.43.469.685 I slot update_slots: id  3 | task 264 | Checking checkpoint with [45, 45] against 50...
1.43.500.555 W slot update_slots: id  3 | task 264 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
1.50.269.385 I slot print_timing: id  3 | task 264 | prompt eval time =     567.12 ms /    18 tokens (   31.51 ms per token,    31.74 tokens per second)
1.50.269.391 I slot print_timing: id  3 | task 264 |        eval time =    6232.57 ms /    94 tokens (   66.30 ms per token,    15.08 tokens per second)
1.50.269.391 I slot print_timing: id  3 | task 264 |       total time =    6799.69 ms /   112 tokens
1.50.269.392 I slot print_timing: id  3 | task 264 |    graphs reused =        328
1.50.269.422 I slot      release: id  3 | task 264 | stop processing: n_tokens = 157, truncated = 0
1.50.269.434 I srv  update_slots: all slots are idle
1.50.299.251 I srv    operator(): Chat format: peg-native
1.50.299.474 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.662 (> 0.100 thold), f_keep = 0.312
1.50.299.476 I srv  get_availabl: updating prompt cache
1.50.299.499 W srv   prompt_save:  - saving prompt with length 157, total state size = 165.917 MiB (draft: 0.000 MiB)
1.50.485.741 I srv          load:  - looking for better prompt, base f_keep = 0.312, sim = 0.662
1.50.485.746 I srv          load:  - found better prompt with f_keep = 0.463, sim = 0.676
1.50.547.660 I srv        update:  - cache state: 5 prompts, 1651.814 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.50.547.663 I srv        update:    - prompt 0x603e552aa360:     125 tokens, checkpoints:  1,   330.355 MiB
1.50.547.664 I srv        update:    - prompt 0x603e5556f790:     141 tokens, checkpoints:  1,   330.480 MiB
1.50.547.665 I srv        update:    - prompt 0x603e55659950:     103 tokens, checkpoints:  1,   330.183 MiB
1.50.547.665 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
1.50.547.666 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
1.50.547.667 I srv  get_availabl: prompt cache update took 248.19 ms
1.50.547.783 I slot launch_slot_: id  3 | task 360 | processing task, is_child = 0
1.50.547.785 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.50.547.786 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.50.547.795 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.50.547.795 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.50.547.800 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.50.547.801 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.50.547.815 I slot update_slots: id  3 | task 360 | Checking checkpoint with [45, 45] against 50...
1.50.641.432 W slot update_slots: id  3 | task 360 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
1.53.015.410 I slot print_timing: id  3 | task 360 | prompt eval time =     804.17 ms /    28 tokens (   28.72 ms per token,    34.82 tokens per second)
1.53.015.417 I slot print_timing: id  3 | task 360 |        eval time =    1663.41 ms /    26 tokens (   63.98 ms per token,    15.63 tokens per second)
1.53.015.418 I slot print_timing: id  3 | task 360 |       total time =    2467.58 ms /    54 tokens
1.53.015.418 I slot print_timing: id  3 | task 360 |    graphs reused =        352
1.53.015.449 I slot      release: id  3 | task 360 | stop processing: n_tokens = 99, truncated = 0
1.53.015.463 I srv  update_slots: all slots are idle
1.53.044.914 I srv    operator(): Chat format: peg-native
1.53.045.138 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.710 (> 0.100 thold), f_keep = 0.495
1.53.045.140 I srv  get_availabl: updating prompt cache
1.53.045.161 W srv   prompt_save:  - saving prompt with length 99, total state size = 165.463 MiB (draft: 0.000 MiB)
1.53.248.514 I srv          load:  - looking for better prompt, base f_keep = 0.495, sim = 0.710
1.53.248.522 I srv        update:  - cache state: 6 prompts, 1981.966 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.53.248.523 I srv        update:    - prompt 0x603e552aa360:     125 tokens, checkpoints:  1,   330.355 MiB
1.53.248.523 I srv        update:    - prompt 0x603e5556f790:     141 tokens, checkpoints:  1,   330.480 MiB
1.53.248.524 I srv        update:    - prompt 0x603e55659950:     103 tokens, checkpoints:  1,   330.183 MiB
1.53.248.525 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
1.53.248.529 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
1.53.248.529 I srv        update:    - prompt 0x603e55548d50:      99 tokens, checkpoints:  1,   330.152 MiB
1.53.248.530 I srv  get_availabl: prompt cache update took 203.39 ms
1.53.248.640 I slot launch_slot_: id  3 | task 388 | processing task, is_child = 0
1.53.248.640 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.53.248.641 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.53.248.649 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.53.248.649 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.53.248.653 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.53.248.653 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.53.248.665 I slot update_slots: id  3 | task 388 | Checking checkpoint with [45, 45] against 49...
1.53.279.289 W slot update_slots: id  3 | task 388 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
1.59.736.244 I slot print_timing: id  3 | task 388 | prompt eval time =     697.89 ms /    23 tokens (   30.34 ms per token,    32.96 tokens per second)
1.59.736.248 I slot print_timing: id  3 | task 388 |        eval time =    5789.68 ms /    88 tokens (   65.79 ms per token,    15.20 tokens per second)
1.59.736.248 I slot print_timing: id  3 | task 388 |       total time =    6487.56 ms /   111 tokens
1.59.736.249 I slot print_timing: id  3 | task 388 |    graphs reused =        438
1.59.736.278 I slot      release: id  3 | task 388 | stop processing: n_tokens = 156, truncated = 0
1.59.736.291 I srv  update_slots: all slots are idle
1.59.765.795 I srv    operator(): Chat format: peg-native
1.59.766.019 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.662 (> 0.100 thold), f_keep = 0.314
1.59.766.021 I srv  get_availabl: updating prompt cache
1.59.766.051 W srv   prompt_save:  - saving prompt with length 156, total state size = 165.909 MiB (draft: 0.000 MiB)
1.59.938.922 I srv          load:  - looking for better prompt, base f_keep = 0.314, sim = 0.662
1.59.938.931 I srv        update:  - cache state: 7 prompts, 2312.564 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.59.938.932 I srv        update:    - prompt 0x603e552aa360:     125 tokens, checkpoints:  1,   330.355 MiB
1.59.938.936 I srv        update:    - prompt 0x603e5556f790:     141 tokens, checkpoints:  1,   330.480 MiB
1.59.938.937 I srv        update:    - prompt 0x603e55659950:     103 tokens, checkpoints:  1,   330.183 MiB
1.59.938.937 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
1.59.938.938 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
1.59.938.938 I srv        update:    - prompt 0x603e55548d50:      99 tokens, checkpoints:  1,   330.152 MiB
1.59.938.939 I srv        update:    - prompt 0x603e556a7000:     156 tokens, checkpoints:  1,   330.598 MiB
1.59.938.940 I srv  get_availabl: prompt cache update took 172.92 ms
1.59.939.038 I slot launch_slot_: id  3 | task 478 | processing task, is_child = 0
1.59.939.039 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
1.59.939.040 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
1.59.939.050 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
1.59.939.050 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
1.59.939.063 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
1.59.939.063 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
1.59.939.086 I slot update_slots: id  3 | task 478 | Checking checkpoint with [45, 45] against 49...
1.59.969.944 W slot update_slots: id  3 | task 478 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.02.451.123 I slot print_timing: id  3 | task 478 | prompt eval time =     760.87 ms /    28 tokens (   27.17 ms per token,    36.80 tokens per second)
2.02.451.127 I slot print_timing: id  3 | task 478 |        eval time =    1751.16 ms /    27 tokens (   64.86 ms per token,    15.42 tokens per second)
2.02.451.128 I slot print_timing: id  3 | task 478 |       total time =    2512.02 ms /    55 tokens
2.02.451.129 I slot print_timing: id  3 | task 478 |    graphs reused =        463
2.02.451.158 I slot      release: id  3 | task 478 | stop processing: n_tokens = 100, truncated = 0
2.02.451.173 I srv  update_slots: all slots are idle
2.02.483.734 I srv    operator(): Chat format: peg-native
2.02.483.974 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.710 (> 0.100 thold), f_keep = 0.490
2.02.483.976 I srv  get_availabl: updating prompt cache
2.02.484.002 W srv   prompt_save:  - saving prompt with length 100, total state size = 165.471 MiB (draft: 0.000 MiB)
2.02.656.623 I srv          load:  - looking for better prompt, base f_keep = 0.490, sim = 0.710
2.02.656.633 I srv        update:  - cache state: 8 prompts, 2642.723 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
2.02.656.640 I srv        update:    - prompt 0x603e552aa360:     125 tokens, checkpoints:  1,   330.355 MiB
2.02.656.642 I srv        update:    - prompt 0x603e5556f790:     141 tokens, checkpoints:  1,   330.480 MiB
2.02.656.642 I srv        update:    - prompt 0x603e55659950:     103 tokens, checkpoints:  1,   330.183 MiB
2.02.656.643 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
2.02.656.643 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
2.02.656.644 I srv        update:    - prompt 0x603e55548d50:      99 tokens, checkpoints:  1,   330.152 MiB
2.02.656.644 I srv        update:    - prompt 0x603e556a7000:     156 tokens, checkpoints:  1,   330.598 MiB
2.02.656.645 I srv        update:    - prompt 0x603e555b8140:     100 tokens, checkpoints:  1,   330.159 MiB
2.02.656.647 I srv  get_availabl: prompt cache update took 172.67 ms
2.02.656.755 I slot launch_slot_: id  3 | task 507 | processing task, is_child = 0
2.02.656.756 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.02.656.757 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.02.656.766 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.02.656.767 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.02.656.778 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.02.656.778 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.02.656.792 I slot update_slots: id  3 | task 507 | Checking checkpoint with [45, 45] against 49...
2.02.687.525 W slot update_slots: id  3 | task 507 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.06.106.185 I slot print_timing: id  3 | task 507 | prompt eval time =     690.14 ms /    23 tokens (   30.01 ms per token,    33.33 tokens per second)
2.06.106.191 I slot print_timing: id  3 | task 507 |        eval time =    2759.23 ms /    42 tokens (   65.70 ms per token,    15.22 tokens per second)
2.06.106.192 I slot print_timing: id  3 | task 507 |       total time =    3449.38 ms /    65 tokens
2.06.106.193 I slot print_timing: id  3 | task 507 |    graphs reused =        503
2.06.106.223 I slot      release: id  3 | task 507 | stop processing: n_tokens = 110, truncated = 0
2.06.106.238 I srv  update_slots: all slots are idle
2.06.138.127 I srv    operator(): Chat format: peg-native
2.06.138.347 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.690 (> 0.100 thold), f_keep = 0.445
2.06.138.349 I srv  get_availabl: updating prompt cache
2.06.138.368 W srv   prompt_save:  - saving prompt with length 110, total state size = 165.549 MiB (draft: 0.000 MiB)
2.06.310.991 I srv          load:  - looking for better prompt, base f_keep = 0.445, sim = 0.690
2.06.311.000 I srv        update:  - cache state: 9 prompts, 2972.961 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
2.06.311.001 I srv        update:    - prompt 0x603e552aa360:     125 tokens, checkpoints:  1,   330.355 MiB
2.06.311.002 I srv        update:    - prompt 0x603e5556f790:     141 tokens, checkpoints:  1,   330.480 MiB
2.06.311.003 I srv        update:    - prompt 0x603e55659950:     103 tokens, checkpoints:  1,   330.183 MiB
2.06.311.004 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
2.06.311.005 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
2.06.311.005 I srv        update:    - prompt 0x603e55548d50:      99 tokens, checkpoints:  1,   330.152 MiB
2.06.311.006 I srv        update:    - prompt 0x603e556a7000:     156 tokens, checkpoints:  1,   330.598 MiB
2.06.311.006 I srv        update:    - prompt 0x603e555b8140:     100 tokens, checkpoints:  1,   330.159 MiB
2.06.311.006 I srv        update:    - prompt 0x603e556c5d60:     110 tokens, checkpoints:  1,   330.238 MiB
2.06.311.008 I srv  get_availabl: prompt cache update took 172.66 ms
2.06.311.122 I slot launch_slot_: id  3 | task 551 | processing task, is_child = 0
2.06.311.125 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.06.311.126 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.06.311.134 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.06.311.135 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.06.311.139 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.06.311.140 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.06.311.153 I slot update_slots: id  3 | task 551 | Checking checkpoint with [45, 45] against 49...
2.06.341.960 W slot update_slots: id  3 | task 551 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.08.241.279 I slot print_timing: id  3 | task 551 | prompt eval time =     721.30 ms /    25 tokens (   28.85 ms per token,    34.66 tokens per second)
2.08.241.286 I slot print_timing: id  3 | task 551 |        eval time =    1208.81 ms /    19 tokens (   63.62 ms per token,    15.72 tokens per second)
2.08.241.286 I slot print_timing: id  3 | task 551 |       total time =    1930.11 ms /    44 tokens
2.08.241.287 I slot print_timing: id  3 | task 551 |    graphs reused =        520
2.08.241.316 I slot      release: id  3 | task 551 | stop processing: n_tokens = 89, truncated = 0
2.08.241.328 I srv  update_slots: all slots are idle
2.08.272.169 I srv    operator(): Chat format: peg-native
2.08.272.400 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.700 (> 0.100 thold), f_keep = 0.551
2.08.272.454 I slot launch_slot_: id  3 | task 572 | processing task, is_child = 0
2.08.272.456 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.08.272.456 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.08.272.464 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.08.272.464 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.08.272.468 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.08.272.468 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.08.272.476 I slot update_slots: id  3 | task 572 | Checking checkpoint with [45, 45] against 49...
2.08.303.393 W slot update_slots: id  3 | task 572 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.14.188.473 I slot print_timing: id  3 | task 572 | prompt eval time =     696.00 ms /    24 tokens (   29.00 ms per token,    34.48 tokens per second)
2.14.188.482 I slot print_timing: id  3 | task 572 |        eval time =    5219.99 ms /    79 tokens (   66.08 ms per token,    15.13 tokens per second)
2.14.188.482 I slot print_timing: id  3 | task 572 |       total time =    5915.98 ms /   103 tokens
2.14.188.483 I slot print_timing: id  3 | task 572 |    graphs reused =        597
2.14.188.517 I slot      release: id  3 | task 572 | stop processing: n_tokens = 148, truncated = 0
2.14.188.530 I srv  update_slots: all slots are idle
2.14.219.940 I srv    operator(): Chat format: peg-native
2.14.220.185 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.681 (> 0.100 thold), f_keep = 0.331
2.14.220.187 I srv  get_availabl: updating prompt cache
2.14.220.214 W srv   prompt_save:  - saving prompt with length 148, total state size = 165.847 MiB (draft: 0.000 MiB)
2.14.397.613 I srv          load:  - looking for better prompt, base f_keep = 0.331, sim = 0.681
2.14.397.619 I srv          load:  - found better prompt with f_keep = 0.400, sim = 0.694
2.14.461.624 I srv        update:  - cache state: 9 prompts, 2973.141 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
2.14.461.629 I srv        update:    - prompt 0x603e5556f790:     141 tokens, checkpoints:  1,   330.480 MiB
2.14.461.630 I srv        update:    - prompt 0x603e55659950:     103 tokens, checkpoints:  1,   330.183 MiB
2.14.461.662 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
2.14.461.673 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
2.14.461.674 I srv        update:    - prompt 0x603e55548d50:      99 tokens, checkpoints:  1,   330.152 MiB
2.14.461.678 I srv        update:    - prompt 0x603e556a7000:     156 tokens, checkpoints:  1,   330.598 MiB
2.14.461.679 I srv        update:    - prompt 0x603e555b8140:     100 tokens, checkpoints:  1,   330.159 MiB
2.14.461.680 I srv        update:    - prompt 0x603e556c5d60:     110 tokens, checkpoints:  1,   330.238 MiB
2.14.461.681 I srv        update:    - prompt 0x603e555ed3d0:     148 tokens, checkpoints:  1,   330.535 MiB
2.14.461.682 I srv  get_availabl: prompt cache update took 241.49 ms
2.14.461.794 I slot launch_slot_: id  3 | task 653 | processing task, is_child = 0
2.14.461.796 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.14.461.797 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.14.461.807 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.14.461.807 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.14.461.813 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.14.461.813 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.14.461.826 I slot update_slots: id  3 | task 653 | Checking checkpoint with [45, 45] against 50...
2.14.586.560 W slot update_slots: id  3 | task 653 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.16.574.227 I slot print_timing: id  3 | task 653 | prompt eval time =     824.85 ms /    26 tokens (   31.72 ms per token,    31.52 tokens per second)
2.16.574.233 I slot print_timing: id  3 | task 653 |        eval time =    1287.54 ms /    20 tokens (   64.38 ms per token,    15.53 tokens per second)
2.16.574.233 I slot print_timing: id  3 | task 653 |       total time =    2112.39 ms /    46 tokens
2.16.574.234 I slot print_timing: id  3 | task 653 |    graphs reused =        615
2.16.574.263 I slot      release: id  3 | task 653 | stop processing: n_tokens = 91, truncated = 0
2.16.574.276 I srv  update_slots: all slots are idle
2.16.605.922 I srv    operator(): Chat format: peg-native
2.16.606.160 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.721 (> 0.100 thold), f_keep = 0.538
2.16.606.249 I slot launch_slot_: id  3 | task 675 | processing task, is_child = 0
2.16.606.251 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.16.606.252 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.16.606.260 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.16.606.261 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.16.606.273 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.16.606.273 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.16.606.284 I slot update_slots: id  3 | task 675 | Checking checkpoint with [45, 45] against 49...
2.16.637.260 W slot update_slots: id  3 | task 675 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.18.032.619 I slot print_timing: id  3 | task 675 | prompt eval time =     677.20 ms /    22 tokens (   30.78 ms per token,    32.49 tokens per second)
2.18.032.623 I slot print_timing: id  3 | task 675 |        eval time =     749.12 ms /    12 tokens (   62.43 ms per token,    16.02 tokens per second)
2.18.032.624 I slot print_timing: id  3 | task 675 |       total time =    1426.32 ms /    34 tokens
2.18.032.624 I slot print_timing: id  3 | task 675 |    graphs reused =        625
2.18.032.654 I slot      release: id  3 | task 675 | stop processing: n_tokens = 79, truncated = 0
2.18.032.666 I srv  update_slots: all slots are idle
2.18.064.083 I srv    operator(): Chat format: peg-native
2.18.064.323 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.681 (> 0.100 thold), f_keep = 0.620
2.18.064.410 I slot launch_slot_: id  3 | task 689 | processing task, is_child = 0
2.18.064.413 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.18.064.414 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.18.064.424 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.18.064.425 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.18.064.430 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.18.064.431 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.18.064.441 I slot update_slots: id  3 | task 689 | Checking checkpoint with [45, 45] against 49...
2.18.095.521 W slot update_slots: id  3 | task 689 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.21.331.768 I slot print_timing: id  3 | task 689 | prompt eval time =     717.32 ms /    26 tokens (   27.59 ms per token,    36.25 tokens per second)
2.21.331.774 I slot print_timing: id  3 | task 689 |        eval time =    2549.99 ms /    39 tokens (   65.38 ms per token,    15.29 tokens per second)
2.21.331.775 I slot print_timing: id  3 | task 689 |       total time =    3267.31 ms /    65 tokens
2.21.331.775 I slot print_timing: id  3 | task 689 |    graphs reused =        662
2.21.331.803 I slot      release: id  3 | task 689 | stop processing: n_tokens = 110, truncated = 0
2.21.331.816 I srv  update_slots: all slots are idle
2.21.363.187 I srv    operator(): Chat format: peg-native
2.21.363.431 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.731 (> 0.100 thold), f_keep = 0.445
2.21.363.433 I srv  get_availabl: updating prompt cache
2.21.363.463 W srv   prompt_save:  - saving prompt with length 110, total state size = 165.549 MiB (draft: 0.000 MiB)
2.21.636.637 I srv          load:  - looking for better prompt, base f_keep = 0.445, sim = 0.731
2.21.636.642 I srv          load:  - found better prompt with f_keep = 0.505, sim = 0.746
2.21.700.650 I srv        update:  - cache state: 9 prompts, 2973.227 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
2.21.700.655 I srv        update:    - prompt 0x603e5556f790:     141 tokens, checkpoints:  1,   330.480 MiB
2.21.700.656 I srv        update:    - prompt 0x603e55659950:     103 tokens, checkpoints:  1,   330.183 MiB
2.21.700.657 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
2.21.700.657 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
2.21.700.658 I srv        update:    - prompt 0x603e556a7000:     156 tokens, checkpoints:  1,   330.598 MiB
2.21.700.659 I srv        update:    - prompt 0x603e555b8140:     100 tokens, checkpoints:  1,   330.159 MiB
2.21.700.659 I srv        update:    - prompt 0x603e556c5d60:     110 tokens, checkpoints:  1,   330.238 MiB
2.21.700.660 I srv        update:    - prompt 0x603e555ed3d0:     148 tokens, checkpoints:  1,   330.535 MiB
2.21.700.661 I srv        update:    - prompt 0x603e556c8e70:     110 tokens, checkpoints:  1,   330.238 MiB
2.21.700.663 I srv  get_availabl: prompt cache update took 337.23 ms
2.21.700.780 I slot launch_slot_: id  3 | task 730 | processing task, is_child = 0
2.21.700.781 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.21.700.782 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.21.700.791 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.21.700.791 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.21.700.796 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.21.700.797 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.21.700.811 I slot update_slots: id  3 | task 730 | Checking checkpoint with [45, 45] against 50...
2.21.743.524 W slot update_slots: id  3 | task 730 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.26.771.719 I slot print_timing: id  3 | task 730 | prompt eval time =     675.17 ms /    21 tokens (   32.15 ms per token,    31.10 tokens per second)
2.26.771.727 I slot print_timing: id  3 | task 730 |        eval time =    4395.73 ms /    67 tokens (   65.61 ms per token,    15.24 tokens per second)
2.26.771.727 I slot print_timing: id  3 | task 730 |       total time =    5070.89 ms /    88 tokens
2.26.771.728 I slot print_timing: id  3 | task 730 |    graphs reused =        727
2.26.771.759 I slot      release: id  3 | task 730 | stop processing: n_tokens = 133, truncated = 0
2.26.771.772 I srv  update_slots: all slots are idle
2.26.803.994 I srv    operator(): Chat format: peg-native
2.26.804.234 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.742 (> 0.100 thold), f_keep = 0.368
2.26.804.236 I srv  get_availabl: updating prompt cache
2.26.804.257 W srv   prompt_save:  - saving prompt with length 133, total state size = 165.729 MiB (draft: 0.000 MiB)
2.27.012.824 I srv          load:  - looking for better prompt, base f_keep = 0.368, sim = 0.742
2.27.012.831 I srv          load:  - found better prompt with f_keep = 0.485, sim = 0.758
2.27.074.206 I srv        update:  - cache state: 9 prompts, 2973.462 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
2.27.074.210 I srv        update:    - prompt 0x603e5556f790:     141 tokens, checkpoints:  1,   330.480 MiB
2.27.074.210 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
2.27.074.211 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
2.27.074.212 I srv        update:    - prompt 0x603e556a7000:     156 tokens, checkpoints:  1,   330.598 MiB
2.27.074.212 I srv        update:    - prompt 0x603e555b8140:     100 tokens, checkpoints:  1,   330.159 MiB
2.27.074.213 I srv        update:    - prompt 0x603e556c5d60:     110 tokens, checkpoints:  1,   330.238 MiB
2.27.074.213 I srv        update:    - prompt 0x603e555ed3d0:     148 tokens, checkpoints:  1,   330.535 MiB
2.27.074.214 I srv        update:    - prompt 0x603e556c8e70:     110 tokens, checkpoints:  1,   330.238 MiB
2.27.074.214 I srv        update:    - prompt 0x603e553306d0:     133 tokens, checkpoints:  1,   330.418 MiB
2.27.074.216 I srv  get_availabl: prompt cache update took 269.98 ms
2.27.074.365 I slot launch_slot_: id  3 | task 799 | processing task, is_child = 0
2.27.074.368 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.27.074.369 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.27.074.378 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.27.074.378 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.27.074.383 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.27.074.383 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.27.074.397 I slot update_slots: id  3 | task 799 | Checking checkpoint with [45, 45] against 50...
2.27.127.054 W slot update_slots: id  3 | task 799 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.28.361.295 I slot print_timing: id  3 | task 799 | prompt eval time =     601.18 ms /    20 tokens (   30.06 ms per token,    33.27 tokens per second)
2.28.361.300 I slot print_timing: id  3 | task 799 |        eval time =     685.70 ms /    11 tokens (   62.34 ms per token,    16.04 tokens per second)
2.28.361.301 I slot print_timing: id  3 | task 799 |       total time =    1286.88 ms /    31 tokens
2.28.361.302 I slot print_timing: id  3 | task 799 |    graphs reused =        736
2.28.361.330 I slot      release: id  3 | task 799 | stop processing: n_tokens = 76, truncated = 0
2.28.361.342 I srv  update_slots: all slots are idle
2.28.392.729 I srv    operator(): Chat format: peg-native
2.28.392.968 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.769 (> 0.100 thold), f_keep = 0.658
2.28.393.065 I slot launch_slot_: id  3 | task 812 | processing task, is_child = 0
2.28.393.067 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.28.393.068 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.28.393.078 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.28.393.079 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.28.393.085 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.28.393.085 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.28.393.098 I slot update_slots: id  3 | task 812 | Checking checkpoint with [45, 45] against 50...
2.28.424.196 W slot update_slots: id  3 | task 812 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.29.699.594 I slot print_timing: id  3 | task 812 | prompt eval time =     561.84 ms /    19 tokens (   29.57 ms per token,    33.82 tokens per second)
2.29.699.600 I slot print_timing: id  3 | task 812 |        eval time =     744.64 ms /    12 tokens (   62.05 ms per token,    16.12 tokens per second)
2.29.699.601 I slot print_timing: id  3 | task 812 |       total time =    1306.48 ms /    31 tokens
2.29.699.602 I slot print_timing: id  3 | task 812 |    graphs reused =        746
2.29.699.631 I slot      release: id  3 | task 812 | stop processing: n_tokens = 76, truncated = 0
2.29.699.643 I srv  update_slots: all slots are idle
2.29.731.535 I srv    operator(): Chat format: peg-native
2.29.731.782 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.766 (> 0.100 thold), f_keep = 0.645
2.29.731.862 I slot launch_slot_: id  3 | task 826 | processing task, is_child = 0
2.29.731.864 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.29.731.865 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.29.731.873 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.29.731.873 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.29.731.880 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.29.731.880 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.29.731.892 I slot update_slots: id  3 | task 826 | Checking checkpoint with [45, 45] against 49...
2.29.763.030 W slot update_slots: id  3 | task 826 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.31.100.491 I slot print_timing: id  3 | task 826 | prompt eval time =     558.62 ms /    18 tokens (   31.03 ms per token,    32.22 tokens per second)
2.31.100.495 I slot print_timing: id  3 | task 826 |        eval time =     809.97 ms /    13 tokens (   62.30 ms per token,    16.05 tokens per second)
2.31.100.496 I slot print_timing: id  3 | task 826 |       total time =    1368.59 ms /    31 tokens
2.31.100.496 I slot print_timing: id  3 | task 826 |    graphs reused =        757
2.31.100.523 I slot      release: id  3 | task 826 | stop processing: n_tokens = 76, truncated = 0
2.31.100.536 I srv  update_slots: all slots are idle
2.31.131.476 I srv    operator(): Chat format: peg-native
2.31.131.721 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.710 (> 0.100 thold), f_keep = 0.645
2.31.131.784 I slot launch_slot_: id  3 | task 841 | processing task, is_child = 0
2.31.131.786 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.31.131.786 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.31.131.795 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.31.131.796 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.31.131.801 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.31.131.801 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.31.131.810 I slot update_slots: id  3 | task 841 | Checking checkpoint with [45, 45] against 49...
2.31.163.082 W slot update_slots: id  3 | task 841 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.32.641.406 I slot print_timing: id  3 | task 841 | prompt eval time =     688.35 ms /    23 tokens (   29.93 ms per token,    33.41 tokens per second)
2.32.641.411 I slot print_timing: id  3 | task 841 |        eval time =     821.23 ms /    13 tokens (   63.17 ms per token,    15.83 tokens per second)
2.32.641.412 I slot print_timing: id  3 | task 841 |       total time =    1509.58 ms /    36 tokens
2.32.641.413 I slot print_timing: id  3 | task 841 |    graphs reused =        768
2.32.641.448 I slot      release: id  3 | task 841 | stop processing: n_tokens = 81, truncated = 0
2.32.641.461 I srv  update_slots: all slots are idle
2.32.671.188 I srv    operator(): Chat format: peg-native
2.32.671.409 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.721 (> 0.100 thold), f_keep = 0.605
2.32.671.482 I slot launch_slot_: id  3 | task 856 | processing task, is_child = 0
2.32.671.484 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.32.671.484 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.32.671.493 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.32.671.493 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.32.671.499 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.32.671.500 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.32.671.512 I slot update_slots: id  3 | task 856 | Checking checkpoint with [45, 45] against 49...
2.32.702.777 W slot update_slots: id  3 | task 856 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.34.453.688 I slot print_timing: id  3 | task 856 | prompt eval time =     695.25 ms /    22 tokens (   31.60 ms per token,    31.64 tokens per second)
2.34.453.693 I slot print_timing: id  3 | task 856 |        eval time =    1086.92 ms /    17 tokens (   63.94 ms per token,    15.64 tokens per second)
2.34.453.694 I slot print_timing: id  3 | task 856 |       total time =    1782.16 ms /    39 tokens
2.34.453.695 I slot print_timing: id  3 | task 856 |    graphs reused =        783
2.34.453.724 I slot      release: id  3 | task 856 | stop processing: n_tokens = 84, truncated = 0
2.34.453.735 I srv  update_slots: all slots are idle
2.34.484.498 I srv    operator(): Chat format: peg-native
2.34.484.743 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.662 (> 0.100 thold), f_keep = 0.583
2.34.484.808 I slot launch_slot_: id  3 | task 875 | processing task, is_child = 0
2.34.484.810 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.34.484.810 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.34.484.819 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.34.484.819 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.34.484.825 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.34.484.825 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.34.484.835 I slot update_slots: id  3 | task 875 | Checking checkpoint with [45, 45] against 49...
2.34.516.078 W slot update_slots: id  3 | task 875 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.36.803.839 I slot print_timing: id  3 | task 875 | prompt eval time =     758.78 ms /    28 tokens (   27.10 ms per token,    36.90 tokens per second)
2.36.803.845 I slot print_timing: id  3 | task 875 |        eval time =    1560.21 ms /    24 tokens (   65.01 ms per token,    15.38 tokens per second)
2.36.803.846 I slot print_timing: id  3 | task 875 |       total time =    2318.99 ms /    52 tokens
2.36.803.847 I slot print_timing: id  3 | task 875 |    graphs reused =        805
2.36.803.884 I slot      release: id  3 | task 875 | stop processing: n_tokens = 97, truncated = 0
2.36.803.896 I srv  update_slots: all slots are idle
2.36.835.881 I srv    operator(): Chat format: peg-native
2.36.836.123 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.671 (> 0.100 thold), f_keep = 0.505
2.36.836.171 I slot launch_slot_: id  3 | task 901 | processing task, is_child = 0
2.36.836.174 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.36.836.174 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.36.836.182 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.36.836.182 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.36.836.186 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.36.836.187 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.36.836.194 I slot update_slots: id  3 | task 901 | Checking checkpoint with [45, 45] against 49...
2.36.867.408 W slot update_slots: id  3 | task 901 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.38.862.531 I slot print_timing: id  3 | task 901 | prompt eval time =     755.59 ms /    27 tokens (   27.98 ms per token,    35.73 tokens per second)
2.38.862.538 I slot print_timing: id  3 | task 901 |        eval time =    1270.74 ms /    20 tokens (   63.54 ms per token,    15.74 tokens per second)
2.38.862.538 I slot print_timing: id  3 | task 901 |       total time =    2026.32 ms /    47 tokens
2.38.862.539 I slot print_timing: id  3 | task 901 |    graphs reused =        823
2.38.862.573 I slot      release: id  3 | task 901 | stop processing: n_tokens = 92, truncated = 0
2.38.862.593 I srv  update_slots: all slots are idle
2.38.893.000 I srv    operator(): Chat format: peg-native
2.38.893.231 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.766 (> 0.100 thold), f_keep = 0.533
2.38.893.284 I slot launch_slot_: id  3 | task 923 | processing task, is_child = 0
2.38.893.285 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.38.893.286 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.38.893.295 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.38.893.295 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.38.893.299 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.38.893.299 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.38.893.307 I slot update_slots: id  3 | task 923 | Checking checkpoint with [45, 45] against 49...
2.38.924.358 W slot update_slots: id  3 | task 923 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.39.990.699 I slot print_timing: id  3 | task 923 | prompt eval time =     556.25 ms /    18 tokens (   30.90 ms per token,    32.36 tokens per second)
2.39.990.703 I slot print_timing: id  3 | task 923 |        eval time =     541.13 ms /     9 tokens (   60.13 ms per token,    16.63 tokens per second)
2.39.990.704 I slot print_timing: id  3 | task 923 |       total time =    1097.38 ms /    27 tokens
2.39.990.704 I slot print_timing: id  3 | task 923 |    graphs reused =        830
2.39.990.735 I slot      release: id  3 | task 923 | stop processing: n_tokens = 72, truncated = 0
2.39.990.748 I srv  update_slots: all slots are idle
2.40.019.945 I srv    operator(): Chat format: peg-native
2.40.020.178 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.721 (> 0.100 thold), f_keep = 0.681
2.40.020.239 I slot launch_slot_: id  3 | task 934 | processing task, is_child = 0
2.40.020.241 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.40.020.242 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.40.020.250 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.40.020.250 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.40.020.255 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.40.020.256 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.40.020.265 I slot update_slots: id  3 | task 934 | Checking checkpoint with [45, 45] against 49...
2.40.051.433 W slot update_slots: id  3 | task 934 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.42.232.782 I slot print_timing: id  3 | task 934 | prompt eval time =     685.31 ms /    22 tokens (   31.15 ms per token,    32.10 tokens per second)
2.42.232.790 I slot print_timing: id  3 | task 934 |        eval time =    1527.19 ms /    24 tokens (   63.63 ms per token,    15.72 tokens per second)
2.42.232.790 I slot print_timing: id  3 | task 934 |       total time =    2212.50 ms /    46 tokens
2.42.232.791 I slot print_timing: id  3 | task 934 |    graphs reused =        852
2.42.232.823 I slot      release: id  3 | task 934 | stop processing: n_tokens = 91, truncated = 0
2.42.232.839 I srv  update_slots: all slots are idle
2.42.262.137 I srv    operator(): Chat format: peg-native
2.42.262.372 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.700 (> 0.100 thold), f_keep = 0.538
2.42.262.437 I slot launch_slot_: id  3 | task 960 | processing task, is_child = 0
2.42.262.439 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.42.262.440 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.42.262.448 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.42.262.449 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.42.262.454 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.42.262.454 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.42.262.464 I slot update_slots: id  3 | task 960 | Checking checkpoint with [45, 45] against 49...
2.42.293.847 W slot update_slots: id  3 | task 960 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.44.040.397 I slot print_timing: id  3 | task 960 | prompt eval time =     711.50 ms /    24 tokens (   29.65 ms per token,    33.73 tokens per second)
2.44.040.404 I slot print_timing: id  3 | task 960 |        eval time =    1066.42 ms /    17 tokens (   62.73 ms per token,    15.94 tokens per second)
2.44.040.405 I slot print_timing: id  3 | task 960 |       total time =    1777.92 ms /    41 tokens
2.44.040.406 I slot print_timing: id  3 | task 960 |    graphs reused =        867
2.44.040.435 I slot      release: id  3 | task 960 | stop processing: n_tokens = 86, truncated = 0
2.44.040.447 I srv  update_slots: all slots are idle
2.44.069.309 I srv    operator(): Chat format: peg-native
2.44.069.541 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.605 (> 0.100 thold), f_keep = 0.570
2.44.069.611 I slot launch_slot_: id  3 | task 979 | processing task, is_child = 0
2.44.069.613 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
2.44.069.614 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
2.44.069.624 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
2.44.069.624 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
2.44.069.629 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
2.44.069.629 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
2.44.069.639 I slot update_slots: id  3 | task 979 | Checking checkpoint with [45, 45] against 49...
2.44.101.059 W slot update_slots: id  3 | task 979 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
2.51.503.460 I slot print_timing: id  3 | task 979 | n_decoded =    100, tg =  15.31 t/s, tg_3s =  15.31 t/s
2.54.561.509 I slot print_timing: id  3 | task 979 | n_decoded =    147, tg =  15.33 t/s, tg_3s =  15.37 t/s
2.57.592.344 I slot print_timing: id  3 | task 979 | n_decoded =    194, tg =  15.37 t/s, tg_3s =  15.51 t/s
3.00.610.495 I slot print_timing: id  3 | task 979 | n_decoded =    241, tg =  15.41 t/s, tg_3s =  15.57 t/s
3.03.651.023 I slot print_timing: id  3 | task 979 | n_decoded =    288, tg =  15.42 t/s, tg_3s =  15.46 t/s
3.06.670.965 I slot print_timing: id  3 | task 979 | n_decoded =    334, tg =  15.39 t/s, tg_3s =  15.23 t/s
3.09.710.410 I slot print_timing: id  3 | task 979 | n_decoded =    380, tg =  15.36 t/s, tg_3s =  15.13 t/s
3.12.753.200 I slot print_timing: id  3 | task 979 | n_decoded =    426, tg =  15.33 t/s, tg_3s =  15.12 t/s
3.15.786.324 I slot print_timing: id  3 | task 979 | n_decoded =    472, tg =  15.32 t/s, tg_3s =  15.17 t/s
3.18.026.053 I slot print_timing: id  3 | task 979 | prompt eval time =     901.38 ms /    35 tokens (   25.75 ms per token,    38.83 tokens per second)
3.18.026.059 I slot print_timing: id  3 | task 979 |        eval time =   33055.02 ms /   506 tokens (   65.33 ms per token,    15.31 tokens per second)
3.18.026.059 I slot print_timing: id  3 | task 979 |       total time =   33956.40 ms /   541 tokens
3.18.026.060 I slot print_timing: id  3 | task 979 |    graphs reused =       1369
3.18.026.090 I slot      release: id  3 | task 979 | stop processing: n_tokens = 586, truncated = 0
3.18.026.107 I srv  update_slots: all slots are idle
3.18.054.852 I srv    operator(): Chat format: peg-native
3.18.055.086 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.694 (> 0.100 thold), f_keep = 0.085
3.18.055.089 I srv  get_availabl: updating prompt cache
3.18.055.143 W srv   prompt_save:  - saving prompt with length 586, total state size = 169.273 MiB (draft: 0.000 MiB)
3.18.253.208 I srv          load:  - looking for better prompt, base f_keep = 0.085, sim = 0.694
3.18.253.221 I srv        update:  - cache state: 10 prompts, 3307.424 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
3.18.253.222 I srv        update:    - prompt 0x603e5556f790:     141 tokens, checkpoints:  1,   330.480 MiB
3.18.253.223 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
3.18.253.224 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
3.18.253.226 I srv        update:    - prompt 0x603e556a7000:     156 tokens, checkpoints:  1,   330.598 MiB
3.18.253.231 I srv        update:    - prompt 0x603e555b8140:     100 tokens, checkpoints:  1,   330.159 MiB
3.18.253.232 I srv        update:    - prompt 0x603e556c5d60:     110 tokens, checkpoints:  1,   330.238 MiB
3.18.253.233 I srv        update:    - prompt 0x603e555ed3d0:     148 tokens, checkpoints:  1,   330.535 MiB
3.18.253.234 I srv        update:    - prompt 0x603e556c8e70:     110 tokens, checkpoints:  1,   330.238 MiB
3.18.253.234 I srv        update:    - prompt 0x603e553306d0:     133 tokens, checkpoints:  1,   330.418 MiB
3.18.253.238 I srv        update:    - prompt 0x603e55594b20:     586 tokens, checkpoints:  1,   333.962 MiB
3.18.253.240 I srv  get_availabl: prompt cache update took 198.15 ms
3.18.253.367 I slot launch_slot_: id  3 | task 1487 | processing task, is_child = 0
3.18.253.368 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
3.18.253.369 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
3.18.253.378 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
3.18.253.379 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
3.18.253.392 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
3.18.253.393 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
3.18.253.420 I slot update_slots: id  3 | task 1487 | Checking checkpoint with [45, 45] against 50...
3.18.284.164 W slot update_slots: id  3 | task 1487 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
3.21.995.373 I slot print_timing: id  3 | task 1487 | prompt eval time =     748.22 ms /    26 tokens (   28.78 ms per token,    34.75 tokens per second)
3.21.995.378 I slot print_timing: id  3 | task 1487 |        eval time =    2993.72 ms /    46 tokens (   65.08 ms per token,    15.37 tokens per second)
3.21.995.378 I slot print_timing: id  3 | task 1487 |       total time =    3741.94 ms /    72 tokens
3.21.995.379 I slot print_timing: id  3 | task 1487 |    graphs reused =       1413
3.21.995.415 I slot      release: id  3 | task 1487 | stop processing: n_tokens = 117, truncated = 0
3.21.995.428 I srv  update_slots: all slots are idle
3.22.027.094 I srv    operator(): Chat format: peg-native
3.22.027.336 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.731 (> 0.100 thold), f_keep = 0.419
3.22.027.339 I srv  get_availabl: updating prompt cache
3.22.027.372 W srv   prompt_save:  - saving prompt with length 117, total state size = 165.604 MiB (draft: 0.000 MiB)
3.22.201.018 I srv          load:  - looking for better prompt, base f_keep = 0.419, sim = 0.731
3.22.201.029 I srv        update:  - cache state: 11 prompts, 3637.716 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
3.22.201.030 I srv        update:    - prompt 0x603e5556f790:     141 tokens, checkpoints:  1,   330.480 MiB
3.22.201.031 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
3.22.201.031 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
3.22.201.032 I srv        update:    - prompt 0x603e556a7000:     156 tokens, checkpoints:  1,   330.598 MiB
3.22.201.036 I srv        update:    - prompt 0x603e555b8140:     100 tokens, checkpoints:  1,   330.159 MiB
3.22.201.036 I srv        update:    - prompt 0x603e556c5d60:     110 tokens, checkpoints:  1,   330.238 MiB
3.22.201.037 I srv        update:    - prompt 0x603e555ed3d0:     148 tokens, checkpoints:  1,   330.535 MiB
3.22.201.037 I srv        update:    - prompt 0x603e556c8e70:     110 tokens, checkpoints:  1,   330.238 MiB
3.22.201.038 I srv        update:    - prompt 0x603e553306d0:     133 tokens, checkpoints:  1,   330.418 MiB
3.22.201.039 I srv        update:    - prompt 0x603e55594b20:     586 tokens, checkpoints:  1,   333.962 MiB
3.22.201.039 I srv        update:    - prompt 0x603e5bb0a670:     117 tokens, checkpoints:  1,   330.292 MiB
3.22.201.040 I srv  get_availabl: prompt cache update took 173.70 ms
3.22.201.144 I slot launch_slot_: id  3 | task 1535 | processing task, is_child = 0
3.22.201.145 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
3.22.201.146 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
3.22.201.154 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
3.22.201.154 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
3.22.201.160 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
3.22.201.160 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
3.22.201.173 I slot update_slots: id  3 | task 1535 | Checking checkpoint with [45, 45] against 49...
3.22.231.968 W slot update_slots: id  3 | task 1535 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
3.29.432.561 I slot print_timing: id  3 | task 1535 | n_decoded =    100, tg =  15.26 t/s, tg_3s =  15.26 t/s
3.30.561.583 I slot print_timing: id  3 | task 1535 | prompt eval time =     677.13 ms /    21 tokens (   32.24 ms per token,    31.01 tokens per second)
3.30.561.594 I slot print_timing: id  3 | task 1535 |        eval time =    7683.27 ms /   117 tokens (   65.67 ms per token,    15.23 tokens per second)
3.30.561.595 I slot print_timing: id  3 | task 1535 |       total time =    8360.40 ms /   138 tokens
3.30.561.595 I slot print_timing: id  3 | task 1535 |    graphs reused =       1528
3.30.561.634 I slot      release: id  3 | task 1535 | stop processing: n_tokens = 183, truncated = 0
3.30.561.650 I srv  update_slots: all slots are idle
3.30.590.648 I srv    operator(): Chat format: peg-native
3.30.590.887 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.681 (> 0.100 thold), f_keep = 0.268
3.30.590.889 I srv  get_availabl: updating prompt cache
3.30.590.913 W srv   prompt_save:  - saving prompt with length 183, total state size = 166.120 MiB (draft: 0.000 MiB)
3.30.776.225 I srv          load:  - looking for better prompt, base f_keep = 0.268, sim = 0.681
3.30.776.231 I srv          load:  - found better prompt with f_keep = 0.355, sim = 0.694
3.30.840.626 I srv        update:  - cache state: 11 prompts, 3638.045 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
3.30.840.631 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
3.30.840.631 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
3.30.840.632 I srv        update:    - prompt 0x603e556a7000:     156 tokens, checkpoints:  1,   330.598 MiB
3.30.840.633 I srv        update:    - prompt 0x603e555b8140:     100 tokens, checkpoints:  1,   330.159 MiB
3.30.840.633 I srv        update:    - prompt 0x603e556c5d60:     110 tokens, checkpoints:  1,   330.238 MiB
3.30.840.634 I srv        update:    - prompt 0x603e555ed3d0:     148 tokens, checkpoints:  1,   330.535 MiB
3.30.840.634 I srv        update:    - prompt 0x603e556c8e70:     110 tokens, checkpoints:  1,   330.238 MiB
3.30.840.635 I srv        update:    - prompt 0x603e553306d0:     133 tokens, checkpoints:  1,   330.418 MiB
3.30.840.635 I srv        update:    - prompt 0x603e55594b20:     586 tokens, checkpoints:  1,   333.962 MiB
3.30.840.636 I srv        update:    - prompt 0x603e5bb0a670:     117 tokens, checkpoints:  1,   330.292 MiB
3.30.840.637 I srv        update:    - prompt 0x603e553711e0:     183 tokens, checkpoints:  1,   330.809 MiB
3.30.840.639 I srv  get_availabl: prompt cache update took 249.75 ms
3.30.840.797 I slot launch_slot_: id  3 | task 1654 | processing task, is_child = 0
3.30.840.802 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
3.30.840.803 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
3.30.840.813 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
3.30.840.814 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
3.30.840.820 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
3.30.840.820 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
3.30.840.839 I slot update_slots: id  3 | task 1654 | Checking checkpoint with [45, 45] against 50...
3.30.908.019 W slot update_slots: id  3 | task 1654 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
3.34.958.205 I slot print_timing: id  3 | task 1654 | prompt eval time =     779.98 ms /    26 tokens (   30.00 ms per token,    33.33 tokens per second)
3.34.958.211 I slot print_timing: id  3 | task 1654 |        eval time =    3337.37 ms /    51 tokens (   65.44 ms per token,    15.28 tokens per second)
3.34.958.212 I slot print_timing: id  3 | task 1654 |       total time =    4117.35 ms /    77 tokens
3.34.958.213 I slot print_timing: id  3 | task 1654 |    graphs reused =       1577
3.34.958.245 I slot      release: id  3 | task 1654 | stop processing: n_tokens = 122, truncated = 0
3.34.958.258 I srv  update_slots: all slots are idle
3.34.988.401 I srv    operator(): Chat format: peg-native
3.34.988.645 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.694 (> 0.100 thold), f_keep = 0.410
3.34.988.646 I srv  get_availabl: updating prompt cache
3.34.988.674 W srv   prompt_save:  - saving prompt with length 122, total state size = 165.643 MiB (draft: 0.000 MiB)
3.35.202.653 I srv          load:  - looking for better prompt, base f_keep = 0.410, sim = 0.694
3.35.202.660 I srv          load:  - found better prompt with f_keep = 0.473, sim = 0.722
3.35.270.327 I srv        update:  - cache state: 11 prompts, 3638.139 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
3.35.270.331 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
3.35.270.332 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
3.35.270.332 I srv        update:    - prompt 0x603e556a7000:     156 tokens, checkpoints:  1,   330.598 MiB
3.35.270.333 I srv        update:    - prompt 0x603e555b8140:     100 tokens, checkpoints:  1,   330.159 MiB
3.35.270.334 I srv        update:    - prompt 0x603e556c5d60:     110 tokens, checkpoints:  1,   330.238 MiB
3.35.270.334 I srv        update:    - prompt 0x603e555ed3d0:     148 tokens, checkpoints:  1,   330.535 MiB
3.35.270.335 I srv        update:    - prompt 0x603e553306d0:     133 tokens, checkpoints:  1,   330.418 MiB
3.35.270.336 I srv        update:    - prompt 0x603e55594b20:     586 tokens, checkpoints:  1,   333.962 MiB
3.35.270.337 I srv        update:    - prompt 0x603e5bb0a670:     117 tokens, checkpoints:  1,   330.292 MiB
3.35.270.337 I srv        update:    - prompt 0x603e553711e0:     183 tokens, checkpoints:  1,   330.809 MiB
3.35.270.338 I srv        update:    - prompt 0x603e55627f20:     122 tokens, checkpoints:  1,   330.332 MiB
3.35.270.339 I srv  get_availabl: prompt cache update took 281.69 ms
3.35.270.466 I slot launch_slot_: id  3 | task 1707 | processing task, is_child = 0
3.35.270.472 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
3.35.270.473 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
3.35.270.483 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
3.35.270.483 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
3.35.270.492 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
3.35.270.492 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
3.35.270.509 I slot update_slots: id  3 | task 1707 | Checking checkpoint with [45, 45] against 52...
3.35.311.284 W slot update_slots: id  3 | task 1707 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
3.39.976.204 I slot print_timing: id  3 | task 1707 | prompt eval time =     745.13 ms /    26 tokens (   28.66 ms per token,    34.89 tokens per second)
3.39.976.210 I slot print_timing: id  3 | task 1707 |        eval time =    3960.55 ms /    60 tokens (   66.01 ms per token,    15.15 tokens per second)
3.39.976.210 I slot print_timing: id  3 | task 1707 |       total time =    4705.68 ms /    86 tokens
3.39.976.211 I slot print_timing: id  3 | task 1707 |    graphs reused =       1635
3.39.976.248 I slot      release: id  3 | task 1707 | stop processing: n_tokens = 131, truncated = 0
3.39.976.264 I srv  update_slots: all slots are idle
3.40.005.181 I srv    operator(): Chat format: peg-native
3.40.005.413 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.742 (> 0.100 thold), f_keep = 0.374
3.40.005.416 I srv  get_availabl: updating prompt cache
3.40.005.443 W srv   prompt_save:  - saving prompt with length 131, total state size = 165.714 MiB (draft: 0.000 MiB)
3.40.221.890 I srv          load:  - looking for better prompt, base f_keep = 0.374, sim = 0.742
3.40.221.903 I srv        update:  - cache state: 12 prompts, 3968.541 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
3.40.221.904 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
3.40.221.904 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
3.40.221.905 I srv        update:    - prompt 0x603e556a7000:     156 tokens, checkpoints:  1,   330.598 MiB
3.40.221.906 I srv        update:    - prompt 0x603e555b8140:     100 tokens, checkpoints:  1,   330.159 MiB
3.40.221.906 I srv        update:    - prompt 0x603e556c5d60:     110 tokens, checkpoints:  1,   330.238 MiB
3.40.221.907 I srv        update:    - prompt 0x603e555ed3d0:     148 tokens, checkpoints:  1,   330.535 MiB
3.40.221.907 I srv        update:    - prompt 0x603e553306d0:     133 tokens, checkpoints:  1,   330.418 MiB
3.40.221.908 I srv        update:    - prompt 0x603e55594b20:     586 tokens, checkpoints:  1,   333.962 MiB
3.40.221.909 I srv        update:    - prompt 0x603e5bb0a670:     117 tokens, checkpoints:  1,   330.292 MiB
3.40.221.909 I srv        update:    - prompt 0x603e553711e0:     183 tokens, checkpoints:  1,   330.809 MiB
3.40.221.910 I srv        update:    - prompt 0x603e55627f20:     122 tokens, checkpoints:  1,   330.332 MiB
3.40.221.910 I srv        update:    - prompt 0x603e551977c0:     131 tokens, checkpoints:  1,   330.402 MiB
3.40.221.911 I srv  get_availabl: prompt cache update took 216.50 ms
3.40.222.034 I slot launch_slot_: id  3 | task 1769 | processing task, is_child = 0
3.40.222.036 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
3.40.222.037 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
3.40.222.046 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
3.40.222.047 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
3.40.222.052 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
3.40.222.052 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
3.40.222.066 I slot update_slots: id  3 | task 1769 | Checking checkpoint with [45, 45] against 49...
3.40.253.052 W slot update_slots: id  3 | task 1769 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
3.43.808.356 I slot print_timing: id  3 | task 1769 | prompt eval time =     596.82 ms /    20 tokens (   29.84 ms per token,    33.51 tokens per second)
3.43.808.364 I slot print_timing: id  3 | task 1769 |        eval time =    2989.45 ms /    45 tokens (   66.43 ms per token,    15.05 tokens per second)
3.43.808.364 I slot print_timing: id  3 | task 1769 |       total time =    3586.28 ms /    65 tokens
3.43.808.365 I slot print_timing: id  3 | task 1769 |    graphs reused =       1678
3.43.808.395 I slot      release: id  3 | task 1769 | stop processing: n_tokens = 110, truncated = 0
3.43.808.407 I srv  update_slots: all slots are idle
3.43.837.483 I srv    operator(): Chat format: peg-native
3.43.837.717 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.778 (> 0.100 thold), f_keep = 0.445
3.43.837.719 I srv  get_availabl: updating prompt cache
3.43.837.740 W srv   prompt_save:  - saving prompt with length 110, total state size = 165.549 MiB (draft: 0.000 MiB)
3.44.013.005 I srv          load:  - looking for better prompt, base f_keep = 0.445, sim = 0.778
3.44.013.014 I srv        update:  - cache state: 13 prompts, 4298.778 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
3.44.013.015 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
3.44.013.016 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
3.44.013.020 I srv        update:    - prompt 0x603e556a7000:     156 tokens, checkpoints:  1,   330.598 MiB
3.44.013.020 I srv        update:    - prompt 0x603e555b8140:     100 tokens, checkpoints:  1,   330.159 MiB
3.44.013.021 I srv        update:    - prompt 0x603e556c5d60:     110 tokens, checkpoints:  1,   330.238 MiB
3.44.013.021 I srv        update:    - prompt 0x603e555ed3d0:     148 tokens, checkpoints:  1,   330.535 MiB
3.44.013.022 I srv        update:    - prompt 0x603e553306d0:     133 tokens, checkpoints:  1,   330.418 MiB
3.44.013.022 I srv        update:    - prompt 0x603e55594b20:     586 tokens, checkpoints:  1,   333.962 MiB
3.44.013.023 I srv        update:    - prompt 0x603e5bb0a670:     117 tokens, checkpoints:  1,   330.292 MiB
3.44.013.024 I srv        update:    - prompt 0x603e553711e0:     183 tokens, checkpoints:  1,   330.809 MiB
3.44.013.025 I srv        update:    - prompt 0x603e55627f20:     122 tokens, checkpoints:  1,   330.332 MiB
3.44.013.025 I srv        update:    - prompt 0x603e551977c0:     131 tokens, checkpoints:  1,   330.402 MiB
3.44.013.026 I srv        update:    - prompt 0x603e55627e70:     110 tokens, checkpoints:  1,   330.238 MiB
3.44.013.027 I srv  get_availabl: prompt cache update took 175.31 ms
3.44.013.133 I slot launch_slot_: id  3 | task 1816 | processing task, is_child = 0
3.44.013.134 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
3.44.013.135 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
3.44.013.143 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
3.44.013.143 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
3.44.013.147 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
3.44.013.148 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
3.44.013.160 I slot update_slots: id  3 | task 1816 | Checking checkpoint with [45, 45] against 49...
3.44.043.823 W slot update_slots: id  3 | task 1816 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
3.45.316.567 I slot print_timing: id  3 | task 1816 | prompt eval time =     549.65 ms /    17 tokens (   32.33 ms per token,    30.93 tokens per second)
3.45.316.573 I slot print_timing: id  3 | task 1816 |        eval time =     753.74 ms /    12 tokens (   62.81 ms per token,    15.92 tokens per second)
3.45.316.573 I slot print_timing: id  3 | task 1816 |       total time =    1303.39 ms /    29 tokens
3.45.316.574 I slot print_timing: id  3 | task 1816 |    graphs reused =       1688
3.45.316.610 I slot      release: id  3 | task 1816 | stop processing: n_tokens = 74, truncated = 0
3.45.316.626 I srv  update_slots: all slots are idle
3.45.345.654 I srv    operator(): Chat format: peg-native
3.45.345.882 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.710 (> 0.100 thold), f_keep = 0.662
3.45.345.932 I slot launch_slot_: id  3 | task 1830 | processing task, is_child = 0
3.45.345.934 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
3.45.345.934 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
3.45.345.943 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
3.45.345.943 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
3.45.345.948 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
3.45.345.948 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
3.45.345.956 I slot update_slots: id  3 | task 1830 | Checking checkpoint with [45, 45] against 49...
3.45.377.252 W slot update_slots: id  3 | task 1830 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
3.46.928.494 I slot print_timing: id  3 | task 1830 | prompt eval time =     691.73 ms /    23 tokens (   30.08 ms per token,    33.25 tokens per second)
3.46.928.498 I slot print_timing: id  3 | task 1830 |        eval time =     890.79 ms /    14 tokens (   63.63 ms per token,    15.72 tokens per second)
3.46.928.499 I slot print_timing: id  3 | task 1830 |       total time =    1582.52 ms /    37 tokens
3.46.928.500 I slot print_timing: id  3 | task 1830 |    graphs reused =       1700
3.46.928.533 I slot      release: id  3 | task 1830 | stop processing: n_tokens = 82, truncated = 0
3.46.928.548 I srv  update_slots: all slots are idle
3.46.958.543 I srv    operator(): Chat format: peg-native
3.46.958.781 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.731 (> 0.100 thold), f_keep = 0.598
3.46.958.852 I slot launch_slot_: id  3 | task 1846 | processing task, is_child = 0
3.46.958.854 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
3.46.958.855 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
3.46.958.864 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
3.46.958.865 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
3.46.958.871 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
3.46.958.871 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
3.46.958.883 I slot update_slots: id  3 | task 1846 | Checking checkpoint with [45, 45] against 49...
3.46.990.354 W slot update_slots: id  3 | task 1846 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
3.52.639.191 I slot print_timing: id  3 | task 1846 | prompt eval time =     676.87 ms /    21 tokens (   32.23 ms per token,    31.03 tokens per second)
3.52.639.196 I slot print_timing: id  3 | task 1846 |        eval time =    5003.43 ms /    75 tokens (   66.71 ms per token,    14.99 tokens per second)
3.52.639.197 I slot print_timing: id  3 | task 1846 |       total time =    5680.30 ms /    96 tokens
3.52.639.198 I slot print_timing: id  3 | task 1846 |    graphs reused =       1773
3.52.639.226 I slot      release: id  3 | task 1846 | stop processing: n_tokens = 141, truncated = 0
3.52.639.240 I srv  update_slots: all slots are idle
3.52.669.124 I srv    operator(): Chat format: peg-native
3.52.669.355 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.758 (> 0.100 thold), f_keep = 0.355
3.52.669.357 I srv  get_availabl: updating prompt cache
3.52.669.379 W srv   prompt_save:  - saving prompt with length 141, total state size = 165.792 MiB (draft: 0.000 MiB)
3.52.845.294 I srv          load:  - looking for better prompt, base f_keep = 0.355, sim = 0.758
3.52.845.307 I srv        update:  - cache state: 14 prompts, 4629.259 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
3.52.845.308 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
3.52.845.309 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
3.52.845.310 I srv        update:    - prompt 0x603e556a7000:     156 tokens, checkpoints:  1,   330.598 MiB
3.52.845.310 I srv        update:    - prompt 0x603e555b8140:     100 tokens, checkpoints:  1,   330.159 MiB
3.52.845.311 I srv        update:    - prompt 0x603e556c5d60:     110 tokens, checkpoints:  1,   330.238 MiB
3.52.845.312 I srv        update:    - prompt 0x603e555ed3d0:     148 tokens, checkpoints:  1,   330.535 MiB
3.52.845.312 I srv        update:    - prompt 0x603e553306d0:     133 tokens, checkpoints:  1,   330.418 MiB
3.52.845.313 I srv        update:    - prompt 0x603e55594b20:     586 tokens, checkpoints:  1,   333.962 MiB
3.52.845.313 I srv        update:    - prompt 0x603e5bb0a670:     117 tokens, checkpoints:  1,   330.292 MiB
3.52.845.314 I srv        update:    - prompt 0x603e553711e0:     183 tokens, checkpoints:  1,   330.809 MiB
3.52.845.314 I srv        update:    - prompt 0x603e55627f20:     122 tokens, checkpoints:  1,   330.332 MiB
3.52.845.315 I srv        update:    - prompt 0x603e551977c0:     131 tokens, checkpoints:  1,   330.402 MiB
3.52.845.316 I srv        update:    - prompt 0x603e55627e70:     110 tokens, checkpoints:  1,   330.238 MiB
3.52.845.316 I srv        update:    - prompt 0x603e5569d530:     141 tokens, checkpoints:  1,   330.480 MiB
3.52.845.317 I srv  get_availabl: prompt cache update took 175.96 ms
3.52.845.441 I slot launch_slot_: id  3 | task 1923 | processing task, is_child = 0
3.52.845.442 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
3.52.845.443 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
3.52.845.455 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
3.52.845.455 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
3.52.845.463 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
3.52.845.463 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
3.52.845.480 I slot update_slots: id  3 | task 1923 | Checking checkpoint with [45, 45] against 50...
3.52.876.411 W slot update_slots: id  3 | task 1923 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
3.58.115.240 I slot print_timing: id  3 | task 1923 | prompt eval time =     592.15 ms /    20 tokens (   29.61 ms per token,    33.78 tokens per second)
3.58.115.246 I slot print_timing: id  3 | task 1923 |        eval time =    4677.60 ms /    71 tokens (   65.88 ms per token,    15.18 tokens per second)
3.58.115.247 I slot print_timing: id  3 | task 1923 |       total time =    5269.75 ms /    91 tokens
3.58.115.248 I slot print_timing: id  3 | task 1923 |    graphs reused =       1842
3.58.115.278 I slot      release: id  3 | task 1923 | stop processing: n_tokens = 136, truncated = 0
3.58.115.291 I srv  update_slots: all slots are idle
3.58.146.575 I srv    operator(): Chat format: peg-native
3.58.146.833 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.710 (> 0.100 thold), f_keep = 0.360
3.58.146.835 I srv  get_availabl: updating prompt cache
3.58.146.861 W srv   prompt_save:  - saving prompt with length 136, total state size = 165.753 MiB (draft: 0.000 MiB)
3.58.321.334 I srv          load:  - looking for better prompt, base f_keep = 0.360, sim = 0.710
3.58.321.346 I srv        update:  - cache state: 15 prompts, 4959.700 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
3.58.321.349 I srv        update:    - prompt 0x603e55664140:     104 tokens, checkpoints:  1,   330.191 MiB
3.58.321.350 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
3.58.321.351 I srv        update:    - prompt 0x603e556a7000:     156 tokens, checkpoints:  1,   330.598 MiB
3.58.321.354 I srv        update:    - prompt 0x603e555b8140:     100 tokens, checkpoints:  1,   330.159 MiB
3.58.321.354 I srv        update:    - prompt 0x603e556c5d60:     110 tokens, checkpoints:  1,   330.238 MiB
3.58.321.355 I srv        update:    - prompt 0x603e555ed3d0:     148 tokens, checkpoints:  1,   330.535 MiB
3.58.321.356 I srv        update:    - prompt 0x603e553306d0:     133 tokens, checkpoints:  1,   330.418 MiB
3.58.321.357 I srv        update:    - prompt 0x603e55594b20:     586 tokens, checkpoints:  1,   333.962 MiB
3.58.321.358 I srv        update:    - prompt 0x603e5bb0a670:     117 tokens, checkpoints:  1,   330.292 MiB
3.58.321.359 I srv        update:    - prompt 0x603e553711e0:     183 tokens, checkpoints:  1,   330.809 MiB
3.58.321.359 I srv        update:    - prompt 0x603e55627f20:     122 tokens, checkpoints:  1,   330.332 MiB
3.58.321.360 I srv        update:    - prompt 0x603e551977c0:     131 tokens, checkpoints:  1,   330.402 MiB
3.58.321.361 I srv        update:    - prompt 0x603e55627e70:     110 tokens, checkpoints:  1,   330.238 MiB
3.58.321.361 I srv        update:    - prompt 0x603e5569d530:     141 tokens, checkpoints:  1,   330.480 MiB
3.58.321.362 I srv        update:    - prompt 0x603e551602f0:     136 tokens, checkpoints:  1,   330.441 MiB
3.58.321.363 I srv  get_availabl: prompt cache update took 174.53 ms
3.58.321.484 I slot launch_slot_: id  3 | task 1996 | processing task, is_child = 0
3.58.321.485 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
3.58.321.486 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
3.58.321.495 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
3.58.321.495 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
3.58.321.509 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
3.58.321.510 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
3.58.321.527 I slot update_slots: id  3 | task 1996 | Checking checkpoint with [45, 45] against 49...
3.58.352.683 W slot update_slots: id  3 | task 1996 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
4.02.542.512 I slot print_timing: id  3 | task 1996 | prompt eval time =     689.25 ms /    23 tokens (   29.97 ms per token,    33.37 tokens per second)
4.02.542.520 I slot print_timing: id  3 | task 1996 |        eval time =    3531.72 ms /    53 tokens (   66.64 ms per token,    15.01 tokens per second)
4.02.542.520 I slot print_timing: id  3 | task 1996 |       total time =    4220.97 ms /    76 tokens
4.02.542.521 I slot print_timing: id  3 | task 1996 |    graphs reused =       1893
4.02.542.553 I slot      release: id  3 | task 1996 | stop processing: n_tokens = 121, truncated = 0
4.02.542.566 I srv  update_slots: all slots are idle
4.02.572.627 I srv    operator(): Chat format: peg-native
4.02.572.854 I slot get_availabl: id  3 | task -1 | selected slot by LCP similarity, sim_best = 0.754 (> 0.100 thold), f_keep = 0.405
4.02.572.855 I srv  get_availabl: updating prompt cache
4.02.572.880 W srv   prompt_save:  - saving prompt with length 121, total state size = 165.635 MiB (draft: 0.000 MiB)
4.02.746.883 I srv          load:  - looking for better prompt, base f_keep = 0.405, sim = 0.754
4.02.746.891 I srv          load:  - found better prompt with f_keep = 0.481, sim = 0.769
4.02.812.641 I srv        update:  - cache state: 15 prompts, 4959.833 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
4.02.812.645 I srv        update:    - prompt 0x603e5bb2f6c0:     157 tokens, checkpoints:  1,   330.605 MiB
4.02.812.646 I srv        update:    - prompt 0x603e556a7000:     156 tokens, checkpoints:  1,   330.598 MiB
4.02.812.647 I srv        update:    - prompt 0x603e555b8140:     100 tokens, checkpoints:  1,   330.159 MiB
4.02.812.647 I srv        update:    - prompt 0x603e556c5d60:     110 tokens, checkpoints:  1,   330.238 MiB
4.02.812.648 I srv        update:    - prompt 0x603e555ed3d0:     148 tokens, checkpoints:  1,   330.535 MiB
4.02.812.649 I srv        update:    - prompt 0x603e553306d0:     133 tokens, checkpoints:  1,   330.418 MiB
4.02.812.649 I srv        update:    - prompt 0x603e55594b20:     586 tokens, checkpoints:  1,   333.962 MiB
4.02.812.650 I srv        update:    - prompt 0x603e5bb0a670:     117 tokens, checkpoints:  1,   330.292 MiB
4.02.812.650 I srv        update:    - prompt 0x603e553711e0:     183 tokens, checkpoints:  1,   330.809 MiB
4.02.812.651 I srv        update:    - prompt 0x603e55627f20:     122 tokens, checkpoints:  1,   330.332 MiB
4.02.812.652 I srv        update:    - prompt 0x603e551977c0:     131 tokens, checkpoints:  1,   330.402 MiB
4.02.812.653 I srv        update:    - prompt 0x603e55627e70:     110 tokens, checkpoints:  1,   330.238 MiB
4.02.812.657 I srv        update:    - prompt 0x603e5569d530:     141 tokens, checkpoints:  1,   330.480 MiB
4.02.812.674 I srv        update:    - prompt 0x603e551602f0:     136 tokens, checkpoints:  1,   330.441 MiB
4.02.812.680 I srv        update:    - prompt 0x603e54fcf540:     121 tokens, checkpoints:  1,   330.324 MiB
4.02.812.682 I srv  get_availabl: prompt cache update took 239.82 ms
4.02.812.801 I slot launch_slot_: id  3 | task 2051 | processing task, is_child = 0
4.02.812.801 I slot process_sing: id  0 | task -1 | saving idle slot to prompt cache
4.02.812.802 I slot prompt_clear: id  0 | task -1 | clearing prompt with 0 tokens
4.02.812.814 I slot process_sing: id  1 | task -1 | saving idle slot to prompt cache
4.02.812.814 I slot prompt_clear: id  1 | task -1 | clearing prompt with 0 tokens
4.02.812.819 I slot process_sing: id  2 | task -1 | saving idle slot to prompt cache
4.02.812.820 I slot prompt_clear: id  2 | task -1 | clearing prompt with 0 tokens
4.02.812.834 I slot update_slots: id  3 | task 2051 | Checking checkpoint with [45, 45] against 50...
4.02.867.788 W slot update_slots: id  3 | task 2051 | restored context checkpoint (pos_min = 45, pos_max = 45, n_tokens = 46, n_past = 46, size = 164.688 MiB)
4.07.462.340 I slot print_timing: id  3 | task 2051 | prompt eval time =     607.03 ms /    19 tokens (   31.95 ms per token,    31.30 tokens per second)
4.07.462.345 I slot print_timing: id  3 | task 2051 |        eval time =    4042.46 ms /    61 tokens (   66.27 ms per token,    15.09 tokens per second)
4.07.462.346 I slot print_timing: id  3 | task 2051 |       total time =    4649.49 ms /    80 tokens
4.07.462.346 I slot print_timing: id  3 | task 2051 |    graphs reused =       1952
4.07.462.377 I slot      release: id  3 | task 2051 | stop processing: n_tokens = 125, truncated = 0
4.07.462.389 I srv  update_slots: all slots are idle
4.07.462.948 I srv    operator(): operator(): cleaning up before exit...