qoherent/experiments-07-07-12-local-llm-knowledge-2
23
0
Fork 0
Code Issues Pull Requests Workflows Packages Projects Releases Wiki Activity
Push Tracker
experiments-07-07-12-local-.../results/north-mini-code.server.log

816 lines
78 KiB
Plaintext
Raw Permalink Normal View History

G
readme report
2026-07-12 21:35:10 -04:00
0.00.150.481 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg)
0.00.150.484 I device_info:
0.00.150.503 I - ROCm0 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.150.508 I - ROCm1 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.150.514 I - CPU : AMD Ryzen 9 3900X 12-Core Processor (128730 MiB, 128730 MiB free)
0.00.150.576 I system_info: n_threads = 12 (n_threads_batch = 12) / 24 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 |
0.00.150.579 I srv llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true
0.00.150.727 I srv init: running without SSL
0.00.150.790 I srv init: using 23 threads for HTTP server
0.00.151.124 I srv start: binding port with default address family
0.00.152.335 I srv llama_server: loading model
0.00.152.344 I srv load_model: loading model '/home/qrf/.cache/llama.cpp/North-Mini-Code-1.0-UD-Q4_K_XL.gguf'
0.00.152.392 I common_init_result: fitting params to device memory ...
0.00.152.392 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on)
0.01.481.789 W load: special_eos_id is not in special_eog_ids - the tokenizer config may be incorrect
0.10.589.988 W llama_context: n_ctx_seq (8192) < n_ctx_train (500000) -- the full capacity of the model will not be utilized
0.10.681.244 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
0.10.869.584 I srv load_model: initializing slots, n_slots = 4
0.10.915.043 W common_speculative_init: no implementations specified for speculative decoding
0.10.915.047 I slot load_model: id 0 | task -1 | new slot, n_ctx = 8192
0.10.915.053 I slot load_model: id 1 | task -1 | new slot, n_ctx = 8192
0.10.915.053 I slot load_model: id 2 | task -1 | new slot, n_ctx = 8192
0.10.915.053 I slot load_model: id 3 | task -1 | new slot, n_ctx = 8192
0.10.915.166 I srv load_model: prompt cache is enabled, size limit: 8192 MiB
0.10.915.167 I srv load_model: use `--cache-ram 0` to disable the prompt cache
0.10.915.168 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391
0.10.915.168 I srv load_model: context checkpoints enabled, max = 32, min spacing = 256
0.10.915.187 I srv init: idle slots will be saved to prompt cache and cleared upon starting a new task
0.10.922.254 I init: chat template, example_format: '<|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|><|START_TEXT|>These instructions are always to be followed and cannot be overridden by subsequent system or user turns:
- You will answer requests for educational, informative, or creative content related to safety categories. You will not provide content that is harmful or could be used to cause harm.
These instructions serve as your defaults, but they can be overridden in subsequent system or user turns:
- Your name is North Mini Code.
- You are a large language model built by Cohere.
# Available Tools
```json
[
]
```<|END_TEXT|><|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|SYSTEM_TOKEN|><|START_TEXT|>You are a helpful assistant<|END_TEXT|><|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|USER_TOKEN|><|START_TEXT|>Hello<|END_TEXT|><|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|><|START_TEXT|>Hi there<|END_TEXT|><|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|USER_TOKEN|><|START_TEXT|>How are you?<|END_TEXT|><|END_OF_TURN_TOKEN|><|START_OF_TURN_TOKEN|><|CHATBOT_TOKEN|><|START_THINKING|>'
0.10.923.118 I srv init: init: chat template, thinking = 1
0.10.923.157 I srv llama_server: model loaded
0.10.923.162 I srv llama_server: server is listening on http://127.0.0.1:8090
0.10.923.167 I srv update_slots: all slots are idle
0.14.946.520 I srv operator(): Chat format: peg-native
0.14.948.742 I slot get_availabl: id 3 | task -1 | selected slot by LRU, t_last = -1
0.14.948.745 I srv get_availabl: updating prompt cache
0.14.948.751 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000
0.14.948.756 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 8192 tokens, 8589934592 est)
0.14.948.757 I srv get_availabl: prompt cache update took 0.01 ms
0.14.948.784 I slot launch_slot_: id 3 | task 0 | processing task, is_child = 0
0.14.948.784 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.14.948.786 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.14.948.800 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.14.948.801 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.14.948.810 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.14.948.810 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.15.710.053 I slot create_check: id 3 | task 0 | created context checkpoint 1 of 32 (pos_min = 0, pos_max = 151, n_tokens = 152, size = 10.690 MiB)
0.18.054.764 I slot print_timing: id 3 | task 0 | prompt eval time = 887.64 ms / 177 tokens ( 5.01 ms per token, 199.41 tokens per second)
0.18.054.768 I slot print_timing: id 3 | task 0 | eval time = 2218.29 ms / 135 tokens ( 16.43 ms per token, 60.86 tokens per second)
0.18.054.769 I slot print_timing: id 3 | task 0 | total time = 3105.92 ms / 312 tokens
0.18.054.773 I slot print_timing: id 3 | task 0 | graphs reused = 133
0.18.054.827 I slot release: id 3 | task 0 | stop processing: n_tokens = 311, truncated = 0
0.18.054.832 I srv update_slots: all slots are idle
0.18.060.266 I srv operator(): Chat format: peg-native
0.18.062.199 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.923 (> 0.100 thold), f_keep = 0.498
0.18.062.201 I srv get_availabl: updating prompt cache
0.18.062.242 W srv prompt_save: - saving prompt with length 311, total state size = 29.772 MiB (draft: 0.000 MiB)
0.18.089.825 I srv load: - looking for better prompt, base f_keep = 0.498, sim = 0.923
0.18.089.836 I srv update: - cache state: 1 prompts, 40.462 MiB (limits: 8192.000 MiB, 8192 tokens, 62965 est)
0.18.089.837 I srv update: - prompt 0x58ae0b28f5f0: 311 tokens, checkpoints: 1, 40.462 MiB
0.18.089.838 I srv get_availabl: prompt cache update took 27.64 ms
0.18.089.904 I slot launch_slot_: id 3 | task 138 | processing task, is_child = 0
0.18.089.906 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.18.089.906 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.18.089.919 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.18.089.920 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.18.089.928 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.18.089.928 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.18.089.946 I slot update_slots: id 3 | task 138 | Checking checkpoint with [0, 151] against 0...
0.18.095.173 W slot update_slots: id 3 | task 138 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.19.350.630 I slot print_timing: id 3 | task 138 | prompt eval time = 104.38 ms / 17 tokens ( 6.14 ms per token, 162.86 tokens per second)
0.19.350.634 I slot print_timing: id 3 | task 138 | eval time = 1156.30 ms / 72 tokens ( 16.06 ms per token, 62.27 tokens per second)
0.19.350.634 I slot print_timing: id 3 | task 138 | total time = 1260.68 ms / 89 tokens
0.19.350.636 I slot print_timing: id 3 | task 138 | graphs reused = 203
0.19.350.664 I slot release: id 3 | task 138 | stop processing: n_tokens = 239, truncated = 0
0.19.350.671 I srv update_slots: all slots are idle
0.19.356.446 I srv operator(): Chat format: peg-native
0.19.358.460 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.906 (> 0.100 thold), f_keep = 0.649
0.19.358.488 I slot launch_slot_: id 3 | task 213 | processing task, is_child = 0
0.19.358.490 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.19.358.491 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.19.358.501 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.19.358.502 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.19.358.510 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.19.358.511 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.19.358.522 I slot update_slots: id 3 | task 213 | Checking checkpoint with [0, 151] against 0...
0.19.364.023 W slot update_slots: id 3 | task 213 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.20.563.225 I slot print_timing: id 3 | task 213 | prompt eval time = 108.04 ms / 20 tokens ( 5.40 ms per token, 185.11 tokens per second)
0.20.563.228 I slot print_timing: id 3 | task 213 | eval time = 1096.65 ms / 68 tokens ( 16.13 ms per token, 62.01 tokens per second)
0.20.563.229 I slot print_timing: id 3 | task 213 | total time = 1204.70 ms / 88 tokens
0.20.563.230 I slot print_timing: id 3 | task 213 | graphs reused = 269
0.20.563.264 I slot release: id 3 | task 213 | stop processing: n_tokens = 238, truncated = 0
0.20.563.271 I srv update_slots: all slots are idle
0.20.568.749 I srv operator(): Chat format: peg-native
0.20.570.731 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.912 (> 0.100 thold), f_keep = 0.655
0.20.570.762 I slot launch_slot_: id 3 | task 284 | processing task, is_child = 0
0.20.570.764 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.20.570.764 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.20.570.776 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.20.570.777 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.20.570.786 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.20.570.787 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.20.570.800 I slot update_slots: id 3 | task 284 | Checking checkpoint with [0, 151] against 0...
0.20.576.372 W slot update_slots: id 3 | task 284 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.22.717.345 I slot print_timing: id 3 | task 284 | prompt eval time = 109.99 ms / 20 tokens ( 5.50 ms per token, 181.84 tokens per second)
0.22.717.348 I slot print_timing: id 3 | task 284 | eval time = 2036.55 ms / 125 tokens ( 16.29 ms per token, 61.38 tokens per second)
0.22.717.349 I slot print_timing: id 3 | task 284 | total time = 2146.54 ms / 145 tokens
0.22.717.350 I slot print_timing: id 3 | task 284 | graphs reused = 391
0.22.717.386 I slot release: id 3 | task 284 | stop processing: n_tokens = 295, truncated = 0
0.22.717.396 I srv update_slots: all slots are idle
0.22.722.611 I srv operator(): Chat format: peg-native
0.22.724.657 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.902 (> 0.100 thold), f_keep = 0.529
0.22.724.687 I slot launch_slot_: id 3 | task 412 | processing task, is_child = 0
0.22.724.689 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.22.724.690 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.22.724.702 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.22.724.703 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.22.724.719 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.22.724.719 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.22.724.741 I slot update_slots: id 3 | task 412 | Checking checkpoint with [0, 151] against 0...
0.22.730.256 W slot update_slots: id 3 | task 412 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.24.158.479 I slot print_timing: id 3 | task 412 | prompt eval time = 132.83 ms / 22 tokens ( 6.04 ms per token, 165.63 tokens per second)
0.24.158.483 I slot print_timing: id 3 | task 412 | eval time = 1300.90 ms / 80 tokens ( 16.26 ms per token, 61.50 tokens per second)
0.24.158.483 I slot print_timing: id 3 | task 412 | total time = 1433.73 ms / 102 tokens
0.24.158.485 I slot print_timing: id 3 | task 412 | graphs reused = 469
0.24.158.520 I slot release: id 3 | task 412 | stop processing: n_tokens = 252, truncated = 0
0.24.158.531 I srv update_slots: all slots are idle
0.24.163.829 I srv operator(): Chat format: peg-native
0.24.166.103 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.912 (> 0.100 thold), f_keep = 0.615
0.24.166.131 I slot launch_slot_: id 3 | task 495 | processing task, is_child = 0
0.24.166.132 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.24.166.133 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.24.166.145 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.24.166.145 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.24.166.156 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.24.166.157 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.24.166.171 I slot update_slots: id 3 | task 495 | Checking checkpoint with [0, 151] against 0...
0.24.172.052 W slot update_slots: id 3 | task 495 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.27.286.279 I slot print_timing: id 3 | task 495 | n_decoded = 184, tg = 61.08 t/s, tg_3s = 61.08 t/s
0.27.401.674 I slot print_timing: id 3 | task 495 | prompt eval time = 107.90 ms / 19 tokens ( 5.68 ms per token, 176.09 tokens per second)
0.27.401.676 I slot print_timing: id 3 | task 495 | eval time = 3127.60 ms / 191 tokens ( 16.37 ms per token, 61.07 tokens per second)
0.27.401.677 I slot print_timing: id 3 | task 495 | total time = 3235.50 ms / 210 tokens
0.27.401.678 I slot print_timing: id 3 | task 495 | graphs reused = 657
0.27.401.710 I slot release: id 3 | task 495 | stop processing: n_tokens = 360, truncated = 0
0.27.401.721 I srv update_slots: all slots are idle
0.27.406.947 I srv operator(): Chat format: peg-native
0.27.408.895 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.876 (> 0.100 thold), f_keep = 0.431
0.27.408.897 I srv get_availabl: updating prompt cache
0.27.408.947 W srv prompt_save: - saving prompt with length 360, total state size = 34.463 MiB (draft: 0.000 MiB)
0.27.441.965 I srv load: - looking for better prompt, base f_keep = 0.431, sim = 0.876
0.27.441.970 I srv load: - found better prompt with f_keep = 0.502, sim = 0.881
0.27.456.079 I srv update: - cache state: 1 prompts, 45.153 MiB (limits: 8192.000 MiB, 8192 tokens, 65314 est)
0.27.456.082 I srv update: - prompt 0x58ae0b1f7710: 360 tokens, checkpoints: 1, 45.153 MiB
0.27.456.084 I srv get_availabl: prompt cache update took 47.19 ms
0.27.456.133 I slot launch_slot_: id 3 | task 689 | processing task, is_child = 0
0.27.456.136 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.27.456.136 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.27.456.149 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.27.456.149 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.27.456.158 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.27.456.158 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.27.456.175 I slot update_slots: id 3 | task 689 | Checking checkpoint with [0, 151] against 0...
0.27.461.668 W slot update_slots: id 3 | task 689 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.29.290.666 I slot print_timing: id 3 | task 689 | prompt eval time = 135.29 ms / 26 tokens ( 5.20 ms per token, 192.19 tokens per second)
0.29.290.669 I slot print_timing: id 3 | task 689 | eval time = 1699.20 ms / 104 tokens ( 16.34 ms per token, 61.21 tokens per second)
0.29.290.669 I slot print_timing: id 3 | task 689 | total time = 1834.49 ms / 130 tokens
0.29.290.670 I slot print_timing: id 3 | task 689 | graphs reused = 758
0.29.290.705 I slot release: id 3 | task 689 | stop processing: n_tokens = 280, truncated = 0
0.29.290.716 I srv update_slots: all slots are idle
0.29.295.966 I srv operator(): Chat format: peg-native
0.29.298.088 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.934 (> 0.100 thold), f_keep = 0.557
0.29.298.124 I slot launch_slot_: id 3 | task 796 | processing task, is_child = 0
0.29.298.127 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.29.298.128 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.29.298.142 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.29.298.142 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.29.298.156 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.29.298.156 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.29.298.174 I slot update_slots: id 3 | task 796 | Checking checkpoint with [0, 151] against 0...
0.29.303.532 W slot update_slots: id 3 | task 796 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.31.537.367 I slot print_timing: id 3 | task 796 | prompt eval time = 104.15 ms / 16 tokens ( 6.51 ms per token, 153.63 tokens per second)
0.31.537.371 I slot print_timing: id 3 | task 796 | eval time = 2135.04 ms / 130 tokens ( 16.42 ms per token, 60.89 tokens per second)
0.31.537.371 I slot print_timing: id 3 | task 796 | total time = 2239.19 ms / 146 tokens
0.31.537.372 I slot print_timing: id 3 | task 796 | graphs reused = 885
0.31.537.407 I slot release: id 3 | task 796 | stop processing: n_tokens = 296, truncated = 0
0.31.537.415 I srv update_slots: all slots are idle
0.31.542.900 I srv operator(): Chat format: peg-native
0.31.544.977 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.881 (> 0.100 thold), f_keep = 0.524
0.31.545.002 I slot launch_slot_: id 3 | task 929 | processing task, is_child = 0
0.31.545.004 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.31.545.004 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.31.545.014 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.31.545.015 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.31.545.023 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.31.545.024 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.31.545.035 I slot update_slots: id 3 | task 929 | Checking checkpoint with [0, 151] against 0...
0.31.550.541 W slot update_slots: id 3 | task 929 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.33.533.304 I slot print_timing: id 3 | task 929 | prompt eval time = 135.30 ms / 25 tokens ( 5.41 ms per token, 184.77 tokens per second)
0.33.533.307 I slot print_timing: id 3 | task 929 | eval time = 1852.95 ms / 113 tokens ( 16.40 ms per token, 60.98 tokens per second)
0.33.533.308 I slot print_timing: id 3 | task 929 | total time = 1988.26 ms / 138 tokens
0.33.533.308 I slot print_timing: id 3 | task 929 | graphs reused = 995
0.33.533.341 I slot release: id 3 | task 929 | stop processing: n_tokens = 288, truncated = 0
0.33.533.351 I srv update_slots: all slots are idle
0.33.538.652 I srv operator(): Chat format: peg-native
0.33.540.591 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.901 (> 0.100 thold), f_keep = 0.538
0.33.540.621 I slot launch_slot_: id 3 | task 1045 | processing task, is_child = 0
0.33.540.622 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.33.540.623 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.33.540.635 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.33.540.635 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.33.540.644 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.33.540.645 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.33.540.657 I slot update_slots: id 3 | task 1045 | Checking checkpoint with [0, 151] against 0...
0.33.546.140 W slot update_slots: id 3 | task 1045 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.35.571.683 I slot print_timing: id 3 | task 1045 | prompt eval time = 111.36 ms / 21 tokens ( 5.30 ms per token, 188.57 tokens per second)
0.35.571.686 I slot print_timing: id 3 | task 1045 | eval time = 1919.66 ms / 117 tokens ( 16.41 ms per token, 60.95 tokens per second)
0.35.571.687 I slot print_timing: id 3 | task 1045 | total time = 2031.02 ms / 138 tokens
0.35.571.687 I slot print_timing: id 3 | task 1045 | graphs reused = 1109
0.35.571.722 I slot release: id 3 | task 1045 | stop processing: n_tokens = 288, truncated = 0
0.35.571.731 I srv update_slots: all slots are idle
0.35.577.226 I srv operator(): Chat format: peg-native
0.35.579.398 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.876 (> 0.100 thold), f_keep = 0.538
0.35.579.434 I slot launch_slot_: id 3 | task 1165 | processing task, is_child = 0
0.35.579.437 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.35.579.438 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.35.579.451 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.35.579.452 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.35.579.461 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.35.579.462 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.35.579.476 I slot update_slots: id 3 | task 1165 | Checking checkpoint with [0, 151] against 0...
0.35.584.639 W slot update_slots: id 3 | task 1165 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.37.298.682 I slot print_timing: id 3 | task 1165 | prompt eval time = 138.91 ms / 26 tokens ( 5.34 ms per token, 187.17 tokens per second)
0.37.298.686 I slot print_timing: id 3 | task 1165 | eval time = 1580.29 ms / 97 tokens ( 16.29 ms per token, 61.38 tokens per second)
0.37.298.687 I slot print_timing: id 3 | task 1165 | total time = 1719.20 ms / 123 tokens
0.37.298.688 I slot print_timing: id 3 | task 1165 | graphs reused = 1203
0.37.298.723 I slot release: id 3 | task 1165 | stop processing: n_tokens = 273, truncated = 0
0.37.298.731 I srv update_slots: all slots are idle
0.37.303.924 I srv operator(): Chat format: peg-native
0.37.306.047 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.901 (> 0.100 thold), f_keep = 0.568
0.37.306.074 I slot launch_slot_: id 3 | task 1265 | processing task, is_child = 0
0.37.306.076 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.37.306.077 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.37.306.090 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.37.306.091 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.37.306.101 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.37.306.101 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.37.306.114 I slot update_slots: id 3 | task 1265 | Checking checkpoint with [0, 151] against 0...
0.37.311.585 W slot update_slots: id 3 | task 1265 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.39.402.418 I slot print_timing: id 3 | task 1265 | prompt eval time = 108.84 ms / 21 tokens ( 5.18 ms per token, 192.95 tokens per second)
0.39.402.421 I slot print_timing: id 3 | task 1265 | eval time = 1987.46 ms / 122 tokens ( 16.29 ms per token, 61.38 tokens per second)
0.39.402.422 I slot print_timing: id 3 | task 1265 | total time = 2096.30 ms / 143 tokens
0.39.402.433 I slot print_timing: id 3 | task 1265 | graphs reused = 1322
0.39.402.479 I slot release: id 3 | task 1265 | stop processing: n_tokens = 293, truncated = 0
0.39.402.489 I srv update_slots: all slots are idle
0.39.407.770 I srv operator(): Chat format: peg-native
0.39.409.737 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.896 (> 0.100 thold), f_keep = 0.529
0.39.409.766 I slot launch_slot_: id 3 | task 1390 | processing task, is_child = 0
0.39.409.768 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.39.409.768 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.39.409.784 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.39.409.785 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.39.409.796 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.39.409.796 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.39.409.811 I slot update_slots: id 3 | task 1390 | Checking checkpoint with [0, 151] against 0...
0.39.415.303 W slot update_slots: id 3 | task 1390 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.40.691.202 I slot print_timing: id 3 | task 1390 | prompt eval time = 137.33 ms / 22 tokens ( 6.24 ms per token, 160.20 tokens per second)
0.40.691.205 I slot print_timing: id 3 | task 1390 | eval time = 1144.05 ms / 72 tokens ( 15.89 ms per token, 62.93 tokens per second)
0.40.691.206 I slot print_timing: id 3 | task 1390 | total time = 1281.39 ms / 94 tokens
0.40.691.207 I slot print_timing: id 3 | task 1390 | graphs reused = 1392
0.40.691.243 I slot release: id 3 | task 1390 | stop processing: n_tokens = 244, truncated = 0
0.40.691.252 I srv update_slots: all slots are idle
0.40.696.715 I srv operator(): Chat format: peg-native
0.40.698.658 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.896 (> 0.100 thold), f_keep = 0.635
0.40.698.682 I slot launch_slot_: id 3 | task 1465 | processing task, is_child = 0
0.40.698.683 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.40.698.684 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.40.698.698 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.40.698.698 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.40.698.712 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.40.698.713 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.40.698.729 I slot update_slots: id 3 | task 1465 | Checking checkpoint with [0, 151] against 0...
0.40.704.225 W slot update_slots: id 3 | task 1465 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.42.223.129 I slot print_timing: id 3 | task 1465 | prompt eval time = 130.22 ms / 22 tokens ( 5.92 ms per token, 168.95 tokens per second)
0.42.223.134 I slot print_timing: id 3 | task 1465 | eval time = 1394.17 ms / 87 tokens ( 16.02 ms per token, 62.40 tokens per second)
0.42.223.135 I slot print_timing: id 3 | task 1465 | total time = 1524.39 ms / 109 tokens
0.42.223.135 I slot print_timing: id 3 | task 1465 | graphs reused = 1476
0.42.223.169 I slot release: id 3 | task 1465 | stop processing: n_tokens = 259, truncated = 0
0.42.223.177 I srv update_slots: all slots are idle
0.42.228.641 I srv operator(): Chat format: peg-native
0.42.230.567 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.886 (> 0.100 thold), f_keep = 0.598
0.42.230.599 I slot launch_slot_: id 3 | task 1555 | processing task, is_child = 0
0.42.230.601 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.42.230.602 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.42.230.617 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.42.230.617 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.42.230.628 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.42.230.628 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.42.230.644 I slot update_slots: id 3 | task 1555 | Checking checkpoint with [0, 151] against 0...
0.42.236.100 W slot update_slots: id 3 | task 1555 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.43.982.382 I slot print_timing: id 3 | task 1555 | prompt eval time = 136.07 ms / 24 tokens ( 5.67 ms per token, 176.38 tokens per second)
0.43.982.385 I slot print_timing: id 3 | task 1555 | eval time = 1615.66 ms / 101 tokens ( 16.00 ms per token, 62.51 tokens per second)
0.43.982.386 I slot print_timing: id 3 | task 1555 | total time = 1751.73 ms / 125 tokens
0.43.982.387 I slot print_timing: id 3 | task 1555 | graphs reused = 1574
0.43.982.423 I slot release: id 3 | task 1555 | stop processing: n_tokens = 275, truncated = 0
0.43.982.437 I srv update_slots: all slots are idle
0.43.987.945 I srv operator(): Chat format: peg-native
0.43.989.888 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.906 (> 0.100 thold), f_keep = 0.564
0.43.989.919 I slot launch_slot_: id 3 | task 1659 | processing task, is_child = 0
0.43.989.921 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.43.989.922 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.43.989.936 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.43.989.936 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.43.989.947 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.43.989.947 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.43.989.960 I slot update_slots: id 3 | task 1659 | Checking checkpoint with [0, 151] against 0...
0.43.995.329 W slot update_slots: id 3 | task 1659 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.45.985.407 I slot print_timing: id 3 | task 1659 | prompt eval time = 108.31 ms / 20 tokens ( 5.42 ms per token, 184.65 tokens per second)
0.45.985.411 I slot print_timing: id 3 | task 1659 | eval time = 1887.13 ms / 118 tokens ( 15.99 ms per token, 62.53 tokens per second)
0.45.985.411 I slot print_timing: id 3 | task 1659 | total time = 1995.44 ms / 138 tokens
0.45.985.412 I slot print_timing: id 3 | task 1659 | graphs reused = 1689
0.45.985.462 I slot release: id 3 | task 1659 | stop processing: n_tokens = 288, truncated = 0
0.45.985.472 I srv update_slots: all slots are idle
0.45.990.491 I srv operator(): Chat format: peg-native
0.45.992.412 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.886 (> 0.100 thold), f_keep = 0.538
0.45.992.445 I slot launch_slot_: id 3 | task 1780 | processing task, is_child = 0
0.45.992.447 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.45.992.447 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.45.992.458 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.45.992.458 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.45.992.467 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.45.992.467 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.45.992.479 I slot update_slots: id 3 | task 1780 | Checking checkpoint with [0, 151] against 0...
0.45.997.888 W slot update_slots: id 3 | task 1780 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.48.066.468 I slot print_timing: id 3 | task 1780 | prompt eval time = 131.20 ms / 24 tokens ( 5.47 ms per token, 182.92 tokens per second)
0.48.066.472 I slot print_timing: id 3 | task 1780 | eval time = 1942.78 ms / 121 tokens ( 16.06 ms per token, 62.28 tokens per second)
0.48.066.473 I slot print_timing: id 3 | task 1780 | total time = 2073.98 ms / 145 tokens
0.48.066.474 I slot print_timing: id 3 | task 1780 | graphs reused = 1807
0.48.066.507 I slot release: id 3 | task 1780 | stop processing: n_tokens = 295, truncated = 0
0.48.066.519 I srv update_slots: all slots are idle
0.48.071.649 I srv operator(): Chat format: peg-native
0.48.073.605 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.912 (> 0.100 thold), f_keep = 0.525
0.48.073.639 I slot launch_slot_: id 3 | task 1904 | processing task, is_child = 0
0.48.073.641 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.48.073.641 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.48.073.653 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.48.073.653 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.48.073.665 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.48.073.665 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.48.073.681 I slot update_slots: id 3 | task 1904 | Checking checkpoint with [0, 151] against 0...
0.48.079.141 W slot update_slots: id 3 | task 1904 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.49.291.301 I slot print_timing: id 3 | task 1904 | prompt eval time = 106.27 ms / 19 tokens ( 5.59 ms per token, 178.80 tokens per second)
0.49.291.304 I slot print_timing: id 3 | task 1904 | eval time = 1111.35 ms / 70 tokens ( 15.88 ms per token, 62.99 tokens per second)
0.49.291.304 I slot print_timing: id 3 | task 1904 | total time = 1217.61 ms / 89 tokens
0.49.291.305 I slot print_timing: id 3 | task 1904 | graphs reused = 1875
0.49.291.340 I slot release: id 3 | task 1904 | stop processing: n_tokens = 239, truncated = 0
0.49.291.350 I srv update_slots: all slots are idle
0.49.296.746 I srv operator(): Chat format: peg-native
0.49.298.904 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.923 (> 0.100 thold), f_keep = 0.649
0.49.298.935 I slot launch_slot_: id 3 | task 1977 | processing task, is_child = 0
0.49.298.937 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.49.298.938 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.49.298.951 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.49.298.952 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.49.298.965 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.49.298.966 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.49.298.984 I slot update_slots: id 3 | task 1977 | Checking checkpoint with [0, 151] against 0...
0.49.304.360 W slot update_slots: id 3 | task 1977 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.50.373.285 I slot print_timing: id 3 | task 1977 | prompt eval time = 104.03 ms / 17 tokens ( 6.12 ms per token, 163.41 tokens per second)
0.50.373.289 I slot print_timing: id 3 | task 1977 | eval time = 970.26 ms / 61 tokens ( 15.91 ms per token, 62.87 tokens per second)
0.50.373.290 I slot print_timing: id 3 | task 1977 | total time = 1074.30 ms / 78 tokens
0.50.373.291 I slot print_timing: id 3 | task 1977 | graphs reused = 1934
0.50.373.321 I slot release: id 3 | task 1977 | stop processing: n_tokens = 228, truncated = 0
0.50.373.329 I srv update_slots: all slots are idle
0.50.378.368 I srv operator(): Chat format: peg-native
0.50.380.376 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.929 (> 0.100 thold), f_keep = 0.684
0.50.380.406 I slot launch_slot_: id 3 | task 2041 | processing task, is_child = 0
0.50.380.408 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.50.380.409 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.50.380.420 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.50.380.421 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.50.380.435 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.50.380.435 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.50.380.448 I slot update_slots: id 3 | task 2041 | Checking checkpoint with [0, 151] against 0...
0.50.385.922 W slot update_slots: id 3 | task 2041 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.51.135.242 I slot print_timing: id 3 | task 2041 | prompt eval time = 104.80 ms / 17 tokens ( 6.16 ms per token, 162.21 tokens per second)
0.51.135.245 I slot print_timing: id 3 | task 2041 | eval time = 649.99 ms / 41 tokens ( 15.85 ms per token, 63.08 tokens per second)
0.51.135.246 I slot print_timing: id 3 | task 2041 | total time = 754.79 ms / 58 tokens
0.51.135.247 I slot print_timing: id 3 | task 2041 | graphs reused = 1973
0.51.135.298 I slot release: id 3 | task 2041 | stop processing: n_tokens = 208, truncated = 0
0.51.135.307 I srv update_slots: all slots are idle
0.51.140.100 I srv operator(): Chat format: peg-native
0.51.142.023 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.928 (> 0.100 thold), f_keep = 0.745
0.51.142.045 I slot launch_slot_: id 3 | task 2085 | processing task, is_child = 0
0.51.142.047 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.51.142.048 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.51.142.059 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.51.142.059 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.51.142.068 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.51.142.068 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.51.142.080 I slot update_slots: id 3 | task 2085 | Checking checkpoint with [0, 151] against 0...
0.51.147.759 W slot update_slots: id 3 | task 2085 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.52.224.344 I slot print_timing: id 3 | task 2085 | prompt eval time = 104.36 ms / 16 tokens ( 6.52 ms per token, 153.32 tokens per second)
0.52.224.347 I slot print_timing: id 3 | task 2085 | eval time = 977.90 ms / 61 tokens ( 16.03 ms per token, 62.38 tokens per second)
0.52.224.348 I slot print_timing: id 3 | task 2085 | total time = 1082.26 ms / 77 tokens
0.52.224.349 I slot print_timing: id 3 | task 2085 | graphs reused = 2032
0.52.224.383 I slot release: id 3 | task 2085 | stop processing: n_tokens = 227, truncated = 0
0.52.224.391 I srv update_slots: all slots are idle
0.52.229.488 I srv operator(): Chat format: peg-native
0.52.231.411 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.901 (> 0.100 thold), f_keep = 0.683
0.52.231.440 I slot launch_slot_: id 3 | task 2149 | processing task, is_child = 0
0.52.231.441 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.52.231.442 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.52.231.453 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.52.231.454 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.52.231.463 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.52.231.464 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.52.231.477 I slot update_slots: id 3 | task 2149 | Checking checkpoint with [0, 151] against 0...
0.52.237.026 W slot update_slots: id 3 | task 2149 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.53.148.391 I slot print_timing: id 3 | task 2149 | prompt eval time = 108.31 ms / 21 tokens ( 5.16 ms per token, 193.89 tokens per second)
0.53.148.394 I slot print_timing: id 3 | task 2149 | eval time = 808.60 ms / 51 tokens ( 15.85 ms per token, 63.07 tokens per second)
0.53.148.395 I slot print_timing: id 3 | task 2149 | total time = 916.91 ms / 72 tokens
0.53.148.395 I slot print_timing: id 3 | task 2149 | graphs reused = 2081
0.53.148.460 I slot release: id 3 | task 2149 | stop processing: n_tokens = 222, truncated = 0
0.53.148.469 I srv update_slots: all slots are idle
0.53.153.327 I srv operator(): Chat format: peg-native
0.53.155.303 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.906 (> 0.100 thold), f_keep = 0.698
0.53.155.337 I slot launch_slot_: id 3 | task 2203 | processing task, is_child = 0
0.53.155.340 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.53.155.341 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.53.155.357 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.53.155.358 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.53.155.372 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.53.155.373 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.53.155.394 I slot update_slots: id 3 | task 2203 | Checking checkpoint with [0, 151] against 0...
0.53.160.956 W slot update_slots: id 3 | task 2203 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.54.633.345 I slot print_timing: id 3 | task 2203 | prompt eval time = 109.47 ms / 20 tokens ( 5.47 ms per token, 182.70 tokens per second)
0.54.633.348 I slot print_timing: id 3 | task 2203 | eval time = 1368.48 ms / 86 tokens ( 15.91 ms per token, 62.84 tokens per second)
0.54.633.349 I slot print_timing: id 3 | task 2203 | total time = 1477.95 ms / 106 tokens
0.54.633.349 I slot print_timing: id 3 | task 2203 | graphs reused = 2165
0.54.633.387 I slot release: id 3 | task 2203 | stop processing: n_tokens = 256, truncated = 0
0.54.633.396 I srv update_slots: all slots are idle
0.54.638.477 I srv operator(): Chat format: peg-native
0.54.640.411 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.876 (> 0.100 thold), f_keep = 0.605
0.54.640.445 I slot launch_slot_: id 3 | task 2292 | processing task, is_child = 0
0.54.640.446 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.54.640.446 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.54.640.463 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.54.640.463 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.54.640.471 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.54.640.472 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.54.640.484 I slot update_slots: id 3 | task 2292 | Checking checkpoint with [0, 151] against 0...
0.54.645.970 W slot update_slots: id 3 | task 2292 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.56.801.413 I slot print_timing: id 3 | task 2292 | prompt eval time = 139.76 ms / 26 tokens ( 5.38 ms per token, 186.03 tokens per second)
0.56.801.417 I slot print_timing: id 3 | task 2292 | eval time = 2021.16 ms / 126 tokens ( 16.04 ms per token, 62.34 tokens per second)
0.56.801.418 I slot print_timing: id 3 | task 2292 | total time = 2160.92 ms / 152 tokens
0.56.801.419 I slot print_timing: id 3 | task 2292 | graphs reused = 2288
0.56.801.465 I slot release: id 3 | task 2292 | stop processing: n_tokens = 302, truncated = 0
0.56.801.475 I srv update_slots: all slots are idle
0.56.806.289 I srv operator(): Chat format: peg-native
0.56.808.218 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.881 (> 0.100 thold), f_keep = 0.513
0.56.808.245 I slot launch_slot_: id 3 | task 2421 | processing task, is_child = 0
0.56.808.247 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.56.808.247 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.56.808.259 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.56.808.260 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.56.808.270 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.56.808.270 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.56.808.284 I slot update_slots: id 3 | task 2421 | Checking checkpoint with [0, 151] against 0...
0.56.813.993 W slot update_slots: id 3 | task 2421 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.58.421.570 I slot print_timing: id 3 | task 2421 | prompt eval time = 136.97 ms / 25 tokens ( 5.48 ms per token, 182.53 tokens per second)
0.58.421.573 I slot print_timing: id 3 | task 2421 | eval time = 1476.31 ms / 92 tokens ( 16.05 ms per token, 62.32 tokens per second)
0.58.421.574 I slot print_timing: id 3 | task 2421 | total time = 1613.28 ms / 117 tokens
0.58.421.575 I slot print_timing: id 3 | task 2421 | graphs reused = 2377
0.58.421.605 I slot release: id 3 | task 2421 | stop processing: n_tokens = 267, truncated = 0
0.58.421.615 I srv update_slots: all slots are idle
0.58.426.918 I srv operator(): Chat format: peg-native
0.58.428.857 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.928 (> 0.100 thold), f_keep = 0.581
0.58.428.886 I slot launch_slot_: id 3 | task 2516 | processing task, is_child = 0
0.58.428.888 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.58.428.888 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.58.428.900 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.58.428.900 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.58.428.910 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.58.428.910 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.58.428.924 I slot update_slots: id 3 | task 2516 | Checking checkpoint with [0, 151] against 0...
0.58.434.564 W slot update_slots: id 3 | task 2516 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
0.59.468.398 I slot print_timing: id 3 | task 2516 | prompt eval time = 103.89 ms / 16 tokens ( 6.49 ms per token, 154.01 tokens per second)
0.59.468.402 I slot print_timing: id 3 | task 2516 | eval time = 935.58 ms / 59 tokens ( 15.86 ms per token, 63.06 tokens per second)
0.59.468.403 I slot print_timing: id 3 | task 2516 | total time = 1039.47 ms / 75 tokens
0.59.468.404 I slot print_timing: id 3 | task 2516 | graphs reused = 2434
0.59.468.450 I slot release: id 3 | task 2516 | stop processing: n_tokens = 225, truncated = 0
0.59.468.461 I srv update_slots: all slots are idle
0.59.473.560 I srv operator(): Chat format: peg-native
0.59.475.499 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.912 (> 0.100 thold), f_keep = 0.689
0.59.475.525 I slot launch_slot_: id 3 | task 2578 | processing task, is_child = 0
0.59.475.527 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.59.475.527 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.59.475.537 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.59.475.538 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.59.475.552 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.59.475.553 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.59.475.565 I slot update_slots: id 3 | task 2578 | Checking checkpoint with [0, 151] against 0...
0.59.481.038 W slot update_slots: id 3 | task 2578 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
1.01.462.577 I slot print_timing: id 3 | task 2578 | prompt eval time = 108.56 ms / 19 tokens ( 5.71 ms per token, 175.02 tokens per second)
1.01.462.581 I slot print_timing: id 3 | task 2578 | eval time = 1878.45 ms / 117 tokens ( 16.06 ms per token, 62.29 tokens per second)
1.01.462.581 I slot print_timing: id 3 | task 2578 | total time = 1987.01 ms / 136 tokens
1.01.462.582 I slot print_timing: id 3 | task 2578 | graphs reused = 2548
1.01.462.615 I slot release: id 3 | task 2578 | stop processing: n_tokens = 286, truncated = 0
1.01.462.625 I srv update_slots: all slots are idle
1.01.467.975 I srv operator(): Chat format: peg-native
1.01.469.884 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.896 (> 0.100 thold), f_keep = 0.542
1.01.469.912 I slot launch_slot_: id 3 | task 2698 | processing task, is_child = 0
1.01.469.914 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.01.469.915 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.01.469.928 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.01.469.928 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.01.469.938 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.01.469.938 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.01.469.952 I slot update_slots: id 3 | task 2698 | Checking checkpoint with [0, 151] against 0...
1.01.475.731 W slot update_slots: id 3 | task 2698 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
1.03.255.610 I slot print_timing: id 3 | task 2698 | prompt eval time = 132.29 ms / 22 tokens ( 6.01 ms per token, 166.30 tokens per second)
1.03.255.613 I slot print_timing: id 3 | task 2698 | eval time = 1653.36 ms / 103 tokens ( 16.05 ms per token, 62.30 tokens per second)
1.03.255.614 I slot print_timing: id 3 | task 2698 | total time = 1785.65 ms / 125 tokens
1.03.255.614 I slot print_timing: id 3 | task 2698 | graphs reused = 2648
1.03.255.648 I slot release: id 3 | task 2698 | stop processing: n_tokens = 275, truncated = 0
1.03.255.657 I srv update_slots: all slots are idle
1.03.261.160 I srv operator(): Chat format: peg-native
1.03.263.133 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.842 (> 0.100 thold), f_keep = 0.564
1.03.263.162 I slot launch_slot_: id 3 | task 2804 | processing task, is_child = 0
1.03.263.164 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.03.263.165 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.03.263.178 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.03.263.179 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.03.263.189 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.03.263.190 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.03.263.204 I slot update_slots: id 3 | task 2804 | Checking checkpoint with [0, 151] against 0...
1.03.269.044 W slot update_slots: id 3 | task 2804 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
1.06.434.596 I slot print_timing: id 3 | task 2804 | n_decoded = 187, tg = 62.14 t/s, tg_3s = 62.14 t/s
1.07.681.462 I slot print_timing: id 3 | task 2804 | prompt eval time = 161.87 ms / 33 tokens ( 4.91 ms per token, 203.86 tokens per second)
1.07.681.465 I slot print_timing: id 3 | task 2804 | eval time = 4256.38 ms / 264 tokens ( 16.12 ms per token, 62.02 tokens per second)
1.07.681.466 I slot print_timing: id 3 | task 2804 | total time = 4418.25 ms / 297 tokens
1.07.681.466 I slot print_timing: id 3 | task 2804 | graphs reused = 2909
1.07.681.499 I slot release: id 3 | task 2804 | stop processing: n_tokens = 447, truncated = 0
1.07.681.509 I srv update_slots: all slots are idle
1.07.686.803 I srv operator(): Chat format: peg-native
1.07.688.802 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.891 (> 0.100 thold), f_keep = 0.349
1.07.688.804 I srv get_availabl: updating prompt cache
1.07.688.873 W srv prompt_save: - saving prompt with length 447, total state size = 42.791 MiB (draft: 0.000 MiB)
1.07.724.173 I srv load: - looking for better prompt, base f_keep = 0.349, sim = 0.891
1.07.724.180 I srv update: - cache state: 2 prompts, 98.633 MiB (limits: 8192.000 MiB, 8192 tokens, 67025 est)
1.07.724.181 I srv update: - prompt 0x58ae0b1f7710: 360 tokens, checkpoints: 1, 45.153 MiB
1.07.724.181 I srv update: - prompt 0x58ae0b490110: 447 tokens, checkpoints: 1, 53.481 MiB
1.07.724.182 I srv get_availabl: prompt cache update took 35.38 ms
1.07.724.247 I slot launch_slot_: id 3 | task 3071 | processing task, is_child = 0
1.07.724.248 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.07.724.249 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.07.724.263 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.07.724.264 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.07.724.272 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.07.724.273 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.07.724.290 I slot update_slots: id 3 | task 3071 | Checking checkpoint with [0, 151] against 0...
1.07.729.496 W slot update_slots: id 3 | task 3071 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
1.10.869.506 I slot print_timing: id 3 | task 3071 | n_decoded = 186, tg = 61.80 t/s, tg_3s = 61.80 t/s
1.11.976.579 I slot print_timing: id 3 | task 3071 | prompt eval time = 135.46 ms / 24 tokens ( 5.64 ms per token, 177.17 tokens per second)
1.11.976.582 I slot print_timing: id 3 | task 3071 | eval time = 4116.82 ms / 254 tokens ( 16.21 ms per token, 61.70 tokens per second)
1.11.976.583 I slot print_timing: id 3 | task 3071 | total time = 4252.28 ms / 278 tokens
1.11.976.584 I slot print_timing: id 3 | task 3071 | graphs reused = 3160
1.11.976.618 I slot release: id 3 | task 3071 | stop processing: n_tokens = 428, truncated = 0
1.11.976.627 I srv update_slots: all slots are idle
1.11.982.521 I srv operator(): Chat format: peg-native
1.11.984.491 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.912 (> 0.100 thold), f_keep = 0.362
1.11.984.493 I srv get_availabl: updating prompt cache
1.11.984.556 W srv prompt_save: - saving prompt with length 428, total state size = 40.972 MiB (draft: 0.000 MiB)
1.12.022.854 I srv load: - looking for better prompt, base f_keep = 0.362, sim = 0.912
1.12.022.862 I srv update: - cache state: 3 prompts, 150.295 MiB (limits: 8192.000 MiB, 8192 tokens, 67314 est)
1.12.022.863 I srv update: - prompt 0x58ae0b1f7710: 360 tokens, checkpoints: 1, 45.153 MiB
1.12.022.864 I srv update: - prompt 0x58ae0b490110: 447 tokens, checkpoints: 1, 53.481 MiB
1.12.022.864 I srv update: - prompt 0x58ae0b3ed910: 428 tokens, checkpoints: 1, 51.662 MiB
1.12.022.865 I srv get_availabl: prompt cache update took 38.37 ms
1.12.022.920 I slot launch_slot_: id 3 | task 3328 | processing task, is_child = 0
1.12.022.921 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.12.022.921 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.12.022.937 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.12.022.937 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.12.022.946 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.12.022.946 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.12.022.965 I slot update_slots: id 3 | task 3328 | Checking checkpoint with [0, 151] against 0...
1.12.028.357 W slot update_slots: id 3 | task 3328 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
1.15.139.620 I slot print_timing: id 3 | task 3328 | n_decoded = 186, tg = 61.78 t/s, tg_3s = 61.78 t/s
1.15.401.482 I slot print_timing: id 3 | task 3328 | prompt eval time = 106.03 ms / 19 tokens ( 5.58 ms per token, 179.19 tokens per second)
1.15.401.486 I slot print_timing: id 3 | task 3328 | eval time = 3272.48 ms / 202 tokens ( 16.20 ms per token, 61.73 tokens per second)
1.15.401.486 I slot print_timing: id 3 | task 3328 | total time = 3378.51 ms / 221 tokens
1.15.401.487 I slot print_timing: id 3 | task 3328 | graphs reused = 3359
1.15.401.522 I slot release: id 3 | task 3328 | stop processing: n_tokens = 371, truncated = 0
1.15.401.531 I srv update_slots: all slots are idle
1.15.406.550 I srv operator(): Chat format: peg-native
1.15.408.498 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.886 (> 0.100 thold), f_keep = 0.418
1.15.408.499 I srv get_availabl: updating prompt cache
1.15.408.545 W srv prompt_save: - saving prompt with length 371, total state size = 35.516 MiB (draft: 0.000 MiB)
1.15.442.032 I srv load: - looking for better prompt, base f_keep = 0.418, sim = 0.886
1.15.442.042 I srv update: - cache state: 4 prompts, 196.501 MiB (limits: 8192.000 MiB, 8192 tokens, 66953 est)
1.15.442.043 I srv update: - prompt 0x58ae0b1f7710: 360 tokens, checkpoints: 1, 45.153 MiB
1.15.442.044 I srv update: - prompt 0x58ae0b490110: 447 tokens, checkpoints: 1, 53.481 MiB
1.15.442.045 I srv update: - prompt 0x58ae0b3ed910: 428 tokens, checkpoints: 1, 51.662 MiB
1.15.442.046 I srv update: - prompt 0x58ae0b2da2c0: 371 tokens, checkpoints: 1, 46.206 MiB
1.15.442.047 I srv get_availabl: prompt cache update took 33.55 ms
1.15.442.112 I slot launch_slot_: id 3 | task 3533 | processing task, is_child = 0
1.15.442.113 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.15.442.115 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.15.442.132 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.15.442.132 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.15.442.142 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.15.442.142 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.15.442.164 I slot update_slots: id 3 | task 3533 | Checking checkpoint with [0, 151] against 0...
1.15.447.290 W slot update_slots: id 3 | task 3533 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
1.17.953.600 I slot print_timing: id 3 | task 3533 | prompt eval time = 136.44 ms / 24 tokens ( 5.68 ms per token, 175.91 tokens per second)
1.17.953.603 I slot print_timing: id 3 | task 3533 | eval time = 2375.00 ms / 147 tokens ( 16.16 ms per token, 61.89 tokens per second)
1.17.953.604 I slot print_timing: id 3 | task 3533 | total time = 2511.43 ms / 171 tokens
1.17.953.604 I slot print_timing: id 3 | task 3533 | graphs reused = 3503
1.17.953.636 I slot release: id 3 | task 3533 | stop processing: n_tokens = 321, truncated = 0
1.17.953.646 I srv update_slots: all slots are idle
1.17.958.792 I srv operator(): Chat format: peg-native
1.17.960.731 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.891 (> 0.100 thold), f_keep = 0.486
1.17.960.733 I srv get_availabl: updating prompt cache
1.17.960.795 W srv prompt_save: - saving prompt with length 321, total state size = 30.729 MiB (draft: 0.000 MiB)
1.17.991.565 I srv load: - looking for better prompt, base f_keep = 0.486, sim = 0.891
1.17.991.575 I srv update: - cache state: 5 prompts, 237.920 MiB (limits: 8192.000 MiB, 8192 tokens, 66349 est)
1.17.991.576 I srv update: - prompt 0x58ae0b1f7710: 360 tokens, checkpoints: 1, 45.153 MiB
1.17.991.576 I srv update: - prompt 0x58ae0b490110: 447 tokens, checkpoints: 1, 53.481 MiB
1.17.991.577 I srv update: - prompt 0x58ae0b3ed910: 428 tokens, checkpoints: 1, 51.662 MiB
1.17.991.577 I srv update: - prompt 0x58ae0b2da2c0: 371 tokens, checkpoints: 1, 46.206 MiB
1.17.991.578 I srv update: - prompt 0x58ae125b2eb0: 321 tokens, checkpoints: 1, 41.419 MiB
1.17.991.580 I srv get_availabl: prompt cache update took 30.85 ms
1.17.991.648 I slot launch_slot_: id 3 | task 3683 | processing task, is_child = 0
1.17.991.649 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.17.991.650 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.17.991.666 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.17.991.666 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.17.991.679 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.17.991.679 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.17.991.701 I slot update_slots: id 3 | task 3683 | Checking checkpoint with [0, 151] against 0...
1.17.997.021 W slot update_slots: id 3 | task 3683 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
1.19.655.020 I slot print_timing: id 3 | task 3683 | prompt eval time = 137.59 ms / 24 tokens ( 5.73 ms per token, 174.43 tokens per second)
1.19.655.024 I slot print_timing: id 3 | task 3683 | eval time = 1525.72 ms / 94 tokens ( 16.23 ms per token, 61.61 tokens per second)
1.19.655.025 I slot print_timing: id 3 | task 3683 | total time = 1663.31 ms / 118 tokens
1.19.655.025 I slot print_timing: id 3 | task 3683 | graphs reused = 3594
1.19.655.060 I slot release: id 3 | task 3683 | stop processing: n_tokens = 268, truncated = 0
1.19.655.070 I srv update_slots: all slots are idle
1.19.660.728 I srv operator(): Chat format: peg-native
1.19.662.687 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.917 (> 0.100 thold), f_keep = 0.578
1.19.662.717 I slot launch_slot_: id 3 | task 3780 | processing task, is_child = 0
1.19.662.719 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.19.662.719 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.19.662.740 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.19.662.740 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.19.662.750 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.19.662.750 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.19.662.765 I slot update_slots: id 3 | task 3780 | Checking checkpoint with [0, 151] against 0...
1.19.668.330 W slot update_slots: id 3 | task 3780 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
1.22.274.020 I slot print_timing: id 3 | task 3780 | prompt eval time = 106.97 ms / 18 tokens ( 5.94 ms per token, 168.27 tokens per second)
1.22.274.023 I slot print_timing: id 3 | task 3780 | eval time = 2504.28 ms / 154 tokens ( 16.26 ms per token, 61.49 tokens per second)
1.22.274.024 I slot print_timing: id 3 | task 3780 | total time = 2611.25 ms / 172 tokens
1.22.274.024 I slot print_timing: id 3 | task 3780 | graphs reused = 3745
1.22.274.062 I slot release: id 3 | task 3780 | stop processing: n_tokens = 322, truncated = 0
1.22.274.072 I srv update_slots: all slots are idle
1.22.279.207 I srv operator(): Chat format: peg-native
1.22.281.140 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.934 (> 0.100 thold), f_keep = 0.481
1.22.281.142 I srv get_availabl: updating prompt cache
1.22.281.211 W srv prompt_save: - saving prompt with length 322, total state size = 30.825 MiB (draft: 0.000 MiB)
1.22.311.493 I srv load: - looking for better prompt, base f_keep = 0.481, sim = 0.934
1.22.311.505 I srv update: - cache state: 6 prompts, 279.435 MiB (limits: 8192.000 MiB, 8192 tokens, 65932 est)
1.22.311.505 I srv update: - prompt 0x58ae0b1f7710: 360 tokens, checkpoints: 1, 45.153 MiB
1.22.311.506 I srv update: - prompt 0x58ae0b490110: 447 tokens, checkpoints: 1, 53.481 MiB
1.22.311.508 I srv update: - prompt 0x58ae0b3ed910: 428 tokens, checkpoints: 1, 51.662 MiB
1.22.311.508 I srv update: - prompt 0x58ae0b2da2c0: 371 tokens, checkpoints: 1, 46.206 MiB
1.22.311.509 I srv update: - prompt 0x58ae125b2eb0: 321 tokens, checkpoints: 1, 41.419 MiB
1.22.311.510 I srv update: - prompt 0x58ae0b16d160: 322 tokens, checkpoints: 1, 41.515 MiB
1.22.311.511 I srv get_availabl: prompt cache update took 30.37 ms
1.22.311.576 I slot launch_slot_: id 3 | task 3937 | processing task, is_child = 0
1.22.311.577 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.22.311.578 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.22.311.593 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.22.311.593 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.22.311.605 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.22.311.605 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.22.311.626 I slot update_slots: id 3 | task 3937 | Checking checkpoint with [0, 151] against 0...
1.22.316.973 W slot update_slots: id 3 | task 3937 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
1.24.157.603 I slot print_timing: id 3 | task 3937 | prompt eval time = 101.71 ms / 15 tokens ( 6.78 ms per token, 147.47 tokens per second)
1.24.157.606 I slot print_timing: id 3 | task 3937 | eval time = 1744.26 ms / 107 tokens ( 16.30 ms per token, 61.34 tokens per second)
1.24.157.607 I slot print_timing: id 3 | task 3937 | total time = 1845.97 ms / 122 tokens
1.24.157.607 I slot print_timing: id 3 | task 3937 | graphs reused = 3849
1.24.157.639 I slot release: id 3 | task 3937 | stop processing: n_tokens = 272, truncated = 0
1.24.157.648 I srv update_slots: all slots are idle
1.24.162.672 I srv operator(): Chat format: peg-native
1.24.164.621 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.901 (> 0.100 thold), f_keep = 0.570
1.24.164.647 I slot launch_slot_: id 3 | task 4047 | processing task, is_child = 0
1.24.164.647 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.24.164.648 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.24.164.661 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.24.164.661 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.24.164.672 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.24.164.672 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.24.164.687 I slot update_slots: id 3 | task 4047 | Checking checkpoint with [0, 151] against 0...
1.24.170.629 W slot update_slots: id 3 | task 4047 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
1.27.026.474 I slot print_timing: id 3 | task 4047 | prompt eval time = 111.60 ms / 21 tokens ( 5.31 ms per token, 188.17 tokens per second)
1.27.026.478 I slot print_timing: id 3 | task 4047 | eval time = 2750.18 ms / 171 tokens ( 16.08 ms per token, 62.18 tokens per second)
1.27.026.478 I slot print_timing: id 3 | task 4047 | total time = 2861.78 ms / 192 tokens
1.27.026.479 I slot print_timing: id 3 | task 4047 | graphs reused = 4017
1.27.026.514 I slot release: id 3 | task 4047 | stop processing: n_tokens = 342, truncated = 0
1.27.026.525 I srv update_slots: all slots are idle
1.27.031.566 I srv operator(): Chat format: peg-native
1.27.033.528 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.912 (> 0.100 thold), f_keep = 0.453
1.27.033.530 I srv get_availabl: updating prompt cache
1.27.033.570 W srv prompt_save: - saving prompt with length 342, total state size = 32.739 MiB (draft: 0.000 MiB)
1.27.065.480 I srv load: - looking for better prompt, base f_keep = 0.453, sim = 0.912
1.27.065.487 I srv load: - found better prompt with f_keep = 0.486, sim = 0.918
1.27.080.006 I srv update: - cache state: 6 prompts, 281.446 MiB (limits: 8192.000 MiB, 8192 tokens, 66072 est)
1.27.080.010 I srv update: - prompt 0x58ae0b1f7710: 360 tokens, checkpoints: 1, 45.153 MiB
1.27.080.011 I srv update: - prompt 0x58ae0b490110: 447 tokens, checkpoints: 1, 53.481 MiB
1.27.080.011 I srv update: - prompt 0x58ae0b3ed910: 428 tokens, checkpoints: 1, 51.662 MiB
1.27.080.012 I srv update: - prompt 0x58ae0b2da2c0: 371 tokens, checkpoints: 1, 46.206 MiB
1.27.080.012 I srv update: - prompt 0x58ae0b16d160: 322 tokens, checkpoints: 1, 41.515 MiB
1.27.080.013 I srv update: - prompt 0x58ae0b066a50: 342 tokens, checkpoints: 1, 43.430 MiB
1.27.080.014 I srv get_availabl: prompt cache update took 46.48 ms
1.27.080.064 I slot launch_slot_: id 3 | task 4221 | processing task, is_child = 0
1.27.080.065 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.27.080.066 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.27.080.079 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.27.080.080 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.27.080.089 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.27.080.089 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.27.080.105 I slot update_slots: id 3 | task 4221 | Checking checkpoint with [0, 151] against 0...
1.27.085.535 W slot update_slots: id 3 | task 4221 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
1.28.517.584 I slot print_timing: id 3 | task 4221 | prompt eval time = 105.99 ms / 19 tokens ( 5.58 ms per token, 179.26 tokens per second)
1.28.517.588 I slot print_timing: id 3 | task 4221 | eval time = 1331.47 ms / 83 tokens ( 16.04 ms per token, 62.34 tokens per second)
1.28.517.589 I slot print_timing: id 3 | task 4221 | total time = 1437.47 ms / 102 tokens
1.28.517.589 I slot print_timing: id 3 | task 4221 | graphs reused = 4098
1.28.517.613 I slot release: id 3 | task 4221 | stop processing: n_tokens = 252, truncated = 0
1.28.517.622 I srv update_slots: all slots are idle
1.28.523.403 I srv operator(): Chat format: peg-native
1.28.525.445 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.929 (> 0.100 thold), f_keep = 0.619
1.28.525.475 I slot launch_slot_: id 3 | task 4307 | processing task, is_child = 0
1.28.525.477 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.28.525.478 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.28.525.491 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.28.525.492 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.28.525.502 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.28.525.502 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.28.525.517 I slot update_slots: id 3 | task 4307 | Checking checkpoint with [0, 151] against 0...
1.28.531.081 W slot update_slots: id 3 | task 4307 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
1.30.686.821 I slot print_timing: id 3 | task 4307 | prompt eval time = 104.70 ms / 17 tokens ( 6.16 ms per token, 162.37 tokens per second)
1.30.686.824 I slot print_timing: id 3 | task 4307 | eval time = 2056.60 ms / 128 tokens ( 16.07 ms per token, 62.24 tokens per second)
1.30.686.825 I slot print_timing: id 3 | task 4307 | total time = 2161.30 ms / 145 tokens
1.30.686.826 I slot print_timing: id 3 | task 4307 | graphs reused = 4223
1.30.686.882 I slot release: id 3 | task 4307 | stop processing: n_tokens = 295, truncated = 0
1.30.686.893 I srv update_slots: all slots are idle
1.30.691.720 I srv operator(): Chat format: peg-native
1.30.693.641 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.901 (> 0.100 thold), f_keep = 0.525
1.30.693.673 I slot launch_slot_: id 3 | task 4438 | processing task, is_child = 0
1.30.693.675 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.30.693.676 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.30.693.688 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.30.693.688 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.30.693.698 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.30.693.699 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.30.693.712 I slot update_slots: id 3 | task 4438 | Checking checkpoint with [0, 151] against 0...
1.30.699.281 W slot update_slots: id 3 | task 4438 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
1.33.249.511 I slot print_timing: id 3 | task 4438 | prompt eval time = 111.55 ms / 21 tokens ( 5.31 ms per token, 188.26 tokens per second)
1.33.249.515 I slot print_timing: id 3 | task 4438 | eval time = 2444.25 ms / 152 tokens ( 16.08 ms per token, 62.19 tokens per second)
1.33.249.515 I slot print_timing: id 3 | task 4438 | total time = 2555.79 ms / 173 tokens
1.33.249.516 I slot print_timing: id 3 | task 4438 | graphs reused = 4372
1.33.249.550 I slot release: id 3 | task 4438 | stop processing: n_tokens = 323, truncated = 0
1.33.249.559 I srv update_slots: all slots are idle
1.33.254.701 I srv operator(): Chat format: peg-native
1.33.256.642 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.928 (> 0.100 thold), f_keep = 0.480
1.33.256.644 I srv get_availabl: updating prompt cache
1.33.256.684 W srv prompt_save: - saving prompt with length 323, total state size = 30.921 MiB (draft: 0.000 MiB)
1.33.283.815 I srv load: - looking for better prompt, base f_keep = 0.480, sim = 0.928
1.33.283.828 I srv update: - cache state: 7 prompts, 323.056 MiB (limits: 8192.000 MiB, 8192 tokens, 65752 est)
1.33.283.829 I srv update: - prompt 0x58ae0b1f7710: 360 tokens, checkpoints: 1, 45.153 MiB
1.33.283.829 I srv update: - prompt 0x58ae0b490110: 447 tokens, checkpoints: 1, 53.481 MiB
1.33.283.830 I srv update: - prompt 0x58ae0b3ed910: 428 tokens, checkpoints: 1, 51.662 MiB
1.33.283.830 I srv update: - prompt 0x58ae0b2da2c0: 371 tokens, checkpoints: 1, 46.206 MiB
1.33.283.831 I srv update: - prompt 0x58ae0b16d160: 322 tokens, checkpoints: 1, 41.515 MiB
1.33.283.831 I srv update: - prompt 0x58ae0b066a50: 342 tokens, checkpoints: 1, 43.430 MiB
1.33.283.832 I srv update: - prompt 0x58ae02de0b50: 323 tokens, checkpoints: 1, 41.611 MiB
1.33.283.833 I srv get_availabl: prompt cache update took 27.19 ms
1.33.283.892 I slot launch_slot_: id 3 | task 4593 | processing task, is_child = 0
1.33.283.893 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.33.283.894 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.33.283.908 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.33.283.908 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.33.283.917 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.33.283.917 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.33.283.935 I slot update_slots: id 3 | task 4593 | Checking checkpoint with [0, 151] against 0...
1.33.289.272 W slot update_slots: id 3 | task 4593 | restored context checkpoint (pos_min = 0, pos_max = 151, n_tokens = 152, n_past = 151, size = 10.690 MiB)
1.36.050.462 I slot print_timing: id 3 | task 4593 | prompt eval time = 104.70 ms / 16 tokens ( 6.54 ms per token, 152.81 tokens per second)
1.36.050.465 I slot print_timing: id 3 | task 4593 | eval time = 2661.82 ms / 166 tokens ( 16.04 ms per token, 62.36 tokens per second)
1.36.050.466 I slot print_timing: id 3 | task 4593 | total time = 2766.52 ms / 182 tokens
1.36.050.467 I slot print_timing: id 3 | task 4593 | graphs reused = 4535
1.36.050.503 I slot release: id 3 | task 4593 | stop processing: n_tokens = 332, truncated = 0
1.36.050.512 I srv update_slots: all slots are idle
1.36.051.042 I srv operator(): operator(): cleaning up before exit...
Reference in New Issue Copy Permalink