0.00.065.550 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg) 0.00.065.553 I device_info: 0.00.065.573 I - ROCm0 : AMD Radeon Graphics (32752 MiB, 32728 MiB free) 0.00.065.577 I - ROCm1 : AMD Radeon Graphics (32752 MiB, 32728 MiB free) 0.00.065.584 I - CPU : AMD Ryzen 9 3900X 12-Core Processor (128730 MiB, 128730 MiB free) 0.00.065.640 I system_info: n_threads = 12 (n_threads_batch = 12) / 24 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 | 0.00.065.643 I srv llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true 0.00.065.687 I srv init: running without SSL 0.00.065.750 I srv init: using 23 threads for HTTP server 0.00.066.071 I srv start: binding port with default address family 0.00.067.282 I srv llama_server: loading model 0.00.067.290 I srv load_model: loading model '/home/qrf/.cache/llama.cpp/openai_gpt-oss-20b-Q5_K_M.gguf' 0.00.067.340 I common_init_result: fitting params to device memory ... 0.00.067.342 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on) 0.01.540.821 W load: setting token '<|message|>' (200008) attribute to USER_DEFINED (16), old attributes: 8 0.01.540.828 W load: setting token '<|start|>' (200006) attribute to USER_DEFINED (16), old attributes: 8 0.01.540.828 W load: setting token '<|constrain|>' (200003) attribute to USER_DEFINED (16), old attributes: 8 0.01.541.946 W load: setting token '<|channel|>' (200005) attribute to USER_DEFINED (16), old attributes: 8 0.01.546.966 W load: special_eog_ids contains both '<|return|>' and '<|call|>', or '<|calls|>' and '<|flush|>' tokens, removing '<|end|>' token from EOG list 0.06.374.371 W llama_context: n_ctx_seq (32768) < n_ctx_train (131072) -- the full capacity of the model will not be utilized 0.06.442.418 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable) 0.06.613.646 I srv load_model: initializing slots, n_slots = 4 0.06.646.787 W common_speculative_init: no implementations specified for speculative decoding 0.06.646.791 I slot load_model: id 0 | task -1 | new slot, n_ctx = 32768 0.06.646.796 I slot load_model: id 1 | task -1 | new slot, n_ctx = 32768 0.06.646.797 I slot load_model: id 2 | task -1 | new slot, n_ctx = 32768 0.06.646.797 I slot load_model: id 3 | task -1 | new slot, n_ctx = 32768 0.06.646.850 I srv load_model: prompt cache is enabled, size limit: 8192 MiB 0.06.646.852 I srv load_model: use `--cache-ram 0` to disable the prompt cache 0.06.646.852 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391 0.06.646.852 I srv load_model: context checkpoints enabled, max = 32, min spacing = 256 0.06.646.869 I srv init: idle slots will be saved to prompt cache and cleared upon starting a new task 0.06.650.484 I init: chat template, example_format: '<|start|>system<|message|>You are ChatGPT, a large language model trained by OpenAI. Knowledge cutoff: 2024-06 Current date: 2026-07-12 Reasoning: medium # Valid channels: analysis, commentary, final. Channel must be included for every message.<|end|><|start|>developer<|message|># Instructions You are a helpful assistant<|end|><|start|>user<|message|>Hello<|end|><|start|>assistant<|channel|>final<|message|>Hi there<|end|><|start|>user<|message|>How are you?<|end|><|start|>assistant' 0.06.651.044 I srv init: init: chat template, thinking = 1 0.06.651.077 I srv llama_server: model loaded 0.06.651.082 I srv llama_server: server is listening on http://127.0.0.1:8090 0.06.651.087 I srv update_slots: all slots are idle 0.09.973.519 I srv operator(): Chat format: peg-native 0.09.978.088 I slot get_availabl: id 3 | task -1 | selected slot by LRU, t_last = -1 0.09.978.092 I srv get_availabl: updating prompt cache 0.09.978.100 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000 0.09.978.104 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 32768 tokens, 8589934592 est) 0.09.978.105 I srv get_availabl: prompt cache update took 0.01 ms 0.09.979.099 I slot launch_slot_: id 3 | task 0 | processing task, is_child = 0 0.09.979.102 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.09.979.104 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.09.979.126 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.09.979.126 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.09.979.143 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.09.979.144 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.10.834.435 I slot create_check: id 3 | task 0 | created context checkpoint 1 of 32 (pos_min = 0, pos_max = 352, n_tokens = 353, size = 3.002 MiB) 0.13.747.793 I slot print_timing: id 3 | task 0 | prompt eval time = 1101.19 ms / 455 tokens ( 2.42 ms per token, 413.19 tokens per second) 0.13.747.796 I slot print_timing: id 3 | task 0 | eval time = 2667.43 ms / 234 tokens ( 11.40 ms per token, 87.73 tokens per second) 0.13.747.797 I slot print_timing: id 3 | task 0 | total time = 3768.61 ms / 689 tokens 0.13.747.801 I slot print_timing: id 3 | task 0 | graphs reused = 232 0.13.747.865 I slot release: id 3 | task 0 | stop processing: n_tokens = 688, truncated = 0 0.13.747.870 I srv update_slots: all slots are idle 0.13.761.048 I srv operator(): Chat format: peg-native 0.13.769.464 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.914 (> 0.100 thold), f_keep = 0.663 0.13.770.434 I slot launch_slot_: id 3 | task 237 | processing task, is_child = 0 0.13.770.436 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.13.770.436 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.13.770.456 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.13.770.456 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.13.770.474 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.13.770.474 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.16.307.138 I slot print_timing: id 3 | task 237 | prompt eval time = 166.49 ms / 43 tokens ( 3.87 ms per token, 258.27 tokens per second) 0.16.307.141 I slot print_timing: id 3 | task 237 | eval time = 2370.15 ms / 207 tokens ( 11.45 ms per token, 87.34 tokens per second) 0.16.307.142 I slot print_timing: id 3 | task 237 | total time = 2536.64 ms / 250 tokens 0.16.307.142 I slot print_timing: id 3 | task 237 | graphs reused = 436 0.16.307.200 I slot release: id 3 | task 237 | stop processing: n_tokens = 705, truncated = 0 0.16.307.208 I srv update_slots: all slots are idle 0.16.323.727 I srv operator(): Chat format: peg-native 0.16.335.635 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.921 (> 0.100 thold), f_keep = 0.709 0.16.336.590 I slot launch_slot_: id 3 | task 447 | processing task, is_child = 0 0.16.336.592 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.16.336.593 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.16.336.613 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.16.336.614 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.16.336.631 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.16.336.631 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.18.992.846 I slot print_timing: id 3 | task 447 | prompt eval time = 168.20 ms / 43 tokens ( 3.91 ms per token, 255.64 tokens per second) 0.18.992.849 I slot print_timing: id 3 | task 447 | eval time = 2487.98 ms / 217 tokens ( 11.47 ms per token, 87.22 tokens per second) 0.18.992.849 I slot print_timing: id 3 | task 447 | total time = 2656.19 ms / 260 tokens 0.18.992.850 I slot print_timing: id 3 | task 447 | graphs reused = 651 0.18.992.903 I slot release: id 3 | task 447 | stop processing: n_tokens = 759, truncated = 0 0.18.992.912 I srv update_slots: all slots are idle 0.19.013.427 I srv operator(): Chat format: peg-native 0.19.028.288 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.927 (> 0.100 thold), f_keep = 0.717 0.19.029.301 I slot launch_slot_: id 3 | task 667 | processing task, is_child = 0 0.19.029.303 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.19.029.304 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.19.029.324 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.19.029.324 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.19.029.342 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.19.029.342 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.22.208.932 I slot print_timing: id 3 | task 667 | n_decoded = 262, tg = 87.08 t/s, tg_3s = 87.08 t/s 0.24.479.390 I slot print_timing: id 3 | task 667 | prompt eval time = 170.67 ms / 43 tokens ( 3.97 ms per token, 251.95 tokens per second) 0.24.479.394 I slot print_timing: id 3 | task 667 | eval time = 5279.35 ms / 459 tokens ( 11.50 ms per token, 86.94 tokens per second) 0.24.479.395 I slot print_timing: id 3 | task 667 | total time = 5450.02 ms / 502 tokens 0.24.479.395 I slot print_timing: id 3 | task 667 | graphs reused = 1106 0.24.479.448 I slot release: id 3 | task 667 | stop processing: n_tokens = 1045, truncated = 0 0.24.479.457 I srv update_slots: all slots are idle 0.24.488.556 I srv operator(): Chat format: peg-native 0.24.493.756 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.825 (> 0.100 thold), f_keep = 0.343 0.24.493.758 I srv get_availabl: updating prompt cache 0.24.493.834 W srv prompt_save: - saving prompt with length 1045, total state size = 27.506 MiB (draft: 0.000 MiB) 0.24.530.466 I srv load: - looking for better prompt, base f_keep = 0.343, sim = 0.825 0.24.530.474 I srv update: - cache state: 1 prompts, 30.508 MiB (limits: 8192.000 MiB, 32768 tokens, 280603 est) 0.24.530.475 I srv update: - prompt 0x56ca64b74f60: 1045 tokens, checkpoints: 1, 30.508 MiB 0.24.530.477 I srv get_availabl: prompt cache update took 36.72 ms 0.24.531.586 I slot launch_slot_: id 3 | task 1129 | processing task, is_child = 0 0.24.531.588 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.24.531.589 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.24.531.612 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.24.531.612 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.24.531.633 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.24.531.633 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.25.039.246 I slot print_timing: id 3 | task 1129 | prompt eval time = 182.42 ms / 76 tokens ( 2.40 ms per token, 416.62 tokens per second) 0.25.039.250 I slot print_timing: id 3 | task 1129 | eval time = 325.16 ms / 29 tokens ( 11.21 ms per token, 89.19 tokens per second) 0.25.039.251 I slot print_timing: id 3 | task 1129 | total time = 507.58 ms / 105 tokens 0.25.039.251 I slot print_timing: id 3 | task 1129 | graphs reused = 1133 0.25.039.299 I slot release: id 3 | task 1129 | stop processing: n_tokens = 462, truncated = 0 0.25.039.307 I srv update_slots: all slots are idle 0.25.052.163 I srv operator(): Chat format: peg-native 0.25.060.196 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.910 (> 0.100 thold), f_keep = 0.942 0.25.061.228 I slot launch_slot_: id 3 | task 1160 | processing task, is_child = 0 0.25.061.230 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.25.061.230 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.25.061.250 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.25.061.250 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.25.061.267 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.25.061.268 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.25.562.868 I slot print_timing: id 3 | task 1160 | prompt eval time = 167.20 ms / 43 tokens ( 3.89 ms per token, 257.18 tokens per second) 0.25.562.872 I slot print_timing: id 3 | task 1160 | eval time = 334.38 ms / 30 tokens ( 11.15 ms per token, 89.72 tokens per second) 0.25.562.872 I slot print_timing: id 3 | task 1160 | total time = 501.58 ms / 73 tokens 0.25.562.873 I slot print_timing: id 3 | task 1160 | graphs reused = 1161 0.25.562.926 I slot release: id 3 | task 1160 | stop processing: n_tokens = 507, truncated = 0 0.25.562.934 I srv update_slots: all slots are idle 0.25.579.247 I srv operator(): Chat format: peg-native 0.25.590.645 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.918 (> 0.100 thold), f_keep = 0.945 0.25.591.533 I slot launch_slot_: id 3 | task 1193 | processing task, is_child = 0 0.25.591.535 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.25.591.535 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.25.591.555 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.25.591.556 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.25.591.573 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.25.591.573 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.26.109.854 I slot print_timing: id 3 | task 1193 | prompt eval time = 169.53 ms / 43 tokens ( 3.94 ms per token, 253.64 tokens per second) 0.26.109.858 I slot print_timing: id 3 | task 1193 | eval time = 348.72 ms / 31 tokens ( 11.25 ms per token, 88.90 tokens per second) 0.26.109.858 I slot print_timing: id 3 | task 1193 | total time = 518.25 ms / 74 tokens 0.26.109.859 I slot print_timing: id 3 | task 1193 | graphs reused = 1190 0.26.109.913 I slot release: id 3 | task 1193 | stop processing: n_tokens = 552, truncated = 0 0.26.109.921 I srv update_slots: all slots are idle 0.26.129.908 I srv operator(): Chat format: peg-native 0.26.145.049 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.924 (> 0.100 thold), f_keep = 0.947 0.26.145.914 I slot launch_slot_: id 3 | task 1227 | processing task, is_child = 0 0.26.145.916 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.26.145.916 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.26.145.938 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.26.145.939 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.26.145.956 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.26.145.956 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.26.666.868 I slot print_timing: id 3 | task 1227 | prompt eval time = 171.95 ms / 43 tokens ( 4.00 ms per token, 250.07 tokens per second) 0.26.666.871 I slot print_timing: id 3 | task 1227 | eval time = 348.93 ms / 31 tokens ( 11.26 ms per token, 88.84 tokens per second) 0.26.666.872 I slot print_timing: id 3 | task 1227 | total time = 520.88 ms / 74 tokens 0.26.666.872 I slot print_timing: id 3 | task 1227 | graphs reused = 1219 0.26.666.922 I slot release: id 3 | task 1227 | stop processing: n_tokens = 596, truncated = 0 0.26.666.931 I srv update_slots: all slots are idle 0.26.784.248 I srv operator(): Chat format: peg-native 0.26.788.798 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.812 (> 0.100 thold), f_keep = 0.601 0.26.789.690 I slot launch_slot_: id 3 | task 1261 | processing task, is_child = 0 0.26.789.693 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.26.789.694 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.26.789.717 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.26.789.718 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.26.789.735 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.26.789.735 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.26.789.757 I slot update_slots: id 3 | task 1261 | Checking checkpoint with [0, 352] against 230... 0.26.791.801 W slot update_slots: id 3 | task 1261 | restored context checkpoint (pos_min = 0, pos_max = 352, n_tokens = 353, n_past = 352, size = 3.002 MiB) 0.28.327.207 I slot print_timing: id 3 | task 1261 | prompt eval time = 219.99 ms / 89 tokens ( 2.47 ms per token, 404.56 tokens per second) 0.28.327.210 I slot print_timing: id 3 | task 1261 | eval time = 1317.45 ms / 115 tokens ( 11.46 ms per token, 87.29 tokens per second) 0.28.327.210 I slot print_timing: id 3 | task 1261 | total time = 1537.44 ms / 204 tokens 0.28.327.211 I slot print_timing: id 3 | task 1261 | graphs reused = 1330 0.28.327.259 I slot release: id 3 | task 1261 | stop processing: n_tokens = 555, truncated = 0 0.28.327.268 I srv update_slots: all slots are idle 0.28.340.032 I srv operator(): Chat format: peg-native 0.28.347.958 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.911 (> 0.100 thold), f_keep = 0.796 0.28.349.017 I slot launch_slot_: id 3 | task 1379 | processing task, is_child = 0 0.28.349.020 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.28.349.020 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.28.349.041 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.28.349.042 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.28.349.059 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.28.349.060 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.29.556.904 I slot print_timing: id 3 | task 1379 | prompt eval time = 165.87 ms / 43 tokens ( 3.86 ms per token, 259.23 tokens per second) 0.29.556.908 I slot print_timing: id 3 | task 1379 | eval time = 1041.94 ms / 91 tokens ( 11.45 ms per token, 87.34 tokens per second) 0.29.556.909 I slot print_timing: id 3 | task 1379 | total time = 1207.82 ms / 134 tokens 0.29.556.909 I slot print_timing: id 3 | task 1379 | graphs reused = 1418 0.29.556.960 I slot release: id 3 | task 1379 | stop processing: n_tokens = 575, truncated = 0 0.29.556.970 I srv update_slots: all slots are idle 0.29.573.279 I srv operator(): Chat format: peg-native 0.29.584.937 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.919 (> 0.100 thold), f_keep = 0.845 0.29.585.973 I slot launch_slot_: id 3 | task 1473 | processing task, is_child = 0 0.29.585.975 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.29.585.976 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.29.586.000 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.29.586.000 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.29.586.018 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.29.586.018 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.31.051.235 I slot print_timing: id 3 | task 1473 | prompt eval time = 168.68 ms / 43 tokens ( 3.92 ms per token, 254.92 tokens per second) 0.31.051.239 I slot print_timing: id 3 | task 1473 | eval time = 1296.51 ms / 113 tokens ( 11.47 ms per token, 87.16 tokens per second) 0.31.051.239 I slot print_timing: id 3 | task 1473 | total time = 1465.19 ms / 156 tokens 0.31.051.240 I slot print_timing: id 3 | task 1473 | graphs reused = 1529 0.31.051.294 I slot release: id 3 | task 1473 | stop processing: n_tokens = 641, truncated = 0 0.31.051.302 I srv update_slots: all slots are idle 0.31.071.121 I srv operator(): Chat format: peg-native 0.31.085.690 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.925 (> 0.100 thold), f_keep = 0.827 0.31.086.658 I slot launch_slot_: id 3 | task 1589 | processing task, is_child = 0 0.31.086.660 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.31.086.661 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.31.086.682 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.31.086.683 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.31.086.700 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.31.086.700 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.32.631.920 I slot print_timing: id 3 | task 1589 | prompt eval time = 172.69 ms / 43 tokens ( 4.02 ms per token, 249.00 tokens per second) 0.32.631.924 I slot print_timing: id 3 | task 1589 | eval time = 1372.50 ms / 120 tokens ( 11.44 ms per token, 87.43 tokens per second) 0.32.631.924 I slot print_timing: id 3 | task 1589 | total time = 1545.19 ms / 163 tokens 0.32.631.925 I slot print_timing: id 3 | task 1589 | graphs reused = 1647 0.32.631.978 I slot release: id 3 | task 1589 | stop processing: n_tokens = 692, truncated = 0 0.32.631.985 I srv update_slots: all slots are idle 0.32.641.331 I srv operator(): Chat format: peg-native 0.32.645.867 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.763 (> 0.100 thold), f_keep = 0.517 0.32.646.897 I slot launch_slot_: id 3 | task 1712 | processing task, is_child = 0 0.32.646.900 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.32.646.901 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.32.646.924 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.32.646.925 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.32.646.945 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.32.646.945 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.35.398.934 I slot print_timing: id 3 | task 1712 | prompt eval time = 245.42 ms / 111 tokens ( 2.21 ms per token, 452.29 tokens per second) 0.35.398.937 I slot print_timing: id 3 | task 1712 | eval time = 2506.54 ms / 218 tokens ( 11.50 ms per token, 86.97 tokens per second) 0.35.398.937 I slot print_timing: id 3 | task 1712 | total time = 2751.96 ms / 329 tokens 0.35.398.938 I slot print_timing: id 3 | task 1712 | graphs reused = 1861 0.35.398.987 I slot release: id 3 | task 1712 | stop processing: n_tokens = 686, truncated = 0 0.35.398.994 I srv update_slots: all slots are idle 0.35.412.114 I srv operator(): Chat format: peg-native 0.35.420.268 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.916 (> 0.100 thold), f_keep = 0.685 0.35.421.308 I slot launch_slot_: id 3 | task 1932 | processing task, is_child = 0 0.35.421.310 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.35.421.311 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.35.421.330 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.35.421.330 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.35.421.348 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.35.421.348 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.35.936.266 I slot print_timing: id 3 | task 1932 | prompt eval time = 166.27 ms / 43 tokens ( 3.87 ms per token, 258.62 tokens per second) 0.35.936.270 I slot print_timing: id 3 | task 1932 | eval time = 348.63 ms / 31 tokens ( 11.25 ms per token, 88.92 tokens per second) 0.35.936.270 I slot print_timing: id 3 | task 1932 | total time = 514.89 ms / 74 tokens 0.35.936.271 I slot print_timing: id 3 | task 1932 | graphs reused = 1890 0.35.936.322 I slot release: id 3 | task 1932 | stop processing: n_tokens = 543, truncated = 0 0.35.936.330 I srv update_slots: all slots are idle 0.35.952.896 I srv operator(): Chat format: peg-native 0.35.964.424 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.923 (> 0.100 thold), f_keep = 0.947 0.35.965.434 I slot launch_slot_: id 3 | task 1966 | processing task, is_child = 0 0.35.965.436 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.35.965.437 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.35.965.458 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.35.965.459 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.35.965.476 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.35.965.477 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.36.604.977 I slot print_timing: id 3 | task 1966 | prompt eval time = 172.75 ms / 43 tokens ( 4.02 ms per token, 248.91 tokens per second) 0.36.604.980 I slot print_timing: id 3 | task 1966 | eval time = 466.72 ms / 41 tokens ( 11.38 ms per token, 87.85 tokens per second) 0.36.604.981 I slot print_timing: id 3 | task 1966 | total time = 639.47 ms / 84 tokens 0.36.604.981 I slot print_timing: id 3 | task 1966 | graphs reused = 1929 0.36.605.032 I slot release: id 3 | task 1966 | stop processing: n_tokens = 597, truncated = 0 0.36.605.040 I srv update_slots: all slots are idle 0.36.625.405 I srv operator(): Chat format: peg-native 0.36.640.231 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.928 (> 0.100 thold), f_keep = 0.935 0.36.641.219 I slot launch_slot_: id 3 | task 2010 | processing task, is_child = 0 0.36.641.221 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.36.641.222 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.36.641.241 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.36.641.242 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.36.641.259 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.36.641.260 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.39.227.792 I slot print_timing: id 3 | task 2010 | prompt eval time = 167.78 ms / 43 tokens ( 3.90 ms per token, 256.29 tokens per second) 0.39.227.796 I slot print_timing: id 3 | task 2010 | eval time = 2418.73 ms / 210 tokens ( 11.52 ms per token, 86.82 tokens per second) 0.39.227.796 I slot print_timing: id 3 | task 2010 | total time = 2586.51 ms / 253 tokens 0.39.227.797 I slot print_timing: id 3 | task 2010 | graphs reused = 2135 0.39.227.849 I slot release: id 3 | task 2010 | stop processing: n_tokens = 810, truncated = 0 0.39.227.859 I srv update_slots: all slots are idle 0.39.237.374 I srv operator(): Chat format: peg-native 0.39.241.896 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.766 (> 0.100 thold), f_keep = 0.444 0.39.241.897 I srv get_availabl: updating prompt cache 0.39.241.954 W srv prompt_save: - saving prompt with length 810, total state size = 21.996 MiB (draft: 0.000 MiB) 0.39.255.569 I srv load: - looking for better prompt, base f_keep = 0.444, sim = 0.766 0.39.255.577 I srv update: - cache state: 2 prompts, 55.505 MiB (limits: 8192.000 MiB, 32768 tokens, 273777 est) 0.39.255.578 I srv update: - prompt 0x56ca64b74f60: 1045 tokens, checkpoints: 1, 30.508 MiB 0.39.255.579 I srv update: - prompt 0x56ca64c1c010: 810 tokens, checkpoints: 1, 24.997 MiB 0.39.255.580 I srv get_availabl: prompt cache update took 13.68 ms 0.39.256.522 I slot launch_slot_: id 3 | task 2223 | processing task, is_child = 0 0.39.256.524 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.39.256.525 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.39.256.552 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.39.256.552 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.39.256.570 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.39.256.570 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.42.493.016 I slot print_timing: id 3 | task 2223 | n_decoded = 261, tg = 86.96 t/s, tg_3s = 86.96 t/s 0.42.819.072 I slot print_timing: id 3 | task 2223 | prompt eval time = 235.01 ms / 110 tokens ( 2.14 ms per token, 468.07 tokens per second) 0.42.819.075 I slot print_timing: id 3 | task 2223 | eval time = 3327.46 ms / 289 tokens ( 11.51 ms per token, 86.85 tokens per second) 0.42.819.076 I slot print_timing: id 3 | task 2223 | total time = 3562.47 ms / 399 tokens 0.42.819.077 I slot print_timing: id 3 | task 2223 | graphs reused = 2419 0.42.819.130 I slot release: id 3 | task 2223 | stop processing: n_tokens = 758, truncated = 0 0.42.819.139 I srv update_slots: all slots are idle 0.42.832.045 I srv operator(): Chat format: peg-native 0.42.839.854 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.916 (> 0.100 thold), f_keep = 0.621 0.42.840.705 I slot launch_slot_: id 3 | task 2514 | processing task, is_child = 0 0.42.840.708 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.42.840.708 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.42.840.729 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.42.840.730 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.42.840.747 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.42.840.747 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.43.459.329 I slot print_timing: id 3 | task 2514 | prompt eval time = 166.22 ms / 43 tokens ( 3.87 ms per token, 258.69 tokens per second) 0.43.459.332 I slot print_timing: id 3 | task 2514 | eval time = 452.34 ms / 40 tokens ( 11.31 ms per token, 88.43 tokens per second) 0.43.459.333 I slot print_timing: id 3 | task 2514 | total time = 618.56 ms / 83 tokens 0.43.459.333 I slot print_timing: id 3 | task 2514 | graphs reused = 2457 0.43.459.385 I slot release: id 3 | task 2514 | stop processing: n_tokens = 553, truncated = 0 0.43.459.392 I srv update_slots: all slots are idle 0.43.475.827 I srv operator(): Chat format: peg-native 0.43.487.270 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.923 (> 0.100 thold), f_keep = 0.931 0.43.488.251 I slot launch_slot_: id 3 | task 2557 | processing task, is_child = 0 0.43.488.253 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.43.488.254 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.43.488.274 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.43.488.275 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.43.488.292 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.43.488.292 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.46.669.444 I slot print_timing: id 3 | task 2557 | n_decoded = 260, tg = 86.39 t/s, tg_3s = 86.39 t/s 0.46.962.057 I slot print_timing: id 3 | task 2557 | prompt eval time = 171.58 ms / 43 tokens ( 3.99 ms per token, 250.61 tokens per second) 0.46.962.060 I slot print_timing: id 3 | task 2557 | eval time = 3302.16 ms / 285 tokens ( 11.59 ms per token, 86.31 tokens per second) 0.46.962.061 I slot print_timing: id 3 | task 2557 | total time = 3473.74 ms / 328 tokens 0.46.962.061 I slot print_timing: id 3 | task 2557 | graphs reused = 2738 0.46.962.118 I slot release: id 3 | task 2557 | stop processing: n_tokens = 842, truncated = 0 0.46.962.125 I srv update_slots: all slots are idle 0.46.982.696 I srv operator(): Chat format: peg-native 0.46.997.951 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.929 (> 0.100 thold), f_keep = 0.664 0.46.998.999 I slot launch_slot_: id 3 | task 2845 | processing task, is_child = 0 0.46.999.001 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache 0.46.999.002 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens 0.46.999.022 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache 0.46.999.023 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens 0.46.999.041 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache 0.46.999.041 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens 0.50.179.435 I slot print_timing: id 3 | task 2845 | n_decoded = 259, tg = 86.04 t/s, tg_3s = 86.04 t/s 0.50.576.173 I slot print_timing: id 3 | task 2845 | prompt eval time = 170.15 ms / 43 tokens ( 3.96 ms per token, 252.72 tokens per second) 0.50.576.177 I slot print_timing: id 3 | task 2845 | eval time = 3406.96 ms / 293 tokens ( 11.63 ms per token, 86.00 tokens per second) 0.50.576.177 I slot print_timing: id 3 | task 2845 | total time = 3577.11 ms / 336 tokens 0.50.576.178 I slot print_timing: id 3 | task 2845 | graphs reused = 3027 0.50.576.239 I slot release: id 3 | task 2845 | stop processing: n_tokens = 894, truncated = 0 0.50.576.248 I srv update_slots: all slots are idle 0.50.659.494 I srv operator(): operator(): cleaning up before exit...