qoherent/experiments-07-07-12-local-llm-knowledge-2
23
0
Fork 0
Code Issues Pull Requests Workflows Packages Projects Releases Wiki Activity
Push Tracker
experiments-07-07-12-local-.../results_roles/qwen3.6-27b.server.log

1483 lines
153 KiB
Plaintext
Raw Normal View History

G
readme report
2026-07-12 21:35:10 -04:00
0.00.323.083 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg)
0.00.323.086 I device_info:
0.00.323.106 I - ROCm0 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.323.111 I - ROCm1 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.323.118 I - CPU : AMD Ryzen 9 3900X 12-Core Processor (128730 MiB, 128730 MiB free)
0.00.323.178 I system_info: n_threads = 12 (n_threads_batch = 12) / 24 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 |
0.00.323.182 I srv llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true
0.00.323.380 I srv init: running without SSL
0.00.323.454 I srv init: using 23 threads for HTTP server
0.00.323.786 I srv start: binding port with default address family
0.00.324.987 I srv llama_server: loading model
0.00.324.995 I srv load_model: loading model '/home/qrf/.cache/llama.cpp/Qwen_Qwen3.6-27B-Q4_K_M.gguf'
0.00.325.049 I common_init_result: fitting params to device memory ...
0.00.325.051 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on)
0.14.269.327 W llama_context: n_ctx_seq (24576) < n_ctx_train (262144) -- the full capacity of the model will not be utilized
0.14.378.791 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
0.14.630.293 I srv load_model: initializing slots, n_slots = 4
0.14.744.543 W srv load_model: speculative decoding will use checkpoints
0.14.744.558 W common_speculative_init: no implementations specified for speculative decoding
0.14.744.559 I slot load_model: id 0 | task -1 | new slot, n_ctx = 24576
0.14.744.563 I slot load_model: id 1 | task -1 | new slot, n_ctx = 24576
0.14.744.564 I slot load_model: id 2 | task -1 | new slot, n_ctx = 24576
0.14.744.564 I slot load_model: id 3 | task -1 | new slot, n_ctx = 24576
0.14.744.603 I srv load_model: prompt cache is enabled, size limit: 8192 MiB
0.14.744.603 I srv load_model: use `--cache-ram 0` to disable the prompt cache
0.14.744.604 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391
0.14.744.604 I srv load_model: context checkpoints enabled, max = 32, min spacing = 256
0.14.744.620 I srv init: idle slots will be saved to prompt cache and cleared upon starting a new task
0.14.763.774 I init: chat template, example_format: '<|im_start|>system
You are a helpful assistant<|im_end|>
<|im_start|>user
Hello<|im_end|>
<|im_start|>assistant
Hi there<|im_end|>
<|im_start|>user
How are you?<|im_end|>
<|im_start|>assistant
<think>
'
0.14.777.563 I srv init: init: chat template, thinking = 1
0.14.777.600 I srv llama_server: model loaded
0.14.777.603 I srv llama_server: server is listening on http://127.0.0.1:8090
0.14.777.608 I srv update_slots: all slots are idle
0.14.925.866 I srv operator(): Chat format: peg-native
0.14.926.136 I slot get_availabl: id 3 | task -1 | selected slot by LRU, t_last = -1
0.14.926.138 I srv get_availabl: updating prompt cache
0.14.926.143 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000
0.14.926.147 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 24576 tokens, 8589934592 est)
0.14.926.148 I srv get_availabl: prompt cache update took 0.01 ms
0.14.926.208 I slot launch_slot_: id 3 | task 0 | processing task, is_child = 0
0.14.926.209 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.14.926.210 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.14.926.231 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.14.926.231 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.14.926.256 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.14.926.256 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.15.815.330 I slot create_check: id 3 | task 0 | created context checkpoint 1 of 32 (pos_min = 40, pos_max = 40, n_tokens = 41, size = 149.626 MiB)
0.21.502.340 I slot print_timing: id 3 | task 0 | n_decoded = 100, tg = 18.74 t/s, tg_3s = 18.74 t/s
0.24.515.118 I slot print_timing: id 3 | task 0 | n_decoded = 156, tg = 18.69 t/s, tg_3s = 18.59 t/s
0.27.546.540 I slot print_timing: id 3 | task 0 | n_decoded = 212, tg = 18.63 t/s, tg_3s = 18.47 t/s
0.30.568.804 I slot print_timing: id 3 | task 0 | n_decoded = 268, tg = 18.61 t/s, tg_3s = 18.53 t/s
0.33.590.630 I slot print_timing: id 3 | task 0 | n_decoded = 324, tg = 18.60 t/s, tg_3s = 18.53 t/s
0.36.614.712 I slot print_timing: id 3 | task 0 | n_decoded = 380, tg = 18.58 t/s, tg_3s = 18.52 t/s
0.37.046.720 I slot print_timing: id 3 | task 0 | prompt eval time = 1240.48 ms / 67 tokens ( 18.51 ms per token, 54.01 tokens per second)
0.37.046.724 I slot print_timing: id 3 | task 0 | eval time = 20879.95 ms / 388 tokens ( 53.81 ms per token, 18.58 tokens per second)
0.37.046.724 I slot print_timing: id 3 | task 0 | total time = 22120.43 ms / 455 tokens
0.37.046.729 I slot print_timing: id 3 | task 0 | graphs reused = 386
0.37.046.779 I slot release: id 3 | task 0 | stop processing: n_tokens = 454, truncated = 0
0.37.046.786 I srv update_slots: all slots are idle
0.37.062.435 I srv operator(): Chat format: peg-native
0.37.062.671 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.629 (> 0.100 thold), f_keep = 0.097
0.37.062.673 I srv get_availabl: updating prompt cache
0.37.062.721 W srv prompt_save: - saving prompt with length 454, total state size = 178.010 MiB (draft: 0.000 MiB)
0.37.314.978 I srv load: - looking for better prompt, base f_keep = 0.097, sim = 0.629
0.37.314.983 I srv update: - cache state: 1 prompts, 327.636 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
0.37.314.984 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
0.37.314.986 I srv get_availabl: prompt cache update took 252.31 ms
0.37.315.069 I slot launch_slot_: id 3 | task 391 | processing task, is_child = 0
0.37.315.071 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.37.315.071 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.37.315.088 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.37.315.088 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.37.315.101 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.37.315.101 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.37.315.121 I slot update_slots: id 3 | task 391 | Checking checkpoint with [40, 40] against 44...
0.37.350.638 W slot update_slots: id 3 | task 391 | restored context checkpoint (pos_min = 40, pos_max = 40, n_tokens = 41, n_past = 41, size = 149.626 MiB)
0.43.390.840 I slot print_timing: id 3 | task 391 | n_decoded = 100, tg = 17.71 t/s, tg_3s = 17.71 t/s
0.43.660.829 I slot print_timing: id 3 | task 391 | prompt eval time = 428.37 ms / 29 tokens ( 14.77 ms per token, 67.70 tokens per second)
0.43.660.832 I slot print_timing: id 3 | task 391 | eval time = 5917.33 ms / 105 tokens ( 56.36 ms per token, 17.74 tokens per second)
0.43.660.832 I slot print_timing: id 3 | task 391 | total time = 6345.70 ms / 134 tokens
0.43.660.833 I slot print_timing: id 3 | task 391 | graphs reused = 489
0.43.660.866 I slot release: id 3 | task 391 | stop processing: n_tokens = 174, truncated = 0
0.43.660.875 I srv update_slots: all slots are idle
0.43.676.763 I srv operator(): Chat format: peg-native
0.43.677.020 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.489 (> 0.100 thold), f_keep = 0.253
0.43.677.022 I srv get_availabl: updating prompt cache
0.43.677.065 W srv prompt_save: - saving prompt with length 174, total state size = 160.505 MiB (draft: 0.000 MiB)
0.43.886.226 I srv load: - looking for better prompt, base f_keep = 0.253, sim = 0.489
0.43.886.232 I srv update: - cache state: 2 prompts, 637.767 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
0.43.886.233 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
0.43.886.234 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
0.43.886.235 I srv get_availabl: prompt cache update took 209.21 ms
0.43.886.321 I slot launch_slot_: id 3 | task 498 | processing task, is_child = 0
0.43.886.322 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.43.886.323 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.43.886.340 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.43.886.340 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.43.886.353 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.43.886.353 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.43.886.373 I slot update_slots: id 3 | task 498 | Checking checkpoint with [40, 40] against 44...
0.43.921.770 W slot update_slots: id 3 | task 498 | restored context checkpoint (pos_min = 40, pos_max = 40, n_tokens = 41, n_past = 41, size = 149.626 MiB)
0.49.670.067 I slot print_timing: id 3 | task 498 | n_decoded = 100, tg = 18.67 t/s, tg_3s = 18.67 t/s
0.52.693.802 I slot print_timing: id 3 | task 498 | n_decoded = 156, tg = 18.62 t/s, tg_3s = 18.52 t/s
0.55.727.807 I slot print_timing: id 3 | task 498 | n_decoded = 212, tg = 18.58 t/s, tg_3s = 18.46 t/s
0.58.752.968 I slot print_timing: id 3 | task 498 | n_decoded = 268, tg = 18.56 t/s, tg_3s = 18.51 t/s
1.01.776.974 I slot print_timing: id 3 | task 498 | n_decoded = 324, tg = 18.55 t/s, tg_3s = 18.52 t/s
1.04.803.150 I slot print_timing: id 3 | task 498 | n_decoded = 380, tg = 18.55 t/s, tg_3s = 18.51 t/s
1.07.837.080 I slot print_timing: id 3 | task 498 | n_decoded = 436, tg = 18.54 t/s, tg_3s = 18.46 t/s
1.10.860.966 I slot print_timing: id 3 | task 498 | n_decoded = 492, tg = 18.53 t/s, tg_3s = 18.52 t/s
1.13.883.789 I slot print_timing: id 3 | task 498 | n_decoded = 548, tg = 18.53 t/s, tg_3s = 18.53 t/s
1.16.908.720 I slot print_timing: id 3 | task 498 | n_decoded = 604, tg = 18.53 t/s, tg_3s = 18.51 t/s
1.19.934.817 I slot print_timing: id 3 | task 498 | n_decoded = 660, tg = 18.53 t/s, tg_3s = 18.51 t/s
1.22.970.133 I slot print_timing: id 3 | task 498 | n_decoded = 716, tg = 18.52 t/s, tg_3s = 18.45 t/s
1.25.999.047 I slot print_timing: id 3 | task 498 | n_decoded = 772, tg = 18.52 t/s, tg_3s = 18.49 t/s
1.29.028.946 I slot print_timing: id 3 | task 498 | n_decoded = 828, tg = 18.52 t/s, tg_3s = 18.48 t/s
1.32.057.167 I slot print_timing: id 3 | task 498 | n_decoded = 884, tg = 18.52 t/s, tg_3s = 18.49 t/s
1.35.097.334 I slot print_timing: id 3 | task 498 | n_decoded = 940, tg = 18.51 t/s, tg_3s = 18.42 t/s
1.38.133.345 I slot print_timing: id 3 | task 498 | n_decoded = 996, tg = 18.51 t/s, tg_3s = 18.45 t/s
1.41.175.054 I slot print_timing: id 3 | task 498 | n_decoded = 1052, tg = 18.50 t/s, tg_3s = 18.41 t/s
1.44.213.300 I slot print_timing: id 3 | task 498 | n_decoded = 1108, tg = 18.50 t/s, tg_3s = 18.43 t/s
1.47.253.547 I slot print_timing: id 3 | task 498 | n_decoded = 1164, tg = 18.49 t/s, tg_3s = 18.42 t/s
1.50.307.268 I slot print_timing: id 3 | task 498 | n_decoded = 1220, tg = 18.49 t/s, tg_3s = 18.34 t/s
1.53.342.871 I slot print_timing: id 3 | task 498 | n_decoded = 1276, tg = 18.49 t/s, tg_3s = 18.45 t/s
1.56.371.073 I slot print_timing: id 3 | task 498 | n_decoded = 1332, tg = 18.49 t/s, tg_3s = 18.49 t/s
1.59.397.234 I slot print_timing: id 3 | task 498 | n_decoded = 1388, tg = 18.49 t/s, tg_3s = 18.51 t/s
2.02.430.886 I slot print_timing: id 3 | task 498 | n_decoded = 1444, tg = 18.49 t/s, tg_3s = 18.46 t/s
2.05.484.249 I slot print_timing: id 3 | task 498 | n_decoded = 1500, tg = 18.48 t/s, tg_3s = 18.34 t/s
2.08.523.204 I slot print_timing: id 3 | task 498 | n_decoded = 1556, tg = 18.48 t/s, tg_3s = 18.43 t/s
2.11.563.351 I slot print_timing: id 3 | task 498 | n_decoded = 1612, tg = 18.48 t/s, tg_3s = 18.42 t/s
2.14.604.222 I slot print_timing: id 3 | task 498 | n_decoded = 1668, tg = 18.47 t/s, tg_3s = 18.42 t/s
2.17.655.815 I slot print_timing: id 3 | task 498 | n_decoded = 1724, tg = 18.47 t/s, tg_3s = 18.35 t/s
2.19.939.418 I slot print_timing: id 3 | task 498 | prompt eval time = 428.75 ms / 49 tokens ( 8.75 ms per token, 114.29 tokens per second)
2.19.939.422 I slot print_timing: id 3 | task 498 | eval time = 95624.29 ms / 1766 tokens ( 54.15 ms per token, 18.47 tokens per second)
2.19.939.423 I slot print_timing: id 3 | task 498 | total time = 96053.04 ms / 1815 tokens
2.19.939.423 I slot print_timing: id 3 | task 498 | graphs reused = 2246
2.19.939.462 I slot release: id 3 | task 498 | stop processing: n_tokens = 1855, truncated = 0
2.19.939.478 I srv update_slots: all slots are idle
2.19.955.338 I srv operator(): Chat format: peg-native
2.19.955.589 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.611 (> 0.100 thold), f_keep = 0.024
2.19.955.591 I srv get_availabl: updating prompt cache
2.19.955.678 W srv prompt_save: - saving prompt with length 1855, total state size = 265.599 MiB (draft: 0.000 MiB)
2.20.247.881 I srv load: - looking for better prompt, base f_keep = 0.024, sim = 0.611
2.20.247.887 I srv update: - cache state: 3 prompts, 1052.993 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
2.20.247.888 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
2.20.247.889 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
2.20.247.889 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
2.20.247.891 I srv get_availabl: prompt cache update took 292.30 ms
2.20.247.966 I slot launch_slot_: id 3 | task 2266 | processing task, is_child = 0
2.20.247.967 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
2.20.247.968 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
2.20.247.987 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
2.20.247.987 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
2.20.248.017 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
2.20.248.018 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
2.20.248.056 I slot update_slots: id 3 | task 2266 | Checking checkpoint with [40, 40] against 44...
2.20.283.121 W slot update_slots: id 3 | task 2266 | restored context checkpoint (pos_min = 40, pos_max = 40, n_tokens = 41, n_past = 41, size = 149.626 MiB)
2.26.031.751 I slot print_timing: id 3 | task 2266 | n_decoded = 100, tg = 18.68 t/s, tg_3s = 18.68 t/s
2.29.065.063 I slot print_timing: id 3 | task 2266 | n_decoded = 156, tg = 18.60 t/s, tg_3s = 18.46 t/s
2.32.107.844 I slot print_timing: id 3 | task 2266 | n_decoded = 212, tg = 18.55 t/s, tg_3s = 18.40 t/s
2.35.140.600 I slot print_timing: id 3 | task 2266 | n_decoded = 268, tg = 18.53 t/s, tg_3s = 18.47 t/s
2.38.176.167 I slot print_timing: id 3 | task 2266 | n_decoded = 324, tg = 18.52 t/s, tg_3s = 18.45 t/s
2.41.214.230 I slot print_timing: id 3 | task 2266 | n_decoded = 380, tg = 18.50 t/s, tg_3s = 18.43 t/s
2.44.249.039 I slot print_timing: id 3 | task 2266 | n_decoded = 436, tg = 18.50 t/s, tg_3s = 18.45 t/s
2.47.293.009 I slot print_timing: id 3 | task 2266 | n_decoded = 492, tg = 18.49 t/s, tg_3s = 18.40 t/s
2.50.317.101 I slot print_timing: id 3 | task 2266 | n_decoded = 548, tg = 18.49 t/s, tg_3s = 18.52 t/s
2.53.340.974 I slot print_timing: id 3 | task 2266 | n_decoded = 604, tg = 18.49 t/s, tg_3s = 18.52 t/s
2.56.365.090 I slot print_timing: id 3 | task 2266 | n_decoded = 660, tg = 18.49 t/s, tg_3s = 18.52 t/s
2.58.367.081 I slot print_timing: id 3 | task 2266 | prompt eval time = 428.98 ms / 31 tokens ( 13.84 ms per token, 72.26 tokens per second)
2.58.367.085 I slot print_timing: id 3 | task 2266 | eval time = 37690.04 ms / 697 tokens ( 54.07 ms per token, 18.49 tokens per second)
2.58.367.086 I slot print_timing: id 3 | task 2266 | total time = 38119.02 ms / 728 tokens
2.58.367.087 I slot print_timing: id 3 | task 2266 | graphs reused = 2939
2.58.367.124 I slot release: id 3 | task 2266 | stop processing: n_tokens = 768, truncated = 0
2.58.367.135 I srv update_slots: all slots are idle
2.58.382.964 I srv operator(): Chat format: peg-native
2.58.383.206 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.657 (> 0.100 thold), f_keep = 0.057
2.58.383.209 I srv get_availabl: updating prompt cache
2.58.383.273 W srv prompt_save: - saving prompt with length 768, total state size = 197.641 MiB (draft: 0.000 MiB)
2.58.603.176 I srv load: - looking for better prompt, base f_keep = 0.057, sim = 0.657
2.58.603.183 I srv update: - cache state: 4 prompts, 1400.260 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
2.58.603.184 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
2.58.603.185 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
2.58.603.186 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
2.58.603.186 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
2.58.603.187 I srv get_availabl: prompt cache update took 219.98 ms
2.58.603.275 I slot launch_slot_: id 3 | task 2965 | processing task, is_child = 0
2.58.603.276 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
2.58.603.277 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
2.58.603.294 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
2.58.603.294 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
2.58.603.307 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
2.58.603.307 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
2.58.603.329 I slot update_slots: id 3 | task 2965 | Checking checkpoint with [40, 40] against 44...
2.58.638.617 W slot update_slots: id 3 | task 2965 | restored context checkpoint (pos_min = 40, pos_max = 40, n_tokens = 41, n_past = 41, size = 149.626 MiB)
3.04.347.135 I slot print_timing: id 3 | task 2965 | n_decoded = 100, tg = 18.67 t/s, tg_3s = 18.67 t/s
3.07.370.945 I slot print_timing: id 3 | task 2965 | n_decoded = 156, tg = 18.62 t/s, tg_3s = 18.52 t/s
3.10.406.981 I slot print_timing: id 3 | task 2965 | n_decoded = 212, tg = 18.57 t/s, tg_3s = 18.45 t/s
3.13.434.150 I slot print_timing: id 3 | task 2965 | n_decoded = 268, tg = 18.56 t/s, tg_3s = 18.50 t/s
3.15.216.062 I slot print_timing: id 3 | task 2965 | prompt eval time = 387.46 ms / 26 tokens ( 14.90 ms per token, 67.10 tokens per second)
3.15.216.066 I slot print_timing: id 3 | task 2965 | eval time = 16225.26 ms / 301 tokens ( 53.90 ms per token, 18.55 tokens per second)
3.15.216.066 I slot print_timing: id 3 | task 2965 | total time = 16612.73 ms / 327 tokens
3.15.216.067 I slot print_timing: id 3 | task 2965 | graphs reused = 3237
3.15.216.103 I slot release: id 3 | task 2965 | stop processing: n_tokens = 367, truncated = 0
3.15.216.111 I srv update_slots: all slots are idle
3.15.232.264 I srv operator(): Chat format: peg-native
3.15.232.517 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.518 (> 0.100 thold), f_keep = 0.120
3.15.232.519 I srv get_availabl: updating prompt cache
3.15.232.557 W srv prompt_save: - saving prompt with length 367, total state size = 172.571 MiB (draft: 0.000 MiB)
3.15.442.943 I srv load: - looking for better prompt, base f_keep = 0.120, sim = 0.518
3.15.442.951 I srv update: - cache state: 5 prompts, 1722.457 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
3.15.442.952 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
3.15.442.953 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
3.15.442.953 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
3.15.442.954 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
3.15.442.954 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
3.15.442.955 I srv get_availabl: prompt cache update took 210.44 ms
3.15.443.036 I slot launch_slot_: id 3 | task 3268 | processing task, is_child = 0
3.15.443.037 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
3.15.443.037 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
3.15.443.055 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
3.15.443.055 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
3.15.443.068 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
3.15.443.068 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
3.15.443.088 I slot update_slots: id 3 | task 3268 | Checking checkpoint with [40, 40] against 44...
3.15.478.497 W slot update_slots: id 3 | task 3268 | restored context checkpoint (pos_min = 40, pos_max = 40, n_tokens = 41, n_past = 41, size = 149.626 MiB)
3.21.265.030 I slot print_timing: id 3 | task 3268 | n_decoded = 100, tg = 18.67 t/s, tg_3s = 18.67 t/s
3.24.289.091 I slot print_timing: id 3 | task 3268 | n_decoded = 156, tg = 18.62 t/s, tg_3s = 18.52 t/s
3.27.324.497 I slot print_timing: id 3 | task 3268 | n_decoded = 212, tg = 18.57 t/s, tg_3s = 18.45 t/s
3.30.355.891 I slot print_timing: id 3 | task 3268 | n_decoded = 268, tg = 18.55 t/s, tg_3s = 18.47 t/s
3.33.381.769 I slot print_timing: id 3 | task 3268 | n_decoded = 324, tg = 18.54 t/s, tg_3s = 18.51 t/s
3.36.401.615 I slot print_timing: id 3 | task 3268 | n_decoded = 380, tg = 18.54 t/s, tg_3s = 18.54 t/s
3.39.428.735 I slot print_timing: id 3 | task 3268 | n_decoded = 436, tg = 18.54 t/s, tg_3s = 18.50 t/s
3.42.454.701 I slot print_timing: id 3 | task 3268 | n_decoded = 492, tg = 18.53 t/s, tg_3s = 18.51 t/s
3.45.482.861 I slot print_timing: id 3 | task 3268 | n_decoded = 548, tg = 18.53 t/s, tg_3s = 18.49 t/s
3.48.510.800 I slot print_timing: id 3 | task 3268 | n_decoded = 604, tg = 18.53 t/s, tg_3s = 18.49 t/s
3.51.535.020 I slot print_timing: id 3 | task 3268 | n_decoded = 660, tg = 18.53 t/s, tg_3s = 18.52 t/s
3.54.575.019 I slot print_timing: id 3 | task 3268 | n_decoded = 716, tg = 18.52 t/s, tg_3s = 18.42 t/s
3.57.603.041 I slot print_timing: id 3 | task 3268 | n_decoded = 772, tg = 18.52 t/s, tg_3s = 18.49 t/s
4.00.633.964 I slot print_timing: id 3 | task 3268 | n_decoded = 828, tg = 18.51 t/s, tg_3s = 18.48 t/s
4.03.670.556 I slot print_timing: id 3 | task 3268 | n_decoded = 884, tg = 18.51 t/s, tg_3s = 18.44 t/s
4.06.708.983 I slot print_timing: id 3 | task 3268 | n_decoded = 940, tg = 18.50 t/s, tg_3s = 18.43 t/s
4.09.759.259 I slot print_timing: id 3 | task 3268 | n_decoded = 996, tg = 18.50 t/s, tg_3s = 18.36 t/s
4.12.808.123 I slot print_timing: id 3 | task 3268 | n_decoded = 1052, tg = 18.49 t/s, tg_3s = 18.37 t/s
4.15.847.178 I slot print_timing: id 3 | task 3268 | n_decoded = 1108, tg = 18.49 t/s, tg_3s = 18.43 t/s
4.18.894.237 I slot print_timing: id 3 | task 3268 | n_decoded = 1164, tg = 18.48 t/s, tg_3s = 18.38 t/s
4.21.907.353 I slot print_timing: id 3 | task 3268 | n_decoded = 1219, tg = 18.47 t/s, tg_3s = 18.25 t/s
4.24.960.929 I slot print_timing: id 3 | task 3268 | n_decoded = 1275, tg = 18.46 t/s, tg_3s = 18.34 t/s
4.25.725.423 I slot print_timing: id 3 | task 3268 | prompt eval time = 465.77 ms / 44 tokens ( 10.59 ms per token, 94.47 tokens per second)
4.25.725.427 I slot print_timing: id 3 | task 3268 | eval time = 69816.56 ms / 1289 tokens ( 54.16 ms per token, 18.46 tokens per second)
4.25.725.428 I slot print_timing: id 3 | task 3268 | total time = 70282.33 ms / 1333 tokens
4.25.725.428 I slot print_timing: id 3 | task 3268 | graphs reused = 4519
4.25.725.465 I slot release: id 3 | task 3268 | stop processing: n_tokens = 1373, truncated = 0
4.25.725.478 I srv update_slots: all slots are idle
4.25.741.264 I srv operator(): Chat format: peg-native
4.25.741.503 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.524 (> 0.100 thold), f_keep = 0.032
4.25.741.505 I srv get_availabl: updating prompt cache
4.25.741.576 W srv prompt_save: - saving prompt with length 1373, total state size = 235.465 MiB (draft: 0.000 MiB)
4.25.984.784 I srv load: - looking for better prompt, base f_keep = 0.032, sim = 0.524
4.25.984.793 I srv update: - cache state: 6 prompts, 2107.548 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
4.25.984.794 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
4.25.984.794 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
4.25.984.795 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
4.25.984.796 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
4.25.984.796 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
4.25.984.797 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
4.25.984.798 I srv get_availabl: prompt cache update took 243.29 ms
4.25.984.868 I slot launch_slot_: id 3 | task 4559 | processing task, is_child = 0
4.25.984.869 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
4.25.984.870 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
4.25.984.888 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
4.25.984.889 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
4.25.984.919 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
4.25.984.919 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
4.25.984.957 I slot update_slots: id 3 | task 4559 | Checking checkpoint with [40, 40] against 44...
4.26.020.126 W slot update_slots: id 3 | task 4559 | restored context checkpoint (pos_min = 40, pos_max = 40, n_tokens = 41, n_past = 41, size = 149.626 MiB)
4.31.800.019 I slot print_timing: id 3 | task 4559 | n_decoded = 100, tg = 18.69 t/s, tg_3s = 18.69 t/s
4.34.824.936 I slot print_timing: id 3 | task 4559 | n_decoded = 156, tg = 18.63 t/s, tg_3s = 18.51 t/s
4.37.862.039 I slot print_timing: id 3 | task 4559 | n_decoded = 212, tg = 18.58 t/s, tg_3s = 18.44 t/s
4.40.886.026 I slot print_timing: id 3 | task 4559 | n_decoded = 268, tg = 18.56 t/s, tg_3s = 18.52 t/s
4.43.909.969 I slot print_timing: id 3 | task 4559 | n_decoded = 324, tg = 18.56 t/s, tg_3s = 18.52 t/s
4.46.932.888 I slot print_timing: id 3 | task 4559 | n_decoded = 380, tg = 18.55 t/s, tg_3s = 18.53 t/s
4.49.971.242 I slot print_timing: id 3 | task 4559 | n_decoded = 436, tg = 18.54 t/s, tg_3s = 18.43 t/s
4.52.997.788 I slot print_timing: id 3 | task 4559 | n_decoded = 492, tg = 18.53 t/s, tg_3s = 18.50 t/s
4.56.026.308 I slot print_timing: id 3 | task 4559 | n_decoded = 548, tg = 18.53 t/s, tg_3s = 18.49 t/s
4.59.056.381 I slot print_timing: id 3 | task 4559 | n_decoded = 604, tg = 18.52 t/s, tg_3s = 18.48 t/s
5.02.087.098 I slot print_timing: id 3 | task 4559 | n_decoded = 660, tg = 18.52 t/s, tg_3s = 18.48 t/s
5.05.136.295 I slot print_timing: id 3 | task 4559 | n_decoded = 716, tg = 18.51 t/s, tg_3s = 18.37 t/s
5.08.171.922 I slot print_timing: id 3 | task 4559 | n_decoded = 772, tg = 18.50 t/s, tg_3s = 18.45 t/s
5.11.208.169 I slot print_timing: id 3 | task 4559 | n_decoded = 828, tg = 18.50 t/s, tg_3s = 18.44 t/s
5.14.232.477 I slot print_timing: id 3 | task 4559 | n_decoded = 884, tg = 18.50 t/s, tg_3s = 18.52 t/s
5.17.260.144 I slot print_timing: id 3 | task 4559 | n_decoded = 940, tg = 18.50 t/s, tg_3s = 18.50 t/s
5.20.299.858 I slot print_timing: id 3 | task 4559 | n_decoded = 996, tg = 18.50 t/s, tg_3s = 18.42 t/s
5.23.331.693 I slot print_timing: id 3 | task 4559 | n_decoded = 1052, tg = 18.49 t/s, tg_3s = 18.47 t/s
5.26.365.599 I slot print_timing: id 3 | task 4559 | n_decoded = 1108, tg = 18.49 t/s, tg_3s = 18.46 t/s
5.29.401.779 I slot print_timing: id 3 | task 4559 | n_decoded = 1164, tg = 18.49 t/s, tg_3s = 18.44 t/s
5.32.450.778 I slot print_timing: id 3 | task 4559 | n_decoded = 1220, tg = 18.48 t/s, tg_3s = 18.37 t/s
5.35.501.673 I slot print_timing: id 3 | task 4559 | n_decoded = 1276, tg = 18.48 t/s, tg_3s = 18.36 t/s
5.38.550.681 I slot print_timing: id 3 | task 4559 | n_decoded = 1332, tg = 18.47 t/s, tg_3s = 18.37 t/s
5.41.551.332 I slot print_timing: id 3 | task 4559 | n_decoded = 1387, tg = 18.47 t/s, tg_3s = 18.33 t/s
5.44.604.732 I slot print_timing: id 3 | task 4559 | n_decoded = 1443, tg = 18.46 t/s, tg_3s = 18.34 t/s
5.47.613.407 I slot print_timing: id 3 | task 4559 | n_decoded = 1498, tg = 18.46 t/s, tg_3s = 18.28 t/s
5.50.664.679 I slot print_timing: id 3 | task 4559 | n_decoded = 1554, tg = 18.45 t/s, tg_3s = 18.35 t/s
5.53.666.984 I slot print_timing: id 3 | task 4559 | n_decoded = 1609, tg = 18.45 t/s, tg_3s = 18.32 t/s
5.56.674.182 I slot print_timing: id 3 | task 4559 | n_decoded = 1664, tg = 18.44 t/s, tg_3s = 18.29 t/s
5.59.688.057 I slot print_timing: id 3 | task 4559 | n_decoded = 1719, tg = 18.44 t/s, tg_3s = 18.25 t/s
6.02.691.987 I slot print_timing: id 3 | task 4559 | n_decoded = 1774, tg = 18.43 t/s, tg_3s = 18.31 t/s
6.05.700.851 I slot print_timing: id 3 | task 4559 | n_decoded = 1829, tg = 18.43 t/s, tg_3s = 18.28 t/s
6.08.745.972 I slot print_timing: id 3 | task 4559 | n_decoded = 1885, tg = 18.43 t/s, tg_3s = 18.39 t/s
6.11.789.280 I slot print_timing: id 3 | task 4559 | n_decoded = 1941, tg = 18.43 t/s, tg_3s = 18.40 t/s
6.14.789.467 I slot print_timing: id 3 | task 4559 | n_decoded = 1996, tg = 18.42 t/s, tg_3s = 18.33 t/s
6.17.841.899 I slot print_timing: id 3 | task 4559 | n_decoded = 2052, tg = 18.42 t/s, tg_3s = 18.35 t/s
6.20.841.935 I slot print_timing: id 3 | task 4559 | n_decoded = 2107, tg = 18.42 t/s, tg_3s = 18.33 t/s
6.23.895.920 I slot print_timing: id 3 | task 4559 | n_decoded = 2163, tg = 18.42 t/s, tg_3s = 18.34 t/s
6.26.950.291 I slot print_timing: id 3 | task 4559 | n_decoded = 2219, tg = 18.41 t/s, tg_3s = 18.33 t/s
6.27.004.928 I slot print_timing: id 3 | task 4559 | prompt eval time = 464.60 ms / 43 tokens ( 10.80 ms per token, 92.55 tokens per second)
6.27.004.931 I slot print_timing: id 3 | task 4559 | eval time = 120555.37 ms / 2220 tokens ( 54.30 ms per token, 18.41 tokens per second)
6.27.004.932 I slot print_timing: id 3 | task 4559 | total time = 121019.97 ms / 2263 tokens
6.27.004.933 I slot print_timing: id 3 | task 4559 | graphs reused = 6729
6.27.004.971 I slot release: id 3 | task 4559 | stop processing: n_tokens = 2303, truncated = 0
6.27.004.987 I srv update_slots: all slots are idle
6.27.020.796 I srv operator(): Chat format: peg-native
6.27.021.037 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.629 (> 0.100 thold), f_keep = 0.019
6.27.021.039 I srv get_availabl: updating prompt cache
6.27.021.144 W srv prompt_save: - saving prompt with length 2303, total state size = 293.608 MiB (draft: 0.000 MiB)
6.27.299.861 I srv load: - looking for better prompt, base f_keep = 0.019, sim = 0.629
6.27.299.871 I srv update: - cache state: 7 prompts, 2550.783 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
6.27.299.872 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
6.27.299.872 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
6.27.299.873 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
6.27.299.873 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
6.27.299.874 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
6.27.299.874 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
6.27.299.875 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
6.27.299.876 I srv get_availabl: prompt cache update took 278.84 ms
6.27.299.950 I slot launch_slot_: id 3 | task 6781 | processing task, is_child = 0
6.27.299.951 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
6.27.299.952 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
6.27.299.972 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
6.27.299.972 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
6.27.299.986 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
6.27.299.986 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
6.27.300.008 I slot update_slots: id 3 | task 6781 | Checking checkpoint with [40, 40] against 44...
6.27.335.396 W slot update_slots: id 3 | task 6781 | restored context checkpoint (pos_min = 40, pos_max = 40, n_tokens = 41, n_past = 41, size = 149.626 MiB)
6.33.088.085 I slot print_timing: id 3 | task 6781 | n_decoded = 100, tg = 18.66 t/s, tg_3s = 18.66 t/s
6.36.113.223 I slot print_timing: id 3 | task 6781 | n_decoded = 156, tg = 18.61 t/s, tg_3s = 18.51 t/s
6.39.153.913 I slot print_timing: id 3 | task 6781 | n_decoded = 212, tg = 18.56 t/s, tg_3s = 18.42 t/s
6.42.187.310 I slot print_timing: id 3 | task 6781 | n_decoded = 268, tg = 18.54 t/s, tg_3s = 18.46 t/s
6.45.217.937 I slot print_timing: id 3 | task 6781 | n_decoded = 324, tg = 18.53 t/s, tg_3s = 18.48 t/s
6.48.246.967 I slot print_timing: id 3 | task 6781 | n_decoded = 380, tg = 18.52 t/s, tg_3s = 18.49 t/s
6.51.275.509 I slot print_timing: id 3 | task 6781 | n_decoded = 436, tg = 18.52 t/s, tg_3s = 18.49 t/s
6.54.313.734 I slot print_timing: id 3 | task 6781 | n_decoded = 492, tg = 18.51 t/s, tg_3s = 18.43 t/s
6.57.336.504 I slot print_timing: id 3 | task 6781 | n_decoded = 548, tg = 18.51 t/s, tg_3s = 18.53 t/s
7.00.360.570 I slot print_timing: id 3 | task 6781 | n_decoded = 604, tg = 18.51 t/s, tg_3s = 18.52 t/s
7.03.392.111 I slot print_timing: id 3 | task 6781 | n_decoded = 660, tg = 18.51 t/s, tg_3s = 18.47 t/s
7.06.436.706 I slot print_timing: id 3 | task 6781 | n_decoded = 716, tg = 18.50 t/s, tg_3s = 18.39 t/s
7.09.460.895 I slot print_timing: id 3 | task 6781 | n_decoded = 772, tg = 18.50 t/s, tg_3s = 18.52 t/s
7.12.486.864 I slot print_timing: id 3 | task 6781 | n_decoded = 828, tg = 18.50 t/s, tg_3s = 18.51 t/s
7.15.514.778 I slot print_timing: id 3 | task 6781 | n_decoded = 884, tg = 18.50 t/s, tg_3s = 18.49 t/s
7.18.541.923 I slot print_timing: id 3 | task 6781 | n_decoded = 940, tg = 18.50 t/s, tg_3s = 18.50 t/s
7.21.586.051 I slot print_timing: id 3 | task 6781 | n_decoded = 996, tg = 18.49 t/s, tg_3s = 18.40 t/s
7.24.623.728 I slot print_timing: id 3 | task 6781 | n_decoded = 1052, tg = 18.49 t/s, tg_3s = 18.44 t/s
7.27.667.614 I slot print_timing: id 3 | task 6781 | n_decoded = 1108, tg = 18.49 t/s, tg_3s = 18.40 t/s
7.30.711.968 I slot print_timing: id 3 | task 6781 | n_decoded = 1164, tg = 18.48 t/s, tg_3s = 18.39 t/s
7.33.764.948 I slot print_timing: id 3 | task 6781 | n_decoded = 1220, tg = 18.47 t/s, tg_3s = 18.34 t/s
7.36.818.356 I slot print_timing: id 3 | task 6781 | n_decoded = 1276, tg = 18.47 t/s, tg_3s = 18.34 t/s
7.39.868.966 I slot print_timing: id 3 | task 6781 | n_decoded = 1332, tg = 18.46 t/s, tg_3s = 18.36 t/s
7.42.922.316 I slot print_timing: id 3 | task 6781 | n_decoded = 1388, tg = 18.46 t/s, tg_3s = 18.34 t/s
7.45.976.096 I slot print_timing: id 3 | task 6781 | n_decoded = 1444, tg = 18.45 t/s, tg_3s = 18.34 t/s
7.49.026.101 I slot print_timing: id 3 | task 6781 | n_decoded = 1500, tg = 18.45 t/s, tg_3s = 18.36 t/s
7.52.066.273 I slot print_timing: id 3 | task 6781 | n_decoded = 1556, tg = 18.45 t/s, tg_3s = 18.42 t/s
7.55.110.160 I slot print_timing: id 3 | task 6781 | n_decoded = 1612, tg = 18.45 t/s, tg_3s = 18.40 t/s
7.58.160.881 I slot print_timing: id 3 | task 6781 | n_decoded = 1668, tg = 18.44 t/s, tg_3s = 18.36 t/s
8.01.208.706 I slot print_timing: id 3 | task 6781 | n_decoded = 1724, tg = 18.44 t/s, tg_3s = 18.37 t/s
8.04.214.856 I slot print_timing: id 3 | task 6781 | n_decoded = 1779, tg = 18.44 t/s, tg_3s = 18.30 t/s
8.07.263.929 I slot print_timing: id 3 | task 6781 | n_decoded = 1835, tg = 18.44 t/s, tg_3s = 18.37 t/s
8.10.318.341 I slot print_timing: id 3 | task 6781 | n_decoded = 1891, tg = 18.43 t/s, tg_3s = 18.33 t/s
8.13.371.965 I slot print_timing: id 3 | task 6781 | n_decoded = 1947, tg = 18.43 t/s, tg_3s = 18.34 t/s
8.16.382.974 I slot print_timing: id 3 | task 6781 | n_decoded = 2002, tg = 18.43 t/s, tg_3s = 18.27 t/s
8.19.390.076 I slot print_timing: id 3 | task 6781 | n_decoded = 2057, tg = 18.42 t/s, tg_3s = 18.29 t/s
8.22.402.465 I slot print_timing: id 3 | task 6781 | n_decoded = 2112, tg = 18.42 t/s, tg_3s = 18.26 t/s
8.25.410.977 I slot print_timing: id 3 | task 6781 | n_decoded = 2167, tg = 18.41 t/s, tg_3s = 18.28 t/s
8.28.418.174 I slot print_timing: id 3 | task 6781 | n_decoded = 2222, tg = 18.41 t/s, tg_3s = 18.29 t/s
8.31.445.187 I slot print_timing: id 3 | task 6781 | n_decoded = 2277, tg = 18.41 t/s, tg_3s = 18.17 t/s
8.34.495.347 I slot print_timing: id 3 | task 6781 | n_decoded = 2333, tg = 18.40 t/s, tg_3s = 18.36 t/s
8.37.537.982 I slot print_timing: id 3 | task 6781 | n_decoded = 2389, tg = 18.40 t/s, tg_3s = 18.41 t/s
8.40.585.672 I slot print_timing: id 3 | task 6781 | n_decoded = 2445, tg = 18.40 t/s, tg_3s = 18.37 t/s
8.43.592.269 I slot print_timing: id 3 | task 6781 | n_decoded = 2500, tg = 18.40 t/s, tg_3s = 18.29 t/s
8.46.597.138 I slot print_timing: id 3 | task 6781 | n_decoded = 2555, tg = 18.40 t/s, tg_3s = 18.30 t/s
8.49.602.172 I slot print_timing: id 3 | task 6781 | n_decoded = 2610, tg = 18.40 t/s, tg_3s = 18.30 t/s
8.52.608.063 I slot print_timing: id 3 | task 6781 | n_decoded = 2665, tg = 18.39 t/s, tg_3s = 18.30 t/s
8.55.616.140 I slot print_timing: id 3 | task 6781 | n_decoded = 2720, tg = 18.39 t/s, tg_3s = 18.28 t/s
8.58.637.880 I slot print_timing: id 3 | task 6781 | n_decoded = 2775, tg = 18.39 t/s, tg_3s = 18.20 t/s
9.01.662.033 I slot print_timing: id 3 | task 6781 | n_decoded = 2830, tg = 18.38 t/s, tg_3s = 18.19 t/s
9.04.679.762 I slot print_timing: id 3 | task 6781 | n_decoded = 2885, tg = 18.38 t/s, tg_3s = 18.23 t/s
9.07.697.361 I slot print_timing: id 3 | task 6781 | n_decoded = 2940, tg = 18.38 t/s, tg_3s = 18.23 t/s
9.09.457.115 I slot print_timing: id 3 | task 6781 | prompt eval time = 428.93 ms / 29 tokens ( 14.79 ms per token, 67.61 tokens per second)
9.09.457.119 I slot print_timing: id 3 | task 6781 | eval time = 161728.17 ms / 2972 tokens ( 54.42 ms per token, 18.38 tokens per second)
9.09.457.120 I slot print_timing: id 3 | task 6781 | total time = 162157.10 ms / 3001 tokens
9.09.457.120 I slot print_timing: id 3 | task 6781 | graphs reused = 9688
9.09.457.159 I slot release: id 3 | task 6781 | stop processing: n_tokens = 3041, truncated = 0
9.09.457.178 I srv update_slots: all slots are idle
9.09.473.465 I srv operator(): Chat format: peg-native
9.09.473.742 I slot get_availabl: id 2 | task -1 | selected slot by LRU, t_last = -1
9.09.473.744 I srv get_availabl: updating prompt cache
9.09.473.747 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000
9.09.473.750 I srv update: - cache state: 7 prompts, 2550.783 MiB (limits: 8192.000 MiB, 24576 tokens, 24576 est)
9.09.473.751 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
9.09.473.752 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
9.09.473.753 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
9.09.473.753 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
9.09.473.754 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
9.09.473.755 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
9.09.473.755 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
9.09.473.756 I srv get_availabl: prompt cache update took 0.01 ms
9.09.473.803 I slot launch_slot_: id 2 | task 9755 | processing task, is_child = 0
9.09.473.804 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
9.09.473.804 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
9.09.473.825 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
9.09.473.825 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
9.09.473.859 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache
9.09.473.994 W srv prompt_save: - saving prompt with length 3041, total state size = 339.747 MiB (draft: 0.000 MiB)
9.09.785.004 I srv update: - cache state: 8 prompts, 3040.156 MiB (limits: 8192.000 MiB, 24576 tokens, 27848 est)
9.09.785.007 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
9.09.785.008 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
9.09.785.009 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
9.09.785.009 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
9.09.785.010 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
9.09.785.010 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
9.09.785.011 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
9.09.785.011 I srv update: - prompt 0x5b027da224e0: 3041 tokens, checkpoints: 1, 489.373 MiB
9.09.785.012 I slot prompt_clear: id 3 | task -1 | clearing prompt with 3041 tokens
9.10.246.506 I slot create_check: id 2 | task 9755 | created context checkpoint 1 of 32 (pos_min = 58, pos_max = 58, n_tokens = 59, size = 149.626 MiB)
9.16.040.100 I slot print_timing: id 2 | task 9755 | n_decoded = 100, tg = 18.64 t/s, tg_3s = 18.64 t/s
9.19.066.622 I slot print_timing: id 2 | task 9755 | n_decoded = 156, tg = 18.59 t/s, tg_3s = 18.50 t/s
9.22.106.982 I slot print_timing: id 2 | task 9755 | n_decoded = 212, tg = 18.54 t/s, tg_3s = 18.42 t/s
9.25.142.136 I slot print_timing: id 2 | task 9755 | n_decoded = 268, tg = 18.52 t/s, tg_3s = 18.45 t/s
9.28.174.769 I slot print_timing: id 2 | task 9755 | n_decoded = 324, tg = 18.51 t/s, tg_3s = 18.47 t/s
9.31.198.287 I slot print_timing: id 2 | task 9755 | n_decoded = 380, tg = 18.51 t/s, tg_3s = 18.52 t/s
9.34.235.769 I slot print_timing: id 2 | task 9755 | n_decoded = 436, tg = 18.50 t/s, tg_3s = 18.44 t/s
9.37.259.790 I slot print_timing: id 2 | task 9755 | n_decoded = 492, tg = 18.51 t/s, tg_3s = 18.52 t/s
9.40.286.051 I slot print_timing: id 2 | task 9755 | n_decoded = 548, tg = 18.51 t/s, tg_3s = 18.50 t/s
9.43.310.132 I slot print_timing: id 2 | task 9755 | n_decoded = 604, tg = 18.51 t/s, tg_3s = 18.52 t/s
9.46.335.050 I slot print_timing: id 2 | task 9755 | n_decoded = 660, tg = 18.51 t/s, tg_3s = 18.51 t/s
9.49.376.274 I slot print_timing: id 2 | task 9755 | n_decoded = 716, tg = 18.50 t/s, tg_3s = 18.41 t/s
9.52.407.087 I slot print_timing: id 2 | task 9755 | n_decoded = 772, tg = 18.50 t/s, tg_3s = 18.48 t/s
9.55.441.234 I slot print_timing: id 2 | task 9755 | n_decoded = 828, tg = 18.50 t/s, tg_3s = 18.46 t/s
9.58.471.089 I slot print_timing: id 2 | task 9755 | n_decoded = 884, tg = 18.49 t/s, tg_3s = 18.48 t/s
10.01.517.295 I slot print_timing: id 2 | task 9755 | n_decoded = 940, tg = 18.49 t/s, tg_3s = 18.38 t/s
10.04.563.309 I slot print_timing: id 2 | task 9755 | n_decoded = 996, tg = 18.48 t/s, tg_3s = 18.38 t/s
10.07.600.787 I slot print_timing: id 2 | task 9755 | n_decoded = 1052, tg = 18.48 t/s, tg_3s = 18.44 t/s
10.10.641.239 I slot print_timing: id 2 | task 9755 | n_decoded = 1108, tg = 18.48 t/s, tg_3s = 18.42 t/s
10.13.678.862 I slot print_timing: id 2 | task 9755 | n_decoded = 1164, tg = 18.47 t/s, tg_3s = 18.44 t/s
10.16.724.236 I slot print_timing: id 2 | task 9755 | n_decoded = 1220, tg = 18.47 t/s, tg_3s = 18.39 t/s
10.19.768.950 I slot print_timing: id 2 | task 9755 | n_decoded = 1276, tg = 18.47 t/s, tg_3s = 18.39 t/s
10.22.811.921 I slot print_timing: id 2 | task 9755 | n_decoded = 1332, tg = 18.46 t/s, tg_3s = 18.40 t/s
10.25.854.000 I slot print_timing: id 2 | task 9755 | n_decoded = 1388, tg = 18.46 t/s, tg_3s = 18.41 t/s
10.28.905.866 I slot print_timing: id 2 | task 9755 | n_decoded = 1444, tg = 18.46 t/s, tg_3s = 18.35 t/s
10.31.952.111 I slot print_timing: id 2 | task 9755 | n_decoded = 1500, tg = 18.46 t/s, tg_3s = 18.38 t/s
10.35.004.241 I slot print_timing: id 2 | task 9755 | n_decoded = 1556, tg = 18.45 t/s, tg_3s = 18.35 t/s
10.38.052.727 I slot print_timing: id 2 | task 9755 | n_decoded = 1612, tg = 18.45 t/s, tg_3s = 18.37 t/s
10.41.057.752 I slot print_timing: id 2 | task 9755 | n_decoded = 1667, tg = 18.44 t/s, tg_3s = 18.30 t/s
10.44.065.115 I slot print_timing: id 2 | task 9755 | n_decoded = 1722, tg = 18.44 t/s, tg_3s = 18.29 t/s
10.47.119.070 I slot print_timing: id 2 | task 9755 | n_decoded = 1778, tg = 18.44 t/s, tg_3s = 18.34 t/s
10.50.119.815 I slot print_timing: id 2 | task 9755 | n_decoded = 1833, tg = 18.43 t/s, tg_3s = 18.33 t/s
10.53.172.824 I slot print_timing: id 2 | task 9755 | n_decoded = 1889, tg = 18.43 t/s, tg_3s = 18.34 t/s
10.56.177.879 I slot print_timing: id 2 | task 9755 | n_decoded = 1944, tg = 18.43 t/s, tg_3s = 18.30 t/s
10.57.994.834 I slot print_timing: id 2 | task 9755 | prompt eval time = 888.60 ms / 98 tokens ( 9.07 ms per token, 110.29 tokens per second)
10.57.994.837 I slot print_timing: id 2 | task 9755 | eval time = 107320.61 ms / 1977 tokens ( 54.28 ms per token, 18.42 tokens per second)
10.57.994.838 I slot print_timing: id 2 | task 9755 | total time = 108209.21 ms / 2075 tokens
10.57.994.839 I slot print_timing: id 2 | task 9755 | graphs reused = 11655
10.57.994.882 I slot release: id 2 | task 9755 | stop processing: n_tokens = 2074, truncated = 0
10.57.994.891 I srv update_slots: all slots are idle
10.58.011.225 I srv operator(): Chat format: peg-native
10.58.011.521 I slot get_availabl: id 2 | task -1 | selected slot by LCP similarity, sim_best = 0.484 (> 0.100 thold), f_keep = 0.030
10.58.011.524 I srv get_availabl: updating prompt cache
10.58.011.612 W srv prompt_save: - saving prompt with length 2074, total state size = 279.291 MiB (draft: 0.000 MiB)
10.58.274.799 I srv load: - looking for better prompt, base f_keep = 0.030, sim = 0.484
10.58.274.806 I srv update: - cache state: 9 prompts, 3469.073 MiB (limits: 8192.000 MiB, 24576 tokens, 29303 est)
10.58.274.807 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
10.58.274.808 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
10.58.274.808 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
10.58.274.809 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
10.58.274.809 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
10.58.274.810 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
10.58.274.810 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
10.58.274.811 I srv update: - prompt 0x5b027da224e0: 3041 tokens, checkpoints: 1, 489.373 MiB
10.58.274.811 I srv update: - prompt 0x5b028561ee30: 2074 tokens, checkpoints: 1, 428.917 MiB
10.58.274.812 I srv get_availabl: prompt cache update took 263.29 ms
10.58.274.892 I slot launch_slot_: id 2 | task 11735 | processing task, is_child = 0
10.58.274.892 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
10.58.274.893 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
10.58.274.912 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
10.58.274.913 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
10.58.274.926 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache
10.58.274.926 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens
10.58.274.948 I slot update_slots: id 2 | task 11735 | Checking checkpoint with [58, 58] against 62...
10.58.310.085 W slot update_slots: id 2 | task 11735 | restored context checkpoint (pos_min = 58, pos_max = 58, n_tokens = 59, n_past = 59, size = 149.626 MiB)
11.04.295.115 I slot print_timing: id 2 | task 11735 | n_decoded = 100, tg = 18.64 t/s, tg_3s = 18.64 t/s
11.07.334.966 I slot print_timing: id 2 | task 11735 | n_decoded = 156, tg = 18.56 t/s, tg_3s = 18.42 t/s
11.10.358.856 I slot print_timing: id 2 | task 11735 | n_decoded = 212, tg = 18.55 t/s, tg_3s = 18.52 t/s
11.13.382.911 I slot print_timing: id 2 | task 11735 | n_decoded = 268, tg = 18.54 t/s, tg_3s = 18.52 t/s
11.16.408.843 I slot print_timing: id 2 | task 11735 | n_decoded = 324, tg = 18.54 t/s, tg_3s = 18.51 t/s
11.19.434.642 I slot print_timing: id 2 | task 11735 | n_decoded = 380, tg = 18.53 t/s, tg_3s = 18.51 t/s
11.22.471.029 I slot print_timing: id 2 | task 11735 | n_decoded = 436, tg = 18.52 t/s, tg_3s = 18.44 t/s
11.25.496.093 I slot print_timing: id 2 | task 11735 | n_decoded = 492, tg = 18.52 t/s, tg_3s = 18.51 t/s
11.28.524.102 I slot print_timing: id 2 | task 11735 | n_decoded = 548, tg = 18.52 t/s, tg_3s = 18.49 t/s
11.31.551.906 I slot print_timing: id 2 | task 11735 | n_decoded = 604, tg = 18.52 t/s, tg_3s = 18.50 t/s
11.34.591.041 I slot print_timing: id 2 | task 11735 | n_decoded = 660, tg = 18.51 t/s, tg_3s = 18.43 t/s
11.37.620.205 I slot print_timing: id 2 | task 11735 | n_decoded = 716, tg = 18.51 t/s, tg_3s = 18.49 t/s
11.40.651.863 I slot print_timing: id 2 | task 11735 | n_decoded = 772, tg = 18.50 t/s, tg_3s = 18.47 t/s
11.43.687.176 I slot print_timing: id 2 | task 11735 | n_decoded = 828, tg = 18.50 t/s, tg_3s = 18.45 t/s
11.46.731.054 I slot print_timing: id 2 | task 11735 | n_decoded = 884, tg = 18.49 t/s, tg_3s = 18.40 t/s
11.49.775.730 I slot print_timing: id 2 | task 11735 | n_decoded = 940, tg = 18.49 t/s, tg_3s = 18.39 t/s
11.52.813.842 I slot print_timing: id 2 | task 11735 | n_decoded = 996, tg = 18.48 t/s, tg_3s = 18.43 t/s
11.55.840.841 I slot print_timing: id 2 | task 11735 | n_decoded = 1052, tg = 18.49 t/s, tg_3s = 18.50 t/s
11.58.867.932 I slot print_timing: id 2 | task 11735 | n_decoded = 1108, tg = 18.49 t/s, tg_3s = 18.50 t/s
12.01.907.639 I slot print_timing: id 2 | task 11735 | n_decoded = 1164, tg = 18.48 t/s, tg_3s = 18.42 t/s
12.04.950.126 I slot print_timing: id 2 | task 11735 | n_decoded = 1220, tg = 18.48 t/s, tg_3s = 18.41 t/s
12.07.992.091 I slot print_timing: id 2 | task 11735 | n_decoded = 1276, tg = 18.48 t/s, tg_3s = 18.41 t/s
12.11.038.233 I slot print_timing: id 2 | task 11735 | n_decoded = 1332, tg = 18.47 t/s, tg_3s = 18.38 t/s
12.14.089.127 I slot print_timing: id 2 | task 11735 | n_decoded = 1388, tg = 18.47 t/s, tg_3s = 18.36 t/s
12.17.095.556 I slot print_timing: id 2 | task 11735 | n_decoded = 1443, tg = 18.46 t/s, tg_3s = 18.29 t/s
12.20.096.063 I slot print_timing: id 2 | task 11735 | n_decoded = 1498, tg = 18.46 t/s, tg_3s = 18.33 t/s
12.23.149.216 I slot print_timing: id 2 | task 11735 | prompt eval time = 656.25 ms / 69 tokens ( 9.51 ms per token, 105.14 tokens per second)
12.23.149.220 I slot print_timing: id 2 | task 11735 | eval time = 84218.01 ms / 1554 tokens ( 54.19 ms per token, 18.45 tokens per second)
12.23.149.220 I slot print_timing: id 2 | task 11735 | total time = 84874.26 ms / 1623 tokens
12.23.149.221 I slot print_timing: id 2 | task 11735 | graphs reused = 13201
12.23.149.262 I slot release: id 2 | task 11735 | stop processing: n_tokens = 1681, truncated = 0
12.23.149.275 I srv update_slots: all slots are idle
12.23.165.424 I srv operator(): Chat format: peg-native
12.23.165.709 I slot get_availabl: id 2 | task -1 | selected slot by LCP similarity, sim_best = 0.508 (> 0.100 thold), f_keep = 0.037
12.23.165.712 I srv get_availabl: updating prompt cache
12.23.165.792 W srv prompt_save: - saving prompt with length 1681, total state size = 254.721 MiB (draft: 0.000 MiB)
12.23.412.023 I srv load: - looking for better prompt, base f_keep = 0.037, sim = 0.508
12.23.412.031 I srv update: - cache state: 10 prompts, 3873.420 MiB (limits: 8192.000 MiB, 24576 tokens, 29799 est)
12.23.412.032 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
12.23.412.032 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
12.23.412.033 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
12.23.412.034 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
12.23.412.034 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
12.23.412.035 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
12.23.412.035 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
12.23.412.036 I srv update: - prompt 0x5b027da224e0: 3041 tokens, checkpoints: 1, 489.373 MiB
12.23.412.036 I srv update: - prompt 0x5b028561ee30: 2074 tokens, checkpoints: 1, 428.917 MiB
12.23.412.037 I srv update: - prompt 0x5b027dea2770: 1681 tokens, checkpoints: 1, 404.347 MiB
12.23.412.038 I srv get_availabl: prompt cache update took 246.33 ms
12.23.412.114 I slot launch_slot_: id 2 | task 13291 | processing task, is_child = 0
12.23.412.114 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
12.23.412.115 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
12.23.412.134 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
12.23.412.134 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
12.23.412.147 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache
12.23.412.148 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens
12.23.412.170 I slot update_slots: id 2 | task 13291 | Checking checkpoint with [58, 58] against 62...
12.23.447.273 W slot update_slots: id 2 | task 13291 | restored context checkpoint (pos_min = 58, pos_max = 58, n_tokens = 59, n_past = 59, size = 149.626 MiB)
12.29.294.035 I slot print_timing: id 2 | task 13291 | n_decoded = 100, tg = 18.64 t/s, tg_3s = 18.64 t/s
12.32.334.316 I slot print_timing: id 2 | task 13291 | n_decoded = 156, tg = 18.56 t/s, tg_3s = 18.42 t/s
12.35.372.717 I slot print_timing: id 2 | task 13291 | n_decoded = 212, tg = 18.53 t/s, tg_3s = 18.43 t/s
12.38.412.335 I slot print_timing: id 2 | task 13291 | n_decoded = 268, tg = 18.51 t/s, tg_3s = 18.42 t/s
12.41.447.957 I slot print_timing: id 2 | task 13291 | n_decoded = 324, tg = 18.50 t/s, tg_3s = 18.45 t/s
12.44.492.726 I slot print_timing: id 2 | task 13291 | n_decoded = 380, tg = 18.48 t/s, tg_3s = 18.39 t/s
12.47.539.896 I slot print_timing: id 2 | task 13291 | n_decoded = 436, tg = 18.47 t/s, tg_3s = 18.38 t/s
12.50.565.685 I slot print_timing: id 2 | task 13291 | n_decoded = 492, tg = 18.47 t/s, tg_3s = 18.51 t/s
12.53.589.890 I slot print_timing: id 2 | task 13291 | n_decoded = 548, tg = 18.48 t/s, tg_3s = 18.52 t/s
12.56.613.006 I slot print_timing: id 2 | task 13291 | n_decoded = 604, tg = 18.48 t/s, tg_3s = 18.52 t/s
12.59.648.208 I slot print_timing: id 2 | task 13291 | n_decoded = 660, tg = 18.48 t/s, tg_3s = 18.45 t/s
13.02.679.064 I slot print_timing: id 2 | task 13291 | n_decoded = 716, tg = 18.48 t/s, tg_3s = 18.48 t/s
13.05.705.055 I slot print_timing: id 2 | task 13291 | n_decoded = 772, tg = 18.48 t/s, tg_3s = 18.51 t/s
13.08.729.695 I slot print_timing: id 2 | task 13291 | n_decoded = 828, tg = 18.48 t/s, tg_3s = 18.51 t/s
13.11.761.132 I slot print_timing: id 2 | task 13291 | n_decoded = 884, tg = 18.48 t/s, tg_3s = 18.47 t/s
13.14.810.304 I slot print_timing: id 2 | task 13291 | n_decoded = 940, tg = 18.47 t/s, tg_3s = 18.37 t/s
13.17.852.302 I slot print_timing: id 2 | task 13291 | n_decoded = 996, tg = 18.47 t/s, tg_3s = 18.41 t/s
13.20.895.535 I slot print_timing: id 2 | task 13291 | n_decoded = 1052, tg = 18.47 t/s, tg_3s = 18.40 t/s
13.23.941.093 I slot print_timing: id 2 | task 13291 | n_decoded = 1108, tg = 18.46 t/s, tg_3s = 18.39 t/s
13.26.943.472 I slot print_timing: id 2 | task 13291 | n_decoded = 1163, tg = 18.46 t/s, tg_3s = 18.32 t/s
13.29.946.939 I slot print_timing: id 2 | task 13291 | n_decoded = 1218, tg = 18.45 t/s, tg_3s = 18.31 t/s
13.33.000.559 I slot print_timing: id 2 | task 13291 | n_decoded = 1274, tg = 18.44 t/s, tg_3s = 18.34 t/s
13.36.038.543 I slot print_timing: id 2 | task 13291 | n_decoded = 1330, tg = 18.44 t/s, tg_3s = 18.43 t/s
13.39.078.967 I slot print_timing: id 2 | task 13291 | n_decoded = 1386, tg = 18.44 t/s, tg_3s = 18.42 t/s
13.42.083.030 I slot print_timing: id 2 | task 13291 | n_decoded = 1441, tg = 18.44 t/s, tg_3s = 18.31 t/s
13.45.133.236 I slot print_timing: id 2 | task 13291 | n_decoded = 1497, tg = 18.44 t/s, tg_3s = 18.36 t/s
13.48.180.284 I slot print_timing: id 2 | task 13291 | n_decoded = 1553, tg = 18.43 t/s, tg_3s = 18.38 t/s
13.51.230.694 I slot print_timing: id 2 | task 13291 | n_decoded = 1609, tg = 18.43 t/s, tg_3s = 18.36 t/s
13.54.279.859 I slot print_timing: id 2 | task 13291 | n_decoded = 1665, tg = 18.43 t/s, tg_3s = 18.37 t/s
13.57.287.321 I slot print_timing: id 2 | task 13291 | n_decoded = 1720, tg = 18.42 t/s, tg_3s = 18.29 t/s
14.00.340.694 I slot print_timing: id 2 | task 13291 | n_decoded = 1776, tg = 18.42 t/s, tg_3s = 18.34 t/s
14.03.341.734 I slot print_timing: id 2 | task 13291 | n_decoded = 1831, tg = 18.42 t/s, tg_3s = 18.33 t/s
14.06.395.450 I slot print_timing: id 2 | task 13291 | n_decoded = 1887, tg = 18.42 t/s, tg_3s = 18.34 t/s
14.09.411.966 I slot print_timing: id 2 | task 13291 | n_decoded = 1942, tg = 18.41 t/s, tg_3s = 18.23 t/s
14.12.421.486 I slot print_timing: id 2 | task 13291 | n_decoded = 1997, tg = 18.41 t/s, tg_3s = 18.28 t/s
14.15.438.158 I slot print_timing: id 2 | task 13291 | n_decoded = 2052, tg = 18.40 t/s, tg_3s = 18.23 t/s
14.18.452.941 I slot print_timing: id 2 | task 13291 | n_decoded = 2107, tg = 18.40 t/s, tg_3s = 18.24 t/s
14.21.464.782 I slot print_timing: id 2 | task 13291 | n_decoded = 2162, tg = 18.39 t/s, tg_3s = 18.26 t/s
14.24.486.455 I slot print_timing: id 2 | task 13291 | n_decoded = 2217, tg = 18.39 t/s, tg_3s = 18.20 t/s
14.27.491.326 I slot print_timing: id 2 | task 13291 | n_decoded = 2272, tg = 18.39 t/s, tg_3s = 18.30 t/s
14.30.541.276 I slot print_timing: id 2 | task 13291 | n_decoded = 2328, tg = 18.39 t/s, tg_3s = 18.36 t/s
14.33.591.706 I slot print_timing: id 2 | task 13291 | n_decoded = 2384, tg = 18.39 t/s, tg_3s = 18.36 t/s
14.36.647.218 I slot print_timing: id 2 | task 13291 | n_decoded = 2440, tg = 18.38 t/s, tg_3s = 18.33 t/s
14.39.665.820 I slot print_timing: id 2 | task 13291 | n_decoded = 2495, tg = 18.38 t/s, tg_3s = 18.22 t/s
14.42.411.334 I slot print_timing: id 2 | task 13291 | prompt eval time = 517.97 ms / 63 tokens ( 8.22 ms per token, 121.63 tokens per second)
14.42.411.338 I slot print_timing: id 2 | task 13291 | eval time = 138481.18 ms / 2545 tokens ( 54.41 ms per token, 18.38 tokens per second)
14.42.411.338 I slot print_timing: id 2 | task 13291 | total time = 138999.16 ms / 2608 tokens
14.42.411.339 I slot print_timing: id 2 | task 13291 | graphs reused = 15734
14.42.411.379 I slot release: id 2 | task 13291 | stop processing: n_tokens = 2666, truncated = 0
14.42.411.398 I srv update_slots: all slots are idle
14.42.427.943 I srv operator(): Chat format: peg-native
14.42.428.228 I slot get_availabl: id 2 | task -1 | selected slot by LCP similarity, sim_best = 0.473 (> 0.100 thold), f_keep = 0.023
14.42.428.230 I srv get_availabl: updating prompt cache
14.42.428.352 W srv prompt_save: - saving prompt with length 2666, total state size = 316.302 MiB (draft: 0.000 MiB)
14.42.712.890 I srv load: - looking for better prompt, base f_keep = 0.023, sim = 0.473
14.42.712.900 I srv update: - cache state: 11 prompts, 4339.349 MiB (limits: 8192.000 MiB, 24576 tokens, 31632 est)
14.42.712.901 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
14.42.712.905 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
14.42.712.905 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
14.42.712.906 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
14.42.712.906 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
14.42.712.907 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
14.42.712.908 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
14.42.712.909 I srv update: - prompt 0x5b027da224e0: 3041 tokens, checkpoints: 1, 489.373 MiB
14.42.712.910 I srv update: - prompt 0x5b028561ee30: 2074 tokens, checkpoints: 1, 428.917 MiB
14.42.712.910 I srv update: - prompt 0x5b027dea2770: 1681 tokens, checkpoints: 1, 404.347 MiB
14.42.712.911 I srv update: - prompt 0x5b027e1254d0: 2666 tokens, checkpoints: 1, 465.928 MiB
14.42.712.912 I srv get_availabl: prompt cache update took 284.68 ms
14.42.712.989 I slot launch_slot_: id 2 | task 15838 | processing task, is_child = 0
14.42.712.990 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
14.42.712.990 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
14.42.713.010 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
14.42.713.010 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
14.42.713.039 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache
14.42.713.040 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens
14.42.713.078 I slot update_slots: id 2 | task 15838 | Checking checkpoint with [58, 58] against 62...
14.42.748.193 W slot update_slots: id 2 | task 15838 | restored context checkpoint (pos_min = 58, pos_max = 58, n_tokens = 59, n_past = 59, size = 149.626 MiB)
14.48.724.102 I slot print_timing: id 2 | task 15838 | n_decoded = 100, tg = 18.69 t/s, tg_3s = 18.69 t/s
14.51.765.664 I slot print_timing: id 2 | task 15838 | n_decoded = 156, tg = 18.59 t/s, tg_3s = 18.41 t/s
14.54.794.259 I slot print_timing: id 2 | task 15838 | n_decoded = 212, tg = 18.56 t/s, tg_3s = 18.49 t/s
14.57.821.656 I slot print_timing: id 2 | task 15838 | n_decoded = 268, tg = 18.55 t/s, tg_3s = 18.50 t/s
15.00.857.962 I slot print_timing: id 2 | task 15838 | n_decoded = 324, tg = 18.53 t/s, tg_3s = 18.44 t/s
15.03.892.369 I slot print_timing: id 2 | task 15838 | n_decoded = 380, tg = 18.52 t/s, tg_3s = 18.46 t/s
15.06.939.190 I slot print_timing: id 2 | task 15838 | n_decoded = 436, tg = 18.50 t/s, tg_3s = 18.38 t/s
15.09.975.857 I slot print_timing: id 2 | task 15838 | n_decoded = 492, tg = 18.49 t/s, tg_3s = 18.44 t/s
15.13.006.457 I slot print_timing: id 2 | task 15838 | n_decoded = 548, tg = 18.49 t/s, tg_3s = 18.48 t/s
15.16.035.621 I slot print_timing: id 2 | task 15838 | n_decoded = 604, tg = 18.49 t/s, tg_3s = 18.49 t/s
15.19.070.689 I slot print_timing: id 2 | task 15838 | n_decoded = 660, tg = 18.49 t/s, tg_3s = 18.45 t/s
15.22.098.578 I slot print_timing: id 2 | task 15838 | n_decoded = 716, tg = 18.49 t/s, tg_3s = 18.49 t/s
15.25.121.664 I slot print_timing: id 2 | task 15838 | n_decoded = 772, tg = 18.49 t/s, tg_3s = 18.52 t/s
15.28.145.827 I slot print_timing: id 2 | task 15838 | n_decoded = 828, tg = 18.49 t/s, tg_3s = 18.52 t/s
15.31.171.465 I slot print_timing: id 2 | task 15838 | n_decoded = 884, tg = 18.49 t/s, tg_3s = 18.51 t/s
15.34.208.664 I slot print_timing: id 2 | task 15838 | n_decoded = 940, tg = 18.49 t/s, tg_3s = 18.44 t/s
15.37.239.709 I slot print_timing: id 2 | task 15838 | n_decoded = 996, tg = 18.49 t/s, tg_3s = 18.48 t/s
15.40.272.835 I slot print_timing: id 2 | task 15838 | n_decoded = 1052, tg = 18.49 t/s, tg_3s = 18.46 t/s
15.43.306.849 I slot print_timing: id 2 | task 15838 | n_decoded = 1108, tg = 18.49 t/s, tg_3s = 18.46 t/s
15.46.358.912 I slot print_timing: id 2 | task 15838 | n_decoded = 1164, tg = 18.48 t/s, tg_3s = 18.35 t/s
15.49.408.879 I slot print_timing: id 2 | task 15838 | n_decoded = 1220, tg = 18.47 t/s, tg_3s = 18.36 t/s
15.52.408.956 I slot print_timing: id 2 | task 15838 | n_decoded = 1275, tg = 18.47 t/s, tg_3s = 18.33 t/s
15.55.410.104 I slot print_timing: id 2 | task 15838 | n_decoded = 1330, tg = 18.46 t/s, tg_3s = 18.33 t/s
15.58.415.672 I slot print_timing: id 2 | task 15838 | n_decoded = 1385, tg = 18.46 t/s, tg_3s = 18.30 t/s
16.01.424.929 I slot print_timing: id 2 | task 15838 | n_decoded = 1440, tg = 18.45 t/s, tg_3s = 18.28 t/s
16.04.425.033 I slot print_timing: id 2 | task 15838 | n_decoded = 1495, tg = 18.44 t/s, tg_3s = 18.33 t/s
16.07.473.109 I slot print_timing: id 2 | task 15838 | n_decoded = 1551, tg = 18.44 t/s, tg_3s = 18.37 t/s
16.10.509.710 I slot print_timing: id 2 | task 15838 | n_decoded = 1607, tg = 18.44 t/s, tg_3s = 18.44 t/s
16.13.556.948 I slot print_timing: id 2 | task 15838 | n_decoded = 1663, tg = 18.44 t/s, tg_3s = 18.38 t/s
16.16.611.079 I slot print_timing: id 2 | task 15838 | n_decoded = 1719, tg = 18.44 t/s, tg_3s = 18.34 t/s
16.19.661.180 I slot print_timing: id 2 | task 15838 | n_decoded = 1775, tg = 18.43 t/s, tg_3s = 18.36 t/s
16.22.708.918 I slot print_timing: id 2 | task 15838 | n_decoded = 1831, tg = 18.43 t/s, tg_3s = 18.37 t/s
16.25.760.620 I slot print_timing: id 2 | task 15838 | n_decoded = 1887, tg = 18.43 t/s, tg_3s = 18.35 t/s
16.28.769.177 I slot print_timing: id 2 | task 15838 | n_decoded = 1942, tg = 18.43 t/s, tg_3s = 18.28 t/s
16.31.772.884 I slot print_timing: id 2 | task 15838 | n_decoded = 1997, tg = 18.42 t/s, tg_3s = 18.31 t/s
16.34.826.091 I slot print_timing: id 2 | task 15838 | n_decoded = 2053, tg = 18.42 t/s, tg_3s = 18.34 t/s
16.37.827.843 I slot print_timing: id 2 | task 15838 | n_decoded = 2108, tg = 18.42 t/s, tg_3s = 18.32 t/s
16.40.836.279 I slot print_timing: id 2 | task 15838 | n_decoded = 2163, tg = 18.41 t/s, tg_3s = 18.28 t/s
16.43.855.804 I slot print_timing: id 2 | task 15838 | n_decoded = 2218, tg = 18.41 t/s, tg_3s = 18.21 t/s
16.46.863.344 I slot print_timing: id 2 | task 15838 | n_decoded = 2273, tg = 18.41 t/s, tg_3s = 18.29 t/s
16.49.868.902 I slot print_timing: id 2 | task 15838 | n_decoded = 2328, tg = 18.40 t/s, tg_3s = 18.30 t/s
16.52.872.775 I slot print_timing: id 2 | task 15838 | n_decoded = 2383, tg = 18.40 t/s, tg_3s = 18.31 t/s
16.55.926.720 I slot print_timing: id 2 | task 15838 | n_decoded = 2439, tg = 18.40 t/s, tg_3s = 18.34 t/s
16.58.926.800 I slot print_timing: id 2 | task 15838 | n_decoded = 2494, tg = 18.40 t/s, tg_3s = 18.33 t/s
17.01.930.433 I slot print_timing: id 2 | task 15838 | n_decoded = 2549, tg = 18.40 t/s, tg_3s = 18.31 t/s
17.04.940.804 I slot print_timing: id 2 | task 15838 | n_decoded = 2604, tg = 18.39 t/s, tg_3s = 18.27 t/s
17.07.944.790 I slot print_timing: id 2 | task 15838 | n_decoded = 2659, tg = 18.39 t/s, tg_3s = 18.31 t/s
17.10.960.455 I slot print_timing: id 2 | task 15838 | n_decoded = 2714, tg = 18.39 t/s, tg_3s = 18.24 t/s
17.13.968.676 I slot print_timing: id 2 | task 15838 | n_decoded = 2769, tg = 18.39 t/s, tg_3s = 18.28 t/s
17.16.980.590 I slot print_timing: id 2 | task 15838 | n_decoded = 2824, tg = 18.38 t/s, tg_3s = 18.26 t/s
17.19.996.098 I slot print_timing: id 2 | task 15838 | n_decoded = 2879, tg = 18.38 t/s, tg_3s = 18.24 t/s
17.23.010.069 I slot print_timing: id 2 | task 15838 | n_decoded = 2934, tg = 18.38 t/s, tg_3s = 18.25 t/s
17.26.039.788 I slot print_timing: id 2 | task 15838 | n_decoded = 2989, tg = 18.37 t/s, tg_3s = 18.15 t/s
17.29.058.782 I slot print_timing: id 2 | task 15838 | n_decoded = 3044, tg = 18.37 t/s, tg_3s = 18.22 t/s
17.32.084.732 I slot print_timing: id 2 | task 15838 | n_decoded = 3099, tg = 18.37 t/s, tg_3s = 18.18 t/s
17.35.103.659 I slot print_timing: id 2 | task 15838 | n_decoded = 3154, tg = 18.37 t/s, tg_3s = 18.22 t/s
17.38.136.141 I slot print_timing: id 2 | task 15838 | n_decoded = 3209, tg = 18.36 t/s, tg_3s = 18.14 t/s
17.41.163.262 I slot print_timing: id 2 | task 15838 | n_decoded = 3264, tg = 18.36 t/s, tg_3s = 18.17 t/s
17.44.190.082 I slot print_timing: id 2 | task 15838 | n_decoded = 3319, tg = 18.36 t/s, tg_3s = 18.17 t/s
17.47.212.677 I slot print_timing: id 2 | task 15838 | n_decoded = 3374, tg = 18.35 t/s, tg_3s = 18.20 t/s
17.50.227.210 I slot print_timing: id 2 | task 15838 | n_decoded = 3429, tg = 18.35 t/s, tg_3s = 18.24 t/s
17.53.248.338 I slot print_timing: id 2 | task 15838 | n_decoded = 3484, tg = 18.35 t/s, tg_3s = 18.21 t/s
17.56.262.346 I slot print_timing: id 2 | task 15838 | n_decoded = 3539, tg = 18.35 t/s, tg_3s = 18.25 t/s
17.59.277.112 I slot print_timing: id 2 | task 15838 | n_decoded = 3594, tg = 18.35 t/s, tg_3s = 18.24 t/s
18.02.291.312 I slot print_timing: id 2 | task 15838 | n_decoded = 3649, tg = 18.34 t/s, tg_3s = 18.25 t/s
18.05.317.069 I slot print_timing: id 2 | task 15838 | n_decoded = 3704, tg = 18.34 t/s, tg_3s = 18.18 t/s
18.08.353.483 I slot print_timing: id 2 | task 15838 | n_decoded = 3759, tg = 18.34 t/s, tg_3s = 18.11 t/s
18.11.380.531 I slot print_timing: id 2 | task 15838 | n_decoded = 3814, tg = 18.34 t/s, tg_3s = 18.17 t/s
18.14.409.531 I slot print_timing: id 2 | task 15838 | n_decoded = 3869, tg = 18.33 t/s, tg_3s = 18.16 t/s
18.17.440.589 I slot print_timing: id 2 | task 15838 | n_decoded = 3924, tg = 18.33 t/s, tg_3s = 18.15 t/s
18.20.487.581 I slot print_timing: id 2 | task 15838 | n_decoded = 3979, tg = 18.33 t/s, tg_3s = 18.05 t/s
18.23.525.151 I slot print_timing: id 2 | task 15838 | n_decoded = 4034, tg = 18.32 t/s, tg_3s = 18.11 t/s
18.26.558.204 I slot print_timing: id 2 | task 15838 | n_decoded = 4089, tg = 18.32 t/s, tg_3s = 18.13 t/s
18.29.597.303 I slot print_timing: id 2 | task 15838 | n_decoded = 4144, tg = 18.32 t/s, tg_3s = 18.10 t/s
18.32.629.761 I slot print_timing: id 2 | task 15838 | n_decoded = 4199, tg = 18.32 t/s, tg_3s = 18.14 t/s
18.35.660.615 I slot print_timing: id 2 | task 15838 | n_decoded = 4254, tg = 18.31 t/s, tg_3s = 18.15 t/s
18.38.683.902 I slot print_timing: id 2 | task 15838 | n_decoded = 4309, tg = 18.31 t/s, tg_3s = 18.19 t/s
18.41.157.702 I slot print_timing: id 2 | task 15838 | prompt eval time = 659.96 ms / 72 tokens ( 9.17 ms per token, 109.10 tokens per second)
18.41.157.705 I slot print_timing: id 2 | task 15838 | eval time = 237784.66 ms / 4354 tokens ( 54.61 ms per token, 18.31 tokens per second)
18.41.157.705 I slot print_timing: id 2 | task 15838 | total time = 238444.62 ms / 4426 tokens
18.41.157.706 I slot print_timing: id 2 | task 15838 | graphs reused = 20069
18.41.157.742 I slot release: id 2 | task 15838 | stop processing: n_tokens = 4484, truncated = 0
18.41.157.765 I srv update_slots: all slots are idle
18.41.174.033 I srv operator(): Chat format: peg-native
18.41.174.318 I slot get_availabl: id 2 | task -1 | selected slot by LCP similarity, sim_best = 0.614 (> 0.100 thold), f_keep = 0.014
18.41.174.320 I srv get_availabl: updating prompt cache
18.41.174.470 W srv prompt_save: - saving prompt with length 4484, total state size = 429.962 MiB (draft: 0.000 MiB)
18.41.536.626 I srv load: - looking for better prompt, base f_keep = 0.014, sim = 0.614
18.41.536.636 I srv update: - cache state: 12 prompts, 4918.937 MiB (limits: 8192.000 MiB, 24576 tokens, 35373 est)
18.41.536.637 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
18.41.536.639 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
18.41.536.639 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
18.41.536.640 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
18.41.536.640 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
18.41.536.641 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
18.41.536.641 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
18.41.536.642 I srv update: - prompt 0x5b027da224e0: 3041 tokens, checkpoints: 1, 489.373 MiB
18.41.536.642 I srv update: - prompt 0x5b028561ee30: 2074 tokens, checkpoints: 1, 428.917 MiB
18.41.536.643 I srv update: - prompt 0x5b027dea2770: 1681 tokens, checkpoints: 1, 404.347 MiB
18.41.536.643 I srv update: - prompt 0x5b027e1254d0: 2666 tokens, checkpoints: 1, 465.928 MiB
18.41.536.644 I srv update: - prompt 0x5b027e095670: 4484 tokens, checkpoints: 1, 579.588 MiB
18.41.536.645 I srv get_availabl: prompt cache update took 362.32 ms
18.41.536.724 I slot launch_slot_: id 2 | task 20194 | processing task, is_child = 0
18.41.536.725 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
18.41.536.726 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
18.41.536.751 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
18.41.536.751 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
18.41.536.765 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache
18.41.536.766 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens
18.41.536.788 I slot update_slots: id 2 | task 20194 | Checking checkpoint with [58, 58] against 62...
18.41.572.052 W slot update_slots: id 2 | task 20194 | restored context checkpoint (pos_min = 58, pos_max = 58, n_tokens = 59, n_past = 59, size = 149.626 MiB)
18.47.358.558 I slot print_timing: id 2 | task 20194 | n_decoded = 100, tg = 18.67 t/s, tg_3s = 18.67 t/s
18.50.382.627 I slot print_timing: id 2 | task 20194 | n_decoded = 156, tg = 18.61 t/s, tg_3s = 18.52 t/s
18.53.420.445 I slot print_timing: id 2 | task 20194 | n_decoded = 212, tg = 18.57 t/s, tg_3s = 18.43 t/s
18.56.444.424 I slot print_timing: id 2 | task 20194 | n_decoded = 268, tg = 18.56 t/s, tg_3s = 18.52 t/s
18.59.468.746 I slot print_timing: id 2 | task 20194 | n_decoded = 324, tg = 18.55 t/s, tg_3s = 18.52 t/s
19.02.492.544 I slot print_timing: id 2 | task 20194 | n_decoded = 380, tg = 18.54 t/s, tg_3s = 18.52 t/s
19.05.533.676 I slot print_timing: id 2 | task 20194 | n_decoded = 436, tg = 18.53 t/s, tg_3s = 18.41 t/s
19.08.560.838 I slot print_timing: id 2 | task 20194 | n_decoded = 492, tg = 18.52 t/s, tg_3s = 18.50 t/s
19.11.589.955 I slot print_timing: id 2 | task 20194 | n_decoded = 548, tg = 18.52 t/s, tg_3s = 18.49 t/s
19.14.627.837 I slot print_timing: id 2 | task 20194 | n_decoded = 604, tg = 18.51 t/s, tg_3s = 18.43 t/s
19.17.664.682 I slot print_timing: id 2 | task 20194 | n_decoded = 660, tg = 18.51 t/s, tg_3s = 18.44 t/s
19.20.664.774 I slot print_timing: id 2 | task 20194 | n_decoded = 715, tg = 18.49 t/s, tg_3s = 18.33 t/s
19.23.711.361 I slot print_timing: id 2 | task 20194 | n_decoded = 771, tg = 18.48 t/s, tg_3s = 18.38 t/s
19.26.748.797 I slot print_timing: id 2 | task 20194 | n_decoded = 827, tg = 18.48 t/s, tg_3s = 18.44 t/s
19.29.773.875 I slot print_timing: id 2 | task 20194 | n_decoded = 883, tg = 18.48 t/s, tg_3s = 18.51 t/s
19.32.808.931 I slot print_timing: id 2 | task 20194 | n_decoded = 939, tg = 18.48 t/s, tg_3s = 18.45 t/s
19.35.837.770 I slot print_timing: id 2 | task 20194 | n_decoded = 995, tg = 18.48 t/s, tg_3s = 18.49 t/s
19.38.861.861 I slot print_timing: id 2 | task 20194 | n_decoded = 1051, tg = 18.48 t/s, tg_3s = 18.52 t/s
19.41.886.242 I slot print_timing: id 2 | task 20194 | n_decoded = 1107, tg = 18.49 t/s, tg_3s = 18.52 t/s
19.44.912.829 I slot print_timing: id 2 | task 20194 | n_decoded = 1163, tg = 18.49 t/s, tg_3s = 18.50 t/s
19.47.960.091 I slot print_timing: id 2 | task 20194 | n_decoded = 1219, tg = 18.48 t/s, tg_3s = 18.38 t/s
19.51.002.106 I slot print_timing: id 2 | task 20194 | n_decoded = 1275, tg = 18.48 t/s, tg_3s = 18.41 t/s
19.54.053.259 I slot print_timing: id 2 | task 20194 | n_decoded = 1331, tg = 18.47 t/s, tg_3s = 18.35 t/s
19.57.100.709 I slot print_timing: id 2 | task 20194 | n_decoded = 1387, tg = 18.47 t/s, tg_3s = 18.38 t/s
20.00.108.165 I slot print_timing: id 2 | task 20194 | n_decoded = 1442, tg = 18.46 t/s, tg_3s = 18.29 t/s
20.03.108.687 I slot print_timing: id 2 | task 20194 | n_decoded = 1497, tg = 18.46 t/s, tg_3s = 18.33 t/s
20.06.112.882 I slot print_timing: id 2 | task 20194 | n_decoded = 1552, tg = 18.45 t/s, tg_3s = 18.31 t/s
20.09.164.784 I slot print_timing: id 2 | task 20194 | n_decoded = 1608, tg = 18.45 t/s, tg_3s = 18.35 t/s
20.12.217.953 I slot print_timing: id 2 | task 20194 | n_decoded = 1664, tg = 18.44 t/s, tg_3s = 18.34 t/s
20.15.272.471 I slot print_timing: id 2 | task 20194 | n_decoded = 1720, tg = 18.44 t/s, tg_3s = 18.33 t/s
20.18.319.941 I slot print_timing: id 2 | task 20194 | n_decoded = 1776, tg = 18.44 t/s, tg_3s = 18.38 t/s
20.21.360.454 I slot print_timing: id 2 | task 20194 | n_decoded = 1832, tg = 18.44 t/s, tg_3s = 18.42 t/s
20.24.401.816 I slot print_timing: id 2 | task 20194 | n_decoded = 1888, tg = 18.44 t/s, tg_3s = 18.41 t/s
20.27.449.511 I slot print_timing: id 2 | task 20194 | n_decoded = 1944, tg = 18.44 t/s, tg_3s = 18.37 t/s
20.30.466.793 I slot print_timing: id 2 | task 20194 | n_decoded = 1999, tg = 18.43 t/s, tg_3s = 18.23 t/s
20.33.516.014 I slot print_timing: id 2 | task 20194 | n_decoded = 2055, tg = 18.43 t/s, tg_3s = 18.37 t/s
20.36.570.491 I slot print_timing: id 2 | task 20194 | n_decoded = 2111, tg = 18.43 t/s, tg_3s = 18.33 t/s
20.36.951.505 I slot print_timing: id 2 | task 20194 | prompt eval time = 464.41 ms / 42 tokens ( 11.06 ms per token, 90.44 tokens per second)
20.36.951.508 I slot print_timing: id 2 | task 20194 | eval time = 114950.30 ms / 2118 tokens ( 54.27 ms per token, 18.43 tokens per second)
20.36.951.509 I slot print_timing: id 2 | task 20194 | total time = 115414.71 ms / 2160 tokens
20.36.951.509 I slot print_timing: id 2 | task 20194 | graphs reused = 22177
20.36.951.550 I slot release: id 2 | task 20194 | stop processing: n_tokens = 2218, truncated = 0
20.36.951.565 I srv update_slots: all slots are idle
20.36.967.903 I srv operator(): Chat format: peg-native
20.36.968.183 I slot get_availabl: id 2 | task -1 | selected slot by LCP similarity, sim_best = 0.525 (> 0.100 thold), f_keep = 0.028
20.36.968.185 I srv get_availabl: updating prompt cache
20.36.968.280 W srv prompt_save: - saving prompt with length 2218, total state size = 288.294 MiB (draft: 0.000 MiB)
20.37.237.067 I srv load: - looking for better prompt, base f_keep = 0.028, sim = 0.525
20.37.237.076 I srv update: - cache state: 13 prompts, 5356.857 MiB (limits: 8192.000 MiB, 24576 tokens, 35873 est)
20.37.237.080 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
20.37.237.081 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
20.37.237.081 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
20.37.237.082 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
20.37.237.083 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
20.37.237.084 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
20.37.237.085 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
20.37.237.085 I srv update: - prompt 0x5b027da224e0: 3041 tokens, checkpoints: 1, 489.373 MiB
20.37.237.086 I srv update: - prompt 0x5b028561ee30: 2074 tokens, checkpoints: 1, 428.917 MiB
20.37.237.086 I srv update: - prompt 0x5b027dea2770: 1681 tokens, checkpoints: 1, 404.347 MiB
20.37.237.087 I srv update: - prompt 0x5b027e1254d0: 2666 tokens, checkpoints: 1, 465.928 MiB
20.37.237.087 I srv update: - prompt 0x5b027e095670: 4484 tokens, checkpoints: 1, 579.588 MiB
20.37.237.088 I srv update: - prompt 0x5b027dc8e820: 2218 tokens, checkpoints: 1, 437.920 MiB
20.37.237.089 I srv get_availabl: prompt cache update took 268.90 ms
20.37.237.165 I slot launch_slot_: id 2 | task 22314 | processing task, is_child = 0
20.37.237.166 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
20.37.237.166 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
20.37.237.187 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
20.37.237.187 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
20.37.237.217 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache
20.37.237.218 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens
20.37.237.260 I slot update_slots: id 2 | task 22314 | Checking checkpoint with [58, 58] against 62...
20.37.272.922 W slot update_slots: id 2 | task 22314 | restored context checkpoint (pos_min = 58, pos_max = 58, n_tokens = 59, n_past = 59, size = 149.626 MiB)
20.43.075.658 I slot print_timing: id 2 | task 22314 | n_decoded = 100, tg = 18.66 t/s, tg_3s = 18.66 t/s
20.46.110.704 I slot print_timing: id 2 | task 22314 | n_decoded = 156, tg = 18.59 t/s, tg_3s = 18.45 t/s
20.49.140.584 I slot print_timing: id 2 | task 22314 | n_decoded = 212, tg = 18.56 t/s, tg_3s = 18.48 t/s
20.52.172.233 I slot print_timing: id 2 | task 22314 | n_decoded = 268, tg = 18.54 t/s, tg_3s = 18.47 t/s
20.55.204.734 I slot print_timing: id 2 | task 22314 | n_decoded = 324, tg = 18.53 t/s, tg_3s = 18.47 t/s
20.58.238.385 I slot print_timing: id 2 | task 22314 | n_decoded = 380, tg = 18.52 t/s, tg_3s = 18.46 t/s
21.01.280.290 I slot print_timing: id 2 | task 22314 | n_decoded = 436, tg = 18.50 t/s, tg_3s = 18.41 t/s
21.04.319.238 I slot print_timing: id 2 | task 22314 | n_decoded = 492, tg = 18.49 t/s, tg_3s = 18.43 t/s
21.07.349.689 I slot print_timing: id 2 | task 22314 | n_decoded = 548, tg = 18.49 t/s, tg_3s = 18.48 t/s
21.10.374.670 I slot print_timing: id 2 | task 22314 | n_decoded = 604, tg = 18.49 t/s, tg_3s = 18.51 t/s
21.13.409.814 I slot print_timing: id 2 | task 22314 | n_decoded = 660, tg = 18.49 t/s, tg_3s = 18.45 t/s
21.16.435.848 I slot print_timing: id 2 | task 22314 | n_decoded = 716, tg = 18.49 t/s, tg_3s = 18.51 t/s
21.19.460.782 I slot print_timing: id 2 | task 22314 | n_decoded = 772, tg = 18.49 t/s, tg_3s = 18.51 t/s
21.22.486.904 I slot print_timing: id 2 | task 22314 | n_decoded = 828, tg = 18.49 t/s, tg_3s = 18.51 t/s
21.25.523.293 I slot print_timing: id 2 | task 22314 | n_decoded = 884, tg = 18.49 t/s, tg_3s = 18.44 t/s
21.28.565.138 I slot print_timing: id 2 | task 22314 | n_decoded = 940, tg = 18.49 t/s, tg_3s = 18.41 t/s
21.31.604.942 I slot print_timing: id 2 | task 22314 | n_decoded = 996, tg = 18.48 t/s, tg_3s = 18.42 t/s
21.34.644.858 I slot print_timing: id 2 | task 22314 | n_decoded = 1052, tg = 18.48 t/s, tg_3s = 18.42 t/s
21.37.691.137 I slot print_timing: id 2 | task 22314 | n_decoded = 1108, tg = 18.47 t/s, tg_3s = 18.38 t/s
21.40.736.687 I slot print_timing: id 2 | task 22314 | n_decoded = 1164, tg = 18.47 t/s, tg_3s = 18.39 t/s
21.43.750.715 I slot print_timing: id 2 | task 22314 | n_decoded = 1219, tg = 18.46 t/s, tg_3s = 18.25 t/s
21.46.759.594 I slot print_timing: id 2 | task 22314 | n_decoded = 1274, tg = 18.45 t/s, tg_3s = 18.28 t/s
21.49.769.752 I slot print_timing: id 2 | task 22314 | n_decoded = 1329, tg = 18.44 t/s, tg_3s = 18.27 t/s
21.52.775.712 I slot print_timing: id 2 | task 22314 | n_decoded = 1384, tg = 18.44 t/s, tg_3s = 18.30 t/s
21.55.829.755 I slot print_timing: id 2 | task 22314 | n_decoded = 1440, tg = 18.43 t/s, tg_3s = 18.34 t/s
21.58.874.948 I slot print_timing: id 2 | task 22314 | n_decoded = 1496, tg = 18.43 t/s, tg_3s = 18.39 t/s
22.01.921.482 I slot print_timing: id 2 | task 22314 | n_decoded = 1552, tg = 18.43 t/s, tg_3s = 18.38 t/s
22.04.966.582 I slot print_timing: id 2 | task 22314 | n_decoded = 1608, tg = 18.43 t/s, tg_3s = 18.39 t/s
22.08.014.508 I slot print_timing: id 2 | task 22314 | n_decoded = 1664, tg = 18.43 t/s, tg_3s = 18.37 t/s
22.11.021.417 I slot print_timing: id 2 | task 22314 | n_decoded = 1719, tg = 18.42 t/s, tg_3s = 18.29 t/s
22.14.070.592 I slot print_timing: id 2 | task 22314 | n_decoded = 1775, tg = 18.42 t/s, tg_3s = 18.37 t/s
22.17.123.529 I slot print_timing: id 2 | task 22314 | n_decoded = 1831, tg = 18.42 t/s, tg_3s = 18.34 t/s
22.20.177.227 I slot print_timing: id 2 | task 22314 | n_decoded = 1887, tg = 18.42 t/s, tg_3s = 18.34 t/s
22.23.189.703 I slot print_timing: id 2 | task 22314 | n_decoded = 1942, tg = 18.41 t/s, tg_3s = 18.26 t/s
22.26.196.556 I slot print_timing: id 2 | task 22314 | n_decoded = 1997, tg = 18.41 t/s, tg_3s = 18.29 t/s
22.29.202.883 I slot print_timing: id 2 | task 22314 | n_decoded = 2052, tg = 18.41 t/s, tg_3s = 18.29 t/s
22.32.211.834 I slot print_timing: id 2 | task 22314 | n_decoded = 2107, tg = 18.40 t/s, tg_3s = 18.28 t/s
22.35.227.505 I slot print_timing: id 2 | task 22314 | n_decoded = 2162, tg = 18.40 t/s, tg_3s = 18.24 t/s
22.38.253.157 I slot print_timing: id 2 | task 22314 | n_decoded = 2217, tg = 18.39 t/s, tg_3s = 18.18 t/s
22.41.272.682 I slot print_timing: id 2 | task 22314 | n_decoded = 2272, tg = 18.39 t/s, tg_3s = 18.21 t/s
22.44.289.772 I slot print_timing: id 2 | task 22314 | n_decoded = 2327, tg = 18.38 t/s, tg_3s = 18.23 t/s
22.47.300.588 I slot print_timing: id 2 | task 22314 | n_decoded = 2382, tg = 18.38 t/s, tg_3s = 18.27 t/s
22.50.352.565 I slot print_timing: id 2 | task 22314 | n_decoded = 2438, tg = 18.38 t/s, tg_3s = 18.35 t/s
22.53.374.568 I slot print_timing: id 2 | task 22314 | n_decoded = 2493, tg = 18.38 t/s, tg_3s = 18.20 t/s
22.56.388.584 I slot print_timing: id 2 | task 22314 | n_decoded = 2548, tg = 18.37 t/s, tg_3s = 18.25 t/s
22.59.402.743 I slot print_timing: id 2 | task 22314 | n_decoded = 2603, tg = 18.37 t/s, tg_3s = 18.25 t/s
23.02.421.515 I slot print_timing: id 2 | task 22314 | n_decoded = 2658, tg = 18.37 t/s, tg_3s = 18.22 t/s
23.05.449.883 I slot print_timing: id 2 | task 22314 | n_decoded = 2713, tg = 18.36 t/s, tg_3s = 18.16 t/s
23.08.475.852 I slot print_timing: id 2 | task 22314 | n_decoded = 2768, tg = 18.36 t/s, tg_3s = 18.18 t/s
23.11.500.989 I slot print_timing: id 2 | task 22314 | n_decoded = 2823, tg = 18.36 t/s, tg_3s = 18.18 t/s
23.14.524.861 I slot print_timing: id 2 | task 22314 | n_decoded = 2878, tg = 18.35 t/s, tg_3s = 18.19 t/s
23.17.551.818 I slot print_timing: id 2 | task 22314 | n_decoded = 2933, tg = 18.35 t/s, tg_3s = 18.17 t/s
23.19.157.875 I slot print_timing: id 2 | task 22314 | prompt eval time = 479.72 ms / 59 tokens ( 8.13 ms per token, 122.99 tokens per second)
23.19.157.878 I slot print_timing: id 2 | task 22314 | eval time = 161440.89 ms / 2962 tokens ( 54.50 ms per token, 18.35 tokens per second)
23.19.157.879 I slot print_timing: id 2 | task 22314 | total time = 161920.61 ms / 3021 tokens
23.19.157.880 I slot print_timing: id 2 | task 22314 | graphs reused = 25125
23.19.157.920 I slot release: id 2 | task 22314 | stop processing: n_tokens = 3079, truncated = 0
23.19.157.937 I srv update_slots: all slots are idle
23.19.174.214 I srv operator(): Chat format: peg-native
23.19.174.488 I slot get_availabl: id 1 | task -1 | selected slot by LRU, t_last = -1
23.19.174.490 I srv get_availabl: updating prompt cache
23.19.174.491 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000
23.19.174.495 I srv update: - cache state: 13 prompts, 5356.857 MiB (limits: 8192.000 MiB, 24576 tokens, 35873 est)
23.19.174.496 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
23.19.174.497 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
23.19.174.497 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
23.19.174.498 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
23.19.174.499 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
23.19.174.499 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
23.19.174.500 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
23.19.174.501 I srv update: - prompt 0x5b027da224e0: 3041 tokens, checkpoints: 1, 489.373 MiB
23.19.174.501 I srv update: - prompt 0x5b028561ee30: 2074 tokens, checkpoints: 1, 428.917 MiB
23.19.174.502 I srv update: - prompt 0x5b027dea2770: 1681 tokens, checkpoints: 1, 404.347 MiB
23.19.174.502 I srv update: - prompt 0x5b027e1254d0: 2666 tokens, checkpoints: 1, 465.928 MiB
23.19.174.503 I srv update: - prompt 0x5b027e095670: 4484 tokens, checkpoints: 1, 579.588 MiB
23.19.174.503 I srv update: - prompt 0x5b027dc8e820: 2218 tokens, checkpoints: 1, 437.920 MiB
23.19.174.504 I srv get_availabl: prompt cache update took 0.01 ms
23.19.174.554 I slot launch_slot_: id 1 | task 25278 | processing task, is_child = 0
23.19.174.554 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
23.19.174.555 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
23.19.174.574 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
23.19.174.698 W srv prompt_save: - saving prompt with length 3079, total state size = 342.123 MiB (draft: 0.000 MiB)
23.19.476.063 I srv update: - cache state: 14 prompts, 5848.606 MiB (limits: 8192.000 MiB, 24576 tokens, 37169 est)
23.19.476.066 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
23.19.476.067 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
23.19.476.068 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
23.19.476.068 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
23.19.476.069 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
23.19.476.069 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
23.19.476.070 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
23.19.476.070 I srv update: - prompt 0x5b027da224e0: 3041 tokens, checkpoints: 1, 489.373 MiB
23.19.476.071 I srv update: - prompt 0x5b028561ee30: 2074 tokens, checkpoints: 1, 428.917 MiB
23.19.476.071 I srv update: - prompt 0x5b027dea2770: 1681 tokens, checkpoints: 1, 404.347 MiB
23.19.476.072 I srv update: - prompt 0x5b027e1254d0: 2666 tokens, checkpoints: 1, 465.928 MiB
23.19.476.073 I srv update: - prompt 0x5b027e095670: 4484 tokens, checkpoints: 1, 579.588 MiB
23.19.476.076 I srv update: - prompt 0x5b027dc8e820: 2218 tokens, checkpoints: 1, 437.920 MiB
23.19.476.077 I srv update: - prompt 0x5b0278730c10: 3079 tokens, checkpoints: 1, 491.749 MiB
23.19.476.077 I slot prompt_clear: id 2 | task -1 | clearing prompt with 3079 tokens
23.19.476.554 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache
23.19.476.556 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens
23.19.894.526 I slot create_check: id 1 | task 25278 | created context checkpoint 1 of 32 (pos_min = 53, pos_max = 53, n_tokens = 54, size = 149.626 MiB)
23.25.883.547 I slot print_timing: id 1 | task 25278 | n_decoded = 100, tg = 18.64 t/s, tg_3s = 18.64 t/s
23.28.928.890 I slot print_timing: id 1 | task 25278 | n_decoded = 156, tg = 18.55 t/s, tg_3s = 18.39 t/s
23.31.962.641 I slot print_timing: id 1 | task 25278 | n_decoded = 212, tg = 18.53 t/s, tg_3s = 18.46 t/s
23.34.986.169 I slot print_timing: id 1 | task 25278 | n_decoded = 268, tg = 18.52 t/s, tg_3s = 18.52 t/s
23.38.011.212 I slot print_timing: id 1 | task 25278 | n_decoded = 324, tg = 18.52 t/s, tg_3s = 18.51 t/s
23.41.034.751 I slot print_timing: id 1 | task 25278 | n_decoded = 380, tg = 18.52 t/s, tg_3s = 18.52 t/s
23.44.069.233 I slot print_timing: id 1 | task 25278 | n_decoded = 436, tg = 18.51 t/s, tg_3s = 18.45 t/s
23.47.093.486 I slot print_timing: id 1 | task 25278 | n_decoded = 492, tg = 18.51 t/s, tg_3s = 18.52 t/s
23.50.123.310 I slot print_timing: id 1 | task 25278 | n_decoded = 548, tg = 18.51 t/s, tg_3s = 18.48 t/s
23.53.147.253 I slot print_timing: id 1 | task 25278 | n_decoded = 604, tg = 18.51 t/s, tg_3s = 18.52 t/s
23.56.184.589 I slot print_timing: id 1 | task 25278 | n_decoded = 660, tg = 18.51 t/s, tg_3s = 18.44 t/s
23.59.209.502 I slot print_timing: id 1 | task 25278 | n_decoded = 716, tg = 18.51 t/s, tg_3s = 18.51 t/s
24.02.248.417 I slot print_timing: id 1 | task 25278 | n_decoded = 772, tg = 18.50 t/s, tg_3s = 18.43 t/s
24.05.282.699 I slot print_timing: id 1 | task 25278 | n_decoded = 828, tg = 18.50 t/s, tg_3s = 18.46 t/s
24.08.311.465 I slot print_timing: id 1 | task 25278 | n_decoded = 884, tg = 18.50 t/s, tg_3s = 18.49 t/s
24.11.360.756 I slot print_timing: id 1 | task 25278 | n_decoded = 940, tg = 18.49 t/s, tg_3s = 18.36 t/s
24.14.400.567 I slot print_timing: id 1 | task 25278 | n_decoded = 996, tg = 18.49 t/s, tg_3s = 18.42 t/s
24.17.443.569 I slot print_timing: id 1 | task 25278 | n_decoded = 1052, tg = 18.48 t/s, tg_3s = 18.40 t/s
24.20.479.448 I slot print_timing: id 1 | task 25278 | n_decoded = 1108, tg = 18.48 t/s, tg_3s = 18.45 t/s
24.23.532.872 I slot print_timing: id 1 | task 25278 | n_decoded = 1164, tg = 18.47 t/s, tg_3s = 18.34 t/s
24.26.582.706 I slot print_timing: id 1 | task 25278 | n_decoded = 1220, tg = 18.47 t/s, tg_3s = 18.36 t/s
24.29.626.735 I slot print_timing: id 1 | task 25278 | n_decoded = 1276, tg = 18.46 t/s, tg_3s = 18.40 t/s
24.32.676.700 I slot print_timing: id 1 | task 25278 | n_decoded = 1332, tg = 18.46 t/s, tg_3s = 18.36 t/s
24.35.718.948 I slot print_timing: id 1 | task 25278 | n_decoded = 1388, tg = 18.46 t/s, tg_3s = 18.41 t/s
24.38.721.750 I slot print_timing: id 1 | task 25278 | n_decoded = 1443, tg = 18.45 t/s, tg_3s = 18.32 t/s
24.41.772.732 I slot print_timing: id 1 | task 25278 | n_decoded = 1499, tg = 18.45 t/s, tg_3s = 18.35 t/s
24.44.823.094 I slot print_timing: id 1 | task 25278 | n_decoded = 1555, tg = 18.45 t/s, tg_3s = 18.36 t/s
24.47.873.114 I slot print_timing: id 1 | task 25278 | n_decoded = 1611, tg = 18.44 t/s, tg_3s = 18.36 t/s
24.50.873.154 I slot print_timing: id 1 | task 25278 | n_decoded = 1666, tg = 18.44 t/s, tg_3s = 18.33 t/s
24.53.880.521 I slot print_timing: id 1 | task 25278 | n_decoded = 1721, tg = 18.43 t/s, tg_3s = 18.29 t/s
24.56.886.155 I slot print_timing: id 1 | task 25278 | n_decoded = 1776, tg = 18.43 t/s, tg_3s = 18.30 t/s
24.59.887.065 I slot print_timing: id 1 | task 25278 | n_decoded = 1831, tg = 18.43 t/s, tg_3s = 18.33 t/s
25.02.892.843 I slot print_timing: id 1 | task 25278 | n_decoded = 1886, tg = 18.42 t/s, tg_3s = 18.30 t/s
25.05.904.107 I slot print_timing: id 1 | task 25278 | n_decoded = 1941, tg = 18.42 t/s, tg_3s = 18.26 t/s
25.08.953.837 I slot print_timing: id 1 | task 25278 | n_decoded = 1997, tg = 18.42 t/s, tg_3s = 18.36 t/s
25.11.954.649 I slot print_timing: id 1 | task 25278 | n_decoded = 2052, tg = 18.41 t/s, tg_3s = 18.33 t/s
25.14.996.806 I slot print_timing: id 1 | task 25278 | n_decoded = 2108, tg = 18.41 t/s, tg_3s = 18.41 t/s
25.18.035.656 I slot print_timing: id 1 | task 25278 | n_decoded = 2164, tg = 18.41 t/s, tg_3s = 18.43 t/s
25.21.037.629 I slot print_timing: id 1 | task 25278 | n_decoded = 2219, tg = 18.41 t/s, tg_3s = 18.32 t/s
25.24.085.724 I slot print_timing: id 1 | task 25278 | n_decoded = 2275, tg = 18.41 t/s, tg_3s = 18.37 t/s
25.27.139.617 I slot print_timing: id 1 | task 25278 | n_decoded = 2331, tg = 18.41 t/s, tg_3s = 18.34 t/s
25.30.187.932 I slot print_timing: id 1 | task 25278 | n_decoded = 2387, tg = 18.41 t/s, tg_3s = 18.37 t/s
25.33.194.925 I slot print_timing: id 1 | task 25278 | n_decoded = 2442, tg = 18.41 t/s, tg_3s = 18.29 t/s
25.36.209.387 I slot print_timing: id 1 | task 25278 | n_decoded = 2497, tg = 18.40 t/s, tg_3s = 18.25 t/s
25.39.225.431 I slot print_timing: id 1 | task 25278 | n_decoded = 2552, tg = 18.40 t/s, tg_3s = 18.24 t/s
25.42.243.558 I slot print_timing: id 1 | task 25278 | n_decoded = 2607, tg = 18.39 t/s, tg_3s = 18.22 t/s
25.45.261.480 I slot print_timing: id 1 | task 25278 | n_decoded = 2662, tg = 18.39 t/s, tg_3s = 18.22 t/s
25.48.289.809 I slot print_timing: id 1 | task 25278 | n_decoded = 2717, tg = 18.39 t/s, tg_3s = 18.16 t/s
25.51.314.386 I slot print_timing: id 1 | task 25278 | n_decoded = 2772, tg = 18.38 t/s, tg_3s = 18.18 t/s
25.54.338.907 I slot print_timing: id 1 | task 25278 | n_decoded = 2827, tg = 18.38 t/s, tg_3s = 18.18 t/s
25.57.359.624 I slot print_timing: id 1 | task 25278 | n_decoded = 2882, tg = 18.38 t/s, tg_3s = 18.21 t/s
26.00.379.965 I slot print_timing: id 1 | task 25278 | n_decoded = 2937, tg = 18.37 t/s, tg_3s = 18.21 t/s
26.03.414.093 I slot print_timing: id 1 | task 25278 | n_decoded = 2992, tg = 18.37 t/s, tg_3s = 18.13 t/s
26.06.438.664 I slot print_timing: id 1 | task 25278 | n_decoded = 3047, tg = 18.36 t/s, tg_3s = 18.18 t/s
26.09.444.035 I slot print_timing: id 1 | task 25278 | n_decoded = 3102, tg = 18.36 t/s, tg_3s = 18.30 t/s
26.12.454.957 I slot print_timing: id 1 | task 25278 | n_decoded = 3157, tg = 18.36 t/s, tg_3s = 18.27 t/s
26.15.472.921 I slot print_timing: id 1 | task 25278 | n_decoded = 3212, tg = 18.36 t/s, tg_3s = 18.22 t/s
26.18.483.186 I slot print_timing: id 1 | task 25278 | n_decoded = 3267, tg = 18.36 t/s, tg_3s = 18.27 t/s
26.21.496.962 I slot print_timing: id 1 | task 25278 | n_decoded = 3322, tg = 18.36 t/s, tg_3s = 18.25 t/s
26.24.513.731 I slot print_timing: id 1 | task 25278 | n_decoded = 3377, tg = 18.35 t/s, tg_3s = 18.23 t/s
26.27.530.780 I slot print_timing: id 1 | task 25278 | n_decoded = 3432, tg = 18.35 t/s, tg_3s = 18.23 t/s
26.30.561.224 I slot print_timing: id 1 | task 25278 | n_decoded = 3487, tg = 18.35 t/s, tg_3s = 18.15 t/s
26.33.582.667 I slot print_timing: id 1 | task 25278 | n_decoded = 3542, tg = 18.35 t/s, tg_3s = 18.20 t/s
26.36.604.787 I slot print_timing: id 1 | task 25278 | n_decoded = 3597, tg = 18.34 t/s, tg_3s = 18.20 t/s
26.39.629.136 I slot print_timing: id 1 | task 25278 | n_decoded = 3652, tg = 18.34 t/s, tg_3s = 18.19 t/s
26.42.652.978 I slot print_timing: id 1 | task 25278 | n_decoded = 3707, tg = 18.34 t/s, tg_3s = 18.19 t/s
26.45.702.052 I slot print_timing: id 1 | task 25278 | n_decoded = 3762, tg = 18.33 t/s, tg_3s = 18.04 t/s
26.48.731.868 I slot print_timing: id 1 | task 25278 | n_decoded = 3817, tg = 18.33 t/s, tg_3s = 18.15 t/s
26.51.761.875 I slot print_timing: id 1 | task 25278 | n_decoded = 3872, tg = 18.33 t/s, tg_3s = 18.15 t/s
26.54.789.445 I slot print_timing: id 1 | task 25278 | n_decoded = 3927, tg = 18.33 t/s, tg_3s = 18.17 t/s
26.57.831.515 I slot print_timing: id 1 | task 25278 | n_decoded = 3982, tg = 18.32 t/s, tg_3s = 18.08 t/s
27.00.858.736 I slot print_timing: id 1 | task 25278 | n_decoded = 4037, tg = 18.32 t/s, tg_3s = 18.17 t/s
27.03.883.778 I slot print_timing: id 1 | task 25278 | n_decoded = 4092, tg = 18.32 t/s, tg_3s = 18.18 t/s
27.06.908.517 I slot print_timing: id 1 | task 25278 | n_decoded = 4147, tg = 18.32 t/s, tg_3s = 18.18 t/s
27.09.940.884 I slot print_timing: id 1 | task 25278 | n_decoded = 4202, tg = 18.32 t/s, tg_3s = 18.14 t/s
27.12.977.801 I slot print_timing: id 1 | task 25278 | n_decoded = 4257, tg = 18.31 t/s, tg_3s = 18.11 t/s
27.16.006.721 I slot print_timing: id 1 | task 25278 | n_decoded = 4312, tg = 18.31 t/s, tg_3s = 18.16 t/s
27.19.033.791 I slot print_timing: id 1 | task 25278 | n_decoded = 4367, tg = 18.31 t/s, tg_3s = 18.17 t/s
27.22.065.899 I slot print_timing: id 1 | task 25278 | n_decoded = 4422, tg = 18.31 t/s, tg_3s = 18.14 t/s
27.25.095.067 I slot print_timing: id 1 | task 25278 | n_decoded = 4477, tg = 18.31 t/s, tg_3s = 18.16 t/s
27.28.141.821 I slot print_timing: id 1 | task 25278 | n_decoded = 4532, tg = 18.30 t/s, tg_3s = 18.05 t/s
27.31.173.173 I slot print_timing: id 1 | task 25278 | n_decoded = 4587, tg = 18.30 t/s, tg_3s = 18.14 t/s
27.34.206.891 I slot print_timing: id 1 | task 25278 | n_decoded = 4642, tg = 18.30 t/s, tg_3s = 18.13 t/s
27.37.244.004 I slot print_timing: id 1 | task 25278 | n_decoded = 4697, tg = 18.30 t/s, tg_3s = 18.11 t/s
27.40.290.904 I slot print_timing: id 1 | task 25278 | n_decoded = 4752, tg = 18.29 t/s, tg_3s = 18.05 t/s
27.43.328.833 I slot print_timing: id 1 | task 25278 | n_decoded = 4807, tg = 18.29 t/s, tg_3s = 18.10 t/s
27.46.367.313 I slot print_timing: id 1 | task 25278 | n_decoded = 4862, tg = 18.29 t/s, tg_3s = 18.10 t/s
27.49.395.674 I slot print_timing: id 1 | task 25278 | n_decoded = 4917, tg = 18.29 t/s, tg_3s = 18.16 t/s
27.52.422.345 I slot print_timing: id 1 | task 25278 | n_decoded = 4972, tg = 18.29 t/s, tg_3s = 18.17 t/s
27.55.473.987 I slot print_timing: id 1 | task 25278 | n_decoded = 5027, tg = 18.28 t/s, tg_3s = 18.02 t/s
27.56.025.928 I slot print_timing: id 1 | task 25278 | prompt eval time = 1042.43 ms / 128 tokens ( 8.14 ms per token, 122.79 tokens per second)
27.56.025.931 I slot print_timing: id 1 | task 25278 | eval time = 275506.74 ms / 5037 tokens ( 54.70 ms per token, 18.28 tokens per second)
27.56.025.932 I slot print_timing: id 1 | task 25278 | total time = 276549.17 ms / 5165 tokens
27.56.025.932 I slot print_timing: id 1 | task 25278 | graphs reused = 30140
27.56.025.977 I slot release: id 1 | task 25278 | stop processing: n_tokens = 5164, truncated = 0
27.56.026.008 I srv update_slots: all slots are idle
27.56.101.700 I srv operator(): Chat format: peg-native
27.56.101.983 I slot get_availabl: id 1 | task -1 | selected slot by LCP similarity, sim_best = 0.681 (> 0.100 thold), f_keep = 0.012
27.56.101.985 I srv get_availabl: updating prompt cache
27.56.102.176 W srv prompt_save: - saving prompt with length 5164, total state size = 472.475 MiB (draft: 0.000 MiB)
27.56.486.315 I srv load: - looking for better prompt, base f_keep = 0.012, sim = 0.681
27.56.486.327 I srv update: - cache state: 15 prompts, 6470.707 MiB (limits: 8192.000 MiB, 24576 tokens, 40133 est)
27.56.486.328 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
27.56.486.329 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
27.56.486.330 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
27.56.486.330 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
27.56.486.331 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
27.56.486.332 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
27.56.486.333 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
27.56.486.333 I srv update: - prompt 0x5b027da224e0: 3041 tokens, checkpoints: 1, 489.373 MiB
27.56.486.334 I srv update: - prompt 0x5b028561ee30: 2074 tokens, checkpoints: 1, 428.917 MiB
27.56.486.335 I srv update: - prompt 0x5b027dea2770: 1681 tokens, checkpoints: 1, 404.347 MiB
27.56.486.335 I srv update: - prompt 0x5b027e1254d0: 2666 tokens, checkpoints: 1, 465.928 MiB
27.56.486.336 I srv update: - prompt 0x5b027e095670: 4484 tokens, checkpoints: 1, 579.588 MiB
27.56.486.336 I srv update: - prompt 0x5b027dc8e820: 2218 tokens, checkpoints: 1, 437.920 MiB
27.56.486.337 I srv update: - prompt 0x5b0278730c10: 3079 tokens, checkpoints: 1, 491.749 MiB
27.56.486.338 I srv update: - prompt 0x5b028564f6d0: 5164 tokens, checkpoints: 1, 622.101 MiB
27.56.486.339 I srv get_availabl: prompt cache update took 384.35 ms
27.56.486.435 I slot launch_slot_: id 1 | task 30318 | processing task, is_child = 0
27.56.486.437 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
27.56.486.438 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
27.56.486.474 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
27.56.486.474 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
27.56.486.510 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache
27.56.486.510 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens
27.56.486.536 I slot update_slots: id 1 | task 30318 | Checking checkpoint with [53, 53] against 62...
27.56.522.021 W slot update_slots: id 1 | task 30318 | restored context checkpoint (pos_min = 53, pos_max = 53, n_tokens = 54, n_past = 54, size = 149.626 MiB)
28.02.310.541 I slot print_timing: id 1 | task 30318 | n_decoded = 100, tg = 18.65 t/s, tg_3s = 18.65 t/s
28.05.342.450 I slot print_timing: id 1 | task 30318 | n_decoded = 156, tg = 18.59 t/s, tg_3s = 18.47 t/s
28.08.376.780 I slot print_timing: id 1 | task 30318 | n_decoded = 212, tg = 18.55 t/s, tg_3s = 18.46 t/s
28.11.400.612 I slot print_timing: id 1 | task 30318 | n_decoded = 268, tg = 18.55 t/s, tg_3s = 18.52 t/s
28.14.430.680 I slot print_timing: id 1 | task 30318 | n_decoded = 324, tg = 18.53 t/s, tg_3s = 18.48 t/s
28.17.457.423 I slot print_timing: id 1 | task 30318 | n_decoded = 380, tg = 18.53 t/s, tg_3s = 18.50 t/s
28.20.495.718 I slot print_timing: id 1 | task 30318 | n_decoded = 436, tg = 18.52 t/s, tg_3s = 18.43 t/s
28.23.524.794 I slot print_timing: id 1 | task 30318 | n_decoded = 492, tg = 18.51 t/s, tg_3s = 18.49 t/s
28.26.555.450 I slot print_timing: id 1 | task 30318 | n_decoded = 548, tg = 18.51 t/s, tg_3s = 18.48 t/s
28.29.584.397 I slot print_timing: id 1 | task 30318 | n_decoded = 604, tg = 18.51 t/s, tg_3s = 18.49 t/s
28.32.611.197 I slot print_timing: id 1 | task 30318 | n_decoded = 660, tg = 18.51 t/s, tg_3s = 18.50 t/s
28.35.644.542 I slot print_timing: id 1 | task 30318 | n_decoded = 716, tg = 18.50 t/s, tg_3s = 18.46 t/s
28.38.669.720 I slot print_timing: id 1 | task 30318 | n_decoded = 772, tg = 18.50 t/s, tg_3s = 18.51 t/s
28.41.700.317 I slot print_timing: id 1 | task 30318 | n_decoded = 828, tg = 18.50 t/s, tg_3s = 18.48 t/s
28.44.729.487 I slot print_timing: id 1 | task 30318 | n_decoded = 884, tg = 18.50 t/s, tg_3s = 18.49 t/s
28.47.770.087 I slot print_timing: id 1 | task 30318 | n_decoded = 940, tg = 18.50 t/s, tg_3s = 18.42 t/s
28.50.803.397 I slot print_timing: id 1 | task 30318 | n_decoded = 996, tg = 18.49 t/s, tg_3s = 18.46 t/s
28.53.839.938 I slot print_timing: id 1 | task 30318 | n_decoded = 1052, tg = 18.49 t/s, tg_3s = 18.44 t/s
28.56.878.548 I slot print_timing: id 1 | task 30318 | n_decoded = 1108, tg = 18.49 t/s, tg_3s = 18.43 t/s
28.57.746.372 I slot print_timing: id 1 | task 30318 | prompt eval time = 463.19 ms / 37 tokens ( 12.52 ms per token, 79.88 tokens per second)
28.57.746.376 I slot print_timing: id 1 | task 30318 | eval time = 60796.64 ms / 1124 tokens ( 54.09 ms per token, 18.49 tokens per second)
28.57.746.376 I slot print_timing: id 1 | task 30318 | total time = 61259.83 ms / 1161 tokens
28.57.746.377 I slot print_timing: id 1 | task 30318 | graphs reused = 31258
28.57.746.416 I slot release: id 1 | task 30318 | stop processing: n_tokens = 1214, truncated = 0
28.57.746.428 I srv update_slots: all slots are idle
28.57.807.599 I srv operator(): Chat format: peg-native
28.57.807.874 I slot get_availabl: id 1 | task -1 | selected slot by LCP similarity, sim_best = 0.633 (> 0.100 thold), f_keep = 0.051
28.57.807.877 I srv get_availabl: updating prompt cache
28.57.807.956 W srv prompt_save: - saving prompt with length 1214, total state size = 225.525 MiB (draft: 0.000 MiB)
28.58.115.795 I srv load: - looking for better prompt, base f_keep = 0.051, sim = 0.633
28.58.115.806 I srv update: - cache state: 16 prompts, 6845.857 MiB (limits: 8192.000 MiB, 24576 tokens, 39387 est)
28.58.115.810 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
28.58.115.811 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
28.58.115.811 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
28.58.115.813 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
28.58.115.814 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
28.58.115.814 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
28.58.115.815 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
28.58.115.815 I srv update: - prompt 0x5b027da224e0: 3041 tokens, checkpoints: 1, 489.373 MiB
28.58.115.816 I srv update: - prompt 0x5b028561ee30: 2074 tokens, checkpoints: 1, 428.917 MiB
28.58.115.816 I srv update: - prompt 0x5b027dea2770: 1681 tokens, checkpoints: 1, 404.347 MiB
28.58.115.817 I srv update: - prompt 0x5b027e1254d0: 2666 tokens, checkpoints: 1, 465.928 MiB
28.58.115.817 I srv update: - prompt 0x5b027e095670: 4484 tokens, checkpoints: 1, 579.588 MiB
28.58.115.818 I srv update: - prompt 0x5b027dc8e820: 2218 tokens, checkpoints: 1, 437.920 MiB
28.58.115.818 I srv update: - prompt 0x5b0278730c10: 3079 tokens, checkpoints: 1, 491.749 MiB
28.58.115.819 I srv update: - prompt 0x5b028564f6d0: 5164 tokens, checkpoints: 1, 622.101 MiB
28.58.115.819 I srv update: - prompt 0x5b0285608620: 1214 tokens, checkpoints: 1, 375.151 MiB
28.58.115.820 I srv get_availabl: prompt cache update took 307.94 ms
28.58.115.899 I slot launch_slot_: id 1 | task 31444 | processing task, is_child = 0
28.58.115.899 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
28.58.115.900 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
28.58.115.919 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
28.58.115.919 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
28.58.115.932 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache
28.58.115.932 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens
28.58.115.953 I slot update_slots: id 1 | task 31444 | Checking checkpoint with [53, 53] against 62...
28.58.151.396 W slot update_slots: id 1 | task 31444 | restored context checkpoint (pos_min = 53, pos_max = 53, n_tokens = 54, n_past = 54, size = 149.626 MiB)
29.03.947.129 I slot print_timing: id 1 | task 31444 | n_decoded = 100, tg = 18.64 t/s, tg_3s = 18.64 t/s
29.06.975.449 I slot print_timing: id 1 | task 31444 | n_decoded = 156, tg = 18.59 t/s, tg_3s = 18.49 t/s
29.10.014.208 I slot print_timing: id 1 | task 31444 | n_decoded = 212, tg = 18.54 t/s, tg_3s = 18.43 t/s
29.13.053.574 I slot print_timing: id 1 | task 31444 | n_decoded = 268, tg = 18.52 t/s, tg_3s = 18.42 t/s
29.16.090.257 I slot print_timing: id 1 | task 31444 | n_decoded = 324, tg = 18.51 t/s, tg_3s = 18.44 t/s
29.19.125.958 I slot print_timing: id 1 | task 31444 | n_decoded = 380, tg = 18.50 t/s, tg_3s = 18.45 t/s
29.22.171.148 I slot print_timing: id 1 | task 31444 | n_decoded = 436, tg = 18.48 t/s, tg_3s = 18.39 t/s
29.25.208.060 I slot print_timing: id 1 | task 31444 | n_decoded = 492, tg = 18.48 t/s, tg_3s = 18.44 t/s
29.28.233.515 I slot print_timing: id 1 | task 31444 | n_decoded = 548, tg = 18.48 t/s, tg_3s = 18.51 t/s
29.31.257.488 I slot print_timing: id 1 | task 31444 | n_decoded = 604, tg = 18.48 t/s, tg_3s = 18.52 t/s
29.33.958.694 I slot print_timing: id 1 | task 31444 | prompt eval time = 466.06 ms / 44 tokens ( 10.59 ms per token, 94.41 tokens per second)
29.33.958.697 I slot print_timing: id 1 | task 31444 | eval time = 35376.67 ms / 654 tokens ( 54.09 ms per token, 18.49 tokens per second)
29.33.958.699 I slot print_timing: id 1 | task 31444 | total time = 35842.74 ms / 698 tokens
29.33.958.699 I slot print_timing: id 1 | task 31444 | graphs reused = 31908
29.33.958.741 I slot release: id 1 | task 31444 | stop processing: n_tokens = 751, truncated = 0
29.33.958.754 I srv update_slots: all slots are idle
29.34.034.973 I srv operator(): Chat format: peg-native
29.34.035.258 I slot get_availabl: id 1 | task -1 | selected slot by LCP similarity, sim_best = 0.481 (> 0.100 thold), f_keep = 0.083
29.34.035.259 I srv get_availabl: updating prompt cache
29.34.035.309 W srv prompt_save: - saving prompt with length 751, total state size = 196.578 MiB (draft: 0.000 MiB)
29.34.246.935 I srv load: - looking for better prompt, base f_keep = 0.083, sim = 0.481
29.34.246.946 I srv update: - cache state: 17 prompts, 7192.062 MiB (limits: 8192.000 MiB, 24576 tokens, 38346 est)
29.34.246.948 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
29.34.246.949 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
29.34.246.949 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
29.34.246.950 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
29.34.246.950 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
29.34.246.951 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
29.34.246.954 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
29.34.246.954 I srv update: - prompt 0x5b027da224e0: 3041 tokens, checkpoints: 1, 489.373 MiB
29.34.246.955 I srv update: - prompt 0x5b028561ee30: 2074 tokens, checkpoints: 1, 428.917 MiB
29.34.246.955 I srv update: - prompt 0x5b027dea2770: 1681 tokens, checkpoints: 1, 404.347 MiB
29.34.246.956 I srv update: - prompt 0x5b027e1254d0: 2666 tokens, checkpoints: 1, 465.928 MiB
29.34.246.956 I srv update: - prompt 0x5b027e095670: 4484 tokens, checkpoints: 1, 579.588 MiB
29.34.246.959 I srv update: - prompt 0x5b027dc8e820: 2218 tokens, checkpoints: 1, 437.920 MiB
29.34.246.960 I srv update: - prompt 0x5b0278730c10: 3079 tokens, checkpoints: 1, 491.749 MiB
29.34.246.960 I srv update: - prompt 0x5b028564f6d0: 5164 tokens, checkpoints: 1, 622.101 MiB
29.34.246.961 I srv update: - prompt 0x5b0285608620: 1214 tokens, checkpoints: 1, 375.151 MiB
29.34.246.961 I srv update: - prompt 0x5b027def7450: 751 tokens, checkpoints: 1, 346.204 MiB
29.34.246.963 I srv get_availabl: prompt cache update took 211.70 ms
29.34.247.044 I slot launch_slot_: id 1 | task 32100 | processing task, is_child = 0
29.34.247.044 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
29.34.247.045 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
29.34.247.063 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
29.34.247.063 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
29.34.247.094 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache
29.34.247.094 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens
29.34.247.133 I slot update_slots: id 1 | task 32100 | Checking checkpoint with [53, 53] against 62...
29.34.282.375 W slot update_slots: id 1 | task 32100 | restored context checkpoint (pos_min = 53, pos_max = 53, n_tokens = 54, n_past = 54, size = 149.626 MiB)
29.40.264.575 I slot print_timing: id 1 | task 32100 | n_decoded = 100, tg = 18.67 t/s, tg_3s = 18.67 t/s
29.43.301.554 I slot print_timing: id 1 | task 32100 | n_decoded = 156, tg = 18.59 t/s, tg_3s = 18.44 t/s
29.46.329.660 I slot print_timing: id 1 | task 32100 | n_decoded = 212, tg = 18.56 t/s, tg_3s = 18.49 t/s
29.49.356.636 I slot print_timing: id 1 | task 32100 | n_decoded = 268, tg = 18.55 t/s, tg_3s = 18.50 t/s
29.52.384.325 I slot print_timing: id 1 | task 32100 | n_decoded = 324, tg = 18.54 t/s, tg_3s = 18.50 t/s
29.55.411.647 I slot print_timing: id 1 | task 32100 | n_decoded = 380, tg = 18.53 t/s, tg_3s = 18.50 t/s
29.58.457.772 I slot print_timing: id 1 | task 32100 | n_decoded = 436, tg = 18.51 t/s, tg_3s = 18.38 t/s
30.01.495.181 I slot print_timing: id 1 | task 32100 | n_decoded = 492, tg = 18.51 t/s, tg_3s = 18.44 t/s
30.04.532.598 I slot print_timing: id 1 | task 32100 | n_decoded = 548, tg = 18.50 t/s, tg_3s = 18.44 t/s
30.07.568.443 I slot print_timing: id 1 | task 32100 | n_decoded = 604, tg = 18.49 t/s, tg_3s = 18.45 t/s
30.10.614.814 I slot print_timing: id 1 | task 32100 | n_decoded = 660, tg = 18.48 t/s, tg_3s = 18.38 t/s
30.13.649.044 I slot print_timing: id 1 | task 32100 | n_decoded = 716, tg = 18.48 t/s, tg_3s = 18.46 t/s
30.16.677.138 I slot print_timing: id 1 | task 32100 | n_decoded = 772, tg = 18.48 t/s, tg_3s = 18.49 t/s
30.19.700.955 I slot print_timing: id 1 | task 32100 | n_decoded = 828, tg = 18.49 t/s, tg_3s = 18.52 t/s
30.22.727.748 I slot print_timing: id 1 | task 32100 | n_decoded = 884, tg = 18.49 t/s, tg_3s = 18.50 t/s
30.25.767.165 I slot print_timing: id 1 | task 32100 | n_decoded = 940, tg = 18.48 t/s, tg_3s = 18.42 t/s
30.28.797.216 I slot print_timing: id 1 | task 32100 | n_decoded = 996, tg = 18.48 t/s, tg_3s = 18.48 t/s
30.31.837.350 I slot print_timing: id 1 | task 32100 | n_decoded = 1052, tg = 18.48 t/s, tg_3s = 18.42 t/s
30.34.877.110 I slot print_timing: id 1 | task 32100 | n_decoded = 1108, tg = 18.48 t/s, tg_3s = 18.42 t/s
30.37.924.401 I slot print_timing: id 1 | task 32100 | n_decoded = 1164, tg = 18.47 t/s, tg_3s = 18.38 t/s
30.40.974.320 I slot print_timing: id 1 | task 32100 | n_decoded = 1220, tg = 18.47 t/s, tg_3s = 18.36 t/s
30.43.975.297 I slot print_timing: id 1 | task 32100 | n_decoded = 1275, tg = 18.46 t/s, tg_3s = 18.33 t/s
30.47.029.146 I slot print_timing: id 1 | task 32100 | n_decoded = 1331, tg = 18.46 t/s, tg_3s = 18.34 t/s
30.50.031.353 I slot print_timing: id 1 | task 32100 | n_decoded = 1386, tg = 18.45 t/s, tg_3s = 18.32 t/s
30.53.054.327 I slot print_timing: id 1 | task 32100 | n_decoded = 1441, tg = 18.44 t/s, tg_3s = 18.19 t/s
30.56.057.456 I slot print_timing: id 1 | task 32100 | n_decoded = 1496, tg = 18.44 t/s, tg_3s = 18.31 t/s
30.59.062.810 I slot print_timing: id 1 | task 32100 | n_decoded = 1551, tg = 18.43 t/s, tg_3s = 18.30 t/s
31.02.066.418 I slot print_timing: id 1 | task 32100 | n_decoded = 1606, tg = 18.43 t/s, tg_3s = 18.31 t/s
31.05.075.387 I slot print_timing: id 1 | task 32100 | n_decoded = 1661, tg = 18.42 t/s, tg_3s = 18.28 t/s
31.08.090.209 I slot print_timing: id 1 | task 32100 | n_decoded = 1716, tg = 18.42 t/s, tg_3s = 18.24 t/s
31.11.137.644 I slot print_timing: id 1 | task 32100 | n_decoded = 1772, tg = 18.41 t/s, tg_3s = 18.38 t/s
31.14.186.774 I slot print_timing: id 1 | task 32100 | n_decoded = 1828, tg = 18.41 t/s, tg_3s = 18.37 t/s
31.17.237.385 I slot print_timing: id 1 | task 32100 | n_decoded = 1884, tg = 18.41 t/s, tg_3s = 18.36 t/s
31.20.245.757 I slot print_timing: id 1 | task 32100 | n_decoded = 1939, tg = 18.41 t/s, tg_3s = 18.28 t/s
31.23.297.605 I slot print_timing: id 1 | task 32100 | n_decoded = 1995, tg = 18.41 t/s, tg_3s = 18.35 t/s
31.26.300.754 I slot print_timing: id 1 | task 32100 | n_decoded = 2050, tg = 18.40 t/s, tg_3s = 18.31 t/s
31.29.353.851 I slot print_timing: id 1 | task 32100 | n_decoded = 2106, tg = 18.40 t/s, tg_3s = 18.34 t/s
31.32.355.500 I slot print_timing: id 1 | task 32100 | n_decoded = 2161, tg = 18.40 t/s, tg_3s = 18.32 t/s
31.35.373.925 I slot print_timing: id 1 | task 32100 | n_decoded = 2216, tg = 18.40 t/s, tg_3s = 18.22 t/s
31.38.383.363 I slot print_timing: id 1 | task 32100 | n_decoded = 2271, tg = 18.39 t/s, tg_3s = 18.28 t/s
31.41.392.306 I slot print_timing: id 1 | task 32100 | n_decoded = 2326, tg = 18.39 t/s, tg_3s = 18.28 t/s
31.44.405.634 I slot print_timing: id 1 | task 32100 | n_decoded = 2381, tg = 18.39 t/s, tg_3s = 18.25 t/s
31.47.429.594 I slot print_timing: id 1 | task 32100 | n_decoded = 2436, tg = 18.38 t/s, tg_3s = 18.19 t/s
31.49.024.655 I slot print_timing: id 1 | task 32100 | prompt eval time = 661.28 ms / 75 tokens ( 8.82 ms per token, 113.42 tokens per second)
31.49.024.658 I slot print_timing: id 1 | task 32100 | eval time = 134116.24 ms / 2465 tokens ( 54.41 ms per token, 18.38 tokens per second)
31.49.024.659 I slot print_timing: id 1 | task 32100 | total time = 134777.52 ms / 2540 tokens
31.49.024.659 I slot print_timing: id 1 | task 32100 | graphs reused = 34361
31.49.024.699 I slot release: id 1 | task 32100 | stop processing: n_tokens = 2593, truncated = 0
31.49.024.716 I srv update_slots: all slots are idle
31.49.113.773 I srv operator(): Chat format: peg-native
31.49.114.048 I slot get_availabl: id 1 | task -1 | selected slot by LCP similarity, sim_best = 0.614 (> 0.100 thold), f_keep = 0.024
31.49.114.050 I srv get_availabl: updating prompt cache
31.49.114.172 W srv prompt_save: - saving prompt with length 2593, total state size = 311.738 MiB (draft: 0.000 MiB)
31.49.399.935 I srv load: - looking for better prompt, base f_keep = 0.024, sim = 0.614
31.49.399.948 I srv update: - cache state: 18 prompts, 7653.426 MiB (limits: 8192.000 MiB, 24576 tokens, 38810 est)
31.49.399.951 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
31.49.399.952 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
31.49.399.953 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
31.49.399.955 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
31.49.399.956 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
31.49.399.957 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
31.49.399.957 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
31.49.399.958 I srv update: - prompt 0x5b027da224e0: 3041 tokens, checkpoints: 1, 489.373 MiB
31.49.399.959 I srv update: - prompt 0x5b028561ee30: 2074 tokens, checkpoints: 1, 428.917 MiB
31.49.399.959 I srv update: - prompt 0x5b027dea2770: 1681 tokens, checkpoints: 1, 404.347 MiB
31.49.399.960 I srv update: - prompt 0x5b027e1254d0: 2666 tokens, checkpoints: 1, 465.928 MiB
31.49.399.961 I srv update: - prompt 0x5b027e095670: 4484 tokens, checkpoints: 1, 579.588 MiB
31.49.399.961 I srv update: - prompt 0x5b027dc8e820: 2218 tokens, checkpoints: 1, 437.920 MiB
31.49.399.962 I srv update: - prompt 0x5b0278730c10: 3079 tokens, checkpoints: 1, 491.749 MiB
31.49.399.963 I srv update: - prompt 0x5b028564f6d0: 5164 tokens, checkpoints: 1, 622.101 MiB
31.49.399.963 I srv update: - prompt 0x5b0285608620: 1214 tokens, checkpoints: 1, 375.151 MiB
31.49.399.964 I srv update: - prompt 0x5b027def7450: 751 tokens, checkpoints: 1, 346.204 MiB
31.49.399.965 I srv update: - prompt 0x5b028564fe40: 2593 tokens, checkpoints: 1, 461.365 MiB
31.49.399.966 I srv get_availabl: prompt cache update took 285.92 ms
31.49.400.052 I slot launch_slot_: id 1 | task 34567 | processing task, is_child = 0
31.49.400.054 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
31.49.400.055 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
31.49.400.087 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
31.49.400.088 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
31.49.400.121 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache
31.49.400.123 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens
31.49.400.163 I slot update_slots: id 1 | task 34567 | Checking checkpoint with [53, 53] against 62...
31.49.435.436 W slot update_slots: id 1 | task 34567 | restored context checkpoint (pos_min = 53, pos_max = 53, n_tokens = 54, n_past = 54, size = 149.626 MiB)
31.55.194.811 I slot print_timing: id 1 | task 34567 | n_decoded = 100, tg = 18.64 t/s, tg_3s = 18.64 t/s
31.58.216.820 I slot print_timing: id 1 | task 34567 | n_decoded = 156, tg = 18.60 t/s, tg_3s = 18.53 t/s
32.01.251.956 I slot print_timing: id 1 | task 34567 | n_decoded = 212, tg = 18.56 t/s, tg_3s = 18.45 t/s
32.04.275.983 I slot print_timing: id 1 | task 34567 | n_decoded = 268, tg = 18.55 t/s, tg_3s = 18.52 t/s
32.07.300.184 I slot print_timing: id 1 | task 34567 | n_decoded = 324, tg = 18.55 t/s, tg_3s = 18.52 t/s
32.10.323.184 I slot print_timing: id 1 | task 34567 | n_decoded = 380, tg = 18.54 t/s, tg_3s = 18.52 t/s
32.13.357.361 I slot print_timing: id 1 | task 34567 | n_decoded = 436, tg = 18.53 t/s, tg_3s = 18.46 t/s
32.16.382.067 I slot print_timing: id 1 | task 34567 | n_decoded = 492, tg = 18.53 t/s, tg_3s = 18.51 t/s
32.19.409.222 I slot print_timing: id 1 | task 34567 | n_decoded = 548, tg = 18.53 t/s, tg_3s = 18.50 t/s
32.22.439.298 I slot print_timing: id 1 | task 34567 | n_decoded = 604, tg = 18.52 t/s, tg_3s = 18.48 t/s
32.25.463.114 I slot print_timing: id 1 | task 34567 | n_decoded = 660, tg = 18.52 t/s, tg_3s = 18.52 t/s
32.28.503.594 I slot print_timing: id 1 | task 34567 | n_decoded = 716, tg = 18.51 t/s, tg_3s = 18.42 t/s
32.31.537.079 I slot print_timing: id 1 | task 34567 | n_decoded = 772, tg = 18.51 t/s, tg_3s = 18.46 t/s
32.34.573.846 I slot print_timing: id 1 | task 34567 | n_decoded = 828, tg = 18.51 t/s, tg_3s = 18.44 t/s
32.37.612.495 I slot print_timing: id 1 | task 34567 | n_decoded = 884, tg = 18.50 t/s, tg_3s = 18.43 t/s
32.40.661.555 I slot print_timing: id 1 | task 34567 | n_decoded = 940, tg = 18.49 t/s, tg_3s = 18.37 t/s
32.43.696.385 I slot print_timing: id 1 | task 34567 | n_decoded = 996, tg = 18.49 t/s, tg_3s = 18.45 t/s
32.46.741.037 I slot print_timing: id 1 | task 34567 | n_decoded = 1052, tg = 18.48 t/s, tg_3s = 18.39 t/s
32.49.771.473 I slot print_timing: id 1 | task 34567 | n_decoded = 1108, tg = 18.48 t/s, tg_3s = 18.48 t/s
32.52.805.338 I slot print_timing: id 1 | task 34567 | n_decoded = 1164, tg = 18.48 t/s, tg_3s = 18.46 t/s
32.55.856.485 I slot print_timing: id 1 | task 34567 | n_decoded = 1220, tg = 18.48 t/s, tg_3s = 18.35 t/s
32.58.900.450 I slot print_timing: id 1 | task 34567 | n_decoded = 1276, tg = 18.47 t/s, tg_3s = 18.40 t/s
33.01.948.549 I slot print_timing: id 1 | task 34567 | n_decoded = 1332, tg = 18.47 t/s, tg_3s = 18.37 t/s
33.04.991.631 I slot print_timing: id 1 | task 34567 | n_decoded = 1388, tg = 18.47 t/s, tg_3s = 18.40 t/s
33.08.000.288 I slot print_timing: id 1 | task 34567 | n_decoded = 1443, tg = 18.46 t/s, tg_3s = 18.28 t/s
33.11.001.720 I slot print_timing: id 1 | task 34567 | n_decoded = 1498, tg = 18.45 t/s, tg_3s = 18.32 t/s
33.11.273.719 I slot print_timing: id 1 | task 34567 | prompt eval time = 429.33 ms / 47 tokens ( 9.13 ms per token, 109.47 tokens per second)
33.11.273.723 I slot print_timing: id 1 | task 34567 | eval time = 81444.22 ms / 1503 tokens ( 54.19 ms per token, 18.45 tokens per second)
33.11.273.723 I slot print_timing: id 1 | task 34567 | total time = 81873.55 ms / 1550 tokens
33.11.273.724 I slot print_timing: id 1 | task 34567 | graphs reused = 35856
33.11.273.764 I slot release: id 1 | task 34567 | stop processing: n_tokens = 1603, truncated = 0
33.11.273.783 I srv update_slots: all slots are idle
33.11.334.870 I srv operator(): Chat format: peg-native
33.11.335.155 I slot get_availabl: id 1 | task -1 | selected slot by LCP similarity, sim_best = 0.509 (> 0.100 thold), f_keep = 0.036
33.11.335.157 I srv get_availabl: updating prompt cache
33.11.335.259 W srv prompt_save: - saving prompt with length 1603, total state size = 249.845 MiB (draft: 0.000 MiB)
33.11.577.115 I srv load: - looking for better prompt, base f_keep = 0.036, sim = 0.509
33.11.577.126 I srv update: - cache state: 19 prompts, 8052.897 MiB (limits: 8192.000 MiB, 24576 tokens, 38516 est)
33.11.577.128 I srv update: - prompt 0x5b027dfdbc90: 454 tokens, checkpoints: 1, 327.636 MiB
33.11.577.129 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
33.11.577.130 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
33.11.577.130 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
33.11.577.131 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
33.11.577.131 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
33.11.577.132 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
33.11.577.132 I srv update: - prompt 0x5b027da224e0: 3041 tokens, checkpoints: 1, 489.373 MiB
33.11.577.133 I srv update: - prompt 0x5b028561ee30: 2074 tokens, checkpoints: 1, 428.917 MiB
33.11.577.133 I srv update: - prompt 0x5b027dea2770: 1681 tokens, checkpoints: 1, 404.347 MiB
33.11.577.134 I srv update: - prompt 0x5b027e1254d0: 2666 tokens, checkpoints: 1, 465.928 MiB
33.11.577.134 I srv update: - prompt 0x5b027e095670: 4484 tokens, checkpoints: 1, 579.588 MiB
33.11.577.135 I srv update: - prompt 0x5b027dc8e820: 2218 tokens, checkpoints: 1, 437.920 MiB
33.11.577.135 I srv update: - prompt 0x5b0278730c10: 3079 tokens, checkpoints: 1, 491.749 MiB
33.11.577.136 I srv update: - prompt 0x5b028564f6d0: 5164 tokens, checkpoints: 1, 622.101 MiB
33.11.577.136 I srv update: - prompt 0x5b0285608620: 1214 tokens, checkpoints: 1, 375.151 MiB
33.11.577.137 I srv update: - prompt 0x5b027def7450: 751 tokens, checkpoints: 1, 346.204 MiB
33.11.577.137 I srv update: - prompt 0x5b028564fe40: 2593 tokens, checkpoints: 1, 461.365 MiB
33.11.577.138 I srv update: - prompt 0x5b027da27d90: 1603 tokens, checkpoints: 1, 399.471 MiB
33.11.577.139 I srv get_availabl: prompt cache update took 241.98 ms
33.11.577.220 I slot launch_slot_: id 1 | task 36072 | processing task, is_child = 0
33.11.577.221 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
33.11.577.221 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
33.11.577.254 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
33.11.577.255 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
33.11.577.273 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache
33.11.577.273 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens
33.11.577.302 I slot update_slots: id 1 | task 36072 | Checking checkpoint with [53, 53] against 57...
33.11.612.402 W slot update_slots: id 1 | task 36072 | restored context checkpoint (pos_min = 53, pos_max = 53, n_tokens = 54, n_past = 54, size = 149.626 MiB)
33.17.411.279 I slot print_timing: id 1 | task 36072 | n_decoded = 100, tg = 18.67 t/s, tg_3s = 18.67 t/s
33.20.446.624 I slot print_timing: id 1 | task 36072 | n_decoded = 156, tg = 18.59 t/s, tg_3s = 18.45 t/s
33.23.476.380 I slot print_timing: id 1 | task 36072 | n_decoded = 212, tg = 18.56 t/s, tg_3s = 18.48 t/s
33.26.511.336 I slot print_timing: id 1 | task 36072 | n_decoded = 268, tg = 18.54 t/s, tg_3s = 18.45 t/s
33.29.547.551 I slot print_timing: id 1 | task 36072 | n_decoded = 324, tg = 18.52 t/s, tg_3s = 18.44 t/s
33.32.576.977 I slot print_timing: id 1 | task 36072 | n_decoded = 380, tg = 18.52 t/s, tg_3s = 18.49 t/s
33.35.614.019 I slot print_timing: id 1 | task 36072 | n_decoded = 436, tg = 18.51 t/s, tg_3s = 18.44 t/s
33.38.639.067 I slot print_timing: id 1 | task 36072 | n_decoded = 492, tg = 18.51 t/s, tg_3s = 18.51 t/s
33.41.665.126 I slot print_timing: id 1 | task 36072 | n_decoded = 548, tg = 18.51 t/s, tg_3s = 18.51 t/s
33.44.689.234 I slot print_timing: id 1 | task 36072 | n_decoded = 604, tg = 18.51 t/s, tg_3s = 18.52 t/s
33.47.725.419 I slot print_timing: id 1 | task 36072 | n_decoded = 660, tg = 18.50 t/s, tg_3s = 18.44 t/s
33.50.753.322 I slot print_timing: id 1 | task 36072 | n_decoded = 716, tg = 18.50 t/s, tg_3s = 18.49 t/s
33.53.782.292 I slot print_timing: id 1 | task 36072 | n_decoded = 772, tg = 18.50 t/s, tg_3s = 18.49 t/s
33.56.807.218 I slot print_timing: id 1 | task 36072 | n_decoded = 828, tg = 18.50 t/s, tg_3s = 18.51 t/s
33.59.837.052 I slot print_timing: id 1 | task 36072 | n_decoded = 884, tg = 18.50 t/s, tg_3s = 18.48 t/s
34.00.434.418 I slot print_timing: id 1 | task 36072 | prompt eval time = 478.44 ms / 58 tokens ( 8.25 ms per token, 121.23 tokens per second)
34.00.434.422 I slot print_timing: id 1 | task 36072 | eval time = 48378.67 ms / 895 tokens ( 54.05 ms per token, 18.50 tokens per second)
34.00.434.423 I slot print_timing: id 1 | task 36072 | total time = 48857.11 ms / 953 tokens
34.00.434.424 I slot print_timing: id 1 | task 36072 | graphs reused = 36746
34.00.434.462 I slot release: id 1 | task 36072 | stop processing: n_tokens = 1006, truncated = 0
34.00.434.474 I srv update_slots: all slots are idle
34.00.450.647 I srv operator(): Chat format: peg-native
34.00.450.922 I slot get_availabl: id 1 | task -1 | selected slot by LCP similarity, sim_best = 0.564 (> 0.100 thold), f_keep = 0.057
34.00.450.924 I srv get_availabl: updating prompt cache
34.00.451.010 W srv prompt_save: - saving prompt with length 1006, total state size = 212.521 MiB (draft: 0.000 MiB)
34.00.720.174 I srv load: - looking for better prompt, base f_keep = 0.057, sim = 0.564
34.00.720.183 W srv update: - cache size limit reached, removing oldest entry (size = 327.636 MiB)
34.00.752.892 I srv update: - cache state: 19 prompts, 8087.408 MiB (limits: 8192.000 MiB, 24576 tokens, 38910 est)
34.00.752.895 I srv update: - prompt 0x5b0284fd29f0: 174 tokens, checkpoints: 1, 310.131 MiB
34.00.752.896 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
34.00.752.896 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
34.00.752.897 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
34.00.752.897 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
34.00.752.898 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
34.00.752.899 I srv update: - prompt 0x5b027da224e0: 3041 tokens, checkpoints: 1, 489.373 MiB
34.00.752.899 I srv update: - prompt 0x5b028561ee30: 2074 tokens, checkpoints: 1, 428.917 MiB
34.00.752.899 I srv update: - prompt 0x5b027dea2770: 1681 tokens, checkpoints: 1, 404.347 MiB
34.00.752.900 I srv update: - prompt 0x5b027e1254d0: 2666 tokens, checkpoints: 1, 465.928 MiB
34.00.752.900 I srv update: - prompt 0x5b027e095670: 4484 tokens, checkpoints: 1, 579.588 MiB
34.00.752.901 I srv update: - prompt 0x5b027dc8e820: 2218 tokens, checkpoints: 1, 437.920 MiB
34.00.752.901 I srv update: - prompt 0x5b0278730c10: 3079 tokens, checkpoints: 1, 491.749 MiB
34.00.752.902 I srv update: - prompt 0x5b028564f6d0: 5164 tokens, checkpoints: 1, 622.101 MiB
34.00.752.903 I srv update: - prompt 0x5b0285608620: 1214 tokens, checkpoints: 1, 375.151 MiB
34.00.752.904 I srv update: - prompt 0x5b027def7450: 751 tokens, checkpoints: 1, 346.204 MiB
34.00.752.905 I srv update: - prompt 0x5b028564fe40: 2593 tokens, checkpoints: 1, 461.365 MiB
34.00.752.905 I srv update: - prompt 0x5b027da27d90: 1603 tokens, checkpoints: 1, 399.471 MiB
34.00.752.906 I srv update: - prompt 0x5b027e0b9820: 1006 tokens, checkpoints: 1, 362.147 MiB
34.00.752.907 I srv get_availabl: prompt cache update took 301.98 ms
34.00.752.991 I slot launch_slot_: id 1 | task 36969 | processing task, is_child = 0
34.00.752.991 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
34.00.752.992 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
34.00.753.013 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
34.00.753.013 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
34.00.753.043 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache
34.00.753.043 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens
34.00.753.065 I slot update_slots: id 1 | task 36969 | Checking checkpoint with [53, 53] against 57...
34.00.789.349 W slot update_slots: id 1 | task 36969 | restored context checkpoint (pos_min = 53, pos_max = 53, n_tokens = 54, n_past = 54, size = 149.626 MiB)
34.06.542.441 I slot print_timing: id 1 | task 36969 | n_decoded = 100, tg = 18.66 t/s, tg_3s = 18.66 t/s
34.09.566.419 I slot print_timing: id 1 | task 36969 | n_decoded = 156, tg = 18.61 t/s, tg_3s = 18.52 t/s
34.12.605.260 I slot print_timing: id 1 | task 36969 | n_decoded = 212, tg = 18.56 t/s, tg_3s = 18.43 t/s
34.15.632.104 I slot print_timing: id 1 | task 36969 | n_decoded = 268, tg = 18.55 t/s, tg_3s = 18.50 t/s
34.18.663.164 I slot print_timing: id 1 | task 36969 | n_decoded = 324, tg = 18.54 t/s, tg_3s = 18.48 t/s
34.21.695.265 I slot print_timing: id 1 | task 36969 | n_decoded = 380, tg = 18.53 t/s, tg_3s = 18.47 t/s
34.24.739.273 I slot print_timing: id 1 | task 36969 | n_decoded = 436, tg = 18.51 t/s, tg_3s = 18.40 t/s
34.27.769.065 I slot print_timing: id 1 | task 36969 | n_decoded = 492, tg = 18.51 t/s, tg_3s = 18.48 t/s
34.30.797.156 I slot print_timing: id 1 | task 36969 | n_decoded = 548, tg = 18.50 t/s, tg_3s = 18.49 t/s
34.33.821.197 I slot print_timing: id 1 | task 36969 | n_decoded = 604, tg = 18.51 t/s, tg_3s = 18.52 t/s
34.36.847.279 I slot print_timing: id 1 | task 36969 | n_decoded = 660, tg = 18.51 t/s, tg_3s = 18.51 t/s
34.39.885.307 I slot print_timing: id 1 | task 36969 | n_decoded = 716, tg = 18.50 t/s, tg_3s = 18.43 t/s
34.42.911.064 I slot print_timing: id 1 | task 36969 | n_decoded = 772, tg = 18.50 t/s, tg_3s = 18.51 t/s
34.45.938.550 I slot print_timing: id 1 | task 36969 | n_decoded = 828, tg = 18.50 t/s, tg_3s = 18.50 t/s
34.48.964.564 I slot print_timing: id 1 | task 36969 | n_decoded = 884, tg = 18.50 t/s, tg_3s = 18.51 t/s
34.52.007.235 I slot print_timing: id 1 | task 36969 | n_decoded = 940, tg = 18.50 t/s, tg_3s = 18.40 t/s
34.55.041.476 I slot print_timing: id 1 | task 36969 | n_decoded = 996, tg = 18.49 t/s, tg_3s = 18.46 t/s
34.58.077.615 I slot print_timing: id 1 | task 36969 | n_decoded = 1052, tg = 18.49 t/s, tg_3s = 18.44 t/s
35.01.112.606 I slot print_timing: id 1 | task 36969 | n_decoded = 1108, tg = 18.49 t/s, tg_3s = 18.45 t/s
35.04.155.271 I slot print_timing: id 1 | task 36969 | n_decoded = 1164, tg = 18.48 t/s, tg_3s = 18.40 t/s
35.07.209.257 I slot print_timing: id 1 | task 36969 | n_decoded = 1220, tg = 18.48 t/s, tg_3s = 18.34 t/s
35.10.251.561 I slot print_timing: id 1 | task 36969 | n_decoded = 1276, tg = 18.47 t/s, tg_3s = 18.41 t/s
35.13.290.451 I slot print_timing: id 1 | task 36969 | n_decoded = 1332, tg = 18.47 t/s, tg_3s = 18.43 t/s
35.16.330.069 I slot print_timing: id 1 | task 36969 | n_decoded = 1388, tg = 18.47 t/s, tg_3s = 18.42 t/s
35.19.378.034 I slot print_timing: id 1 | task 36969 | n_decoded = 1444, tg = 18.47 t/s, tg_3s = 18.37 t/s
35.19.432.341 I slot print_timing: id 1 | task 36969 | prompt eval time = 430.06 ms / 47 tokens ( 9.15 ms per token, 109.29 tokens per second)
35.19.432.344 I slot print_timing: id 1 | task 36969 | eval time = 78249.22 ms / 1445 tokens ( 54.15 ms per token, 18.47 tokens per second)
35.19.432.345 I slot print_timing: id 1 | task 36969 | total time = 78679.27 ms / 1492 tokens
35.19.432.346 I slot print_timing: id 1 | task 36969 | graphs reused = 38183
35.19.432.393 I slot release: id 1 | task 36969 | stop processing: n_tokens = 1545, truncated = 0
35.19.432.409 I srv update_slots: all slots are idle
35.19.509.571 I srv operator(): Chat format: peg-native
35.19.509.850 I slot get_availabl: id 1 | task -1 | selected slot by LCP similarity, sim_best = 0.620 (> 0.100 thold), f_keep = 0.040
35.19.509.852 I srv get_availabl: updating prompt cache
35.19.509.939 W srv prompt_save: - saving prompt with length 1545, total state size = 246.218 MiB (draft: 0.000 MiB)
35.19.837.719 I srv load: - looking for better prompt, base f_keep = 0.040, sim = 0.620
35.19.837.730 W srv update: - cache size limit reached, removing oldest entry (size = 310.131 MiB)
35.19.864.935 I srv update: - cache state: 19 prompts, 8173.121 MiB (limits: 8192.000 MiB, 24576 tokens, 39876 est)
35.19.864.939 I srv update: - prompt 0x5b0285636510: 1855 tokens, checkpoints: 1, 415.226 MiB
35.19.864.940 I srv update: - prompt 0x5b027e2753e0: 768 tokens, checkpoints: 1, 347.267 MiB
35.19.864.941 I srv update: - prompt 0x5b027e26ca30: 367 tokens, checkpoints: 1, 322.197 MiB
35.19.864.942 I srv update: - prompt 0x5b027e0c7f60: 1373 tokens, checkpoints: 1, 385.091 MiB
35.19.864.942 I srv update: - prompt 0x5b027da2a140: 2303 tokens, checkpoints: 1, 443.234 MiB
35.19.864.943 I srv update: - prompt 0x5b027da224e0: 3041 tokens, checkpoints: 1, 489.373 MiB
35.19.864.944 I srv update: - prompt 0x5b028561ee30: 2074 tokens, checkpoints: 1, 428.917 MiB
35.19.864.944 I srv update: - prompt 0x5b027dea2770: 1681 tokens, checkpoints: 1, 404.347 MiB
35.19.864.945 I srv update: - prompt 0x5b027e1254d0: 2666 tokens, checkpoints: 1, 465.928 MiB
35.19.864.946 I srv update: - prompt 0x5b027e095670: 4484 tokens, checkpoints: 1, 579.588 MiB
35.19.864.947 I srv update: - prompt 0x5b027dc8e820: 2218 tokens, checkpoints: 1, 437.920 MiB
35.19.864.947 I srv update: - prompt 0x5b0278730c10: 3079 tokens, checkpoints: 1, 491.749 MiB
35.19.864.948 I srv update: - prompt 0x5b028564f6d0: 5164 tokens, checkpoints: 1, 622.101 MiB
35.19.864.952 I srv update: - prompt 0x5b0285608620: 1214 tokens, checkpoints: 1, 375.151 MiB
35.19.864.953 I srv update: - prompt 0x5b027def7450: 751 tokens, checkpoints: 1, 346.204 MiB
35.19.864.954 I srv update: - prompt 0x5b028564fe40: 2593 tokens, checkpoints: 1, 461.365 MiB
35.19.864.955 I srv update: - prompt 0x5b027da27d90: 1603 tokens, checkpoints: 1, 399.471 MiB
35.19.864.955 I srv update: - prompt 0x5b027e0b9820: 1006 tokens, checkpoints: 1, 362.147 MiB
35.19.864.956 I srv update: - prompt 0x5b027e058560: 1545 tokens, checkpoints: 1, 395.845 MiB
35.19.864.957 I srv get_availabl: prompt cache update took 355.10 ms
35.19.865.087 I slot launch_slot_: id 1 | task 38416 | processing task, is_child = 0
35.19.865.088 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
35.19.865.089 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
35.19.865.110 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
35.19.865.111 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
35.19.865.126 I slot process_sing: id 3 | task -1 | saving idle slot to prompt cache
35.19.865.126 I slot prompt_clear: id 3 | task -1 | clearing prompt with 0 tokens
35.19.865.149 I slot update_slots: id 1 | task 38416 | Checking checkpoint with [53, 53] against 62...
35.19.900.580 W slot update_slots: id 1 | task 38416 | restored context checkpoint (pos_min = 53, pos_max = 53, n_tokens = 54, n_past = 54, size = 149.626 MiB)
35.25.647.931 I slot print_timing: id 1 | task 38416 | n_decoded = 100, tg = 18.68 t/s, tg_3s = 18.68 t/s
35.28.672.162 I slot print_timing: id 1 | task 38416 | n_decoded = 156, tg = 18.62 t/s, tg_3s = 18.52 t/s
35.31.711.220 I slot print_timing: id 1 | task 38416 | n_decoded = 212, tg = 18.57 t/s, tg_3s = 18.43 t/s
35.34.737.150 I slot print_timing: id 1 | task 38416 | n_decoded = 268, tg = 18.55 t/s, tg_3s = 18.51 t/s
35.37.761.224 I slot print_timing: id 1 | task 38416 | n_decoded = 324, tg = 18.55 t/s, tg_3s = 18.52 t/s
35.40.786.128 I slot print_timing: id 1 | task 38416 | n_decoded = 380, tg = 18.54 t/s, tg_3s = 18.51 t/s
35.43.825.328 I slot print_timing: id 1 | task 38416 | n_decoded = 436, tg = 18.53 t/s, tg_3s = 18.43 t/s
35.46.857.216 I slot print_timing: id 1 | task 38416 | n_decoded = 492, tg = 18.52 t/s, tg_3s = 18.47 t/s
35.49.891.677 I slot print_timing: id 1 | task 38416 | n_decoded = 548, tg = 18.51 t/s, tg_3s = 18.45 t/s
35.52.924.359 I slot print_timing: id 1 | task 38416 | n_decoded = 604, tg = 18.51 t/s, tg_3s = 18.47 t/s
35.55.962.447 I slot print_timing: id 1 | task 38416 | n_decoded = 660, tg = 18.50 t/s, tg_3s = 18.43 t/s
35.59.015.498 I slot print_timing: id 1 | task 38416 | n_decoded = 716, tg = 18.49 t/s, tg_3s = 18.34 t/s
36.02.066.034 I slot print_timing: id 1 | task 38416 | n_decoded = 772, tg = 18.48 t/s, tg_3s = 18.36 t/s
36.05.110.773 I slot print_timing: id 1 | task 38416 | n_decoded = 828, tg = 18.47 t/s, tg_3s = 18.39 t/s
36.08.141.333 I slot print_timing: id 1 | task 38416 | n_decoded = 884, tg = 18.48 t/s, tg_3s = 18.48 t/s
36.11.176.295 I slot print_timing: id 1 | task 38416 | n_decoded = 940, tg = 18.47 t/s, tg_3s = 18.45 t/s
36.14.200.336 I slot print_timing: id 1 | task 38416 | n_decoded = 996, tg = 18.48 t/s, tg_3s = 18.52 t/s
36.17.224.382 I slot print_timing: id 1 | task 38416 | n_decoded = 1052, tg = 18.48 t/s, tg_3s = 18.52 t/s
36.20.254.468 I slot print_timing: id 1 | task 38416 | n_decoded = 1108, tg = 18.48 t/s, tg_3s = 18.48 t/s
36.23.284.557 I slot print_timing: id 1 | task 38416 | n_decoded = 1164, tg = 18.48 t/s, tg_3s = 18.48 t/s
36.26.334.110 I slot print_timing: id 1 | task 38416 | n_decoded = 1220, tg = 18.47 t/s, tg_3s = 18.36 t/s
36.29.379.133 I slot print_timing: id 1 | task 38416 | n_decoded = 1276, tg = 18.47 t/s, tg_3s = 18.39 t/s
36.32.428.297 I slot print_timing: id 1 | task 38416 | n_decoded = 1332, tg = 18.47 t/s, tg_3s = 18.37 t/s
36.35.477.206 I slot print_timing: id 1 | task 38416 | n_decoded = 1388, tg = 18.46 t/s, tg_3s = 18.37 t/s
36.38.488.280 I slot print_timing: id 1 | task 38416 | n_decoded = 1443, tg = 18.45 t/s, tg_3s = 18.27 t/s
36.41.490.108 I slot print_timing: id 1 | task 38416 | n_decoded = 1498, tg = 18.45 t/s, tg_3s = 18.32 t/s
36.44.494.482 I slot print_timing: id 1 | task 38416 | n_decoded = 1553, tg = 18.44 t/s, tg_3s = 18.31 t/s
36.47.548.374 I slot print_timing: id 1 | task 38416 | n_decoded = 1609, tg = 18.44 t/s, tg_3s = 18.34 t/s
36.50.548.488 I slot print_timing: id 1 | task 38416 | n_decoded = 1664, tg = 18.44 t/s, tg_3s = 18.33 t/s
36.53.560.123 I slot print_timing: id 1 | task 38416 | n_decoded = 1719, tg = 18.43 t/s, tg_3s = 18.26 t/s
36.56.604.898 I slot print_timing: id 1 | task 38416 | n_decoded = 1775, tg = 18.43 t/s, tg_3s = 18.39 t/s
36.59.652.373 I slot print_timing: id 1 | task 38416 | n_decoded = 1831, tg = 18.43 t/s, tg_3s = 18.38 t/s
37.02.696.952 I slot print_timing: id 1 | task 38416 | n_decoded = 1887, tg = 18.43 t/s, tg_3s = 18.39 t/s
37.05.745.525 I slot print_timing: id 1 | task 38416 | n_decoded = 1943, tg = 18.43 t/s, tg_3s = 18.37 t/s
37.08.756.063 I slot print_timing: id 1 | task 38416 | n_decoded = 1998, tg = 18.42 t/s, tg_3s = 18.27 t/s
37.11.808.875 I slot print_timing: id 1 | task 38416 | n_decoded = 2054, tg = 18.42 t/s, tg_3s = 18.34 t/s
37.14.811.058 I slot print_timing: id 1 | task 38416 | n_decoded = 2109, tg = 18.42 t/s, tg_3s = 18.32 t/s
37.17.815.685 I slot print_timing: id 1 | task 38416 | n_decoded = 2164, tg = 18.41 t/s, tg_3s = 18.31 t/s
37.20.837.028 I slot print_timing: id 1 | task 38416 | n_decoded = 2219, tg = 18.41 t/s, tg_3s = 18.20 t/s
37.23.855.032 I slot print_timing: id 1 | task 38416 | n_decoded = 2274, tg = 18.40 t/s, tg_3s = 18.22 t/s
37.26.869.542 I slot print_timing: id 1 | task 38416 | n_decoded = 2329, tg = 18.40 t/s, tg_3s = 18.25 t/s
37.29.885.099 I slot print_timing: id 1 | task 38416 | n_decoded = 2384, tg = 18.40 t/s, tg_3s = 18.24 t/s
37.32.900.867 I slot print_timing: id 1 | task 38416 | n_decoded = 2439, tg = 18.39 t/s, tg_3s = 18.24 t/s
37.33.559.114 I slot print_timing: id 1 | task 38416 | prompt eval time = 428.23 ms / 46 tokens ( 9.31 ms per token, 107.42 tokens per second)
37.33.559.117 I slot print_timing: id 1 | task 38416 | eval time = 133265.73 ms / 2451 tokens ( 54.37 ms per token, 18.39 tokens per second)
37.33.559.118 I slot print_timing: id 1 | task 38416 | total time = 133693.96 ms / 2497 tokens
37.33.559.118 I slot print_timing: id 1 | task 38416 | graphs reused = 40623
37.33.559.158 I slot release: id 1 | task 38416 | stop processing: n_tokens = 2550, truncated = 0
37.33.559.181 I srv update_slots: all slots are idle
37.33.618.997 I srv operator(): operator(): cleaning up before exit...
Reference in New Issue Copy Permalink