qoherent/experiments-07-07-12-local-llm-knowledge-2
23
0
Fork 0
Code Issues Pull Requests Workflows Packages Projects Releases Wiki Activity
Push Tracker
experiments-07-07-12-local-.../results_hard/qwen3.6-27b.server.log

1525 lines
157 KiB
Plaintext
Raw Permalink Normal View History

G
readme report
2026-07-12 21:35:10 -04:00
0.00.066.292 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg)
0.00.066.296 I device_info:
0.00.066.317 I - ROCm0 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.066.320 I - ROCm1 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.066.326 I - CPU : AMD Ryzen 9 3900X 12-Core Processor (128730 MiB, 128730 MiB free)
0.00.066.382 I system_info: n_threads = 12 (n_threads_batch = 12) / 24 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 |
0.00.066.386 I srv llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true
0.00.066.423 I srv init: running without SSL
0.00.066.494 I srv init: using 23 threads for HTTP server
0.00.066.819 I srv start: binding port with default address family
0.00.068.010 I srv llama_server: loading model
0.00.068.018 I srv load_model: loading model '/home/qrf/.cache/llama.cpp/Qwen_Qwen3.6-27B-Q4_K_M.gguf'
0.00.068.070 I common_init_result: fitting params to device memory ...
0.00.068.071 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on)
0.13.786.869 W llama_context: n_ctx_seq (16384) < n_ctx_train (262144) -- the full capacity of the model will not be utilized
0.13.877.893 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
0.14.118.340 I srv load_model: initializing slots, n_slots = 4
0.14.231.144 W srv load_model: speculative decoding will use checkpoints
0.14.231.159 W common_speculative_init: no implementations specified for speculative decoding
0.14.231.161 I slot load_model: id 0 | task -1 | new slot, n_ctx = 16384
0.14.231.165 I slot load_model: id 1 | task -1 | new slot, n_ctx = 16384
0.14.231.166 I slot load_model: id 2 | task -1 | new slot, n_ctx = 16384
0.14.231.166 I slot load_model: id 3 | task -1 | new slot, n_ctx = 16384
0.14.231.218 I srv load_model: prompt cache is enabled, size limit: 8192 MiB
0.14.231.219 I srv load_model: use `--cache-ram 0` to disable the prompt cache
0.14.231.219 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391
0.14.231.220 I srv load_model: context checkpoints enabled, max = 32, min spacing = 256
0.14.231.241 I srv init: idle slots will be saved to prompt cache and cleared upon starting a new task
0.14.249.231 I init: chat template, example_format: '<|im_start|>system
You are a helpful assistant<|im_end|>
<|im_start|>user
Hello<|im_end|>
<|im_start|>assistant
Hi there<|im_end|>
<|im_start|>user
How are you?<|im_end|>
<|im_start|>assistant
<think>
'
0.14.263.001 I srv init: init: chat template, thinking = 1
0.14.263.038 I srv llama_server: model loaded
0.14.263.042 I srv llama_server: server is listening on http://127.0.0.1:8090
0.14.263.047 I srv update_slots: all slots are idle
0.14.979.535 I srv operator(): Chat format: peg-native
0.14.979.885 I slot get_availabl: id 3 | task -1 | selected slot by LRU, t_last = -1
0.14.979.888 I srv get_availabl: updating prompt cache
0.14.979.895 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000
0.14.979.899 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 16384 tokens, 8589934592 est)
0.14.979.900 I srv get_availabl: prompt cache update took 0.01 ms
0.14.979.980 I slot launch_slot_: id 3 | task 0 | processing task, is_child = 0
0.14.979.983 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.14.979.984 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.14.980.001 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.14.980.001 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.14.980.011 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.14.980.011 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.16.154.186 I slot create_check: id 3 | task 0 | created context checkpoint 1 of 32 (pos_min = 70, pos_max = 70, n_tokens = 71, size = 149.626 MiB)
0.21.886.998 I slot print_timing: id 3 | task 0 | n_decoded = 100, tg = 18.72 t/s, tg_3s = 18.72 t/s
0.24.905.884 I slot print_timing: id 3 | task 0 | n_decoded = 156, tg = 18.66 t/s, tg_3s = 18.55 t/s
0.27.936.862 I slot print_timing: id 3 | task 0 | n_decoded = 212, tg = 18.61 t/s, tg_3s = 18.48 t/s
0.30.983.865 I slot print_timing: id 3 | task 0 | n_decoded = 269, tg = 18.63 t/s, tg_3s = 18.71 t/s
0.34.032.795 I slot print_timing: id 3 | task 0 | n_decoded = 326, tg = 18.64 t/s, tg_3s = 18.70 t/s
0.37.084.054 I slot print_timing: id 3 | task 0 | n_decoded = 383, tg = 18.65 t/s, tg_3s = 18.68 t/s
0.40.095.939 I slot print_timing: id 3 | task 0 | n_decoded = 439, tg = 18.64 t/s, tg_3s = 18.59 t/s
0.43.105.985 I slot print_timing: id 3 | task 0 | n_decoded = 495, tg = 18.64 t/s, tg_3s = 18.60 t/s
0.46.116.821 I slot print_timing: id 3 | task 0 | n_decoded = 551, tg = 18.63 t/s, tg_3s = 18.60 t/s
0.49.129.293 I slot print_timing: id 3 | task 0 | n_decoded = 607, tg = 18.63 t/s, tg_3s = 18.59 t/s
0.52.139.982 I slot print_timing: id 3 | task 0 | n_decoded = 663, tg = 18.63 t/s, tg_3s = 18.60 t/s
0.55.167.035 I slot print_timing: id 3 | task 0 | n_decoded = 719, tg = 18.62 t/s, tg_3s = 18.50 t/s
0.58.191.999 I slot print_timing: id 3 | task 0 | n_decoded = 775, tg = 18.61 t/s, tg_3s = 18.51 t/s
1.01.217.241 I slot print_timing: id 3 | task 0 | n_decoded = 831, tg = 18.60 t/s, tg_3s = 18.51 t/s
1.04.242.214 I slot print_timing: id 3 | task 0 | n_decoded = 887, tg = 18.60 t/s, tg_3s = 18.51 t/s
1.07.278.405 I slot print_timing: id 3 | task 0 | n_decoded = 943, tg = 18.59 t/s, tg_3s = 18.44 t/s
1.10.303.272 I slot print_timing: id 3 | task 0 | n_decoded = 999, tg = 18.58 t/s, tg_3s = 18.51 t/s
1.13.334.235 I slot print_timing: id 3 | task 0 | n_decoded = 1055, tg = 18.58 t/s, tg_3s = 18.48 t/s
1.16.365.316 I slot print_timing: id 3 | task 0 | n_decoded = 1111, tg = 18.57 t/s, tg_3s = 18.48 t/s
1.19.394.903 I slot print_timing: id 3 | task 0 | n_decoded = 1167, tg = 18.57 t/s, tg_3s = 18.48 t/s
1.22.435.333 I slot print_timing: id 3 | task 0 | n_decoded = 1223, tg = 18.56 t/s, tg_3s = 18.42 t/s
1.25.459.468 I slot print_timing: id 3 | task 0 | n_decoded = 1279, tg = 18.56 t/s, tg_3s = 18.52 t/s
1.28.484.397 I slot print_timing: id 3 | task 0 | n_decoded = 1335, tg = 18.56 t/s, tg_3s = 18.51 t/s
1.31.508.412 I slot print_timing: id 3 | task 0 | n_decoded = 1391, tg = 18.56 t/s, tg_3s = 18.52 t/s
1.34.544.569 I slot print_timing: id 3 | task 0 | n_decoded = 1447, tg = 18.55 t/s, tg_3s = 18.44 t/s
1.37.572.417 I slot print_timing: id 3 | task 0 | n_decoded = 1503, tg = 18.55 t/s, tg_3s = 18.49 t/s
1.40.601.179 I slot print_timing: id 3 | task 0 | n_decoded = 1559, tg = 18.55 t/s, tg_3s = 18.49 t/s
1.43.635.476 I slot print_timing: id 3 | task 0 | n_decoded = 1615, tg = 18.54 t/s, tg_3s = 18.46 t/s
1.46.671.223 I slot print_timing: id 3 | task 0 | n_decoded = 1671, tg = 18.54 t/s, tg_3s = 18.45 t/s
1.49.725.651 I slot print_timing: id 3 | task 0 | n_decoded = 1727, tg = 18.53 t/s, tg_3s = 18.33 t/s
1.52.768.715 I slot print_timing: id 3 | task 0 | n_decoded = 1783, tg = 18.53 t/s, tg_3s = 18.40 t/s
1.55.811.577 I slot print_timing: id 3 | task 0 | n_decoded = 1839, tg = 18.53 t/s, tg_3s = 18.40 t/s
1.58.862.253 I slot print_timing: id 3 | task 0 | n_decoded = 1895, tg = 18.52 t/s, tg_3s = 18.36 t/s
2.01.918.919 I slot print_timing: id 3 | task 0 | n_decoded = 1951, tg = 18.52 t/s, tg_3s = 18.32 t/s
2.04.961.250 I slot print_timing: id 3 | task 0 | n_decoded = 2007, tg = 18.51 t/s, tg_3s = 18.41 t/s
2.08.001.425 I slot print_timing: id 3 | task 0 | n_decoded = 2063, tg = 18.51 t/s, tg_3s = 18.42 t/s
2.11.032.993 I slot print_timing: id 3 | task 0 | n_decoded = 2119, tg = 18.51 t/s, tg_3s = 18.47 t/s
2.14.066.302 I slot print_timing: id 3 | task 0 | n_decoded = 2175, tg = 18.51 t/s, tg_3s = 18.46 t/s
2.17.110.302 I slot print_timing: id 3 | task 0 | n_decoded = 2231, tg = 18.50 t/s, tg_3s = 18.40 t/s
2.20.145.002 I slot print_timing: id 3 | task 0 | n_decoded = 2287, tg = 18.50 t/s, tg_3s = 18.45 t/s
2.23.183.021 I slot print_timing: id 3 | task 0 | n_decoded = 2343, tg = 18.50 t/s, tg_3s = 18.43 t/s
2.26.223.341 I slot print_timing: id 3 | task 0 | n_decoded = 2399, tg = 18.50 t/s, tg_3s = 18.42 t/s
2.28.503.634 I slot print_timing: id 3 | task 0 | prompt eval time = 1565.12 ms / 100 tokens ( 15.65 ms per token, 63.89 tokens per second)
2.28.503.638 I slot print_timing: id 3 | task 0 | eval time = 131958.47 ms / 2441 tokens ( 54.06 ms per token, 18.50 tokens per second)
2.28.503.639 I slot print_timing: id 3 | task 0 | total time = 133523.59 ms / 2541 tokens
2.28.503.643 I slot print_timing: id 3 | task 0 | graphs reused = 2431
2.28.503.694 I slot release: id 3 | task 0 | stop processing: n_tokens = 2540, truncated = 0
2.28.503.707 I srv update_slots: all slots are idle
2.28.519.927 I srv operator(): Chat format: peg-native
2.28.520.221 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.787 (> 0.100 thold), f_keep = 0.029
2.28.520.223 I srv get_availabl: updating prompt cache
2.28.520.346 W srv prompt_save: - saving prompt with length 2540, total state size = 308.425 MiB (draft: 0.000 MiB)
2.28.980.439 I srv load: - looking for better prompt, base f_keep = 0.029, sim = 0.787
2.28.980.446 I srv update: - cache state: 1 prompts, 458.051 MiB (limits: 8192.000 MiB, 16384 tokens, 45426 est)
2.28.980.447 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
2.28.980.448 I srv get_availabl: prompt cache update took 460.23 ms
2.28.980.537 I slot launch_slot_: id 3 | task 2444 | processing task, is_child = 0
2.28.980.539 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
2.28.980.539 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
2.28.980.558 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
2.28.980.558 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
2.28.980.567 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
2.28.980.568 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
2.28.980.586 I slot update_slots: id 3 | task 2444 | Checking checkpoint with [70, 70] against 74...
2.29.015.836 W slot update_slots: id 3 | task 2444 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
2.34.701.092 I slot print_timing: id 3 | task 2444 | n_decoded = 100, tg = 18.75 t/s, tg_3s = 18.75 t/s
2.37.715.732 I slot print_timing: id 3 | task 2444 | n_decoded = 156, tg = 18.68 t/s, tg_3s = 18.58 t/s
2.40.744.209 I slot print_timing: id 3 | task 2444 | n_decoded = 212, tg = 18.63 t/s, tg_3s = 18.49 t/s
2.43.770.186 I slot print_timing: id 3 | task 2444 | n_decoded = 268, tg = 18.61 t/s, tg_3s = 18.51 t/s
2.46.797.229 I slot print_timing: id 3 | task 2444 | n_decoded = 324, tg = 18.59 t/s, tg_3s = 18.50 t/s
2.49.822.229 I slot print_timing: id 3 | task 2444 | n_decoded = 380, tg = 18.58 t/s, tg_3s = 18.51 t/s
2.52.863.868 I slot print_timing: id 3 | task 2444 | n_decoded = 436, tg = 18.56 t/s, tg_3s = 18.41 t/s
2.55.891.746 I slot print_timing: id 3 | task 2444 | n_decoded = 492, tg = 18.55 t/s, tg_3s = 18.49 t/s
2.58.919.985 I slot print_timing: id 3 | task 2444 | n_decoded = 548, tg = 18.54 t/s, tg_3s = 18.49 t/s
3.01.945.193 I slot print_timing: id 3 | task 2444 | n_decoded = 604, tg = 18.54 t/s, tg_3s = 18.51 t/s
3.04.956.918 I slot print_timing: id 3 | task 2444 | n_decoded = 660, tg = 18.54 t/s, tg_3s = 18.59 t/s
3.07.986.477 I slot print_timing: id 3 | task 2444 | n_decoded = 716, tg = 18.54 t/s, tg_3s = 18.48 t/s
3.11.005.442 I slot print_timing: id 3 | task 2444 | n_decoded = 772, tg = 18.54 t/s, tg_3s = 18.55 t/s
3.14.028.472 I slot print_timing: id 3 | task 2444 | n_decoded = 828, tg = 18.54 t/s, tg_3s = 18.52 t/s
3.17.052.593 I slot print_timing: id 3 | task 2444 | n_decoded = 884, tg = 18.54 t/s, tg_3s = 18.52 t/s
3.20.090.409 I slot print_timing: id 3 | task 2444 | n_decoded = 940, tg = 18.53 t/s, tg_3s = 18.43 t/s
3.23.117.996 I slot print_timing: id 3 | task 2444 | n_decoded = 996, tg = 18.53 t/s, tg_3s = 18.50 t/s
3.26.145.551 I slot print_timing: id 3 | task 2444 | n_decoded = 1052, tg = 18.53 t/s, tg_3s = 18.50 t/s
3.29.174.022 I slot print_timing: id 3 | task 2444 | n_decoded = 1108, tg = 18.53 t/s, tg_3s = 18.49 t/s
3.32.205.428 I slot print_timing: id 3 | task 2444 | n_decoded = 1164, tg = 18.52 t/s, tg_3s = 18.47 t/s
3.35.256.132 I slot print_timing: id 3 | task 2444 | n_decoded = 1220, tg = 18.52 t/s, tg_3s = 18.36 t/s
3.38.305.420 I slot print_timing: id 3 | task 2444 | n_decoded = 1276, tg = 18.51 t/s, tg_3s = 18.36 t/s
3.41.353.304 I slot print_timing: id 3 | task 2444 | n_decoded = 1332, tg = 18.50 t/s, tg_3s = 18.37 t/s
3.44.401.389 I slot print_timing: id 3 | task 2444 | n_decoded = 1388, tg = 18.50 t/s, tg_3s = 18.37 t/s
3.47.450.387 I slot print_timing: id 3 | task 2444 | n_decoded = 1444, tg = 18.49 t/s, tg_3s = 18.37 t/s
3.50.489.896 I slot print_timing: id 3 | task 2444 | n_decoded = 1500, tg = 18.49 t/s, tg_3s = 18.42 t/s
3.52.704.852 I slot print_timing: id 3 | task 2444 | prompt eval time = 386.12 ms / 23 tokens ( 16.79 ms per token, 59.57 tokens per second)
3.52.704.856 I slot print_timing: id 3 | task 2444 | eval time = 83338.14 ms / 1541 tokens ( 54.08 ms per token, 18.49 tokens per second)
3.52.704.856 I slot print_timing: id 3 | task 2444 | total time = 83724.26 ms / 1564 tokens
3.52.704.857 I slot print_timing: id 3 | task 2444 | graphs reused = 3964
3.52.704.890 I slot release: id 3 | task 2444 | stop processing: n_tokens = 1634, truncated = 0
3.52.704.903 I srv update_slots: all slots are idle
3.52.721.258 I srv operator(): Chat format: peg-native
3.52.721.556 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.787 (> 0.100 thold), f_keep = 0.045
3.52.721.558 I srv get_availabl: updating prompt cache
3.52.721.634 W srv prompt_save: - saving prompt with length 1634, total state size = 251.783 MiB (draft: 0.000 MiB)
3.53.050.276 I srv load: - looking for better prompt, base f_keep = 0.045, sim = 0.787
3.53.050.282 I srv update: - cache state: 2 prompts, 859.460 MiB (limits: 8192.000 MiB, 16384 tokens, 39784 est)
3.53.050.283 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
3.53.050.284 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
3.53.050.285 I srv get_availabl: prompt cache update took 328.73 ms
3.53.050.362 I slot launch_slot_: id 3 | task 3987 | processing task, is_child = 0
3.53.050.362 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
3.53.050.363 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
3.53.050.378 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
3.53.050.379 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
3.53.050.388 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
3.53.050.388 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
3.53.050.406 I slot update_slots: id 3 | task 3987 | Checking checkpoint with [70, 70] against 74...
3.53.085.495 W slot update_slots: id 3 | task 3987 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
3.58.763.496 I slot print_timing: id 3 | task 3987 | n_decoded = 100, tg = 18.77 t/s, tg_3s = 18.77 t/s
4.01.776.216 I slot print_timing: id 3 | task 3987 | n_decoded = 156, tg = 18.71 t/s, tg_3s = 18.59 t/s
4.04.805.175 I slot print_timing: id 3 | task 3987 | n_decoded = 212, tg = 18.65 t/s, tg_3s = 18.49 t/s
4.07.827.562 I slot print_timing: id 3 | task 3987 | n_decoded = 268, tg = 18.62 t/s, tg_3s = 18.53 t/s
4.10.850.908 I slot print_timing: id 3 | task 3987 | n_decoded = 324, tg = 18.61 t/s, tg_3s = 18.52 t/s
4.13.874.889 I slot print_timing: id 3 | task 3987 | n_decoded = 380, tg = 18.59 t/s, tg_3s = 18.52 t/s
4.16.909.012 I slot print_timing: id 3 | task 3987 | n_decoded = 436, tg = 18.57 t/s, tg_3s = 18.46 t/s
4.19.932.878 I slot print_timing: id 3 | task 3987 | n_decoded = 492, tg = 18.57 t/s, tg_3s = 18.52 t/s
4.22.957.119 I slot print_timing: id 3 | task 3987 | n_decoded = 548, tg = 18.56 t/s, tg_3s = 18.52 t/s
4.25.984.050 I slot print_timing: id 3 | task 3987 | n_decoded = 604, tg = 18.56 t/s, tg_3s = 18.50 t/s
4.29.015.001 I slot print_timing: id 3 | task 3987 | n_decoded = 660, tg = 18.55 t/s, tg_3s = 18.48 t/s
4.32.059.837 I slot print_timing: id 3 | task 3987 | n_decoded = 716, tg = 18.54 t/s, tg_3s = 18.39 t/s
4.35.089.998 I slot print_timing: id 3 | task 3987 | n_decoded = 772, tg = 18.53 t/s, tg_3s = 18.48 t/s
4.38.117.822 I slot print_timing: id 3 | task 3987 | n_decoded = 828, tg = 18.53 t/s, tg_3s = 18.50 t/s
4.41.144.799 I slot print_timing: id 3 | task 3987 | n_decoded = 884, tg = 18.53 t/s, tg_3s = 18.50 t/s
4.44.180.908 I slot print_timing: id 3 | task 3987 | n_decoded = 940, tg = 18.52 t/s, tg_3s = 18.44 t/s
4.47.205.283 I slot print_timing: id 3 | task 3987 | n_decoded = 996, tg = 18.52 t/s, tg_3s = 18.52 t/s
4.50.226.401 I slot print_timing: id 3 | task 3987 | n_decoded = 1052, tg = 18.52 t/s, tg_3s = 18.54 t/s
4.53.250.919 I slot print_timing: id 3 | task 3987 | n_decoded = 1108, tg = 18.52 t/s, tg_3s = 18.52 t/s
4.56.275.075 I slot print_timing: id 3 | task 3987 | n_decoded = 1164, tg = 18.52 t/s, tg_3s = 18.52 t/s
4.59.324.020 I slot print_timing: id 3 | task 3987 | n_decoded = 1220, tg = 18.52 t/s, tg_3s = 18.37 t/s
5.00.301.310 I slot print_timing: id 3 | task 3987 | prompt eval time = 385.82 ms / 23 tokens ( 16.77 ms per token, 59.61 tokens per second)
5.00.301.315 I slot print_timing: id 3 | task 3987 | eval time = 66865.07 ms / 1238 tokens ( 54.01 ms per token, 18.51 tokens per second)
5.00.301.315 I slot print_timing: id 3 | task 3987 | total time = 67250.90 ms / 1261 tokens
5.00.301.316 I slot print_timing: id 3 | task 3987 | graphs reused = 5195
5.00.301.356 I slot release: id 3 | task 3987 | stop processing: n_tokens = 1331, truncated = 0
5.00.301.368 I srv update_slots: all slots are idle
5.00.317.206 I srv operator(): Chat format: peg-native
5.00.317.503 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.796 (> 0.100 thold), f_keep = 0.056
5.00.317.505 I srv get_availabl: updating prompt cache
5.00.317.571 W srv prompt_save: - saving prompt with length 1331, total state size = 232.839 MiB (draft: 0.000 MiB)
5.00.566.068 I srv load: - looking for better prompt, base f_keep = 0.056, sim = 0.796
5.00.566.076 I srv update: - cache state: 3 prompts, 1241.925 MiB (limits: 8192.000 MiB, 16384 tokens, 36312 est)
5.00.566.077 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
5.00.566.077 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
5.00.566.078 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
5.00.566.079 I srv get_availabl: prompt cache update took 248.57 ms
5.00.566.161 I slot launch_slot_: id 3 | task 5227 | processing task, is_child = 0
5.00.566.161 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
5.00.566.162 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
5.00.566.177 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
5.00.566.178 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
5.00.566.186 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
5.00.566.187 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
5.00.566.205 I slot update_slots: id 3 | task 5227 | Checking checkpoint with [70, 70] against 74...
5.00.601.239 W slot update_slots: id 3 | task 5227 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
5.06.300.781 I slot print_timing: id 3 | task 5227 | n_decoded = 100, tg = 18.70 t/s, tg_3s = 18.70 t/s
5.09.320.276 I slot print_timing: id 3 | task 5227 | n_decoded = 156, tg = 18.64 t/s, tg_3s = 18.55 t/s
5.12.353.983 I slot print_timing: id 3 | task 5227 | n_decoded = 212, tg = 18.59 t/s, tg_3s = 18.46 t/s
5.15.377.969 I slot print_timing: id 3 | task 5227 | n_decoded = 268, tg = 18.58 t/s, tg_3s = 18.52 t/s
5.18.405.243 I slot print_timing: id 3 | task 5227 | n_decoded = 324, tg = 18.56 t/s, tg_3s = 18.50 t/s
5.21.429.259 I slot print_timing: id 3 | task 5227 | n_decoded = 380, tg = 18.56 t/s, tg_3s = 18.52 t/s
5.24.466.191 I slot print_timing: id 3 | task 5227 | n_decoded = 436, tg = 18.54 t/s, tg_3s = 18.44 t/s
5.27.496.979 I slot print_timing: id 3 | task 5227 | n_decoded = 492, tg = 18.53 t/s, tg_3s = 18.48 t/s
5.30.517.738 I slot print_timing: id 3 | task 5227 | n_decoded = 548, tg = 18.54 t/s, tg_3s = 18.54 t/s
5.33.535.606 I slot print_timing: id 3 | task 5227 | n_decoded = 604, tg = 18.54 t/s, tg_3s = 18.56 t/s
5.36.554.730 I slot print_timing: id 3 | task 5227 | n_decoded = 660, tg = 18.54 t/s, tg_3s = 18.55 t/s
5.39.584.343 I slot print_timing: id 3 | task 5227 | n_decoded = 716, tg = 18.53 t/s, tg_3s = 18.48 t/s
5.42.606.719 I slot print_timing: id 3 | task 5227 | n_decoded = 772, tg = 18.53 t/s, tg_3s = 18.53 t/s
5.45.635.723 I slot print_timing: id 3 | task 5227 | n_decoded = 828, tg = 18.53 t/s, tg_3s = 18.49 t/s
5.48.659.770 I slot print_timing: id 3 | task 5227 | n_decoded = 884, tg = 18.53 t/s, tg_3s = 18.52 t/s
5.51.699.291 I slot print_timing: id 3 | task 5227 | n_decoded = 940, tg = 18.52 t/s, tg_3s = 18.42 t/s
5.54.723.142 I slot print_timing: id 3 | task 5227 | n_decoded = 996, tg = 18.52 t/s, tg_3s = 18.52 t/s
5.57.747.341 I slot print_timing: id 3 | task 5227 | n_decoded = 1052, tg = 18.52 t/s, tg_3s = 18.52 t/s
6.00.774.156 I slot print_timing: id 3 | task 5227 | n_decoded = 1108, tg = 18.52 t/s, tg_3s = 18.50 t/s
6.03.802.108 I slot print_timing: id 3 | task 5227 | n_decoded = 1164, tg = 18.52 t/s, tg_3s = 18.49 t/s
6.06.849.384 I slot print_timing: id 3 | task 5227 | n_decoded = 1220, tg = 18.51 t/s, tg_3s = 18.38 t/s
6.09.896.870 I slot print_timing: id 3 | task 5227 | n_decoded = 1276, tg = 18.51 t/s, tg_3s = 18.38 t/s
6.12.943.233 I slot print_timing: id 3 | task 5227 | n_decoded = 1332, tg = 18.50 t/s, tg_3s = 18.38 t/s
6.15.983.529 I slot print_timing: id 3 | task 5227 | n_decoded = 1388, tg = 18.50 t/s, tg_3s = 18.42 t/s
6.19.023.826 I slot print_timing: id 3 | task 5227 | n_decoded = 1444, tg = 18.50 t/s, tg_3s = 18.42 t/s
6.22.069.474 I slot print_timing: id 3 | task 5227 | n_decoded = 1500, tg = 18.49 t/s, tg_3s = 18.39 t/s
6.25.101.023 I slot print_timing: id 3 | task 5227 | n_decoded = 1556, tg = 18.49 t/s, tg_3s = 18.47 t/s
6.28.135.343 I slot print_timing: id 3 | task 5227 | n_decoded = 1612, tg = 18.49 t/s, tg_3s = 18.46 t/s
6.31.168.252 I slot print_timing: id 3 | task 5227 | n_decoded = 1668, tg = 18.49 t/s, tg_3s = 18.46 t/s
6.31.763.447 I slot print_timing: id 3 | task 5227 | prompt eval time = 385.91 ms / 22 tokens ( 17.54 ms per token, 57.01 tokens per second)
6.31.763.451 I slot print_timing: id 3 | task 5227 | eval time = 90811.32 ms / 1679 tokens ( 54.09 ms per token, 18.49 tokens per second)
6.31.763.451 I slot print_timing: id 3 | task 5227 | total time = 91197.24 ms / 1701 tokens
6.31.763.452 I slot print_timing: id 3 | task 5227 | graphs reused = 6866
6.31.763.498 I slot release: id 3 | task 5227 | stop processing: n_tokens = 1771, truncated = 0
6.31.763.512 I srv update_slots: all slots are idle
6.31.779.426 I srv operator(): Chat format: peg-native
6.31.779.729 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.698 (> 0.100 thold), f_keep = 0.042
6.31.779.732 I srv get_availabl: updating prompt cache
6.31.779.800 W srv prompt_save: - saving prompt with length 1771, total state size = 260.348 MiB (draft: 0.000 MiB)
6.32.043.340 I srv load: - looking for better prompt, base f_keep = 0.042, sim = 0.698
6.32.043.348 I srv update: - cache state: 4 prompts, 1651.899 MiB (limits: 8192.000 MiB, 16384 tokens, 36082 est)
6.32.043.349 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
6.32.043.349 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
6.32.043.350 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
6.32.043.350 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
6.32.043.352 I srv get_availabl: prompt cache update took 263.62 ms
6.32.043.424 I slot launch_slot_: id 3 | task 6908 | processing task, is_child = 0
6.32.043.426 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
6.32.043.427 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
6.32.043.443 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
6.32.043.443 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
6.32.043.452 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
6.32.043.453 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
6.32.043.483 I slot update_slots: id 3 | task 6908 | Checking checkpoint with [70, 70] against 74...
6.32.078.960 W slot update_slots: id 3 | task 6908 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
6.37.820.623 I slot print_timing: id 3 | task 6908 | n_decoded = 100, tg = 18.71 t/s, tg_3s = 18.71 t/s
6.40.854.716 I slot print_timing: id 3 | task 6908 | n_decoded = 156, tg = 18.62 t/s, tg_3s = 18.46 t/s
6.43.881.941 I slot print_timing: id 3 | task 6908 | n_decoded = 212, tg = 18.59 t/s, tg_3s = 18.50 t/s
6.46.907.925 I slot print_timing: id 3 | task 6908 | n_decoded = 268, tg = 18.57 t/s, tg_3s = 18.51 t/s
6.49.931.924 I slot print_timing: id 3 | task 6908 | n_decoded = 324, tg = 18.56 t/s, tg_3s = 18.52 t/s
6.52.955.940 I slot print_timing: id 3 | task 6908 | n_decoded = 380, tg = 18.55 t/s, tg_3s = 18.52 t/s
6.55.990.112 I slot print_timing: id 3 | task 6908 | n_decoded = 436, tg = 18.54 t/s, tg_3s = 18.46 t/s
6.59.014.474 I slot print_timing: id 3 | task 6908 | n_decoded = 492, tg = 18.54 t/s, tg_3s = 18.52 t/s
7.02.040.131 I slot print_timing: id 3 | task 6908 | n_decoded = 548, tg = 18.54 t/s, tg_3s = 18.51 t/s
7.05.065.039 I slot print_timing: id 3 | task 6908 | n_decoded = 604, tg = 18.53 t/s, tg_3s = 18.51 t/s
7.08.093.042 I slot print_timing: id 3 | task 6908 | n_decoded = 660, tg = 18.53 t/s, tg_3s = 18.49 t/s
7.11.126.666 I slot print_timing: id 3 | task 6908 | n_decoded = 716, tg = 18.52 t/s, tg_3s = 18.46 t/s
7.14.149.773 I slot print_timing: id 3 | task 6908 | n_decoded = 772, tg = 18.52 t/s, tg_3s = 18.52 t/s
7.17.173.650 I slot print_timing: id 3 | task 6908 | n_decoded = 828, tg = 18.52 t/s, tg_3s = 18.52 t/s
7.20.199.837 I slot print_timing: id 3 | task 6908 | n_decoded = 884, tg = 18.52 t/s, tg_3s = 18.51 t/s
7.23.232.785 I slot print_timing: id 3 | task 6908 | n_decoded = 940, tg = 18.52 t/s, tg_3s = 18.46 t/s
7.26.257.982 I slot print_timing: id 3 | task 6908 | n_decoded = 996, tg = 18.52 t/s, tg_3s = 18.51 t/s
7.29.281.877 I slot print_timing: id 3 | task 6908 | n_decoded = 1052, tg = 18.52 t/s, tg_3s = 18.52 t/s
7.32.305.643 I slot print_timing: id 3 | task 6908 | n_decoded = 1108, tg = 18.52 t/s, tg_3s = 18.52 t/s
7.35.333.291 I slot print_timing: id 3 | task 6908 | n_decoded = 1164, tg = 18.52 t/s, tg_3s = 18.50 t/s
7.38.379.607 I slot print_timing: id 3 | task 6908 | n_decoded = 1220, tg = 18.51 t/s, tg_3s = 18.38 t/s
7.41.419.001 I slot print_timing: id 3 | task 6908 | n_decoded = 1276, tg = 18.51 t/s, tg_3s = 18.42 t/s
7.44.457.849 I slot print_timing: id 3 | task 6908 | n_decoded = 1332, tg = 18.50 t/s, tg_3s = 18.43 t/s
7.47.501.720 I slot print_timing: id 3 | task 6908 | n_decoded = 1388, tg = 18.50 t/s, tg_3s = 18.40 t/s
7.50.507.735 I slot print_timing: id 3 | task 6908 | n_decoded = 1443, tg = 18.49 t/s, tg_3s = 18.30 t/s
7.53.557.253 I slot print_timing: id 3 | task 6908 | n_decoded = 1499, tg = 18.49 t/s, tg_3s = 18.36 t/s
7.56.602.680 I slot print_timing: id 3 | task 6908 | n_decoded = 1555, tg = 18.48 t/s, tg_3s = 18.39 t/s
7.59.646.244 I slot print_timing: id 3 | task 6908 | n_decoded = 1611, tg = 18.48 t/s, tg_3s = 18.40 t/s
8.02.690.177 I slot print_timing: id 3 | task 6908 | n_decoded = 1667, tg = 18.48 t/s, tg_3s = 18.40 t/s
8.05.730.792 I slot print_timing: id 3 | task 6908 | n_decoded = 1723, tg = 18.48 t/s, tg_3s = 18.42 t/s
8.08.758.976 I slot print_timing: id 3 | task 6908 | n_decoded = 1779, tg = 18.48 t/s, tg_3s = 18.49 t/s
8.11.785.417 I slot print_timing: id 3 | task 6908 | n_decoded = 1835, tg = 18.48 t/s, tg_3s = 18.50 t/s
8.14.816.367 I slot print_timing: id 3 | task 6908 | n_decoded = 1891, tg = 18.48 t/s, tg_3s = 18.48 t/s
8.17.862.453 I slot print_timing: id 3 | task 6908 | n_decoded = 1947, tg = 18.47 t/s, tg_3s = 18.38 t/s
8.20.901.352 I slot print_timing: id 3 | task 6908 | n_decoded = 2003, tg = 18.47 t/s, tg_3s = 18.43 t/s
8.23.944.415 I slot print_timing: id 3 | task 6908 | n_decoded = 2059, tg = 18.47 t/s, tg_3s = 18.40 t/s
8.26.993.195 I slot print_timing: id 3 | task 6908 | n_decoded = 2115, tg = 18.47 t/s, tg_3s = 18.37 t/s
8.30.039.670 I slot print_timing: id 3 | task 6908 | n_decoded = 2171, tg = 18.47 t/s, tg_3s = 18.38 t/s
8.33.043.542 I slot print_timing: id 3 | task 6908 | n_decoded = 2226, tg = 18.46 t/s, tg_3s = 18.31 t/s
8.36.096.290 I slot print_timing: id 3 | task 6908 | n_decoded = 2282, tg = 18.46 t/s, tg_3s = 18.34 t/s
8.39.147.626 I slot print_timing: id 3 | task 6908 | n_decoded = 2338, tg = 18.46 t/s, tg_3s = 18.35 t/s
8.42.201.683 I slot print_timing: id 3 | task 6908 | n_decoded = 2394, tg = 18.45 t/s, tg_3s = 18.34 t/s
8.45.251.519 I slot print_timing: id 3 | task 6908 | n_decoded = 2450, tg = 18.45 t/s, tg_3s = 18.36 t/s
8.48.271.776 I slot print_timing: id 3 | task 6908 | n_decoded = 2505, tg = 18.45 t/s, tg_3s = 18.21 t/s
8.51.319.413 I slot print_timing: id 3 | task 6908 | n_decoded = 2561, tg = 18.45 t/s, tg_3s = 18.37 t/s
8.54.371.827 I slot print_timing: id 3 | task 6908 | n_decoded = 2617, tg = 18.44 t/s, tg_3s = 18.35 t/s
8.57.423.733 I slot print_timing: id 3 | task 6908 | n_decoded = 2673, tg = 18.44 t/s, tg_3s = 18.35 t/s
9.00.434.728 I slot print_timing: id 3 | task 6908 | n_decoded = 2728, tg = 18.44 t/s, tg_3s = 18.27 t/s
9.03.436.015 I slot print_timing: id 3 | task 6908 | n_decoded = 2783, tg = 18.44 t/s, tg_3s = 18.33 t/s
9.06.439.366 I slot print_timing: id 3 | task 6908 | n_decoded = 2838, tg = 18.43 t/s, tg_3s = 18.31 t/s
9.09.445.362 I slot print_timing: id 3 | task 6908 | n_decoded = 2893, tg = 18.43 t/s, tg_3s = 18.30 t/s
9.09.772.857 I slot print_timing: id 3 | task 6908 | prompt eval time = 432.09 ms / 35 tokens ( 12.35 ms per token, 81.00 tokens per second)
9.09.772.860 I slot print_timing: id 3 | task 6908 | eval time = 157297.28 ms / 2899 tokens ( 54.26 ms per token, 18.43 tokens per second)
9.09.772.861 I slot print_timing: id 3 | task 6908 | total time = 157729.37 ms / 2934 tokens
9.09.772.862 I slot print_timing: id 3 | task 6908 | graphs reused = 9752
9.09.772.904 I slot release: id 3 | task 6908 | stop processing: n_tokens = 3004, truncated = 0
9.09.772.924 I srv update_slots: all slots are idle
9.09.788.919 I srv operator(): Chat format: peg-native
9.09.789.214 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.779 (> 0.100 thold), f_keep = 0.025
9.09.789.217 I srv get_availabl: updating prompt cache
9.09.789.350 W srv prompt_save: - saving prompt with length 3004, total state size = 337.434 MiB (draft: 0.000 MiB)
9.10.093.940 I srv load: - looking for better prompt, base f_keep = 0.025, sim = 0.779
9.10.093.948 I srv update: - cache state: 5 prompts, 2138.959 MiB (limits: 8192.000 MiB, 16384 tokens, 39371 est)
9.10.093.949 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
9.10.093.949 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
9.10.093.950 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
9.10.093.950 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
9.10.093.951 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
9.10.093.952 I srv get_availabl: prompt cache update took 304.74 ms
9.10.094.033 I slot launch_slot_: id 3 | task 9809 | processing task, is_child = 0
9.10.094.034 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
9.10.094.035 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
9.10.094.055 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
9.10.094.055 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
9.10.094.065 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
9.10.094.065 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
9.10.094.082 I slot update_slots: id 3 | task 9809 | Checking checkpoint with [70, 70] against 74...
9.10.129.470 W slot update_slots: id 3 | task 9809 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
9.15.829.415 I slot print_timing: id 3 | task 9809 | n_decoded = 100, tg = 18.70 t/s, tg_3s = 18.70 t/s
9.18.851.812 I slot print_timing: id 3 | task 9809 | n_decoded = 156, tg = 18.64 t/s, tg_3s = 18.53 t/s
9.21.885.897 I slot print_timing: id 3 | task 9809 | n_decoded = 212, tg = 18.59 t/s, tg_3s = 18.46 t/s
9.24.908.792 I slot print_timing: id 3 | task 9809 | n_decoded = 268, tg = 18.58 t/s, tg_3s = 18.53 t/s
9.27.932.836 I slot print_timing: id 3 | task 9809 | n_decoded = 324, tg = 18.57 t/s, tg_3s = 18.52 t/s
9.30.958.717 I slot print_timing: id 3 | task 9809 | n_decoded = 380, tg = 18.56 t/s, tg_3s = 18.51 t/s
9.33.997.502 I slot print_timing: id 3 | task 9809 | n_decoded = 436, tg = 18.54 t/s, tg_3s = 18.43 t/s
9.37.027.721 I slot print_timing: id 3 | task 9809 | n_decoded = 492, tg = 18.53 t/s, tg_3s = 18.48 t/s
9.40.057.635 I slot print_timing: id 3 | task 9809 | n_decoded = 548, tg = 18.53 t/s, tg_3s = 18.48 t/s
9.43.081.882 I slot print_timing: id 3 | task 9809 | n_decoded = 604, tg = 18.53 t/s, tg_3s = 18.52 t/s
9.46.106.898 I slot print_timing: id 3 | task 9809 | n_decoded = 660, tg = 18.53 t/s, tg_3s = 18.51 t/s
9.49.140.815 I slot print_timing: id 3 | task 9809 | n_decoded = 716, tg = 18.52 t/s, tg_3s = 18.46 t/s
9.52.165.233 I slot print_timing: id 3 | task 9809 | n_decoded = 772, tg = 18.52 t/s, tg_3s = 18.52 t/s
9.55.188.843 I slot print_timing: id 3 | task 9809 | n_decoded = 828, tg = 18.52 t/s, tg_3s = 18.52 t/s
9.58.213.356 I slot print_timing: id 3 | task 9809 | n_decoded = 884, tg = 18.52 t/s, tg_3s = 18.52 t/s
10.01.251.522 I slot print_timing: id 3 | task 9809 | n_decoded = 940, tg = 18.51 t/s, tg_3s = 18.43 t/s
10.04.279.141 I slot print_timing: id 3 | task 9809 | n_decoded = 996, tg = 18.51 t/s, tg_3s = 18.50 t/s
10.07.311.212 I slot print_timing: id 3 | task 9809 | n_decoded = 1052, tg = 18.51 t/s, tg_3s = 18.47 t/s
10.10.348.199 I slot print_timing: id 3 | task 9809 | n_decoded = 1108, tg = 18.51 t/s, tg_3s = 18.44 t/s
10.13.386.640 I slot print_timing: id 3 | task 9809 | n_decoded = 1164, tg = 18.50 t/s, tg_3s = 18.43 t/s
10.16.437.385 I slot print_timing: id 3 | task 9809 | n_decoded = 1220, tg = 18.50 t/s, tg_3s = 18.36 t/s
10.19.486.543 I slot print_timing: id 3 | task 9809 | n_decoded = 1276, tg = 18.49 t/s, tg_3s = 18.37 t/s
10.22.525.923 I slot print_timing: id 3 | task 9809 | n_decoded = 1332, tg = 18.49 t/s, tg_3s = 18.42 t/s
10.25.567.018 I slot print_timing: id 3 | task 9809 | prompt eval time = 386.77 ms / 24 tokens ( 16.12 ms per token, 62.05 tokens per second)
10.25.567.021 I slot print_timing: id 3 | task 9809 | eval time = 75086.16 ms / 1388 tokens ( 54.10 ms per token, 18.49 tokens per second)
10.25.567.022 I slot print_timing: id 3 | task 9809 | total time = 75472.93 ms / 1412 tokens
10.25.567.022 I slot print_timing: id 3 | task 9809 | graphs reused = 11133
10.25.567.066 I slot release: id 3 | task 9809 | stop processing: n_tokens = 1482, truncated = 0
10.25.567.081 I srv update_slots: all slots are idle
10.25.582.935 I srv operator(): Chat format: peg-native
10.25.583.232 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.824 (> 0.100 thold), f_keep = 0.051
10.25.583.235 I srv get_availabl: updating prompt cache
10.25.583.310 W srv prompt_save: - saving prompt with length 1482, total state size = 242.280 MiB (draft: 0.000 MiB)
10.25.824.014 I srv load: - looking for better prompt, base f_keep = 0.051, sim = 0.824
10.25.824.022 I srv update: - cache state: 6 prompts, 2530.865 MiB (limits: 8192.000 MiB, 16384 tokens, 38071 est)
10.25.824.023 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
10.25.824.024 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
10.25.824.024 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
10.25.824.025 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
10.25.824.025 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
10.25.824.026 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
10.25.824.027 I srv get_availabl: prompt cache update took 240.79 ms
10.25.824.109 I slot launch_slot_: id 3 | task 11199 | processing task, is_child = 0
10.25.824.110 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
10.25.824.111 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
10.25.824.126 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
10.25.824.126 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
10.25.824.146 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
10.25.824.146 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
10.25.824.175 I slot update_slots: id 3 | task 11199 | Checking checkpoint with [70, 70] against 75...
10.25.859.664 W slot update_slots: id 3 | task 11199 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
10.31.454.237 I slot print_timing: id 3 | task 11199 | n_decoded = 100, tg = 18.71 t/s, tg_3s = 18.71 t/s
10.34.464.366 I slot print_timing: id 3 | task 11199 | n_decoded = 156, tg = 18.67 t/s, tg_3s = 18.60 t/s
10.37.487.446 I slot print_timing: id 3 | task 11199 | n_decoded = 212, tg = 18.63 t/s, tg_3s = 18.52 t/s
10.40.503.308 I slot print_timing: id 3 | task 11199 | n_decoded = 268, tg = 18.62 t/s, tg_3s = 18.57 t/s
10.43.518.750 I slot print_timing: id 3 | task 11199 | n_decoded = 324, tg = 18.61 t/s, tg_3s = 18.57 t/s
10.46.535.501 I slot print_timing: id 3 | task 11199 | n_decoded = 380, tg = 18.60 t/s, tg_3s = 18.56 t/s
10.49.565.866 I slot print_timing: id 3 | task 11199 | n_decoded = 436, tg = 18.59 t/s, tg_3s = 18.48 t/s
10.52.587.545 I slot print_timing: id 3 | task 11199 | n_decoded = 492, tg = 18.58 t/s, tg_3s = 18.53 t/s
10.55.614.714 I slot print_timing: id 3 | task 11199 | n_decoded = 548, tg = 18.57 t/s, tg_3s = 18.50 t/s
10.58.641.568 I slot print_timing: id 3 | task 11199 | n_decoded = 604, tg = 18.57 t/s, tg_3s = 18.50 t/s
11.01.670.643 I slot print_timing: id 3 | task 11199 | n_decoded = 660, tg = 18.56 t/s, tg_3s = 18.49 t/s
11.04.712.953 I slot print_timing: id 3 | task 11199 | n_decoded = 716, tg = 18.55 t/s, tg_3s = 18.41 t/s
11.07.744.843 I slot print_timing: id 3 | task 11199 | n_decoded = 772, tg = 18.54 t/s, tg_3s = 18.47 t/s
11.10.783.399 I slot print_timing: id 3 | task 11199 | n_decoded = 828, tg = 18.53 t/s, tg_3s = 18.43 t/s
11.13.819.815 I slot print_timing: id 3 | task 11199 | n_decoded = 884, tg = 18.53 t/s, tg_3s = 18.44 t/s
11.16.820.040 I slot print_timing: id 3 | task 11199 | n_decoded = 939, tg = 18.52 t/s, tg_3s = 18.33 t/s
11.19.857.752 I slot print_timing: id 3 | task 11199 | n_decoded = 995, tg = 18.51 t/s, tg_3s = 18.43 t/s
11.22.890.991 I slot print_timing: id 3 | task 11199 | n_decoded = 1051, tg = 18.51 t/s, tg_3s = 18.46 t/s
11.25.914.754 I slot print_timing: id 3 | task 11199 | n_decoded = 1107, tg = 18.51 t/s, tg_3s = 18.52 t/s
11.28.941.021 I slot print_timing: id 3 | task 11199 | n_decoded = 1163, tg = 18.51 t/s, tg_3s = 18.50 t/s
11.31.980.245 I slot print_timing: id 3 | task 11199 | n_decoded = 1219, tg = 18.51 t/s, tg_3s = 18.43 t/s
11.32.902.183 I slot print_timing: id 3 | task 11199 | prompt eval time = 286.38 ms / 20 tokens ( 14.32 ms per token, 69.84 tokens per second)
11.32.902.186 I slot print_timing: id 3 | task 11199 | eval time = 66791.62 ms / 1236 tokens ( 54.04 ms per token, 18.51 tokens per second)
11.32.902.187 I slot print_timing: id 3 | task 11199 | total time = 67078.00 ms / 1256 tokens
11.32.902.188 I slot print_timing: id 3 | task 11199 | graphs reused = 12362
11.32.902.278 I slot release: id 3 | task 11199 | stop processing: n_tokens = 1326, truncated = 0
11.32.902.293 I srv update_slots: all slots are idle
11.32.918.343 I srv operator(): Chat format: peg-native
11.32.918.646 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.806 (> 0.100 thold), f_keep = 0.057
11.32.918.649 I srv get_availabl: updating prompt cache
11.32.918.718 W srv prompt_save: - saving prompt with length 1326, total state size = 232.527 MiB (draft: 0.000 MiB)
11.33.150.428 I srv load: - looking for better prompt, base f_keep = 0.057, sim = 0.806
11.33.150.436 I srv update: - cache state: 7 prompts, 2913.018 MiB (limits: 8192.000 MiB, 16384 tokens, 36806 est)
11.33.150.437 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
11.33.150.438 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
11.33.150.439 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
11.33.150.440 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
11.33.150.440 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
11.33.150.441 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
11.33.150.441 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
11.33.150.442 I srv get_availabl: prompt cache update took 231.79 ms
11.33.150.529 I slot launch_slot_: id 3 | task 12437 | processing task, is_child = 0
11.33.150.530 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
11.33.150.531 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
11.33.150.543 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
11.33.150.543 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
11.33.150.552 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
11.33.150.552 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
11.33.150.570 I slot update_slots: id 3 | task 12437 | Checking checkpoint with [70, 70] against 75...
11.33.185.859 W slot update_slots: id 3 | task 12437 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
11.38.877.664 I slot print_timing: id 3 | task 12437 | n_decoded = 100, tg = 18.72 t/s, tg_3s = 18.72 t/s
11.41.895.020 I slot print_timing: id 3 | task 12437 | n_decoded = 156, tg = 18.66 t/s, tg_3s = 18.56 t/s
11.44.931.140 I slot print_timing: id 3 | task 12437 | n_decoded = 212, tg = 18.60 t/s, tg_3s = 18.44 t/s
11.47.957.622 I slot print_timing: id 3 | task 12437 | n_decoded = 268, tg = 18.58 t/s, tg_3s = 18.50 t/s
11.50.980.851 I slot print_timing: id 3 | task 12437 | n_decoded = 324, tg = 18.57 t/s, tg_3s = 18.52 t/s
11.54.006.185 I slot print_timing: id 3 | task 12437 | n_decoded = 380, tg = 18.56 t/s, tg_3s = 18.51 t/s
11.57.041.126 I slot print_timing: id 3 | task 12437 | n_decoded = 436, tg = 18.55 t/s, tg_3s = 18.45 t/s
12.00.069.360 I slot print_timing: id 3 | task 12437 | n_decoded = 492, tg = 18.54 t/s, tg_3s = 18.49 t/s
12.03.095.707 I slot print_timing: id 3 | task 12437 | n_decoded = 548, tg = 18.54 t/s, tg_3s = 18.50 t/s
12.06.121.135 I slot print_timing: id 3 | task 12437 | n_decoded = 604, tg = 18.54 t/s, tg_3s = 18.51 t/s
12.09.147.500 I slot print_timing: id 3 | task 12437 | n_decoded = 660, tg = 18.53 t/s, tg_3s = 18.50 t/s
12.12.177.302 I slot print_timing: id 3 | task 12437 | n_decoded = 716, tg = 18.53 t/s, tg_3s = 18.48 t/s
12.15.195.396 I slot print_timing: id 3 | task 12437 | n_decoded = 772, tg = 18.53 t/s, tg_3s = 18.55 t/s
12.18.217.467 I slot print_timing: id 3 | task 12437 | n_decoded = 828, tg = 18.53 t/s, tg_3s = 18.53 t/s
12.21.235.295 I slot print_timing: id 3 | task 12437 | n_decoded = 884, tg = 18.53 t/s, tg_3s = 18.56 t/s
12.24.268.521 I slot print_timing: id 3 | task 12437 | n_decoded = 940, tg = 18.53 t/s, tg_3s = 18.46 t/s
12.27.295.556 I slot print_timing: id 3 | task 12437 | n_decoded = 996, tg = 18.53 t/s, tg_3s = 18.50 t/s
12.30.322.741 I slot print_timing: id 3 | task 12437 | n_decoded = 1052, tg = 18.53 t/s, tg_3s = 18.50 t/s
12.33.347.602 I slot print_timing: id 3 | task 12437 | n_decoded = 1108, tg = 18.52 t/s, tg_3s = 18.51 t/s
12.34.751.754 I slot print_timing: id 3 | task 12437 | prompt eval time = 385.77 ms / 22 tokens ( 17.54 ms per token, 57.03 tokens per second)
12.34.751.757 I slot print_timing: id 3 | task 12437 | eval time = 61215.41 ms / 1134 tokens ( 53.98 ms per token, 18.52 tokens per second)
12.34.751.758 I slot print_timing: id 3 | task 12437 | total time = 61601.18 ms / 1156 tokens
12.34.751.759 I slot print_timing: id 3 | task 12437 | graphs reused = 13490
12.34.751.794 I slot release: id 3 | task 12437 | stop processing: n_tokens = 1226, truncated = 0
12.34.751.806 I srv update_slots: all slots are idle
12.34.768.257 I srv operator(): Chat format: peg-native
12.34.768.609 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.612 (> 0.100 thold), f_keep = 0.060
12.34.768.611 I srv get_availabl: updating prompt cache
12.34.768.668 W srv prompt_save: - saving prompt with length 1226, total state size = 226.275 MiB (draft: 0.000 MiB)
12.34.994.759 I srv load: - looking for better prompt, base f_keep = 0.060, sim = 0.612
12.34.994.767 I srv update: - cache state: 8 prompts, 3288.919 MiB (limits: 8192.000 MiB, 16384 tokens, 35653 est)
12.34.994.768 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
12.34.994.769 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
12.34.994.769 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
12.34.994.770 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
12.34.994.770 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
12.34.994.771 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
12.34.994.772 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
12.34.994.772 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
12.34.994.773 I srv get_availabl: prompt cache update took 226.16 ms
12.34.994.846 I slot launch_slot_: id 3 | task 13573 | processing task, is_child = 0
12.34.994.846 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
12.34.994.847 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
12.34.994.862 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
12.34.994.862 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
12.34.994.871 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
12.34.994.871 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
12.34.994.889 I slot update_slots: id 3 | task 13573 | Checking checkpoint with [70, 70] against 74...
12.35.030.343 W slot update_slots: id 3 | task 13573 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
12.40.777.969 I slot print_timing: id 3 | task 13573 | n_decoded = 100, tg = 18.68 t/s, tg_3s = 18.68 t/s
12.43.809.499 I slot print_timing: id 3 | task 13573 | n_decoded = 156, tg = 18.61 t/s, tg_3s = 18.47 t/s
12.46.834.753 I slot print_timing: id 3 | task 13573 | n_decoded = 212, tg = 18.58 t/s, tg_3s = 18.51 t/s
12.49.859.818 I slot print_timing: id 3 | task 13573 | n_decoded = 268, tg = 18.57 t/s, tg_3s = 18.51 t/s
12.52.887.650 I slot print_timing: id 3 | task 13573 | n_decoded = 324, tg = 18.55 t/s, tg_3s = 18.50 t/s
12.55.912.383 I slot print_timing: id 3 | task 13573 | n_decoded = 380, tg = 18.55 t/s, tg_3s = 18.51 t/s
12.58.950.821 I slot print_timing: id 3 | task 13573 | n_decoded = 436, tg = 18.53 t/s, tg_3s = 18.43 t/s
13.01.974.755 I slot print_timing: id 3 | task 13573 | n_decoded = 492, tg = 18.53 t/s, tg_3s = 18.52 t/s
13.04.991.425 I slot print_timing: id 3 | task 13573 | n_decoded = 548, tg = 18.53 t/s, tg_3s = 18.56 t/s
13.08.009.104 I slot print_timing: id 3 | task 13573 | n_decoded = 604, tg = 18.54 t/s, tg_3s = 18.56 t/s
13.11.042.013 I slot print_timing: id 3 | task 13573 | n_decoded = 660, tg = 18.53 t/s, tg_3s = 18.46 t/s
13.14.066.794 I slot print_timing: id 3 | task 13573 | n_decoded = 716, tg = 18.53 t/s, tg_3s = 18.51 t/s
13.17.091.680 I slot print_timing: id 3 | task 13573 | n_decoded = 772, tg = 18.53 t/s, tg_3s = 18.51 t/s
13.20.120.816 I slot print_timing: id 3 | task 13573 | n_decoded = 828, tg = 18.53 t/s, tg_3s = 18.49 t/s
13.23.146.736 I slot print_timing: id 3 | task 13573 | n_decoded = 884, tg = 18.52 t/s, tg_3s = 18.51 t/s
13.26.187.756 I slot print_timing: id 3 | task 13573 | n_decoded = 940, tg = 18.52 t/s, tg_3s = 18.41 t/s
13.29.215.313 I slot print_timing: id 3 | task 13573 | n_decoded = 996, tg = 18.52 t/s, tg_3s = 18.50 t/s
13.32.249.936 I slot print_timing: id 3 | task 13573 | n_decoded = 1052, tg = 18.51 t/s, tg_3s = 18.45 t/s
13.35.287.915 I slot print_timing: id 3 | task 13573 | n_decoded = 1108, tg = 18.51 t/s, tg_3s = 18.43 t/s
13.38.334.927 I slot print_timing: id 3 | task 13573 | n_decoded = 1164, tg = 18.50 t/s, tg_3s = 18.38 t/s
13.41.386.129 I slot print_timing: id 3 | task 13573 | n_decoded = 1220, tg = 18.50 t/s, tg_3s = 18.35 t/s
13.44.433.285 I slot print_timing: id 3 | task 13573 | n_decoded = 1276, tg = 18.49 t/s, tg_3s = 18.38 t/s
13.47.480.923 I slot print_timing: id 3 | task 13573 | n_decoded = 1332, tg = 18.49 t/s, tg_3s = 18.37 t/s
13.50.509.634 I slot print_timing: id 3 | task 13573 | n_decoded = 1388, tg = 18.49 t/s, tg_3s = 18.49 t/s
13.53.545.690 I slot print_timing: id 3 | task 13573 | n_decoded = 1444, tg = 18.48 t/s, tg_3s = 18.44 t/s
13.56.571.601 I slot print_timing: id 3 | task 13573 | n_decoded = 1500, tg = 18.49 t/s, tg_3s = 18.51 t/s
13.59.596.738 I slot print_timing: id 3 | task 13573 | n_decoded = 1556, tg = 18.49 t/s, tg_3s = 18.51 t/s
14.02.626.611 I slot print_timing: id 3 | task 13573 | n_decoded = 1612, tg = 18.49 t/s, tg_3s = 18.48 t/s
14.05.659.876 I slot print_timing: id 3 | task 13573 | n_decoded = 1668, tg = 18.49 t/s, tg_3s = 18.46 t/s
14.08.704.822 I slot print_timing: id 3 | task 13573 | n_decoded = 1724, tg = 18.48 t/s, tg_3s = 18.39 t/s
14.11.744.923 I slot print_timing: id 3 | task 13573 | n_decoded = 1780, tg = 18.48 t/s, tg_3s = 18.42 t/s
14.14.789.650 I slot print_timing: id 3 | task 13573 | n_decoded = 1836, tg = 18.48 t/s, tg_3s = 18.39 t/s
14.17.831.041 I slot print_timing: id 3 | task 13573 | n_decoded = 1892, tg = 18.48 t/s, tg_3s = 18.41 t/s
14.20.883.063 I slot print_timing: id 3 | task 13573 | n_decoded = 1948, tg = 18.47 t/s, tg_3s = 18.35 t/s
14.23.934.411 I slot print_timing: id 3 | task 13573 | n_decoded = 2004, tg = 18.47 t/s, tg_3s = 18.35 t/s
14.26.981.869 I slot print_timing: id 3 | task 13573 | n_decoded = 2060, tg = 18.47 t/s, tg_3s = 18.38 t/s
14.30.034.578 I slot print_timing: id 3 | task 13573 | n_decoded = 2116, tg = 18.46 t/s, tg_3s = 18.34 t/s
14.30.307.145 I slot print_timing: id 3 | task 13573 | prompt eval time = 430.12 ms / 50 tokens ( 8.60 ms per token, 116.25 tokens per second)
14.30.307.148 I slot print_timing: id 3 | task 13573 | eval time = 114882.13 ms / 2121 tokens ( 54.16 ms per token, 18.46 tokens per second)
14.30.307.149 I slot print_timing: id 3 | task 13573 | total time = 115312.25 ms / 2171 tokens
14.30.307.150 I slot print_timing: id 3 | task 13573 | graphs reused = 15601
14.30.307.195 I slot release: id 3 | task 13573 | stop processing: n_tokens = 2241, truncated = 0
14.30.307.210 I srv update_slots: all slots are idle
14.30.323.253 I srv operator(): Chat format: peg-native
14.30.323.551 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.532 (> 0.100 thold), f_keep = 0.033
14.30.323.553 I srv get_availabl: updating prompt cache
14.30.323.646 W srv prompt_save: - saving prompt with length 2241, total state size = 289.732 MiB (draft: 0.000 MiB)
14.30.592.729 I srv load: - looking for better prompt, base f_keep = 0.033, sim = 0.532
14.30.592.738 I srv update: - cache state: 9 prompts, 3728.277 MiB (limits: 8192.000 MiB, 16384 tokens, 36375 est)
14.30.592.739 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
14.30.592.740 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
14.30.592.741 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
14.30.592.741 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
14.30.592.742 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
14.30.592.742 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
14.30.592.743 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
14.30.592.744 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
14.30.592.744 I srv update: - prompt 0x62c6df012e70: 2241 tokens, checkpoints: 1, 439.358 MiB
14.30.592.745 I srv get_availabl: prompt cache update took 269.19 ms
14.30.592.822 I slot launch_slot_: id 3 | task 15696 | processing task, is_child = 0
14.30.592.823 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
14.30.592.823 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
14.30.592.839 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
14.30.592.840 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
14.30.592.849 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
14.30.592.849 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
14.30.592.867 I slot update_slots: id 3 | task 15696 | Checking checkpoint with [70, 70] against 75...
14.30.628.097 W slot update_slots: id 3 | task 15696 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
14.36.608.496 I slot print_timing: id 3 | task 15696 | n_decoded = 100, tg = 18.66 t/s, tg_3s = 18.66 t/s
14.39.645.885 I slot print_timing: id 3 | task 15696 | n_decoded = 156, tg = 18.58 t/s, tg_3s = 18.44 t/s
14.42.668.367 I slot print_timing: id 3 | task 15696 | n_decoded = 212, tg = 18.57 t/s, tg_3s = 18.53 t/s
14.45.691.977 I slot print_timing: id 3 | task 15696 | n_decoded = 268, tg = 18.56 t/s, tg_3s = 18.52 t/s
14.48.716.515 I slot print_timing: id 3 | task 15696 | n_decoded = 324, tg = 18.55 t/s, tg_3s = 18.52 t/s
14.51.752.488 I slot print_timing: id 3 | task 15696 | n_decoded = 380, tg = 18.53 t/s, tg_3s = 18.45 t/s
14.54.774.476 I slot print_timing: id 3 | task 15696 | n_decoded = 436, tg = 18.53 t/s, tg_3s = 18.53 t/s
14.57.798.618 I slot print_timing: id 3 | task 15696 | n_decoded = 492, tg = 18.53 t/s, tg_3s = 18.52 t/s
15.00.821.424 I slot print_timing: id 3 | task 15696 | n_decoded = 548, tg = 18.53 t/s, tg_3s = 18.53 t/s
15.03.845.758 I slot print_timing: id 3 | task 15696 | n_decoded = 604, tg = 18.53 t/s, tg_3s = 18.52 t/s
15.06.880.825 I slot print_timing: id 3 | task 15696 | n_decoded = 660, tg = 18.52 t/s, tg_3s = 18.45 t/s
15.09.905.212 I slot print_timing: id 3 | task 15696 | n_decoded = 716, tg = 18.52 t/s, tg_3s = 18.52 t/s
15.12.931.698 I slot print_timing: id 3 | task 15696 | n_decoded = 772, tg = 18.52 t/s, tg_3s = 18.50 t/s
15.15.958.478 I slot print_timing: id 3 | task 15696 | n_decoded = 828, tg = 18.52 t/s, tg_3s = 18.50 t/s
15.18.989.207 I slot print_timing: id 3 | task 15696 | n_decoded = 884, tg = 18.52 t/s, tg_3s = 18.48 t/s
15.22.029.768 I slot print_timing: id 3 | task 15696 | n_decoded = 940, tg = 18.51 t/s, tg_3s = 18.42 t/s
15.25.058.012 I slot print_timing: id 3 | task 15696 | n_decoded = 996, tg = 18.51 t/s, tg_3s = 18.49 t/s
15.28.086.718 I slot print_timing: id 3 | task 15696 | n_decoded = 1052, tg = 18.51 t/s, tg_3s = 18.49 t/s
15.30.084.477 I slot print_timing: id 3 | task 15696 | prompt eval time = 656.16 ms / 70 tokens ( 9.37 ms per token, 106.68 tokens per second)
15.30.084.481 I slot print_timing: id 3 | task 15696 | eval time = 58835.44 ms / 1089 tokens ( 54.03 ms per token, 18.51 tokens per second)
15.30.084.481 I slot print_timing: id 3 | task 15696 | total time = 59491.61 ms / 1159 tokens
15.30.084.482 I slot print_timing: id 3 | task 15696 | graphs reused = 16684
15.30.084.527 I slot release: id 3 | task 15696 | stop processing: n_tokens = 1229, truncated = 0
15.30.084.540 I srv update_slots: all slots are idle
15.30.100.538 I srv operator(): Chat format: peg-native
15.30.100.830 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.643 (> 0.100 thold), f_keep = 0.060
15.30.100.832 I srv get_availabl: updating prompt cache
15.30.100.893 W srv prompt_save: - saving prompt with length 1229, total state size = 226.462 MiB (draft: 0.000 MiB)
15.30.327.542 I srv load: - looking for better prompt, base f_keep = 0.060, sim = 0.643
15.30.327.551 I srv update: - cache state: 10 prompts, 4104.366 MiB (limits: 8192.000 MiB, 16384 tokens, 35495 est)
15.30.327.552 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
15.30.327.552 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
15.30.327.553 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
15.30.327.554 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
15.30.327.554 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
15.30.327.555 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
15.30.327.555 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
15.30.327.556 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
15.30.327.556 I srv update: - prompt 0x62c6df012e70: 2241 tokens, checkpoints: 1, 439.358 MiB
15.30.327.557 I srv update: - prompt 0x62c6df06adb0: 1229 tokens, checkpoints: 1, 376.089 MiB
15.30.327.558 I srv get_availabl: prompt cache update took 226.73 ms
15.30.327.630 I slot launch_slot_: id 3 | task 16787 | processing task, is_child = 0
15.30.327.631 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
15.30.327.632 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
15.30.327.646 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
15.30.327.647 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
15.30.327.656 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
15.30.327.656 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
15.30.327.672 I slot update_slots: id 3 | task 16787 | Checking checkpoint with [70, 70] against 74...
15.30.362.871 W slot update_slots: id 3 | task 16787 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
15.36.125.131 I slot print_timing: id 3 | task 16787 | n_decoded = 100, tg = 18.75 t/s, tg_3s = 18.75 t/s
15.39.150.932 I slot print_timing: id 3 | task 16787 | n_decoded = 156, tg = 18.67 t/s, tg_3s = 18.51 t/s
15.42.173.290 I slot print_timing: id 3 | task 16787 | n_decoded = 212, tg = 18.63 t/s, tg_3s = 18.53 t/s
15.45.200.332 I slot print_timing: id 3 | task 16787 | n_decoded = 268, tg = 18.60 t/s, tg_3s = 18.50 t/s
15.48.224.344 I slot print_timing: id 3 | task 16787 | n_decoded = 324, tg = 18.59 t/s, tg_3s = 18.52 t/s
15.51.250.352 I slot print_timing: id 3 | task 16787 | n_decoded = 380, tg = 18.58 t/s, tg_3s = 18.51 t/s
15.54.284.511 I slot print_timing: id 3 | task 16787 | n_decoded = 436, tg = 18.56 t/s, tg_3s = 18.46 t/s
15.57.308.668 I slot print_timing: id 3 | task 16787 | n_decoded = 492, tg = 18.56 t/s, tg_3s = 18.52 t/s
16.00.332.725 I slot print_timing: id 3 | task 16787 | n_decoded = 548, tg = 18.55 t/s, tg_3s = 18.52 t/s
16.03.356.551 I slot print_timing: id 3 | task 16787 | n_decoded = 604, tg = 18.55 t/s, tg_3s = 18.52 t/s
16.06.392.864 I slot print_timing: id 3 | task 16787 | n_decoded = 660, tg = 18.54 t/s, tg_3s = 18.44 t/s
16.09.422.285 I slot print_timing: id 3 | task 16787 | n_decoded = 716, tg = 18.54 t/s, tg_3s = 18.49 t/s
16.12.447.762 I slot print_timing: id 3 | task 16787 | n_decoded = 772, tg = 18.53 t/s, tg_3s = 18.51 t/s
16.15.476.882 I slot print_timing: id 3 | task 16787 | n_decoded = 828, tg = 18.53 t/s, tg_3s = 18.49 t/s
16.18.509.669 I slot print_timing: id 3 | task 16787 | n_decoded = 884, tg = 18.53 t/s, tg_3s = 18.46 t/s
16.21.554.993 I slot print_timing: id 3 | task 16787 | n_decoded = 940, tg = 18.52 t/s, tg_3s = 18.39 t/s
16.24.579.476 I slot print_timing: id 3 | task 16787 | n_decoded = 996, tg = 18.52 t/s, tg_3s = 18.52 t/s
16.27.603.559 I slot print_timing: id 3 | task 16787 | n_decoded = 1052, tg = 18.52 t/s, tg_3s = 18.52 t/s
16.30.631.864 I slot print_timing: id 3 | task 16787 | n_decoded = 1108, tg = 18.52 t/s, tg_3s = 18.49 t/s
16.33.655.714 I slot print_timing: id 3 | task 16787 | n_decoded = 1164, tg = 18.52 t/s, tg_3s = 18.52 t/s
16.36.698.938 I slot print_timing: id 3 | task 16787 | n_decoded = 1220, tg = 18.51 t/s, tg_3s = 18.40 t/s
16.39.732.068 I slot print_timing: id 3 | task 16787 | n_decoded = 1276, tg = 18.51 t/s, tg_3s = 18.46 t/s
16.42.766.030 I slot print_timing: id 3 | task 16787 | n_decoded = 1332, tg = 18.51 t/s, tg_3s = 18.46 t/s
16.45.800.918 I slot print_timing: id 3 | task 16787 | n_decoded = 1388, tg = 18.50 t/s, tg_3s = 18.45 t/s
16.48.847.054 I slot print_timing: id 3 | task 16787 | n_decoded = 1444, tg = 18.50 t/s, tg_3s = 18.38 t/s
16.51.887.348 I slot print_timing: id 3 | task 16787 | n_decoded = 1500, tg = 18.50 t/s, tg_3s = 18.42 t/s
16.54.932.853 I slot print_timing: id 3 | task 16787 | n_decoded = 1556, tg = 18.49 t/s, tg_3s = 18.39 t/s
16.57.974.907 I slot print_timing: id 3 | task 16787 | n_decoded = 1612, tg = 18.49 t/s, tg_3s = 18.41 t/s
17.01.018.259 I slot print_timing: id 3 | task 16787 | n_decoded = 1668, tg = 18.49 t/s, tg_3s = 18.40 t/s
17.04.067.225 I slot print_timing: id 3 | task 16787 | n_decoded = 1724, tg = 18.48 t/s, tg_3s = 18.37 t/s
17.07.106.769 I slot print_timing: id 3 | task 16787 | n_decoded = 1780, tg = 18.48 t/s, tg_3s = 18.42 t/s
17.10.136.734 I slot print_timing: id 3 | task 16787 | n_decoded = 1836, tg = 18.48 t/s, tg_3s = 18.48 t/s
17.13.164.773 I slot print_timing: id 3 | task 16787 | n_decoded = 1892, tg = 18.48 t/s, tg_3s = 18.49 t/s
17.16.206.015 I slot print_timing: id 3 | task 16787 | n_decoded = 1948, tg = 18.48 t/s, tg_3s = 18.41 t/s
17.19.243.502 I slot print_timing: id 3 | task 16787 | n_decoded = 2004, tg = 18.48 t/s, tg_3s = 18.44 t/s
17.22.282.755 I slot print_timing: id 3 | task 16787 | n_decoded = 2060, tg = 18.48 t/s, tg_3s = 18.43 t/s
17.25.322.669 I slot print_timing: id 3 | task 16787 | n_decoded = 2116, tg = 18.48 t/s, tg_3s = 18.42 t/s
17.28.364.370 I slot print_timing: id 3 | task 16787 | n_decoded = 2172, tg = 18.47 t/s, tg_3s = 18.41 t/s
17.31.366.815 I slot print_timing: id 3 | task 16787 | n_decoded = 2227, tg = 18.47 t/s, tg_3s = 18.32 t/s
17.34.414.981 I slot print_timing: id 3 | task 16787 | n_decoded = 2283, tg = 18.47 t/s, tg_3s = 18.37 t/s
17.37.465.347 I slot print_timing: id 3 | task 16787 | n_decoded = 2339, tg = 18.46 t/s, tg_3s = 18.36 t/s
17.40.518.885 I slot print_timing: id 3 | task 16787 | n_decoded = 2395, tg = 18.46 t/s, tg_3s = 18.34 t/s
17.43.527.786 I slot print_timing: id 3 | task 16787 | n_decoded = 2450, tg = 18.46 t/s, tg_3s = 18.28 t/s
17.46.542.708 I slot print_timing: id 3 | task 16787 | n_decoded = 2505, tg = 18.45 t/s, tg_3s = 18.24 t/s
17.49.556.996 I slot print_timing: id 3 | task 16787 | n_decoded = 2560, tg = 18.45 t/s, tg_3s = 18.25 t/s
17.52.573.543 I slot print_timing: id 3 | task 16787 | n_decoded = 2615, tg = 18.44 t/s, tg_3s = 18.23 t/s
17.55.591.114 I slot print_timing: id 3 | task 16787 | n_decoded = 2670, tg = 18.44 t/s, tg_3s = 18.23 t/s
17.58.618.634 I slot print_timing: id 3 | task 16787 | n_decoded = 2725, tg = 18.43 t/s, tg_3s = 18.17 t/s
18.01.642.857 I slot print_timing: id 3 | task 16787 | n_decoded = 2780, tg = 18.43 t/s, tg_3s = 18.19 t/s
18.04.694.662 I slot print_timing: id 3 | task 16787 | n_decoded = 2836, tg = 18.43 t/s, tg_3s = 18.35 t/s
18.07.745.218 I slot print_timing: id 3 | task 16787 | n_decoded = 2892, tg = 18.43 t/s, tg_3s = 18.36 t/s
18.09.821.159 I slot print_timing: id 3 | task 16787 | prompt eval time = 465.43 ms / 44 tokens ( 10.58 ms per token, 94.54 tokens per second)
18.09.821.163 I slot print_timing: id 3 | task 16787 | eval time = 159028.05 ms / 2930 tokens ( 54.28 ms per token, 18.42 tokens per second)
18.09.821.164 I slot print_timing: id 3 | task 16787 | total time = 159493.48 ms / 2974 tokens
18.09.821.164 I slot print_timing: id 3 | task 16787 | graphs reused = 19601
18.09.821.198 I slot release: id 3 | task 16787 | stop processing: n_tokens = 3044, truncated = 0
18.09.821.217 I srv update_slots: all slots are idle
18.09.837.078 I srv operator(): Chat format: peg-native
18.09.837.586 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.525 (> 0.100 thold), f_keep = 0.024
18.09.837.587 I srv get_availabl: updating prompt cache
18.09.837.703 W srv prompt_save: - saving prompt with length 3044, total state size = 339.935 MiB (draft: 0.000 MiB)
18.10.137.531 I srv load: - looking for better prompt, base f_keep = 0.024, sim = 0.525
18.10.137.541 I srv update: - cache state: 11 prompts, 4593.926 MiB (limits: 8192.000 MiB, 16384 tokens, 37140 est)
18.10.137.542 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
18.10.137.543 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
18.10.137.543 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
18.10.137.544 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
18.10.137.545 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
18.10.137.545 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
18.10.137.546 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
18.10.137.546 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
18.10.137.547 I srv update: - prompt 0x62c6df012e70: 2241 tokens, checkpoints: 1, 439.358 MiB
18.10.137.547 I srv update: - prompt 0x62c6df06adb0: 1229 tokens, checkpoints: 1, 376.089 MiB
18.10.137.548 I srv update: - prompt 0x62c6e65c2b80: 3044 tokens, checkpoints: 1, 489.561 MiB
18.10.137.549 I srv get_availabl: prompt cache update took 299.96 ms
18.10.137.621 I slot launch_slot_: id 3 | task 19719 | processing task, is_child = 0
18.10.137.622 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
18.10.137.622 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
18.10.137.641 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
18.10.137.641 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
18.10.137.651 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
18.10.137.652 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
18.10.137.670 I slot update_slots: id 3 | task 19719 | Checking checkpoint with [70, 70] against 74...
18.10.172.939 W slot update_slots: id 3 | task 19719 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
18.16.132.360 I slot print_timing: id 3 | task 19719 | n_decoded = 100, tg = 18.73 t/s, tg_3s = 18.73 t/s
18.19.167.542 I slot print_timing: id 3 | task 19719 | n_decoded = 156, tg = 18.63 t/s, tg_3s = 18.45 t/s
18.22.190.561 I slot print_timing: id 3 | task 19719 | n_decoded = 212, tg = 18.60 t/s, tg_3s = 18.52 t/s
18.25.211.636 I slot print_timing: id 3 | task 19719 | n_decoded = 268, tg = 18.59 t/s, tg_3s = 18.54 t/s
18.28.235.782 I slot print_timing: id 3 | task 19719 | n_decoded = 324, tg = 18.58 t/s, tg_3s = 18.52 t/s
18.31.269.938 I slot print_timing: id 3 | task 19719 | n_decoded = 380, tg = 18.56 t/s, tg_3s = 18.46 t/s
18.34.294.850 I slot print_timing: id 3 | task 19719 | n_decoded = 436, tg = 18.55 t/s, tg_3s = 18.51 t/s
18.37.317.763 I slot print_timing: id 3 | task 19719 | n_decoded = 492, tg = 18.55 t/s, tg_3s = 18.53 t/s
18.40.343.587 I slot print_timing: id 3 | task 19719 | n_decoded = 548, tg = 18.54 t/s, tg_3s = 18.51 t/s
18.43.371.843 I slot print_timing: id 3 | task 19719 | n_decoded = 604, tg = 18.54 t/s, tg_3s = 18.49 t/s
18.46.410.682 I slot print_timing: id 3 | task 19719 | n_decoded = 660, tg = 18.53 t/s, tg_3s = 18.43 t/s
18.49.437.544 I slot print_timing: id 3 | task 19719 | n_decoded = 716, tg = 18.53 t/s, tg_3s = 18.50 t/s
18.52.454.893 I slot print_timing: id 3 | task 19719 | n_decoded = 772, tg = 18.53 t/s, tg_3s = 18.56 t/s
18.55.472.495 I slot print_timing: id 3 | task 19719 | n_decoded = 828, tg = 18.53 t/s, tg_3s = 18.56 t/s
18.58.494.522 I slot print_timing: id 3 | task 19719 | n_decoded = 884, tg = 18.53 t/s, tg_3s = 18.53 t/s
19.01.527.699 I slot print_timing: id 3 | task 19719 | n_decoded = 940, tg = 18.53 t/s, tg_3s = 18.46 t/s
19.04.448.593 I slot print_timing: id 3 | task 19719 | prompt eval time = 656.08 ms / 70 tokens ( 9.37 ms per token, 106.69 tokens per second)
19.04.448.597 I slot print_timing: id 3 | task 19719 | eval time = 53654.84 ms / 994 tokens ( 53.98 ms per token, 18.53 tokens per second)
19.04.448.598 I slot print_timing: id 3 | task 19719 | total time = 54310.92 ms / 1064 tokens
19.04.448.599 I slot print_timing: id 3 | task 19719 | graphs reused = 20589
19.04.448.642 I slot release: id 3 | task 19719 | stop processing: n_tokens = 1134, truncated = 0
19.04.448.655 I srv update_slots: all slots are idle
19.04.464.867 I srv operator(): Chat format: peg-native
19.04.465.155 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.552 (> 0.100 thold), f_keep = 0.065
19.04.465.157 I srv get_availabl: updating prompt cache
19.04.465.213 W srv prompt_save: - saving prompt with length 1134, total state size = 220.523 MiB (draft: 0.000 MiB)
19.04.687.519 I srv load: - looking for better prompt, base f_keep = 0.065, sim = 0.552
19.04.687.529 I srv update: - cache state: 12 prompts, 4964.075 MiB (limits: 8192.000 MiB, 16384 tokens, 36242 est)
19.04.687.530 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
19.04.687.531 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
19.04.687.532 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
19.04.687.532 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
19.04.687.533 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
19.04.687.533 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
19.04.687.534 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
19.04.687.534 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
19.04.687.535 I srv update: - prompt 0x62c6df012e70: 2241 tokens, checkpoints: 1, 439.358 MiB
19.04.687.536 I srv update: - prompt 0x62c6df06adb0: 1229 tokens, checkpoints: 1, 376.089 MiB
19.04.687.536 I srv update: - prompt 0x62c6e65c2b80: 3044 tokens, checkpoints: 1, 489.561 MiB
19.04.687.537 I srv update: - prompt 0x62c6df0c8650: 1134 tokens, checkpoints: 1, 370.149 MiB
19.04.687.538 I srv get_availabl: prompt cache update took 222.38 ms
19.04.687.606 I slot launch_slot_: id 3 | task 20715 | processing task, is_child = 0
19.04.687.607 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
19.04.687.607 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
19.04.687.621 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
19.04.687.621 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
19.04.687.630 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
19.04.687.631 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
19.04.687.647 I slot update_slots: id 3 | task 20715 | Checking checkpoint with [70, 70] against 74...
19.04.722.696 W slot update_slots: id 3 | task 20715 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
19.10.548.122 I slot print_timing: id 3 | task 20715 | n_decoded = 100, tg = 18.72 t/s, tg_3s = 18.72 t/s
19.13.577.162 I slot print_timing: id 3 | task 20715 | n_decoded = 156, tg = 18.63 t/s, tg_3s = 18.49 t/s
19.16.597.136 I slot print_timing: id 3 | task 20715 | n_decoded = 212, tg = 18.61 t/s, tg_3s = 18.54 t/s
19.19.618.311 I slot print_timing: id 3 | task 20715 | n_decoded = 268, tg = 18.59 t/s, tg_3s = 18.54 t/s
19.22.644.327 I slot print_timing: id 3 | task 20715 | n_decoded = 324, tg = 18.58 t/s, tg_3s = 18.51 t/s
19.25.675.682 I slot print_timing: id 3 | task 20715 | n_decoded = 380, tg = 18.56 t/s, tg_3s = 18.47 t/s
19.28.711.269 I slot print_timing: id 3 | task 20715 | n_decoded = 436, tg = 18.55 t/s, tg_3s = 18.45 t/s
19.31.744.076 I slot print_timing: id 3 | task 20715 | n_decoded = 492, tg = 18.54 t/s, tg_3s = 18.46 t/s
19.34.782.151 I slot print_timing: id 3 | task 20715 | n_decoded = 548, tg = 18.53 t/s, tg_3s = 18.43 t/s
19.37.812.207 I slot print_timing: id 3 | task 20715 | n_decoded = 604, tg = 18.52 t/s, tg_3s = 18.48 t/s
19.40.855.258 I slot print_timing: id 3 | task 20715 | n_decoded = 660, tg = 18.51 t/s, tg_3s = 18.40 t/s
19.43.872.515 I slot print_timing: id 3 | task 20715 | n_decoded = 716, tg = 18.52 t/s, tg_3s = 18.56 t/s
19.46.897.300 I slot print_timing: id 3 | task 20715 | n_decoded = 772, tg = 18.52 t/s, tg_3s = 18.51 t/s
19.49.916.614 I slot print_timing: id 3 | task 20715 | n_decoded = 828, tg = 18.52 t/s, tg_3s = 18.55 t/s
19.52.938.832 I slot print_timing: id 3 | task 20715 | n_decoded = 884, tg = 18.52 t/s, tg_3s = 18.53 t/s
19.55.975.030 I slot print_timing: id 3 | task 20715 | n_decoded = 940, tg = 18.51 t/s, tg_3s = 18.44 t/s
19.59.002.510 I slot print_timing: id 3 | task 20715 | n_decoded = 996, tg = 18.51 t/s, tg_3s = 18.50 t/s
20.02.038.503 I slot print_timing: id 3 | task 20715 | n_decoded = 1052, tg = 18.51 t/s, tg_3s = 18.45 t/s
20.03.773.534 I slot print_timing: id 3 | task 20715 | prompt eval time = 517.33 ms / 63 tokens ( 8.21 ms per token, 121.78 tokens per second)
20.03.773.538 I slot print_timing: id 3 | task 20715 | eval time = 58568.55 ms / 1084 tokens ( 54.03 ms per token, 18.51 tokens per second)
20.03.773.539 I slot print_timing: id 3 | task 20715 | total time = 59085.88 ms / 1147 tokens
20.03.773.540 I slot print_timing: id 3 | task 20715 | graphs reused = 21667
20.03.773.584 I slot release: id 3 | task 20715 | stop processing: n_tokens = 1217, truncated = 0
20.03.773.595 I srv update_slots: all slots are idle
20.03.789.557 I srv operator(): Chat format: peg-native
20.03.789.856 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.615 (> 0.100 thold), f_keep = 0.062
20.03.789.858 I srv get_availabl: updating prompt cache
20.03.789.924 W srv prompt_save: - saving prompt with length 1217, total state size = 225.712 MiB (draft: 0.000 MiB)
20.04.014.274 I srv load: - looking for better prompt, base f_keep = 0.062, sim = 0.615
20.04.014.285 I srv update: - cache state: 13 prompts, 5339.414 MiB (limits: 8192.000 MiB, 16384 tokens, 35562 est)
20.04.014.287 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
20.04.014.288 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
20.04.014.288 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
20.04.014.289 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
20.04.014.290 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
20.04.014.290 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
20.04.014.291 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
20.04.014.292 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
20.04.014.292 I srv update: - prompt 0x62c6df012e70: 2241 tokens, checkpoints: 1, 439.358 MiB
20.04.014.293 I srv update: - prompt 0x62c6df06adb0: 1229 tokens, checkpoints: 1, 376.089 MiB
20.04.014.294 I srv update: - prompt 0x62c6e65c2b80: 3044 tokens, checkpoints: 1, 489.561 MiB
20.04.014.294 I srv update: - prompt 0x62c6df0c8650: 1134 tokens, checkpoints: 1, 370.149 MiB
20.04.014.295 I srv update: - prompt 0x62c6df0ce030: 1217 tokens, checkpoints: 1, 375.338 MiB
20.04.014.296 I srv get_availabl: prompt cache update took 224.44 ms
20.04.014.383 I slot launch_slot_: id 3 | task 21801 | processing task, is_child = 0
20.04.014.384 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
20.04.014.384 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
20.04.014.406 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
20.04.014.407 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
20.04.014.429 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
20.04.014.430 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
20.04.014.468 I slot update_slots: id 3 | task 21801 | Checking checkpoint with [70, 70] against 75...
20.04.049.562 W slot update_slots: id 3 | task 21801 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
20.09.800.625 I slot print_timing: id 3 | task 21801 | n_decoded = 100, tg = 18.67 t/s, tg_3s = 18.67 t/s
20.12.834.012 I slot print_timing: id 3 | task 21801 | n_decoded = 156, tg = 18.59 t/s, tg_3s = 18.46 t/s
20.15.862.696 I slot print_timing: id 3 | task 21801 | n_decoded = 212, tg = 18.57 t/s, tg_3s = 18.49 t/s
20.18.891.194 I slot print_timing: id 3 | task 21801 | n_decoded = 268, tg = 18.55 t/s, tg_3s = 18.49 t/s
20.21.920.500 I slot print_timing: id 3 | task 21801 | n_decoded = 324, tg = 18.54 t/s, tg_3s = 18.49 t/s
20.24.954.700 I slot print_timing: id 3 | task 21801 | n_decoded = 380, tg = 18.53 t/s, tg_3s = 18.46 t/s
20.27.997.579 I slot print_timing: id 3 | task 21801 | n_decoded = 436, tg = 18.51 t/s, tg_3s = 18.40 t/s
20.31.014.954 I slot print_timing: id 3 | task 21801 | n_decoded = 492, tg = 18.52 t/s, tg_3s = 18.56 t/s
20.34.036.308 I slot print_timing: id 3 | task 21801 | n_decoded = 548, tg = 18.52 t/s, tg_3s = 18.53 t/s
20.37.056.252 I slot print_timing: id 3 | task 21801 | n_decoded = 604, tg = 18.52 t/s, tg_3s = 18.54 t/s
20.40.088.177 I slot print_timing: id 3 | task 21801 | n_decoded = 660, tg = 18.52 t/s, tg_3s = 18.47 t/s
20.43.112.103 I slot print_timing: id 3 | task 21801 | n_decoded = 716, tg = 18.52 t/s, tg_3s = 18.52 t/s
20.46.136.417 I slot print_timing: id 3 | task 21801 | n_decoded = 772, tg = 18.52 t/s, tg_3s = 18.52 t/s
20.49.162.179 I slot print_timing: id 3 | task 21801 | n_decoded = 828, tg = 18.52 t/s, tg_3s = 18.51 t/s
20.52.186.259 I slot print_timing: id 3 | task 21801 | n_decoded = 884, tg = 18.52 t/s, tg_3s = 18.52 t/s
20.55.221.259 I slot print_timing: id 3 | task 21801 | n_decoded = 940, tg = 18.51 t/s, tg_3s = 18.45 t/s
20.58.250.571 I slot print_timing: id 3 | task 21801 | n_decoded = 996, tg = 18.51 t/s, tg_3s = 18.49 t/s
21.01.277.372 I slot print_timing: id 3 | task 21801 | n_decoded = 1052, tg = 18.51 t/s, tg_3s = 18.50 t/s
21.04.305.413 I slot print_timing: id 3 | task 21801 | n_decoded = 1108, tg = 18.51 t/s, tg_3s = 18.49 t/s
21.07.346.423 I slot print_timing: id 3 | task 21801 | n_decoded = 1164, tg = 18.50 t/s, tg_3s = 18.41 t/s
21.10.393.559 I slot print_timing: id 3 | task 21801 | n_decoded = 1220, tg = 18.50 t/s, tg_3s = 18.38 t/s
21.13.440.494 I slot print_timing: id 3 | task 21801 | n_decoded = 1276, tg = 18.49 t/s, tg_3s = 18.38 t/s
21.16.483.678 I slot print_timing: id 3 | task 21801 | n_decoded = 1332, tg = 18.49 t/s, tg_3s = 18.40 t/s
21.19.527.498 I slot print_timing: id 3 | task 21801 | n_decoded = 1388, tg = 18.49 t/s, tg_3s = 18.40 t/s
21.22.573.776 I slot print_timing: id 3 | task 21801 | n_decoded = 1444, tg = 18.48 t/s, tg_3s = 18.38 t/s
21.25.606.409 I slot print_timing: id 3 | task 21801 | n_decoded = 1500, tg = 18.48 t/s, tg_3s = 18.47 t/s
21.28.644.302 I slot print_timing: id 3 | task 21801 | n_decoded = 1556, tg = 18.48 t/s, tg_3s = 18.43 t/s
21.28.970.266 I slot print_timing: id 3 | task 21801 | prompt eval time = 429.95 ms / 51 tokens ( 8.43 ms per token, 118.62 tokens per second)
21.28.970.270 I slot print_timing: id 3 | task 21801 | eval time = 84525.85 ms / 1562 tokens ( 54.11 ms per token, 18.48 tokens per second)
21.28.970.271 I slot print_timing: id 3 | task 21801 | total time = 84955.80 ms / 1613 tokens
21.28.970.272 I slot print_timing: id 3 | task 21801 | graphs reused = 23221
21.28.970.310 I slot release: id 3 | task 21801 | stop processing: n_tokens = 1683, truncated = 0
21.28.970.324 I srv update_slots: all slots are idle
21.28.986.528 I srv operator(): Chat format: peg-native
21.28.986.821 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.587 (> 0.100 thold), f_keep = 0.044
21.28.986.822 I srv get_availabl: updating prompt cache
21.28.986.908 W srv prompt_save: - saving prompt with length 1683, total state size = 254.846 MiB (draft: 0.000 MiB)
21.29.229.651 I srv load: - looking for better prompt, base f_keep = 0.044, sim = 0.587
21.29.229.661 I srv update: - cache state: 14 prompts, 5743.886 MiB (limits: 8192.000 MiB, 16384 tokens, 35458 est)
21.29.229.662 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
21.29.229.663 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
21.29.229.664 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
21.29.229.664 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
21.29.229.665 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
21.29.229.665 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
21.29.229.666 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
21.29.229.666 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
21.29.229.667 I srv update: - prompt 0x62c6df012e70: 2241 tokens, checkpoints: 1, 439.358 MiB
21.29.229.668 I srv update: - prompt 0x62c6df06adb0: 1229 tokens, checkpoints: 1, 376.089 MiB
21.29.229.668 I srv update: - prompt 0x62c6e65c2b80: 3044 tokens, checkpoints: 1, 489.561 MiB
21.29.229.669 I srv update: - prompt 0x62c6df0c8650: 1134 tokens, checkpoints: 1, 370.149 MiB
21.29.229.669 I srv update: - prompt 0x62c6df0ce030: 1217 tokens, checkpoints: 1, 375.338 MiB
21.29.229.670 I srv update: - prompt 0x62c6deff7270: 1683 tokens, checkpoints: 1, 404.472 MiB
21.29.229.671 I srv get_availabl: prompt cache update took 242.85 ms
21.29.229.739 I slot launch_slot_: id 3 | task 23365 | processing task, is_child = 0
21.29.229.739 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
21.29.229.740 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
21.29.229.755 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
21.29.229.756 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
21.29.229.765 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
21.29.229.765 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
21.29.229.782 I slot update_slots: id 3 | task 23365 | Checking checkpoint with [70, 70] against 74...
21.29.264.788 W slot update_slots: id 3 | task 23365 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
21.35.039.764 I slot print_timing: id 3 | task 23365 | n_decoded = 100, tg = 18.75 t/s, tg_3s = 18.75 t/s
21.38.066.683 I slot print_timing: id 3 | task 23365 | n_decoded = 156, tg = 18.66 t/s, tg_3s = 18.50 t/s
21.41.086.107 I slot print_timing: id 3 | task 23365 | n_decoded = 212, tg = 18.63 t/s, tg_3s = 18.55 t/s
21.44.109.180 I slot print_timing: id 3 | task 23365 | n_decoded = 268, tg = 18.61 t/s, tg_3s = 18.52 t/s
21.47.133.328 I slot print_timing: id 3 | task 23365 | n_decoded = 324, tg = 18.59 t/s, tg_3s = 18.52 t/s
21.50.162.308 I slot print_timing: id 3 | task 23365 | n_decoded = 380, tg = 18.58 t/s, tg_3s = 18.49 t/s
21.53.201.436 I slot print_timing: id 3 | task 23365 | n_decoded = 436, tg = 18.56 t/s, tg_3s = 18.43 t/s
21.56.237.303 I slot print_timing: id 3 | task 23365 | n_decoded = 492, tg = 18.54 t/s, tg_3s = 18.45 t/s
21.59.263.820 I slot print_timing: id 3 | task 23365 | n_decoded = 548, tg = 18.54 t/s, tg_3s = 18.50 t/s
22.02.293.474 I slot print_timing: id 3 | task 23365 | n_decoded = 604, tg = 18.53 t/s, tg_3s = 18.48 t/s
22.05.333.551 I slot print_timing: id 3 | task 23365 | n_decoded = 660, tg = 18.52 t/s, tg_3s = 18.42 t/s
22.08.363.139 I slot print_timing: id 3 | task 23365 | n_decoded = 716, tg = 18.52 t/s, tg_3s = 18.48 t/s
22.11.386.982 I slot print_timing: id 3 | task 23365 | n_decoded = 772, tg = 18.52 t/s, tg_3s = 18.52 t/s
22.14.413.916 I slot print_timing: id 3 | task 23365 | n_decoded = 828, tg = 18.52 t/s, tg_3s = 18.50 t/s
22.17.440.189 I slot print_timing: id 3 | task 23365 | n_decoded = 884, tg = 18.52 t/s, tg_3s = 18.50 t/s
22.20.481.189 I slot print_timing: id 3 | task 23365 | n_decoded = 940, tg = 18.51 t/s, tg_3s = 18.41 t/s
22.23.508.258 I slot print_timing: id 3 | task 23365 | n_decoded = 996, tg = 18.51 t/s, tg_3s = 18.50 t/s
22.26.541.517 I slot print_timing: id 3 | task 23365 | n_decoded = 1052, tg = 18.51 t/s, tg_3s = 18.46 t/s
22.29.570.326 I slot print_timing: id 3 | task 23365 | n_decoded = 1108, tg = 18.51 t/s, tg_3s = 18.49 t/s
22.32.606.617 I slot print_timing: id 3 | task 23365 | n_decoded = 1164, tg = 18.51 t/s, tg_3s = 18.44 t/s
22.35.648.257 I slot print_timing: id 3 | task 23365 | n_decoded = 1220, tg = 18.50 t/s, tg_3s = 18.41 t/s
22.38.682.575 I slot print_timing: id 3 | task 23365 | n_decoded = 1276, tg = 18.50 t/s, tg_3s = 18.46 t/s
22.41.723.278 I slot print_timing: id 3 | task 23365 | n_decoded = 1332, tg = 18.50 t/s, tg_3s = 18.42 t/s
22.44.762.508 I slot print_timing: id 3 | task 23365 | n_decoded = 1388, tg = 18.49 t/s, tg_3s = 18.43 t/s
22.47.814.273 I slot print_timing: id 3 | task 23365 | n_decoded = 1444, tg = 18.49 t/s, tg_3s = 18.35 t/s
22.50.859.609 I slot print_timing: id 3 | task 23365 | n_decoded = 1500, tg = 18.48 t/s, tg_3s = 18.39 t/s
22.53.908.228 I slot print_timing: id 3 | task 23365 | n_decoded = 1556, tg = 18.48 t/s, tg_3s = 18.37 t/s
22.56.953.641 I slot print_timing: id 3 | task 23365 | n_decoded = 1612, tg = 18.48 t/s, tg_3s = 18.39 t/s
23.00.001.749 I slot print_timing: id 3 | task 23365 | n_decoded = 1668, tg = 18.47 t/s, tg_3s = 18.37 t/s
23.03.053.393 I slot print_timing: id 3 | task 23365 | n_decoded = 1724, tg = 18.47 t/s, tg_3s = 18.35 t/s
23.06.091.788 I slot print_timing: id 3 | task 23365 | n_decoded = 1780, tg = 18.47 t/s, tg_3s = 18.43 t/s
23.09.126.478 I slot print_timing: id 3 | task 23365 | n_decoded = 1836, tg = 18.47 t/s, tg_3s = 18.45 t/s
23.12.167.506 I slot print_timing: id 3 | task 23365 | n_decoded = 1892, tg = 18.47 t/s, tg_3s = 18.41 t/s
23.15.169.433 I slot print_timing: id 3 | task 23365 | n_decoded = 1947, tg = 18.46 t/s, tg_3s = 18.32 t/s
23.18.213.635 I slot print_timing: id 3 | task 23365 | n_decoded = 2003, tg = 18.46 t/s, tg_3s = 18.40 t/s
23.21.259.660 I slot print_timing: id 3 | task 23365 | n_decoded = 2059, tg = 18.46 t/s, tg_3s = 18.38 t/s
23.24.301.482 I slot print_timing: id 3 | task 23365 | n_decoded = 2115, tg = 18.46 t/s, tg_3s = 18.41 t/s
23.27.347.671 I slot print_timing: id 3 | task 23365 | n_decoded = 2171, tg = 18.45 t/s, tg_3s = 18.38 t/s
23.30.355.744 I slot print_timing: id 3 | task 23365 | n_decoded = 2226, tg = 18.45 t/s, tg_3s = 18.28 t/s
23.33.409.647 I slot print_timing: id 3 | task 23365 | n_decoded = 2282, tg = 18.45 t/s, tg_3s = 18.34 t/s
23.36.411.791 I slot print_timing: id 3 | task 23365 | n_decoded = 2337, tg = 18.44 t/s, tg_3s = 18.32 t/s
23.39.416.827 I slot print_timing: id 3 | task 23365 | n_decoded = 2392, tg = 18.44 t/s, tg_3s = 18.30 t/s
23.42.429.672 I slot print_timing: id 3 | task 23365 | n_decoded = 2447, tg = 18.44 t/s, tg_3s = 18.26 t/s
23.45.438.532 I slot print_timing: id 3 | task 23365 | n_decoded = 2502, tg = 18.43 t/s, tg_3s = 18.28 t/s
23.48.447.621 I slot print_timing: id 3 | task 23365 | n_decoded = 2557, tg = 18.43 t/s, tg_3s = 18.28 t/s
23.51.496.385 I slot print_timing: id 3 | task 23365 | n_decoded = 2613, tg = 18.43 t/s, tg_3s = 18.37 t/s
23.54.549.570 I slot print_timing: id 3 | task 23365 | n_decoded = 2669, tg = 18.43 t/s, tg_3s = 18.34 t/s
23.57.556.578 I slot print_timing: id 3 | task 23365 | n_decoded = 2724, tg = 18.42 t/s, tg_3s = 18.29 t/s
24.00.558.184 I slot print_timing: id 3 | task 23365 | n_decoded = 2779, tg = 18.42 t/s, tg_3s = 18.32 t/s
24.01.158.660 I slot print_timing: id 3 | task 23365 | prompt eval time = 475.72 ms / 55 tokens ( 8.65 ms per token, 115.62 tokens per second)
24.01.158.664 I slot print_timing: id 3 | task 23365 | eval time = 151453.16 ms / 2790 tokens ( 54.28 ms per token, 18.42 tokens per second)
24.01.158.664 I slot print_timing: id 3 | task 23365 | total time = 151928.87 ms / 2845 tokens
24.01.158.665 I slot print_timing: id 3 | task 23365 | graphs reused = 25998
24.01.158.702 I slot release: id 3 | task 23365 | stop processing: n_tokens = 2915, truncated = 0
24.01.158.720 I srv update_slots: all slots are idle
24.01.174.648 I srv operator(): Chat format: peg-native
24.01.174.957 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.638 (> 0.100 thold), f_keep = 0.025
24.01.174.960 I srv get_availabl: updating prompt cache
24.01.175.085 W srv prompt_save: - saving prompt with length 2915, total state size = 331.870 MiB (draft: 0.000 MiB)
24.01.471.971 I srv load: - looking for better prompt, base f_keep = 0.025, sim = 0.638
24.01.471.982 I srv update: - cache state: 15 prompts, 6225.382 MiB (limits: 8192.000 MiB, 16384 tokens, 36551 est)
24.01.471.986 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
24.01.471.986 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
24.01.471.987 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
24.01.471.987 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
24.01.471.990 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
24.01.471.991 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
24.01.471.992 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
24.01.471.992 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
24.01.471.993 I srv update: - prompt 0x62c6df012e70: 2241 tokens, checkpoints: 1, 439.358 MiB
24.01.471.994 I srv update: - prompt 0x62c6df06adb0: 1229 tokens, checkpoints: 1, 376.089 MiB
24.01.471.995 I srv update: - prompt 0x62c6e65c2b80: 3044 tokens, checkpoints: 1, 489.561 MiB
24.01.471.995 I srv update: - prompt 0x62c6df0c8650: 1134 tokens, checkpoints: 1, 370.149 MiB
24.01.471.996 I srv update: - prompt 0x62c6df0ce030: 1217 tokens, checkpoints: 1, 375.338 MiB
24.01.471.996 I srv update: - prompt 0x62c6deff7270: 1683 tokens, checkpoints: 1, 404.472 MiB
24.01.471.997 I srv update: - prompt 0x62c6e6528c00: 2915 tokens, checkpoints: 1, 481.496 MiB
24.01.471.999 I srv get_availabl: prompt cache update took 297.04 ms
24.01.472.085 I slot launch_slot_: id 3 | task 26157 | processing task, is_child = 0
24.01.472.086 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
24.01.472.087 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
24.01.472.104 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
24.01.472.104 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
24.01.472.124 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
24.01.472.124 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
24.01.472.153 I slot update_slots: id 3 | task 26157 | Checking checkpoint with [70, 70] against 74...
24.01.507.222 W slot update_slots: id 3 | task 26157 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
24.07.252.836 I slot print_timing: id 3 | task 26157 | n_decoded = 100, tg = 18.68 t/s, tg_3s = 18.68 t/s
24.10.285.931 I slot print_timing: id 3 | task 26157 | n_decoded = 156, tg = 18.60 t/s, tg_3s = 18.46 t/s
24.13.310.014 I slot print_timing: id 3 | task 26157 | n_decoded = 212, tg = 18.58 t/s, tg_3s = 18.52 t/s
24.16.334.285 I slot print_timing: id 3 | task 26157 | n_decoded = 268, tg = 18.57 t/s, tg_3s = 18.52 t/s
24.19.365.302 I slot print_timing: id 3 | task 26157 | n_decoded = 324, tg = 18.55 t/s, tg_3s = 18.48 t/s
24.22.392.332 I slot print_timing: id 3 | task 26157 | n_decoded = 380, tg = 18.54 t/s, tg_3s = 18.50 t/s
24.25.429.396 I slot print_timing: id 3 | task 26157 | n_decoded = 436, tg = 18.53 t/s, tg_3s = 18.44 t/s
24.28.461.479 I slot print_timing: id 3 | task 26157 | n_decoded = 492, tg = 18.52 t/s, tg_3s = 18.47 t/s
24.31.488.471 I slot print_timing: id 3 | task 26157 | n_decoded = 548, tg = 18.52 t/s, tg_3s = 18.50 t/s
24.34.518.448 I slot print_timing: id 3 | task 26157 | n_decoded = 604, tg = 18.52 t/s, tg_3s = 18.48 t/s
24.37.558.504 I slot print_timing: id 3 | task 26157 | n_decoded = 660, tg = 18.51 t/s, tg_3s = 18.42 t/s
24.40.592.756 I slot print_timing: id 3 | task 26157 | n_decoded = 716, tg = 18.50 t/s, tg_3s = 18.46 t/s
24.43.619.153 I slot print_timing: id 3 | task 26157 | n_decoded = 772, tg = 18.50 t/s, tg_3s = 18.50 t/s
24.46.643.259 I slot print_timing: id 3 | task 26157 | n_decoded = 828, tg = 18.51 t/s, tg_3s = 18.52 t/s
24.49.675.339 I slot print_timing: id 3 | task 26157 | n_decoded = 884, tg = 18.50 t/s, tg_3s = 18.47 t/s
24.52.710.386 I slot print_timing: id 3 | task 26157 | n_decoded = 940, tg = 18.50 t/s, tg_3s = 18.45 t/s
24.55.734.556 I slot print_timing: id 3 | task 26157 | n_decoded = 996, tg = 18.50 t/s, tg_3s = 18.52 t/s
24.58.758.334 I slot print_timing: id 3 | task 26157 | n_decoded = 1052, tg = 18.50 t/s, tg_3s = 18.52 t/s
25.01.785.505 I slot print_timing: id 3 | task 26157 | n_decoded = 1108, tg = 18.50 t/s, tg_3s = 18.50 t/s
25.04.811.449 I slot print_timing: id 3 | task 26157 | n_decoded = 1164, tg = 18.50 t/s, tg_3s = 18.51 t/s
25.07.859.313 I slot print_timing: id 3 | task 26157 | n_decoded = 1220, tg = 18.50 t/s, tg_3s = 18.37 t/s
25.10.901.634 I slot print_timing: id 3 | task 26157 | n_decoded = 1276, tg = 18.49 t/s, tg_3s = 18.41 t/s
25.13.947.670 I slot print_timing: id 3 | task 26157 | n_decoded = 1332, tg = 18.49 t/s, tg_3s = 18.38 t/s
25.16.990.854 I slot print_timing: id 3 | task 26157 | n_decoded = 1388, tg = 18.48 t/s, tg_3s = 18.40 t/s
25.20.044.729 I slot print_timing: id 3 | task 26157 | n_decoded = 1444, tg = 18.48 t/s, tg_3s = 18.34 t/s
25.23.089.983 I slot print_timing: id 3 | task 26157 | n_decoded = 1500, tg = 18.48 t/s, tg_3s = 18.39 t/s
25.26.133.240 I slot print_timing: id 3 | task 26157 | n_decoded = 1556, tg = 18.47 t/s, tg_3s = 18.40 t/s
25.29.171.483 I slot print_timing: id 3 | task 26157 | n_decoded = 1612, tg = 18.47 t/s, tg_3s = 18.43 t/s
25.32.203.076 I slot print_timing: id 3 | task 26157 | n_decoded = 1668, tg = 18.47 t/s, tg_3s = 18.47 t/s
25.35.251.176 I slot print_timing: id 3 | task 26157 | n_decoded = 1724, tg = 18.47 t/s, tg_3s = 18.37 t/s
25.38.287.177 I slot print_timing: id 3 | task 26157 | n_decoded = 1780, tg = 18.47 t/s, tg_3s = 18.45 t/s
25.41.324.530 I slot print_timing: id 3 | task 26157 | n_decoded = 1836, tg = 18.47 t/s, tg_3s = 18.44 t/s
25.44.359.839 I slot print_timing: id 3 | task 26157 | n_decoded = 1892, tg = 18.47 t/s, tg_3s = 18.45 t/s
25.47.408.579 I slot print_timing: id 3 | task 26157 | n_decoded = 1948, tg = 18.46 t/s, tg_3s = 18.37 t/s
25.50.452.044 I slot print_timing: id 3 | task 26157 | n_decoded = 2004, tg = 18.46 t/s, tg_3s = 18.40 t/s
25.53.499.622 I slot print_timing: id 3 | task 26157 | n_decoded = 2060, tg = 18.46 t/s, tg_3s = 18.38 t/s
25.56.546.250 I slot print_timing: id 3 | task 26157 | n_decoded = 2116, tg = 18.46 t/s, tg_3s = 18.38 t/s
25.59.597.434 I slot print_timing: id 3 | task 26157 | n_decoded = 2172, tg = 18.45 t/s, tg_3s = 18.35 t/s
26.00.806.693 I slot print_timing: id 3 | task 26157 | prompt eval time = 427.09 ms / 45 tokens ( 9.49 ms per token, 105.36 tokens per second)
26.00.806.696 I slot print_timing: id 3 | task 26157 | eval time = 118907.44 ms / 2194 tokens ( 54.20 ms per token, 18.45 tokens per second)
26.00.806.697 I slot print_timing: id 3 | task 26157 | total time = 119334.53 ms / 2239 tokens
26.00.806.698 I slot print_timing: id 3 | task 26157 | graphs reused = 28181
26.00.806.734 I slot release: id 3 | task 26157 | stop processing: n_tokens = 2309, truncated = 0
26.00.806.752 I srv update_slots: all slots are idle
26.00.822.397 I srv operator(): Chat format: peg-native
26.00.822.700 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.643 (> 0.100 thold), f_keep = 0.032
26.00.822.702 I srv get_availabl: updating prompt cache
26.00.822.805 W srv prompt_save: - saving prompt with length 2309, total state size = 293.983 MiB (draft: 0.000 MiB)
26.01.093.042 I srv load: - looking for better prompt, base f_keep = 0.032, sim = 0.643
26.01.093.054 I srv update: - cache state: 16 prompts, 6668.991 MiB (limits: 8192.000 MiB, 16384 tokens, 36956 est)
26.01.093.055 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
26.01.093.056 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
26.01.093.056 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
26.01.093.057 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
26.01.093.057 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
26.01.093.058 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
26.01.093.058 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
26.01.093.059 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
26.01.093.059 I srv update: - prompt 0x62c6df012e70: 2241 tokens, checkpoints: 1, 439.358 MiB
26.01.093.060 I srv update: - prompt 0x62c6df06adb0: 1229 tokens, checkpoints: 1, 376.089 MiB
26.01.093.060 I srv update: - prompt 0x62c6e65c2b80: 3044 tokens, checkpoints: 1, 489.561 MiB
26.01.093.061 I srv update: - prompt 0x62c6df0c8650: 1134 tokens, checkpoints: 1, 370.149 MiB
26.01.093.061 I srv update: - prompt 0x62c6df0ce030: 1217 tokens, checkpoints: 1, 375.338 MiB
26.01.093.062 I srv update: - prompt 0x62c6deff7270: 1683 tokens, checkpoints: 1, 404.472 MiB
26.01.093.062 I srv update: - prompt 0x62c6e6528c00: 2915 tokens, checkpoints: 1, 481.496 MiB
26.01.093.063 I srv update: - prompt 0x62c6e646bb10: 2309 tokens, checkpoints: 1, 443.609 MiB
26.01.093.064 I srv get_availabl: prompt cache update took 270.36 ms
26.01.093.140 I slot launch_slot_: id 3 | task 28353 | processing task, is_child = 0
26.01.093.141 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
26.01.093.141 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
26.01.093.157 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
26.01.093.157 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
26.01.093.177 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
26.01.093.177 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
26.01.093.205 I slot update_slots: id 3 | task 28353 | Checking checkpoint with [70, 70] against 74...
26.01.128.423 W slot update_slots: id 3 | task 28353 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
26.06.917.070 I slot print_timing: id 3 | task 28353 | n_decoded = 100, tg = 18.66 t/s, tg_3s = 18.66 t/s
26.09.959.192 I slot print_timing: id 3 | task 28353 | n_decoded = 156, tg = 18.57 t/s, tg_3s = 18.41 t/s
26.12.988.184 I slot print_timing: id 3 | task 28353 | n_decoded = 212, tg = 18.55 t/s, tg_3s = 18.49 t/s
26.16.016.541 I slot print_timing: id 3 | task 28353 | n_decoded = 268, tg = 18.54 t/s, tg_3s = 18.49 t/s
26.19.044.796 I slot print_timing: id 3 | task 28353 | n_decoded = 324, tg = 18.53 t/s, tg_3s = 18.49 t/s
26.22.071.068 I slot print_timing: id 3 | task 28353 | n_decoded = 380, tg = 18.53 t/s, tg_3s = 18.50 t/s
26.25.104.159 I slot print_timing: id 3 | task 28353 | n_decoded = 436, tg = 18.52 t/s, tg_3s = 18.46 t/s
26.28.128.266 I slot print_timing: id 3 | task 28353 | n_decoded = 492, tg = 18.52 t/s, tg_3s = 18.52 t/s
26.31.153.267 I slot print_timing: id 3 | task 28353 | n_decoded = 548, tg = 18.52 t/s, tg_3s = 18.51 t/s
26.34.176.267 I slot print_timing: id 3 | task 28353 | n_decoded = 604, tg = 18.52 t/s, tg_3s = 18.52 t/s
26.37.215.511 I slot print_timing: id 3 | task 28353 | n_decoded = 660, tg = 18.51 t/s, tg_3s = 18.43 t/s
26.40.241.498 I slot print_timing: id 3 | task 28353 | n_decoded = 716, tg = 18.51 t/s, tg_3s = 18.51 t/s
26.43.272.901 I slot print_timing: id 3 | task 28353 | n_decoded = 772, tg = 18.51 t/s, tg_3s = 18.47 t/s
26.46.300.491 I slot print_timing: id 3 | task 28353 | n_decoded = 828, tg = 18.51 t/s, tg_3s = 18.50 t/s
26.49.334.362 I slot print_timing: id 3 | task 28353 | n_decoded = 884, tg = 18.50 t/s, tg_3s = 18.46 t/s
26.52.376.580 I slot print_timing: id 3 | task 28353 | n_decoded = 940, tg = 18.50 t/s, tg_3s = 18.41 t/s
26.55.414.491 I slot print_timing: id 3 | task 28353 | n_decoded = 996, tg = 18.49 t/s, tg_3s = 18.43 t/s
26.58.453.678 I slot print_timing: id 3 | task 28353 | n_decoded = 1052, tg = 18.49 t/s, tg_3s = 18.43 t/s
27.01.491.186 I slot print_timing: id 3 | task 28353 | n_decoded = 1108, tg = 18.49 t/s, tg_3s = 18.44 t/s
27.04.522.924 I slot print_timing: id 3 | task 28353 | n_decoded = 1164, tg = 18.49 t/s, tg_3s = 18.47 t/s
27.07.527.379 I slot print_timing: id 3 | task 28353 | n_decoded = 1219, tg = 18.48 t/s, tg_3s = 18.31 t/s
27.10.559.927 I slot print_timing: id 3 | task 28353 | n_decoded = 1275, tg = 18.48 t/s, tg_3s = 18.47 t/s
27.13.592.315 I slot print_timing: id 3 | task 28353 | n_decoded = 1331, tg = 18.48 t/s, tg_3s = 18.47 t/s
27.16.632.821 I slot print_timing: id 3 | task 28353 | n_decoded = 1387, tg = 18.48 t/s, tg_3s = 18.42 t/s
27.19.685.307 I slot print_timing: id 3 | task 28353 | n_decoded = 1443, tg = 18.47 t/s, tg_3s = 18.35 t/s
27.22.728.045 I slot print_timing: id 3 | task 28353 | n_decoded = 1499, tg = 18.47 t/s, tg_3s = 18.40 t/s
27.25.772.457 I slot print_timing: id 3 | task 28353 | n_decoded = 1555, tg = 18.46 t/s, tg_3s = 18.39 t/s
27.28.818.049 I slot print_timing: id 3 | task 28353 | n_decoded = 1611, tg = 18.46 t/s, tg_3s = 18.39 t/s
27.31.866.486 I slot print_timing: id 3 | task 28353 | n_decoded = 1667, tg = 18.46 t/s, tg_3s = 18.37 t/s
27.34.871.062 I slot print_timing: id 3 | task 28353 | n_decoded = 1722, tg = 18.45 t/s, tg_3s = 18.31 t/s
27.37.922.147 I slot print_timing: id 3 | task 28353 | n_decoded = 1778, tg = 18.45 t/s, tg_3s = 18.35 t/s
27.40.264.222 I slot print_timing: id 3 | task 28353 | prompt eval time = 465.52 ms / 44 tokens ( 10.58 ms per token, 94.52 tokens per second)
27.40.264.226 I slot print_timing: id 3 | task 28353 | eval time = 98705.49 ms / 1821 tokens ( 54.20 ms per token, 18.45 tokens per second)
27.40.264.227 I slot print_timing: id 3 | task 28353 | total time = 99171.01 ms / 1865 tokens
27.40.264.227 I slot print_timing: id 3 | task 28353 | graphs reused = 29993
27.40.264.275 I slot release: id 3 | task 28353 | stop processing: n_tokens = 1935, truncated = 0
27.40.264.288 I srv update_slots: all slots are idle
27.40.280.046 I srv operator(): Chat format: peg-native
27.40.280.338 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.692 (> 0.100 thold), f_keep = 0.038
27.40.280.341 I srv get_availabl: updating prompt cache
27.40.280.431 W srv prompt_save: - saving prompt with length 1935, total state size = 270.601 MiB (draft: 0.000 MiB)
27.40.537.390 I srv load: - looking for better prompt, base f_keep = 0.038, sim = 0.692
27.40.537.402 I srv update: - cache state: 17 prompts, 7089.218 MiB (limits: 8192.000 MiB, 16384 tokens, 37002 est)
27.40.537.403 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
27.40.537.404 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
27.40.537.405 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
27.40.537.405 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
27.40.537.406 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
27.40.537.406 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
27.40.537.407 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
27.40.537.407 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
27.40.537.408 I srv update: - prompt 0x62c6df012e70: 2241 tokens, checkpoints: 1, 439.358 MiB
27.40.537.408 I srv update: - prompt 0x62c6df06adb0: 1229 tokens, checkpoints: 1, 376.089 MiB
27.40.537.409 I srv update: - prompt 0x62c6e65c2b80: 3044 tokens, checkpoints: 1, 489.561 MiB
27.40.537.409 I srv update: - prompt 0x62c6df0c8650: 1134 tokens, checkpoints: 1, 370.149 MiB
27.40.537.410 I srv update: - prompt 0x62c6df0ce030: 1217 tokens, checkpoints: 1, 375.338 MiB
27.40.537.411 I srv update: - prompt 0x62c6deff7270: 1683 tokens, checkpoints: 1, 404.472 MiB
27.40.537.411 I srv update: - prompt 0x62c6e6528c00: 2915 tokens, checkpoints: 1, 481.496 MiB
27.40.537.412 I srv update: - prompt 0x62c6e646bb10: 2309 tokens, checkpoints: 1, 443.609 MiB
27.40.537.412 I srv update: - prompt 0x62c6df116c40: 1935 tokens, checkpoints: 1, 420.227 MiB
27.40.537.413 I srv get_availabl: prompt cache update took 257.07 ms
27.40.537.491 I slot launch_slot_: id 3 | task 30176 | processing task, is_child = 0
27.40.537.491 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
27.40.537.492 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
27.40.537.507 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
27.40.537.507 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
27.40.537.527 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
27.40.537.527 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
27.40.537.545 I slot update_slots: id 3 | task 30176 | Checking checkpoint with [70, 70] against 74...
27.40.573.013 W slot update_slots: id 3 | task 30176 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
27.46.333.195 I slot print_timing: id 3 | task 30176 | n_decoded = 100, tg = 18.65 t/s, tg_3s = 18.65 t/s
27.49.372.773 I slot print_timing: id 3 | task 30176 | n_decoded = 156, tg = 18.57 t/s, tg_3s = 18.42 t/s
27.52.401.010 I slot print_timing: id 3 | task 30176 | n_decoded = 212, tg = 18.55 t/s, tg_3s = 18.49 t/s
27.55.431.490 I slot print_timing: id 3 | task 30176 | n_decoded = 268, tg = 18.53 t/s, tg_3s = 18.48 t/s
27.58.461.671 I slot print_timing: id 3 | task 30176 | n_decoded = 324, tg = 18.52 t/s, tg_3s = 18.48 t/s
28.01.498.209 I slot print_timing: id 3 | task 30176 | n_decoded = 380, tg = 18.51 t/s, tg_3s = 18.44 t/s
28.04.533.403 I slot print_timing: id 3 | task 30176 | n_decoded = 436, tg = 18.50 t/s, tg_3s = 18.45 t/s
28.07.555.816 I slot print_timing: id 3 | task 30176 | n_decoded = 492, tg = 18.51 t/s, tg_3s = 18.53 t/s
28.10.579.358 I slot print_timing: id 3 | task 30176 | n_decoded = 548, tg = 18.51 t/s, tg_3s = 18.52 t/s
28.13.603.130 I slot print_timing: id 3 | task 30176 | n_decoded = 604, tg = 18.51 t/s, tg_3s = 18.52 t/s
28.16.632.980 I slot print_timing: id 3 | task 30176 | n_decoded = 660, tg = 18.51 t/s, tg_3s = 18.48 t/s
28.19.670.423 I slot print_timing: id 3 | task 30176 | n_decoded = 716, tg = 18.50 t/s, tg_3s = 18.44 t/s
28.22.696.541 I slot print_timing: id 3 | task 30176 | n_decoded = 772, tg = 18.50 t/s, tg_3s = 18.51 t/s
28.25.733.542 I slot print_timing: id 3 | task 30176 | n_decoded = 828, tg = 18.50 t/s, tg_3s = 18.44 t/s
28.28.764.933 I slot print_timing: id 3 | task 30176 | n_decoded = 884, tg = 18.50 t/s, tg_3s = 18.47 t/s
28.31.810.570 I slot print_timing: id 3 | task 30176 | n_decoded = 940, tg = 18.49 t/s, tg_3s = 18.39 t/s
28.34.848.440 I slot print_timing: id 3 | task 30176 | n_decoded = 996, tg = 18.49 t/s, tg_3s = 18.43 t/s
28.37.888.447 I slot print_timing: id 3 | task 30176 | n_decoded = 1052, tg = 18.48 t/s, tg_3s = 18.42 t/s
28.40.931.261 I slot print_timing: id 3 | task 30176 | n_decoded = 1108, tg = 18.48 t/s, tg_3s = 18.40 t/s
28.43.974.141 I slot print_timing: id 3 | task 30176 | n_decoded = 1164, tg = 18.48 t/s, tg_3s = 18.40 t/s
28.46.988.559 I slot print_timing: id 3 | task 30176 | n_decoded = 1219, tg = 18.46 t/s, tg_3s = 18.25 t/s
28.48.517.939 I slot print_timing: id 3 | task 30176 | prompt eval time = 433.34 ms / 36 tokens ( 12.04 ms per token, 83.08 tokens per second)
28.48.517.943 I slot print_timing: id 3 | task 30176 | eval time = 67547.05 ms / 1247 tokens ( 54.17 ms per token, 18.46 tokens per second)
28.48.517.944 I slot print_timing: id 3 | task 30176 | total time = 67980.39 ms / 1283 tokens
28.48.517.944 I slot print_timing: id 3 | task 30176 | graphs reused = 31233
28.48.517.982 I slot release: id 3 | task 30176 | stop processing: n_tokens = 1353, truncated = 0
28.48.517.993 I srv update_slots: all slots are idle
28.48.534.051 I srv operator(): Chat format: peg-native
28.48.534.342 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.763 (> 0.100 thold), f_keep = 0.055
28.48.534.344 I srv get_availabl: updating prompt cache
28.48.534.406 W srv prompt_save: - saving prompt with length 1353, total state size = 234.215 MiB (draft: 0.000 MiB)
28.48.767.127 I srv load: - looking for better prompt, base f_keep = 0.055, sim = 0.763
28.48.767.141 I srv update: - cache state: 18 prompts, 7473.059 MiB (limits: 8192.000 MiB, 16384 tokens, 36584 est)
28.48.767.142 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
28.48.767.142 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
28.48.767.143 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
28.48.767.143 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
28.48.767.144 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
28.48.767.144 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
28.48.767.145 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
28.48.767.146 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
28.48.767.146 I srv update: - prompt 0x62c6df012e70: 2241 tokens, checkpoints: 1, 439.358 MiB
28.48.767.147 I srv update: - prompt 0x62c6df06adb0: 1229 tokens, checkpoints: 1, 376.089 MiB
28.48.767.147 I srv update: - prompt 0x62c6e65c2b80: 3044 tokens, checkpoints: 1, 489.561 MiB
28.48.767.148 I srv update: - prompt 0x62c6df0c8650: 1134 tokens, checkpoints: 1, 370.149 MiB
28.48.767.148 I srv update: - prompt 0x62c6df0ce030: 1217 tokens, checkpoints: 1, 375.338 MiB
28.48.767.149 I srv update: - prompt 0x62c6deff7270: 1683 tokens, checkpoints: 1, 404.472 MiB
28.48.767.149 I srv update: - prompt 0x62c6e6528c00: 2915 tokens, checkpoints: 1, 481.496 MiB
28.48.767.150 I srv update: - prompt 0x62c6e646bb10: 2309 tokens, checkpoints: 1, 443.609 MiB
28.48.767.150 I srv update: - prompt 0x62c6df116c40: 1935 tokens, checkpoints: 1, 420.227 MiB
28.48.767.151 I srv update: - prompt 0x62c6e6545c90: 1353 tokens, checkpoints: 1, 383.841 MiB
28.48.767.152 I srv get_availabl: prompt cache update took 232.81 ms
28.48.767.224 I slot launch_slot_: id 3 | task 31425 | processing task, is_child = 0
28.48.767.225 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
28.48.767.226 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
28.48.767.239 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
28.48.767.240 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
28.48.767.259 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
28.48.767.260 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
28.48.767.287 I slot update_slots: id 3 | task 31425 | Checking checkpoint with [70, 70] against 74...
28.48.803.028 W slot update_slots: id 3 | task 31425 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
28.54.496.122 I slot print_timing: id 3 | task 31425 | n_decoded = 100, tg = 18.72 t/s, tg_3s = 18.72 t/s
28.57.512.632 I slot print_timing: id 3 | task 31425 | n_decoded = 156, tg = 18.67 t/s, tg_3s = 18.56 t/s
29.00.543.562 I slot print_timing: id 3 | task 31425 | n_decoded = 212, tg = 18.62 t/s, tg_3s = 18.48 t/s
29.03.566.676 I slot print_timing: id 3 | task 31425 | n_decoded = 268, tg = 18.60 t/s, tg_3s = 18.52 t/s
29.06.588.399 I slot print_timing: id 3 | task 31425 | n_decoded = 324, tg = 18.59 t/s, tg_3s = 18.53 t/s
29.09.612.633 I slot print_timing: id 3 | task 31425 | n_decoded = 380, tg = 18.58 t/s, tg_3s = 18.52 t/s
29.12.649.792 I slot print_timing: id 3 | task 31425 | n_decoded = 436, tg = 18.56 t/s, tg_3s = 18.44 t/s
29.15.677.661 I slot print_timing: id 3 | task 31425 | n_decoded = 492, tg = 18.55 t/s, tg_3s = 18.49 t/s
29.18.705.743 I slot print_timing: id 3 | task 31425 | n_decoded = 548, tg = 18.54 t/s, tg_3s = 18.49 t/s
29.21.731.871 I slot print_timing: id 3 | task 31425 | n_decoded = 604, tg = 18.54 t/s, tg_3s = 18.51 t/s
29.24.756.898 I slot print_timing: id 3 | task 31425 | n_decoded = 660, tg = 18.54 t/s, tg_3s = 18.51 t/s
29.27.795.779 I slot print_timing: id 3 | task 31425 | n_decoded = 716, tg = 18.53 t/s, tg_3s = 18.43 t/s
29.30.826.837 I slot print_timing: id 3 | task 31425 | n_decoded = 772, tg = 18.53 t/s, tg_3s = 18.48 t/s
29.33.862.050 I slot print_timing: id 3 | task 31425 | n_decoded = 828, tg = 18.52 t/s, tg_3s = 18.45 t/s
29.36.887.858 I slot print_timing: id 3 | task 31425 | n_decoded = 884, tg = 18.52 t/s, tg_3s = 18.51 t/s
29.39.929.790 I slot print_timing: id 3 | task 31425 | n_decoded = 940, tg = 18.51 t/s, tg_3s = 18.41 t/s
29.42.955.617 I slot print_timing: id 3 | task 31425 | n_decoded = 996, tg = 18.51 t/s, tg_3s = 18.51 t/s
29.45.980.947 I slot print_timing: id 3 | task 31425 | n_decoded = 1052, tg = 18.51 t/s, tg_3s = 18.51 t/s
29.49.006.776 I slot print_timing: id 3 | task 31425 | n_decoded = 1108, tg = 18.51 t/s, tg_3s = 18.51 t/s
29.52.030.844 I slot print_timing: id 3 | task 31425 | n_decoded = 1164, tg = 18.51 t/s, tg_3s = 18.52 t/s
29.55.073.496 I slot print_timing: id 3 | task 31425 | n_decoded = 1220, tg = 18.51 t/s, tg_3s = 18.41 t/s
29.58.111.988 I slot print_timing: id 3 | task 31425 | n_decoded = 1276, tg = 18.50 t/s, tg_3s = 18.43 t/s
30.01.148.374 I slot print_timing: id 3 | task 31425 | n_decoded = 1332, tg = 18.50 t/s, tg_3s = 18.44 t/s
30.04.192.791 I slot print_timing: id 3 | task 31425 | n_decoded = 1388, tg = 18.50 t/s, tg_3s = 18.39 t/s
30.07.246.661 I slot print_timing: id 3 | task 31425 | n_decoded = 1444, tg = 18.49 t/s, tg_3s = 18.34 t/s
30.10.297.071 I slot print_timing: id 3 | task 31425 | n_decoded = 1500, tg = 18.49 t/s, tg_3s = 18.36 t/s
30.13.345.284 I slot print_timing: id 3 | task 31425 | n_decoded = 1556, tg = 18.48 t/s, tg_3s = 18.37 t/s
30.16.393.303 I slot print_timing: id 3 | task 31425 | n_decoded = 1612, tg = 18.48 t/s, tg_3s = 18.37 t/s
30.19.444.153 I slot print_timing: id 3 | task 31425 | n_decoded = 1668, tg = 18.47 t/s, tg_3s = 18.36 t/s
30.22.453.140 I slot print_timing: id 3 | task 31425 | n_decoded = 1723, tg = 18.47 t/s, tg_3s = 18.28 t/s
30.24.088.350 I slot print_timing: id 3 | task 31425 | prompt eval time = 387.95 ms / 26 tokens ( 14.92 ms per token, 67.02 tokens per second)
30.24.088.353 I slot print_timing: id 3 | task 31425 | eval time = 94933.11 ms / 1753 tokens ( 54.15 ms per token, 18.47 tokens per second)
30.24.088.354 I slot print_timing: id 3 | task 31425 | total time = 95321.06 ms / 1779 tokens
30.24.088.355 I slot print_timing: id 3 | task 31425 | graphs reused = 32977
30.24.088.395 I slot release: id 3 | task 31425 | stop processing: n_tokens = 1849, truncated = 0
30.24.088.409 I srv update_slots: all slots are idle
30.24.104.629 I srv operator(): Chat format: peg-native
30.24.104.933 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.627 (> 0.100 thold), f_keep = 0.040
30.24.104.935 I srv get_availabl: updating prompt cache
30.24.105.010 W srv prompt_save: - saving prompt with length 1849, total state size = 265.224 MiB (draft: 0.000 MiB)
30.24.358.697 I srv load: - looking for better prompt, base f_keep = 0.040, sim = 0.627
30.24.358.712 I srv update: - cache state: 19 prompts, 7887.909 MiB (limits: 8192.000 MiB, 16384 tokens, 36580 est)
30.24.358.713 I srv update: - prompt 0x62c6debdc1a0: 2540 tokens, checkpoints: 1, 458.051 MiB
30.24.358.714 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
30.24.358.715 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
30.24.358.716 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
30.24.358.716 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
30.24.358.717 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
30.24.358.718 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
30.24.358.718 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
30.24.358.719 I srv update: - prompt 0x62c6df012e70: 2241 tokens, checkpoints: 1, 439.358 MiB
30.24.358.720 I srv update: - prompt 0x62c6df06adb0: 1229 tokens, checkpoints: 1, 376.089 MiB
30.24.358.720 I srv update: - prompt 0x62c6e65c2b80: 3044 tokens, checkpoints: 1, 489.561 MiB
30.24.358.721 I srv update: - prompt 0x62c6df0c8650: 1134 tokens, checkpoints: 1, 370.149 MiB
30.24.358.722 I srv update: - prompt 0x62c6df0ce030: 1217 tokens, checkpoints: 1, 375.338 MiB
30.24.358.722 I srv update: - prompt 0x62c6deff7270: 1683 tokens, checkpoints: 1, 404.472 MiB
30.24.358.723 I srv update: - prompt 0x62c6e6528c00: 2915 tokens, checkpoints: 1, 481.496 MiB
30.24.358.723 I srv update: - prompt 0x62c6e646bb10: 2309 tokens, checkpoints: 1, 443.609 MiB
30.24.358.724 I srv update: - prompt 0x62c6df116c40: 1935 tokens, checkpoints: 1, 420.227 MiB
30.24.358.725 I srv update: - prompt 0x62c6e6545c90: 1353 tokens, checkpoints: 1, 383.841 MiB
30.24.358.725 I srv update: - prompt 0x62c6e65a0ae0: 1849 tokens, checkpoints: 1, 414.850 MiB
30.24.358.726 I srv get_availabl: prompt cache update took 253.79 ms
30.24.358.807 I slot launch_slot_: id 3 | task 33180 | processing task, is_child = 0
30.24.358.808 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
30.24.358.809 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
30.24.358.825 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
30.24.358.825 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
30.24.358.836 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
30.24.358.837 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
30.24.358.856 I slot update_slots: id 3 | task 33180 | Checking checkpoint with [70, 70] against 74...
30.24.393.880 W slot update_slots: id 3 | task 33180 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
30.30.141.614 I slot print_timing: id 3 | task 33180 | n_decoded = 100, tg = 18.68 t/s, tg_3s = 18.68 t/s
30.33.175.468 I slot print_timing: id 3 | task 33180 | n_decoded = 156, tg = 18.60 t/s, tg_3s = 18.46 t/s
30.36.198.479 I slot print_timing: id 3 | task 33180 | n_decoded = 212, tg = 18.58 t/s, tg_3s = 18.52 t/s
30.39.222.711 I slot print_timing: id 3 | task 33180 | n_decoded = 268, tg = 18.57 t/s, tg_3s = 18.52 t/s
30.42.247.628 I slot print_timing: id 3 | task 33180 | n_decoded = 324, tg = 18.56 t/s, tg_3s = 18.51 t/s
30.45.271.623 I slot print_timing: id 3 | task 33180 | n_decoded = 380, tg = 18.55 t/s, tg_3s = 18.52 t/s
30.48.308.653 I slot print_timing: id 3 | task 33180 | n_decoded = 436, tg = 18.54 t/s, tg_3s = 18.44 t/s
30.51.332.643 I slot print_timing: id 3 | task 33180 | n_decoded = 492, tg = 18.53 t/s, tg_3s = 18.52 t/s
30.54.356.775 I slot print_timing: id 3 | task 33180 | n_decoded = 548, tg = 18.53 t/s, tg_3s = 18.52 t/s
30.57.380.901 I slot print_timing: id 3 | task 33180 | n_decoded = 604, tg = 18.53 t/s, tg_3s = 18.52 t/s
31.00.418.646 I slot print_timing: id 3 | task 33180 | n_decoded = 660, tg = 18.52 t/s, tg_3s = 18.43 t/s
31.03.443.996 I slot print_timing: id 3 | task 33180 | n_decoded = 716, tg = 18.52 t/s, tg_3s = 18.51 t/s
31.06.472.020 I slot print_timing: id 3 | task 33180 | n_decoded = 772, tg = 18.52 t/s, tg_3s = 18.49 t/s
31.09.498.026 I slot print_timing: id 3 | task 33180 | n_decoded = 828, tg = 18.52 t/s, tg_3s = 18.51 t/s
31.12.531.114 I slot print_timing: id 3 | task 33180 | n_decoded = 884, tg = 18.52 t/s, tg_3s = 18.46 t/s
31.15.576.043 I slot print_timing: id 3 | task 33180 | n_decoded = 940, tg = 18.51 t/s, tg_3s = 18.39 t/s
31.18.611.073 I slot print_timing: id 3 | task 33180 | n_decoded = 996, tg = 18.50 t/s, tg_3s = 18.45 t/s
31.21.639.002 I slot print_timing: id 3 | task 33180 | n_decoded = 1052, tg = 18.50 t/s, tg_3s = 18.49 t/s
31.24.662.920 I slot print_timing: id 3 | task 33180 | n_decoded = 1108, tg = 18.51 t/s, tg_3s = 18.52 t/s
31.25.148.903 I slot print_timing: id 3 | task 33180 | prompt eval time = 428.76 ms / 47 tokens ( 9.12 ms per token, 109.62 tokens per second)
31.25.148.907 I slot print_timing: id 3 | task 33180 | eval time = 60361.28 ms / 1117 tokens ( 54.04 ms per token, 18.51 tokens per second)
31.25.148.908 I slot print_timing: id 3 | task 33180 | total time = 60790.04 ms / 1164 tokens
31.25.148.909 I slot print_timing: id 3 | task 33180 | graphs reused = 34088
31.25.148.950 I slot release: id 3 | task 33180 | stop processing: n_tokens = 1234, truncated = 0
31.25.148.962 I srv update_slots: all slots are idle
31.25.165.263 I srv operator(): Chat format: peg-native
31.25.165.562 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.705 (> 0.100 thold), f_keep = 0.060
31.25.165.565 I srv get_availabl: updating prompt cache
31.25.165.626 W srv prompt_save: - saving prompt with length 1234, total state size = 226.775 MiB (draft: 0.000 MiB)
31.25.402.531 I srv load: - looking for better prompt, base f_keep = 0.060, sim = 0.705
31.25.402.544 W srv update: - cache size limit reached, removing oldest entry (size = 458.051 MiB)
31.25.446.520 I srv update: - cache state: 19 prompts, 7806.259 MiB (limits: 8192.000 MiB, 16384 tokens, 35592 est)
31.25.446.525 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
31.25.446.525 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
31.25.446.526 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
31.25.446.526 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
31.25.446.527 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
31.25.446.527 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
31.25.446.528 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
31.25.446.529 I srv update: - prompt 0x62c6df012e70: 2241 tokens, checkpoints: 1, 439.358 MiB
31.25.446.529 I srv update: - prompt 0x62c6df06adb0: 1229 tokens, checkpoints: 1, 376.089 MiB
31.25.446.530 I srv update: - prompt 0x62c6e65c2b80: 3044 tokens, checkpoints: 1, 489.561 MiB
31.25.446.530 I srv update: - prompt 0x62c6df0c8650: 1134 tokens, checkpoints: 1, 370.149 MiB
31.25.446.531 I srv update: - prompt 0x62c6df0ce030: 1217 tokens, checkpoints: 1, 375.338 MiB
31.25.446.531 I srv update: - prompt 0x62c6deff7270: 1683 tokens, checkpoints: 1, 404.472 MiB
31.25.446.532 I srv update: - prompt 0x62c6e6528c00: 2915 tokens, checkpoints: 1, 481.496 MiB
31.25.446.532 I srv update: - prompt 0x62c6e646bb10: 2309 tokens, checkpoints: 1, 443.609 MiB
31.25.446.533 I srv update: - prompt 0x62c6df116c40: 1935 tokens, checkpoints: 1, 420.227 MiB
31.25.446.534 I srv update: - prompt 0x62c6e6545c90: 1353 tokens, checkpoints: 1, 383.841 MiB
31.25.446.534 I srv update: - prompt 0x62c6e65a0ae0: 1849 tokens, checkpoints: 1, 414.850 MiB
31.25.446.537 I srv update: - prompt 0x62c6dedae410: 1234 tokens, checkpoints: 1, 376.401 MiB
31.25.446.539 I srv get_availabl: prompt cache update took 280.97 ms
31.25.446.623 I slot launch_slot_: id 3 | task 34299 | processing task, is_child = 0
31.25.446.625 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
31.25.446.625 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
31.25.446.640 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
31.25.446.641 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
31.25.446.650 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
31.25.446.650 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
31.25.446.668 I slot update_slots: id 3 | task 34299 | Checking checkpoint with [70, 70] against 74...
31.25.484.429 W slot update_slots: id 3 | task 34299 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
31.31.233.646 I slot print_timing: id 3 | task 34299 | n_decoded = 100, tg = 18.68 t/s, tg_3s = 18.68 t/s
31.34.267.692 I slot print_timing: id 3 | task 34299 | n_decoded = 156, tg = 18.60 t/s, tg_3s = 18.46 t/s
31.37.291.702 I slot print_timing: id 3 | task 34299 | n_decoded = 212, tg = 18.58 t/s, tg_3s = 18.52 t/s
31.40.315.870 I slot print_timing: id 3 | task 34299 | n_decoded = 268, tg = 18.57 t/s, tg_3s = 18.52 t/s
31.43.338.823 I slot print_timing: id 3 | task 34299 | n_decoded = 324, tg = 18.56 t/s, tg_3s = 18.52 t/s
31.46.365.639 I slot print_timing: id 3 | task 34299 | n_decoded = 380, tg = 18.55 t/s, tg_3s = 18.50 t/s
31.49.400.830 I slot print_timing: id 3 | task 34299 | n_decoded = 436, tg = 18.54 t/s, tg_3s = 18.45 t/s
31.52.423.813 I slot print_timing: id 3 | task 34299 | n_decoded = 492, tg = 18.54 t/s, tg_3s = 18.52 t/s
31.55.449.180 I slot print_timing: id 3 | task 34299 | n_decoded = 548, tg = 18.53 t/s, tg_3s = 18.51 t/s
31.58.473.898 I slot print_timing: id 3 | task 34299 | n_decoded = 604, tg = 18.53 t/s, tg_3s = 18.51 t/s
32.01.501.088 I slot print_timing: id 3 | task 34299 | n_decoded = 660, tg = 18.53 t/s, tg_3s = 18.50 t/s
32.04.543.072 I slot print_timing: id 3 | task 34299 | n_decoded = 716, tg = 18.52 t/s, tg_3s = 18.41 t/s
32.07.577.980 I slot print_timing: id 3 | task 34299 | n_decoded = 772, tg = 18.51 t/s, tg_3s = 18.45 t/s
32.10.602.636 I slot print_timing: id 3 | task 34299 | n_decoded = 828, tg = 18.51 t/s, tg_3s = 18.51 t/s
32.13.628.631 I slot print_timing: id 3 | task 34299 | n_decoded = 884, tg = 18.51 t/s, tg_3s = 18.51 t/s
32.16.663.734 I slot print_timing: id 3 | task 34299 | n_decoded = 940, tg = 18.51 t/s, tg_3s = 18.45 t/s
32.19.687.800 I slot print_timing: id 3 | task 34299 | n_decoded = 996, tg = 18.51 t/s, tg_3s = 18.52 t/s
32.22.713.699 I slot print_timing: id 3 | task 34299 | n_decoded = 1052, tg = 18.51 t/s, tg_3s = 18.51 t/s
32.25.737.757 I slot print_timing: id 3 | task 34299 | n_decoded = 1108, tg = 18.51 t/s, tg_3s = 18.52 t/s
32.28.764.566 I slot print_timing: id 3 | task 34299 | n_decoded = 1164, tg = 18.51 t/s, tg_3s = 18.50 t/s
32.31.817.970 I slot print_timing: id 3 | task 34299 | n_decoded = 1220, tg = 18.50 t/s, tg_3s = 18.34 t/s
32.34.700.866 I slot print_timing: id 3 | task 34299 | prompt eval time = 434.74 ms / 34 tokens ( 12.79 ms per token, 78.21 tokens per second)
32.34.700.870 I slot print_timing: id 3 | task 34299 | eval time = 68819.46 ms / 1273 tokens ( 54.06 ms per token, 18.50 tokens per second)
32.34.700.871 I slot print_timing: id 3 | task 34299 | total time = 69254.19 ms / 1307 tokens
32.34.700.871 I slot print_timing: id 3 | task 34299 | graphs reused = 35354
32.34.700.905 I slot release: id 3 | task 34299 | stop processing: n_tokens = 1377, truncated = 0
32.34.700.918 I srv update_slots: all slots are idle
32.34.716.870 I srv operator(): Chat format: peg-native
32.34.717.161 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.661 (> 0.100 thold), f_keep = 0.054
32.34.717.163 I srv get_availabl: updating prompt cache
32.34.717.221 W srv prompt_save: - saving prompt with length 1377, total state size = 235.715 MiB (draft: 0.000 MiB)
32.35.015.753 I srv load: - looking for better prompt, base f_keep = 0.054, sim = 0.661
32.35.015.768 I srv update: - cache state: 20 prompts, 8191.601 MiB (limits: 8192.000 MiB, 16384 tokens, 35295 est)
32.35.015.771 I srv update: - prompt 0x62c6e65c09d0: 1634 tokens, checkpoints: 1, 401.409 MiB
32.35.015.772 I srv update: - prompt 0x62c6df01e060: 1331 tokens, checkpoints: 1, 382.466 MiB
32.35.015.772 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
32.35.015.773 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
32.35.015.773 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
32.35.015.776 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
32.35.015.777 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
32.35.015.777 I srv update: - prompt 0x62c6df012e70: 2241 tokens, checkpoints: 1, 439.358 MiB
32.35.015.778 I srv update: - prompt 0x62c6df06adb0: 1229 tokens, checkpoints: 1, 376.089 MiB
32.35.015.779 I srv update: - prompt 0x62c6e65c2b80: 3044 tokens, checkpoints: 1, 489.561 MiB
32.35.015.782 I srv update: - prompt 0x62c6df0c8650: 1134 tokens, checkpoints: 1, 370.149 MiB
32.35.015.782 I srv update: - prompt 0x62c6df0ce030: 1217 tokens, checkpoints: 1, 375.338 MiB
32.35.015.783 I srv update: - prompt 0x62c6deff7270: 1683 tokens, checkpoints: 1, 404.472 MiB
32.35.015.783 I srv update: - prompt 0x62c6e6528c00: 2915 tokens, checkpoints: 1, 481.496 MiB
32.35.015.784 I srv update: - prompt 0x62c6e646bb10: 2309 tokens, checkpoints: 1, 443.609 MiB
32.35.015.785 I srv update: - prompt 0x62c6df116c40: 1935 tokens, checkpoints: 1, 420.227 MiB
32.35.015.786 I srv update: - prompt 0x62c6e6545c90: 1353 tokens, checkpoints: 1, 383.841 MiB
32.35.015.787 I srv update: - prompt 0x62c6e65a0ae0: 1849 tokens, checkpoints: 1, 414.850 MiB
32.35.015.787 I srv update: - prompt 0x62c6dedae410: 1234 tokens, checkpoints: 1, 376.401 MiB
32.35.015.788 I srv update: - prompt 0x62c6debdc1a0: 1377 tokens, checkpoints: 1, 385.341 MiB
32.35.015.789 I srv get_availabl: prompt cache update took 298.63 ms
32.35.015.880 I slot launch_slot_: id 3 | task 35574 | processing task, is_child = 0
32.35.015.880 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
32.35.015.881 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
32.35.015.899 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
32.35.015.900 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
32.35.015.924 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
32.35.015.924 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
32.35.015.946 I slot update_slots: id 3 | task 35574 | Checking checkpoint with [70, 70] against 74...
32.35.051.411 W slot update_slots: id 3 | task 35574 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
32.40.836.624 I slot print_timing: id 3 | task 35574 | n_decoded = 100, tg = 18.67 t/s, tg_3s = 18.67 t/s
32.43.871.990 I slot print_timing: id 3 | task 35574 | n_decoded = 156, tg = 18.59 t/s, tg_3s = 18.45 t/s
32.46.904.670 I slot print_timing: id 3 | task 35574 | n_decoded = 212, tg = 18.56 t/s, tg_3s = 18.47 t/s
32.49.931.962 I slot print_timing: id 3 | task 35574 | n_decoded = 268, tg = 18.54 t/s, tg_3s = 18.50 t/s
32.52.959.718 I slot print_timing: id 3 | task 35574 | n_decoded = 324, tg = 18.54 t/s, tg_3s = 18.50 t/s
32.55.990.371 I slot print_timing: id 3 | task 35574 | n_decoded = 380, tg = 18.53 t/s, tg_3s = 18.48 t/s
32.59.035.044 I slot print_timing: id 3 | task 35574 | n_decoded = 436, tg = 18.51 t/s, tg_3s = 18.39 t/s
33.02.068.679 I slot print_timing: id 3 | task 35574 | n_decoded = 492, tg = 18.50 t/s, tg_3s = 18.46 t/s
33.05.095.754 I slot print_timing: id 3 | task 35574 | n_decoded = 548, tg = 18.50 t/s, tg_3s = 18.50 t/s
33.08.119.794 I slot print_timing: id 3 | task 35574 | n_decoded = 604, tg = 18.50 t/s, tg_3s = 18.52 t/s
33.11.156.209 I slot print_timing: id 3 | task 35574 | n_decoded = 660, tg = 18.50 t/s, tg_3s = 18.44 t/s
33.14.181.805 I slot print_timing: id 3 | task 35574 | n_decoded = 716, tg = 18.50 t/s, tg_3s = 18.51 t/s
33.17.207.781 I slot print_timing: id 3 | task 35574 | n_decoded = 772, tg = 18.50 t/s, tg_3s = 18.51 t/s
33.20.234.832 I slot print_timing: id 3 | task 35574 | n_decoded = 828, tg = 18.50 t/s, tg_3s = 18.50 t/s
33.23.258.949 I slot print_timing: id 3 | task 35574 | n_decoded = 884, tg = 18.50 t/s, tg_3s = 18.52 t/s
33.26.299.098 I slot print_timing: id 3 | task 35574 | n_decoded = 940, tg = 18.50 t/s, tg_3s = 18.42 t/s
33.29.326.992 I slot print_timing: id 3 | task 35574 | n_decoded = 996, tg = 18.50 t/s, tg_3s = 18.49 t/s
33.32.354.032 I slot print_timing: id 3 | task 35574 | n_decoded = 1052, tg = 18.50 t/s, tg_3s = 18.50 t/s
33.35.387.172 I slot print_timing: id 3 | task 35574 | n_decoded = 1108, tg = 18.50 t/s, tg_3s = 18.46 t/s
33.38.419.224 I slot print_timing: id 3 | task 35574 | n_decoded = 1164, tg = 18.49 t/s, tg_3s = 18.47 t/s
33.41.419.245 I slot print_timing: id 3 | task 35574 | n_decoded = 1219, tg = 18.49 t/s, tg_3s = 18.33 t/s
33.44.466.307 I slot print_timing: id 3 | task 35574 | n_decoded = 1275, tg = 18.48 t/s, tg_3s = 18.38 t/s
33.47.514.703 I slot print_timing: id 3 | task 35574 | n_decoded = 1331, tg = 18.48 t/s, tg_3s = 18.37 t/s
33.50.548.104 I slot print_timing: id 3 | task 35574 | n_decoded = 1387, tg = 18.48 t/s, tg_3s = 18.46 t/s
33.53.590.745 I slot print_timing: id 3 | task 35574 | n_decoded = 1443, tg = 18.47 t/s, tg_3s = 18.41 t/s
33.56.628.172 I slot print_timing: id 3 | task 35574 | n_decoded = 1499, tg = 18.47 t/s, tg_3s = 18.44 t/s
33.59.672.094 I slot print_timing: id 3 | task 35574 | n_decoded = 1555, tg = 18.47 t/s, tg_3s = 18.40 t/s
34.02.715.988 I slot print_timing: id 3 | task 35574 | n_decoded = 1611, tg = 18.47 t/s, tg_3s = 18.40 t/s
34.05.435.093 I slot print_timing: id 3 | task 35574 | prompt eval time = 463.68 ms / 41 tokens ( 11.31 ms per token, 88.42 tokens per second)
34.05.435.096 I slot print_timing: id 3 | task 35574 | eval time = 89955.46 ms / 1661 tokens ( 54.16 ms per token, 18.46 tokens per second)
34.05.435.097 I slot print_timing: id 3 | task 35574 | total time = 90419.14 ms / 1702 tokens
34.05.435.098 I slot print_timing: id 3 | task 35574 | graphs reused = 37007
34.05.435.132 I slot release: id 3 | task 35574 | stop processing: n_tokens = 1772, truncated = 0
34.05.435.145 I srv update_slots: all slots are idle
34.05.450.960 I srv operator(): Chat format: peg-native
34.05.451.262 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.617 (> 0.100 thold), f_keep = 0.042
34.05.451.264 I srv get_availabl: updating prompt cache
34.05.451.346 W srv prompt_save: - saving prompt with length 1772, total state size = 260.410 MiB (draft: 0.000 MiB)
34.05.713.322 I srv load: - looking for better prompt, base f_keep = 0.042, sim = 0.617
34.05.713.337 W srv update: - cache size limit reached, removing oldest entry (size = 401.409 MiB)
34.05.753.620 W srv update: - cache size limit reached, removing oldest entry (size = 382.466 MiB)
34.05.790.574 I srv update: - cache state: 19 prompts, 7817.763 MiB (limits: 8192.000 MiB, 16384 tokens, 35733 est)
34.05.790.579 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
34.05.790.579 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
34.05.790.580 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
34.05.790.580 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
34.05.790.581 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
34.05.790.582 I srv update: - prompt 0x62c6df012e70: 2241 tokens, checkpoints: 1, 439.358 MiB
34.05.790.582 I srv update: - prompt 0x62c6df06adb0: 1229 tokens, checkpoints: 1, 376.089 MiB
34.05.790.583 I srv update: - prompt 0x62c6e65c2b80: 3044 tokens, checkpoints: 1, 489.561 MiB
34.05.790.583 I srv update: - prompt 0x62c6df0c8650: 1134 tokens, checkpoints: 1, 370.149 MiB
34.05.790.584 I srv update: - prompt 0x62c6df0ce030: 1217 tokens, checkpoints: 1, 375.338 MiB
34.05.790.584 I srv update: - prompt 0x62c6deff7270: 1683 tokens, checkpoints: 1, 404.472 MiB
34.05.790.585 I srv update: - prompt 0x62c6e6528c00: 2915 tokens, checkpoints: 1, 481.496 MiB
34.05.790.585 I srv update: - prompt 0x62c6e646bb10: 2309 tokens, checkpoints: 1, 443.609 MiB
34.05.790.586 I srv update: - prompt 0x62c6df116c40: 1935 tokens, checkpoints: 1, 420.227 MiB
34.05.790.586 I srv update: - prompt 0x62c6e6545c90: 1353 tokens, checkpoints: 1, 383.841 MiB
34.05.790.587 I srv update: - prompt 0x62c6e65a0ae0: 1849 tokens, checkpoints: 1, 414.850 MiB
34.05.790.587 I srv update: - prompt 0x62c6dedae410: 1234 tokens, checkpoints: 1, 376.401 MiB
34.05.790.588 I srv update: - prompt 0x62c6debdc1a0: 1377 tokens, checkpoints: 1, 385.341 MiB
34.05.790.589 I srv update: - prompt 0x62c6e64682a0: 1772 tokens, checkpoints: 1, 410.036 MiB
34.05.790.591 I srv get_availabl: prompt cache update took 339.33 ms
34.05.790.689 I slot launch_slot_: id 3 | task 37237 | processing task, is_child = 0
34.05.790.690 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
34.05.790.691 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
34.05.790.713 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
34.05.790.713 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
34.05.790.726 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
34.05.790.726 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
34.05.790.760 I slot update_slots: id 3 | task 37237 | Checking checkpoint with [70, 70] against 74...
34.05.827.219 W slot update_slots: id 3 | task 37237 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
34.11.574.591 I slot print_timing: id 3 | task 37237 | n_decoded = 100, tg = 18.68 t/s, tg_3s = 18.68 t/s
34.14.607.584 I slot print_timing: id 3 | task 37237 | n_decoded = 156, tg = 18.60 t/s, tg_3s = 18.46 t/s
34.17.631.061 I slot print_timing: id 3 | task 37237 | n_decoded = 212, tg = 18.58 t/s, tg_3s = 18.52 t/s
34.20.656.820 I slot print_timing: id 3 | task 37237 | n_decoded = 268, tg = 18.57 t/s, tg_3s = 18.51 t/s
34.23.681.880 I slot print_timing: id 3 | task 37237 | n_decoded = 324, tg = 18.56 t/s, tg_3s = 18.51 t/s
34.26.710.957 I slot print_timing: id 3 | task 37237 | n_decoded = 380, tg = 18.55 t/s, tg_3s = 18.49 t/s
34.29.756.887 I slot print_timing: id 3 | task 37237 | n_decoded = 436, tg = 18.53 t/s, tg_3s = 18.39 t/s
34.32.790.405 I slot print_timing: id 3 | task 37237 | n_decoded = 492, tg = 18.52 t/s, tg_3s = 18.46 t/s
34.35.825.952 I slot print_timing: id 3 | task 37237 | n_decoded = 548, tg = 18.51 t/s, tg_3s = 18.45 t/s
34.38.866.440 I slot print_timing: id 3 | task 37237 | n_decoded = 604, tg = 18.50 t/s, tg_3s = 18.42 t/s
34.41.914.788 I slot print_timing: id 3 | task 37237 | n_decoded = 660, tg = 18.49 t/s, tg_3s = 18.37 t/s
34.44.938.487 I slot print_timing: id 3 | task 37237 | n_decoded = 716, tg = 18.49 t/s, tg_3s = 18.52 t/s
34.47.962.591 I slot print_timing: id 3 | task 37237 | n_decoded = 772, tg = 18.50 t/s, tg_3s = 18.52 t/s
34.50.988.963 I slot print_timing: id 3 | task 37237 | n_decoded = 828, tg = 18.50 t/s, tg_3s = 18.50 t/s
34.54.013.172 I slot print_timing: id 3 | task 37237 | n_decoded = 884, tg = 18.50 t/s, tg_3s = 18.52 t/s
34.56.130.534 I slot print_timing: id 3 | task 37237 | prompt eval time = 431.89 ms / 49 tokens ( 8.81 ms per token, 113.45 tokens per second)
34.56.130.538 I slot print_timing: id 3 | task 37237 | eval time = 49907.88 ms / 923 tokens ( 54.07 ms per token, 18.49 tokens per second)
34.56.130.538 I slot print_timing: id 3 | task 37237 | total time = 50339.77 ms / 972 tokens
34.56.130.539 I slot print_timing: id 3 | task 37237 | graphs reused = 37924
34.56.130.577 I slot release: id 3 | task 37237 | stop processing: n_tokens = 1042, truncated = 0
34.56.130.592 I srv update_slots: all slots are idle
34.56.146.573 I srv operator(): Chat format: peg-native
34.56.146.882 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.712 (> 0.100 thold), f_keep = 0.071
34.56.146.884 I srv get_availabl: updating prompt cache
34.56.146.941 W srv prompt_save: - saving prompt with length 1042, total state size = 214.771 MiB (draft: 0.000 MiB)
34.56.415.535 I srv load: - looking for better prompt, base f_keep = 0.071, sim = 0.712
34.56.415.549 I srv update: - cache state: 20 prompts, 8182.160 MiB (limits: 8192.000 MiB, 16384 tokens, 35185 est)
34.56.415.549 I srv update: - prompt 0x62c6deec0e30: 1771 tokens, checkpoints: 1, 409.974 MiB
34.56.415.550 I srv update: - prompt 0x62c6df1d2df0: 3004 tokens, checkpoints: 1, 487.060 MiB
34.56.415.551 I srv update: - prompt 0x62c6e6546e90: 1482 tokens, checkpoints: 1, 391.906 MiB
34.56.415.551 I srv update: - prompt 0x62c6e652c410: 1326 tokens, checkpoints: 1, 382.153 MiB
34.56.415.552 I srv update: - prompt 0x62c6df02aa40: 1226 tokens, checkpoints: 1, 375.901 MiB
34.56.415.552 I srv update: - prompt 0x62c6df012e70: 2241 tokens, checkpoints: 1, 439.358 MiB
34.56.415.553 I srv update: - prompt 0x62c6df06adb0: 1229 tokens, checkpoints: 1, 376.089 MiB
34.56.415.553 I srv update: - prompt 0x62c6e65c2b80: 3044 tokens, checkpoints: 1, 489.561 MiB
34.56.415.554 I srv update: - prompt 0x62c6df0c8650: 1134 tokens, checkpoints: 1, 370.149 MiB
34.56.415.554 I srv update: - prompt 0x62c6df0ce030: 1217 tokens, checkpoints: 1, 375.338 MiB
34.56.415.555 I srv update: - prompt 0x62c6deff7270: 1683 tokens, checkpoints: 1, 404.472 MiB
34.56.415.555 I srv update: - prompt 0x62c6e6528c00: 2915 tokens, checkpoints: 1, 481.496 MiB
34.56.415.556 I srv update: - prompt 0x62c6e646bb10: 2309 tokens, checkpoints: 1, 443.609 MiB
34.56.415.557 I srv update: - prompt 0x62c6df116c40: 1935 tokens, checkpoints: 1, 420.227 MiB
34.56.415.557 I srv update: - prompt 0x62c6e6545c90: 1353 tokens, checkpoints: 1, 383.841 MiB
34.56.415.558 I srv update: - prompt 0x62c6e65a0ae0: 1849 tokens, checkpoints: 1, 414.850 MiB
34.56.415.558 I srv update: - prompt 0x62c6dedae410: 1234 tokens, checkpoints: 1, 376.401 MiB
34.56.415.559 I srv update: - prompt 0x62c6debdc1a0: 1377 tokens, checkpoints: 1, 385.341 MiB
34.56.415.559 I srv update: - prompt 0x62c6e64682a0: 1772 tokens, checkpoints: 1, 410.036 MiB
34.56.415.560 I srv update: - prompt 0x62c6e64722c0: 1042 tokens, checkpoints: 1, 364.398 MiB
34.56.415.561 I srv get_availabl: prompt cache update took 268.68 ms
34.56.415.642 I slot launch_slot_: id 3 | task 38162 | processing task, is_child = 0
34.56.415.643 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
34.56.415.644 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
34.56.415.658 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
34.56.415.658 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
34.56.415.667 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
34.56.415.667 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
34.56.415.683 I slot update_slots: id 3 | task 38162 | Checking checkpoint with [70, 70] against 74...
34.56.450.968 W slot update_slots: id 3 | task 38162 | restored context checkpoint (pos_min = 70, pos_max = 70, n_tokens = 71, n_past = 71, size = 149.626 MiB)
35.02.201.774 I slot print_timing: id 3 | task 38162 | n_decoded = 100, tg = 18.68 t/s, tg_3s = 18.68 t/s
35.05.235.880 I slot print_timing: id 3 | task 38162 | n_decoded = 156, tg = 18.60 t/s, tg_3s = 18.46 t/s
35.08.261.923 I slot print_timing: id 3 | task 38162 | n_decoded = 212, tg = 18.57 t/s, tg_3s = 18.51 t/s
35.11.287.973 I slot print_timing: id 3 | task 38162 | n_decoded = 268, tg = 18.56 t/s, tg_3s = 18.51 t/s
35.14.312.924 I slot print_timing: id 3 | task 38162 | n_decoded = 324, tg = 18.55 t/s, tg_3s = 18.51 t/s
35.17.340.238 I slot print_timing: id 3 | task 38162 | n_decoded = 380, tg = 18.54 t/s, tg_3s = 18.50 t/s
35.20.379.993 I slot print_timing: id 3 | task 38162 | n_decoded = 436, tg = 18.53 t/s, tg_3s = 18.42 t/s
35.23.409.104 I slot print_timing: id 3 | task 38162 | n_decoded = 492, tg = 18.52 t/s, tg_3s = 18.49 t/s
35.26.439.917 I slot print_timing: id 3 | task 38162 | n_decoded = 548, tg = 18.52 t/s, tg_3s = 18.48 t/s
35.29.462.384 I slot print_timing: id 3 | task 38162 | n_decoded = 604, tg = 18.52 t/s, tg_3s = 18.53 t/s
35.32.481.290 I slot print_timing: id 3 | task 38162 | n_decoded = 660, tg = 18.52 t/s, tg_3s = 18.55 t/s
35.35.514.392 I slot print_timing: id 3 | task 38162 | n_decoded = 716, tg = 18.52 t/s, tg_3s = 18.46 t/s
35.38.540.592 I slot print_timing: id 3 | task 38162 | n_decoded = 772, tg = 18.52 t/s, tg_3s = 18.51 t/s
35.41.564.522 I slot print_timing: id 3 | task 38162 | n_decoded = 828, tg = 18.52 t/s, tg_3s = 18.52 t/s
35.44.593.451 I slot print_timing: id 3 | task 38162 | n_decoded = 884, tg = 18.51 t/s, tg_3s = 18.49 t/s
35.47.631.824 I slot print_timing: id 3 | task 38162 | n_decoded = 940, tg = 18.51 t/s, tg_3s = 18.43 t/s
35.50.663.272 I slot print_timing: id 3 | task 38162 | n_decoded = 996, tg = 18.51 t/s, tg_3s = 18.47 t/s
35.53.695.540 I slot print_timing: id 3 | task 38162 | n_decoded = 1052, tg = 18.51 t/s, tg_3s = 18.47 t/s
35.56.734.883 I slot print_timing: id 3 | task 38162 | n_decoded = 1108, tg = 18.50 t/s, tg_3s = 18.43 t/s
35.59.770.519 I slot print_timing: id 3 | task 38162 | n_decoded = 1164, tg = 18.50 t/s, tg_3s = 18.45 t/s
36.02.772.720 I slot print_timing: id 3 | task 38162 | n_decoded = 1219, tg = 18.49 t/s, tg_3s = 18.32 t/s
36.05.826.653 I slot print_timing: id 3 | task 38162 | n_decoded = 1275, tg = 18.48 t/s, tg_3s = 18.34 t/s
36.08.877.688 I slot print_timing: id 3 | task 38162 | n_decoded = 1331, tg = 18.48 t/s, tg_3s = 18.35 t/s
36.11.878.903 I slot print_timing: id 3 | task 38162 | n_decoded = 1386, tg = 18.47 t/s, tg_3s = 18.33 t/s
36.14.890.900 I slot print_timing: id 3 | task 38162 | n_decoded = 1441, tg = 18.46 t/s, tg_3s = 18.26 t/s
36.17.894.078 I slot print_timing: id 3 | task 38162 | n_decoded = 1496, tg = 18.46 t/s, tg_3s = 18.31 t/s
36.20.898.514 I slot print_timing: id 3 | task 38162 | n_decoded = 1551, tg = 18.45 t/s, tg_3s = 18.31 t/s
36.23.943.894 I slot print_timing: id 3 | task 38162 | n_decoded = 1607, tg = 18.45 t/s, tg_3s = 18.39 t/s
36.26.988.932 I slot print_timing: id 3 | task 38162 | n_decoded = 1663, tg = 18.45 t/s, tg_3s = 18.39 t/s
36.30.041.890 I slot print_timing: id 3 | task 38162 | n_decoded = 1719, tg = 18.45 t/s, tg_3s = 18.34 t/s
36.33.088.859 I slot print_timing: id 3 | task 38162 | n_decoded = 1775, tg = 18.44 t/s, tg_3s = 18.38 t/s
36.36.134.707 I slot print_timing: id 3 | task 38162 | n_decoded = 1831, tg = 18.44 t/s, tg_3s = 18.39 t/s
36.38.531.871 I slot print_timing: id 3 | task 38162 | prompt eval time = 431.38 ms / 33 tokens ( 13.07 ms per token, 76.50 tokens per second)
36.38.531.877 I slot print_timing: id 3 | task 38162 | eval time = 101684.81 ms / 1875 tokens ( 54.23 ms per token, 18.44 tokens per second)
36.38.531.878 I slot print_timing: id 3 | task 38162 | total time = 102116.18 ms / 1908 tokens
36.38.531.878 I slot print_timing: id 3 | task 38162 | graphs reused = 39790
36.38.531.911 I slot release: id 3 | task 38162 | stop processing: n_tokens = 1978, truncated = 0
36.38.531.926 I srv update_slots: all slots are idle
36.38.532.596 I srv operator(): operator(): cleaning up before exit...
Reference in New Issue Copy Permalink