qoherent/experiments-07-07-12-local-llm-knowledge-2
23
0
Fork 0
Code Issues Pull Requests Workflows Packages Projects Releases Wiki Activity
Push Tracker
experiments-07-07-12-local-.../results/gemma4-31b.server.log

996 lines
95 KiB
Plaintext
Raw Permalink Normal View History

G
readme report
2026-07-12 21:35:10 -04:00
0.00.187.247 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg)
0.00.187.250 I device_info:
0.00.187.269 I - ROCm0 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.187.273 I - ROCm1 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.187.280 I - CPU : AMD Ryzen 9 3900X 12-Core Processor (128730 MiB, 128730 MiB free)
0.00.187.338 I system_info: n_threads = 12 (n_threads_batch = 12) / 24 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 |
0.00.187.341 I srv llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true
0.00.187.552 I srv init: running without SSL
0.00.187.615 I srv init: using 23 threads for HTTP server
0.00.188.047 I srv start: binding port with default address family
0.00.189.247 I srv llama_server: loading model
0.00.189.257 I srv load_model: loading model '/home/qrf/.cache/llama.cpp/google_gemma-4-31B-it-Q4_K_M.gguf'
0.00.189.301 I common_init_result: fitting params to device memory ...
0.00.189.307 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on)
0.02.011.925 W load: control-looking token: 212 '</s>' was not control-type; this is probably a bug in the model. its type will be overridden
0.02.012.425 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden
0.02.037.907 W load: special_eog_ids contains '<|tool_response>', removing '</s>' token from EOG list
0.11.943.805 W llama_context: n_ctx_seq (8192) < n_ctx_train (262144) -- the full capacity of the model will not be utilized
0.12.046.226 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
0.12.246.303 I srv load_model: initializing slots, n_slots = 4
0.12.363.165 W common_speculative_init: no implementations specified for speculative decoding
0.12.363.169 I slot load_model: id 0 | task -1 | new slot, n_ctx = 8192
0.12.363.174 I slot load_model: id 1 | task -1 | new slot, n_ctx = 8192
0.12.363.174 I slot load_model: id 2 | task -1 | new slot, n_ctx = 8192
0.12.363.175 I slot load_model: id 3 | task -1 | new slot, n_ctx = 8192
0.12.363.216 I srv load_model: prompt cache is enabled, size limit: 8192 MiB
0.12.363.216 I srv load_model: use `--cache-ram 0` to disable the prompt cache
0.12.363.217 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391
0.12.363.217 I srv load_model: context checkpoints enabled, max = 32, min spacing = 256
0.12.363.233 I srv init: idle slots will be saved to prompt cache and cleared upon starting a new task
0.12.371.387 I init: chat template, example_format: '<|turn>system
<|think|>
You are a helpful assistant<turn|>
<|turn>user
Hello<turn|>
<|turn>model
Hi there<turn|>
<|turn>user
How are you?<turn|>
<|turn>model
'
0.12.372.140 I srv init: init: chat template, thinking = 1
0.12.372.174 I srv llama_server: model loaded
0.12.372.177 I srv llama_server: server is listening on http://127.0.0.1:8090
0.12.372.182 I srv update_slots: all slots are idle
0.14.937.329 I srv operator(): Chat format: peg-gemma4
0.14.937.634 I slot get_availabl: id 3 | task -1 | selected slot by LRU, t_last = -1
0.14.937.636 I srv get_availabl: updating prompt cache
0.14.937.642 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000
0.14.937.647 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 8192 tokens, 8589934592 est)
0.14.937.647 I srv get_availabl: prompt cache update took 0.01 ms
0.14.937.691 I slot launch_slot_: id 3 | task 0 | processing task, is_child = 0
0.14.937.692 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.14.937.694 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.14.937.707 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.14.937.707 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.14.937.716 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.14.937.716 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.15.315.548 I slot create_check: id 3 | task 0 | created context checkpoint 1 of 32 (pos_min = 0, pos_max = 44, n_tokens = 45, size = 35.158 MiB)
0.18.888.039 I slot print_timing: id 3 | task 0 | prompt eval time = 755.51 ms / 73 tokens ( 10.35 ms per token, 96.62 tokens per second)
0.18.888.043 I slot print_timing: id 3 | task 0 | eval time = 3194.79 ms / 56 tokens ( 57.05 ms per token, 17.53 tokens per second)
0.18.888.043 I slot print_timing: id 3 | task 0 | total time = 3950.30 ms / 129 tokens
0.18.888.049 I slot print_timing: id 3 | task 0 | graphs reused = 55
0.18.888.095 I slot release: id 3 | task 0 | stop processing: n_tokens = 128, truncated = 0
0.18.888.100 I srv update_slots: all slots are idle
0.18.890.510 I srv operator(): Chat format: peg-gemma4
0.18.890.741 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.738 (> 0.100 thold), f_keep = 0.375
0.18.890.743 I srv get_availabl: updating prompt cache
0.18.890.774 W srv prompt_save: - saving prompt with length 128, total state size = 110.004 MiB (draft: 0.000 MiB)
0.18.991.002 I srv load: - looking for better prompt, base f_keep = 0.375, sim = 0.738
0.18.991.011 I srv update: - cache state: 1 prompts, 145.162 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
0.18.991.012 I srv update: - prompt 0x64c4217fcdf0: 128 tokens, checkpoints: 1, 145.162 MiB
0.18.991.013 I srv get_availabl: prompt cache update took 100.27 ms
0.18.991.107 I slot launch_slot_: id 3 | task 59 | processing task, is_child = 0
0.18.991.108 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.18.991.109 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.18.991.121 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.18.991.121 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.18.991.128 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.18.991.128 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.18.991.159 I slot update_slots: id 3 | task 59 | Checking checkpoint with [0, 44] against 0...
0.19.004.285 W slot update_slots: id 3 | task 59 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.20.707.063 I slot print_timing: id 3 | task 59 | prompt eval time = 318.87 ms / 21 tokens ( 15.18 ms per token, 65.86 tokens per second)
0.20.707.066 I slot print_timing: id 3 | task 59 | eval time = 1397.03 ms / 25 tokens ( 55.88 ms per token, 17.90 tokens per second)
0.20.707.067 I slot print_timing: id 3 | task 59 | total time = 1715.90 ms / 46 tokens
0.20.707.067 I slot print_timing: id 3 | task 59 | graphs reused = 78
0.20.707.097 I slot release: id 3 | task 59 | stop processing: n_tokens = 89, truncated = 0
0.20.707.104 I srv update_slots: all slots are idle
0.20.709.771 I srv operator(): Chat format: peg-gemma4
0.20.710.000 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.696 (> 0.100 thold), f_keep = 0.539
0.20.710.051 I slot launch_slot_: id 3 | task 87 | processing task, is_child = 0
0.20.710.053 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.20.710.053 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.20.710.066 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.20.710.066 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.20.710.083 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.20.710.083 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.20.710.098 I slot update_slots: id 3 | task 87 | Checking checkpoint with [0, 44] against 0...
0.20.723.269 W slot update_slots: id 3 | task 87 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.23.338.119 I slot print_timing: id 3 | task 87 | prompt eval time = 419.39 ms / 25 tokens ( 16.78 ms per token, 59.61 tokens per second)
0.23.338.122 I slot print_timing: id 3 | task 87 | eval time = 2208.62 ms / 39 tokens ( 56.63 ms per token, 17.66 tokens per second)
0.23.338.123 I slot print_timing: id 3 | task 87 | total time = 2628.01 ms / 64 tokens
0.23.338.124 I slot print_timing: id 3 | task 87 | graphs reused = 115
0.23.338.164 I slot release: id 3 | task 87 | stop processing: n_tokens = 107, truncated = 0
0.23.338.171 I srv update_slots: all slots are idle
0.23.340.388 I srv operator(): Chat format: peg-gemma4
0.23.340.621 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.721 (> 0.100 thold), f_keep = 0.458
0.23.340.623 I srv get_availabl: updating prompt cache
0.23.340.651 W srv prompt_save: - saving prompt with length 107, total state size = 91.957 MiB (draft: 0.000 MiB)
0.23.427.205 I srv load: - looking for better prompt, base f_keep = 0.458, sim = 0.721
0.23.427.214 I srv update: - cache state: 2 prompts, 272.277 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
0.23.427.215 I srv update: - prompt 0x64c4217fcdf0: 128 tokens, checkpoints: 1, 145.162 MiB
0.23.427.215 I srv update: - prompt 0x64c41d5b27f0: 107 tokens, checkpoints: 1, 127.115 MiB
0.23.427.217 I srv get_availabl: prompt cache update took 86.59 ms
0.23.427.320 I slot launch_slot_: id 3 | task 129 | processing task, is_child = 0
0.23.427.320 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.23.427.321 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.23.427.333 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.23.427.333 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.23.427.340 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.23.427.340 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.23.427.354 I slot update_slots: id 3 | task 129 | Checking checkpoint with [0, 44] against 0...
0.23.440.527 W slot update_slots: id 3 | task 129 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.27.102.204 I slot print_timing: id 3 | task 129 | prompt eval time = 419.10 ms / 24 tokens ( 17.46 ms per token, 57.27 tokens per second)
0.27.102.209 I slot print_timing: id 3 | task 129 | eval time = 3255.74 ms / 57 tokens ( 57.12 ms per token, 17.51 tokens per second)
0.27.102.209 I slot print_timing: id 3 | task 129 | total time = 3674.84 ms / 81 tokens
0.27.102.210 I slot print_timing: id 3 | task 129 | graphs reused = 170
0.27.102.240 I slot release: id 3 | task 129 | stop processing: n_tokens = 124, truncated = 0
0.27.102.248 I srv update_slots: all slots are idle
0.27.104.495 I srv operator(): Chat format: peg-gemma4
0.27.104.736 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.710 (> 0.100 thold), f_keep = 0.395
0.27.104.738 I srv get_availabl: updating prompt cache
0.27.104.767 W srv prompt_save: - saving prompt with length 124, total state size = 106.567 MiB (draft: 0.000 MiB)
0.27.202.179 I srv load: - looking for better prompt, base f_keep = 0.395, sim = 0.710
0.27.202.185 I srv load: - found better prompt with f_keep = 0.398, sim = 0.739
0.27.248.313 I srv update: - cache state: 2 prompts, 268.840 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
0.27.248.317 I srv update: - prompt 0x64c41d5b27f0: 107 tokens, checkpoints: 1, 127.115 MiB
0.27.248.318 I srv update: - prompt 0x64c421629450: 124 tokens, checkpoints: 1, 141.725 MiB
0.27.248.319 I srv get_availabl: prompt cache update took 143.58 ms
0.27.248.399 I slot launch_slot_: id 3 | task 189 | processing task, is_child = 0
0.27.248.400 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.27.248.401 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.27.248.415 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.27.248.416 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.27.248.432 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.27.248.432 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.27.248.456 I slot update_slots: id 3 | task 189 | Checking checkpoint with [0, 44] against 0...
0.27.261.776 W slot update_slots: id 3 | task 189 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.28.895.214 I slot print_timing: id 3 | task 189 | prompt eval time = 420.22 ms / 25 tokens ( 16.81 ms per token, 59.49 tokens per second)
0.28.895.217 I slot print_timing: id 3 | task 189 | eval time = 1226.54 ms / 22 tokens ( 55.75 ms per token, 17.94 tokens per second)
0.28.895.218 I slot print_timing: id 3 | task 189 | total time = 1646.75 ms / 47 tokens
0.28.895.219 I slot print_timing: id 3 | task 189 | graphs reused = 190
0.28.895.255 I slot release: id 3 | task 189 | stop processing: n_tokens = 90, truncated = 0
0.28.895.263 I srv update_slots: all slots are idle
0.28.897.516 I srv operator(): Chat format: peg-gemma4
0.28.897.747 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.716 (> 0.100 thold), f_keep = 0.533
0.28.897.779 I slot launch_slot_: id 3 | task 214 | processing task, is_child = 0
0.28.897.780 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.28.897.781 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.28.897.790 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.28.897.791 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.28.897.798 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.28.897.798 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.28.897.807 I slot update_slots: id 3 | task 214 | Checking checkpoint with [0, 44] against 0...
0.28.910.863 W slot update_slots: id 3 | task 214 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.29.847.246 I slot print_timing: id 3 | task 214 | prompt eval time = 419.48 ms / 23 tokens ( 18.24 ms per token, 54.83 tokens per second)
0.29.847.249 I slot print_timing: id 3 | task 214 | eval time = 529.95 ms / 10 tokens ( 53.00 ms per token, 18.87 tokens per second)
0.29.847.250 I slot print_timing: id 3 | task 214 | total time = 949.43 ms / 33 tokens
0.29.847.250 I slot print_timing: id 3 | task 214 | graphs reused = 198
0.29.847.272 I slot release: id 3 | task 214 | stop processing: n_tokens = 76, truncated = 0
0.29.847.279 I srv update_slots: all slots are idle
0.29.849.473 I srv operator(): Chat format: peg-gemma4
0.29.849.707 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.649 (> 0.100 thold), f_keep = 0.632
0.29.849.740 I slot launch_slot_: id 3 | task 227 | processing task, is_child = 0
0.29.849.741 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.29.849.746 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.29.849.755 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.29.849.755 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.29.849.762 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.29.849.762 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.29.849.774 I slot update_slots: id 3 | task 227 | Checking checkpoint with [0, 44] against 0...
0.29.862.803 W slot update_slots: id 3 | task 227 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.31.481.209 I slot print_timing: id 3 | task 227 | prompt eval time = 464.15 ms / 30 tokens ( 15.47 ms per token, 64.63 tokens per second)
0.31.481.212 I slot print_timing: id 3 | task 227 | eval time = 1167.28 ms / 21 tokens ( 55.58 ms per token, 17.99 tokens per second)
0.31.481.213 I slot print_timing: id 3 | task 227 | total time = 1631.43 ms / 51 tokens
0.31.481.214 I slot print_timing: id 3 | task 227 | graphs reused = 217
0.31.481.244 I slot release: id 3 | task 227 | stop processing: n_tokens = 94, truncated = 0
0.31.481.251 I srv update_slots: all slots are idle
0.31.483.537 I srv operator(): Chat format: peg-gemma4
0.31.483.770 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.778 (> 0.100 thold), f_keep = 0.521
0.31.483.802 I slot launch_slot_: id 3 | task 251 | processing task, is_child = 0
0.31.483.803 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.31.483.803 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.31.483.816 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.31.483.816 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.31.483.832 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.31.483.832 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.31.483.848 I slot update_slots: id 3 | task 251 | Checking checkpoint with [0, 44] against 0...
0.31.496.831 W slot update_slots: id 3 | task 251 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.35.747.362 I slot print_timing: id 3 | task 251 | prompt eval time = 314.38 ms / 19 tokens ( 16.55 ms per token, 60.44 tokens per second)
0.35.747.366 I slot print_timing: id 3 | task 251 | eval time = 3949.13 ms / 69 tokens ( 57.23 ms per token, 17.47 tokens per second)
0.35.747.366 I slot print_timing: id 3 | task 251 | total time = 4263.51 ms / 88 tokens
0.35.747.367 I slot print_timing: id 3 | task 251 | graphs reused = 284
0.35.747.397 I slot release: id 3 | task 251 | stop processing: n_tokens = 131, truncated = 0
0.35.747.405 I srv update_slots: all slots are idle
0.35.749.596 I srv operator(): Chat format: peg-gemma4
0.35.749.825 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.649 (> 0.100 thold), f_keep = 0.366
0.35.749.827 I srv get_availabl: updating prompt cache
0.35.749.854 W srv prompt_save: - saving prompt with length 131, total state size = 112.583 MiB (draft: 0.000 MiB)
0.35.854.381 I srv load: - looking for better prompt, base f_keep = 0.366, sim = 0.649
0.35.854.388 I srv update: - cache state: 3 prompts, 416.580 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
0.35.854.389 I srv update: - prompt 0x64c41d5b27f0: 107 tokens, checkpoints: 1, 127.115 MiB
0.35.854.390 I srv update: - prompt 0x64c421629450: 124 tokens, checkpoints: 1, 141.725 MiB
0.35.854.390 I srv update: - prompt 0x64c4217a4e70: 131 tokens, checkpoints: 1, 147.740 MiB
0.35.854.392 I srv get_availabl: prompt cache update took 104.56 ms
0.35.854.470 I slot launch_slot_: id 3 | task 323 | processing task, is_child = 0
0.35.854.471 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.35.854.471 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.35.854.482 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.35.854.483 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.35.854.490 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.35.854.490 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.35.854.505 I slot update_slots: id 3 | task 323 | Checking checkpoint with [0, 44] against 0...
0.35.867.275 W slot update_slots: id 3 | task 323 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.37.997.302 I slot print_timing: id 3 | task 323 | prompt eval time = 463.70 ms / 30 tokens ( 15.46 ms per token, 64.70 tokens per second)
0.37.997.305 I slot print_timing: id 3 | task 323 | eval time = 1679.09 ms / 30 tokens ( 55.97 ms per token, 17.87 tokens per second)
0.37.997.306 I slot print_timing: id 3 | task 323 | total time = 2142.79 ms / 60 tokens
0.37.997.307 I slot print_timing: id 3 | task 323 | graphs reused = 312
0.37.997.336 I slot release: id 3 | task 323 | stop processing: n_tokens = 103, truncated = 0
0.37.997.344 I srv update_slots: all slots are idle
0.37.999.576 I srv operator(): Chat format: peg-gemma4
0.37.999.808 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.696 (> 0.100 thold), f_keep = 0.466
0.37.999.810 I srv get_availabl: updating prompt cache
0.37.999.833 W srv prompt_save: - saving prompt with length 103, total state size = 88.519 MiB (draft: 0.000 MiB)
0.38.084.161 I srv load: - looking for better prompt, base f_keep = 0.466, sim = 0.696
0.38.084.168 I srv load: - found better prompt with f_keep = 0.477, sim = 0.739
0.38.123.061 I srv update: - cache state: 3 prompts, 413.142 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
0.38.123.065 I srv update: - prompt 0x64c421629450: 124 tokens, checkpoints: 1, 141.725 MiB
0.38.123.066 I srv update: - prompt 0x64c4217a4e70: 131 tokens, checkpoints: 1, 147.740 MiB
0.38.123.066 I srv update: - prompt 0x64c4214e6780: 103 tokens, checkpoints: 1, 123.677 MiB
0.38.123.068 I srv get_availabl: prompt cache update took 123.26 ms
0.38.123.152 I slot launch_slot_: id 3 | task 356 | processing task, is_child = 0
0.38.123.152 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.38.123.153 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.38.123.165 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.38.123.165 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.38.123.172 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.38.123.172 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.38.123.187 I slot update_slots: id 3 | task 356 | Checking checkpoint with [0, 44] against 0...
0.38.135.994 W slot update_slots: id 3 | task 356 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.41.611.806 I slot print_timing: id 3 | task 356 | prompt eval time = 419.64 ms / 25 tokens ( 16.79 ms per token, 59.58 tokens per second)
0.41.611.809 I slot print_timing: id 3 | task 356 | eval time = 3068.98 ms / 54 tokens ( 56.83 ms per token, 17.60 tokens per second)
0.41.611.810 I slot print_timing: id 3 | task 356 | total time = 3488.61 ms / 79 tokens
0.41.611.810 I slot print_timing: id 3 | task 356 | graphs reused = 364
0.41.611.840 I slot release: id 3 | task 356 | stop processing: n_tokens = 122, truncated = 0
0.41.611.848 I srv update_slots: all slots are idle
0.41.613.993 I srv operator(): Chat format: peg-gemma4
0.41.614.227 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.649 (> 0.100 thold), f_keep = 0.393
0.41.614.228 I srv get_availabl: updating prompt cache
0.41.614.254 W srv prompt_save: - saving prompt with length 122, total state size = 104.848 MiB (draft: 0.000 MiB)
0.41.711.239 I srv load: - looking for better prompt, base f_keep = 0.393, sim = 0.649
0.41.711.248 I srv update: - cache state: 4 prompts, 553.148 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
0.41.711.249 I srv update: - prompt 0x64c421629450: 124 tokens, checkpoints: 1, 141.725 MiB
0.41.711.250 I srv update: - prompt 0x64c4217a4e70: 131 tokens, checkpoints: 1, 147.740 MiB
0.41.711.251 I srv update: - prompt 0x64c4214e6780: 103 tokens, checkpoints: 1, 123.677 MiB
0.41.711.251 I srv update: - prompt 0x64c4217fcdf0: 122 tokens, checkpoints: 1, 140.006 MiB
0.41.711.252 I srv get_availabl: prompt cache update took 97.02 ms
0.41.711.347 I slot launch_slot_: id 3 | task 413 | processing task, is_child = 0
0.41.711.349 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.41.711.350 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.41.711.363 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.41.711.363 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.41.711.370 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.41.711.370 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.41.711.386 I slot update_slots: id 3 | task 413 | Checking checkpoint with [0, 44] against 0...
0.41.724.137 W slot update_slots: id 3 | task 413 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.43.800.871 I slot print_timing: id 3 | task 413 | prompt eval time = 463.68 ms / 30 tokens ( 15.46 ms per token, 64.70 tokens per second)
0.43.800.874 I slot print_timing: id 3 | task 413 | eval time = 1625.80 ms / 29 tokens ( 56.06 ms per token, 17.84 tokens per second)
0.43.800.875 I slot print_timing: id 3 | task 413 | total time = 2089.48 ms / 59 tokens
0.43.800.875 I slot print_timing: id 3 | task 413 | graphs reused = 391
0.43.800.905 I slot release: id 3 | task 413 | stop processing: n_tokens = 102, truncated = 0
0.43.800.913 I srv update_slots: all slots are idle
0.43.803.065 I srv operator(): Chat format: peg-gemma4
0.43.803.301 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.696 (> 0.100 thold), f_keep = 0.471
0.43.803.303 I srv get_availabl: updating prompt cache
0.43.803.331 W srv prompt_save: - saving prompt with length 102, total state size = 87.660 MiB (draft: 0.000 MiB)
0.43.886.600 I srv load: - looking for better prompt, base f_keep = 0.471, sim = 0.696
0.43.886.612 I srv update: - cache state: 5 prompts, 675.966 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
0.43.886.613 I srv update: - prompt 0x64c421629450: 124 tokens, checkpoints: 1, 141.725 MiB
0.43.886.614 I srv update: - prompt 0x64c4217a4e70: 131 tokens, checkpoints: 1, 147.740 MiB
0.43.886.615 I srv update: - prompt 0x64c4214e6780: 103 tokens, checkpoints: 1, 123.677 MiB
0.43.886.615 I srv update: - prompt 0x64c4217fcdf0: 122 tokens, checkpoints: 1, 140.006 MiB
0.43.886.616 I srv update: - prompt 0x64c421760090: 102 tokens, checkpoints: 1, 122.818 MiB
0.43.886.617 I srv get_availabl: prompt cache update took 83.31 ms
0.43.886.711 I slot launch_slot_: id 3 | task 445 | processing task, is_child = 0
0.43.886.712 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.43.886.713 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.43.886.725 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.43.886.725 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.43.886.732 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.43.886.732 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.43.886.747 I slot update_slots: id 3 | task 445 | Checking checkpoint with [0, 44] against 0...
0.43.899.765 W slot update_slots: id 3 | task 445 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.46.456.893 I slot print_timing: id 3 | task 445 | prompt eval time = 420.18 ms / 25 tokens ( 16.81 ms per token, 59.50 tokens per second)
0.46.456.896 I slot print_timing: id 3 | task 445 | eval time = 2149.96 ms / 38 tokens ( 56.58 ms per token, 17.67 tokens per second)
0.46.456.897 I slot print_timing: id 3 | task 445 | total time = 2570.14 ms / 63 tokens
0.46.456.897 I slot print_timing: id 3 | task 445 | graphs reused = 427
0.46.456.929 I slot release: id 3 | task 445 | stop processing: n_tokens = 106, truncated = 0
0.46.456.936 I srv update_slots: all slots are idle
0.46.458.736 I srv operator(): Chat format: peg-gemma4
0.46.458.960 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.686 (> 0.100 thold), f_keep = 0.453
0.46.458.962 I srv get_availabl: updating prompt cache
0.46.458.987 W srv prompt_save: - saving prompt with length 106, total state size = 91.098 MiB (draft: 0.000 MiB)
0.46.544.324 I srv load: - looking for better prompt, base f_keep = 0.453, sim = 0.686
0.46.544.335 I srv update: - cache state: 6 prompts, 802.222 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
0.46.544.336 I srv update: - prompt 0x64c421629450: 124 tokens, checkpoints: 1, 141.725 MiB
0.46.544.336 I srv update: - prompt 0x64c4217a4e70: 131 tokens, checkpoints: 1, 147.740 MiB
0.46.544.337 I srv update: - prompt 0x64c4214e6780: 103 tokens, checkpoints: 1, 123.677 MiB
0.46.544.337 I srv update: - prompt 0x64c4217fcdf0: 122 tokens, checkpoints: 1, 140.006 MiB
0.46.544.338 I srv update: - prompt 0x64c421760090: 102 tokens, checkpoints: 1, 122.818 MiB
0.46.544.338 I srv update: - prompt 0x64c42185fbc0: 106 tokens, checkpoints: 1, 126.256 MiB
0.46.544.340 I srv get_availabl: prompt cache update took 85.38 ms
0.46.544.435 I slot launch_slot_: id 3 | task 486 | processing task, is_child = 0
0.46.544.436 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.46.544.437 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.46.544.449 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.46.544.450 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.46.544.456 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.46.544.457 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.46.544.472 I slot update_slots: id 3 | task 486 | Checking checkpoint with [0, 44] against 0...
0.46.557.240 W slot update_slots: id 3 | task 486 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.47.839.867 I slot print_timing: id 3 | task 486 | prompt eval time = 419.55 ms / 26 tokens ( 16.14 ms per token, 61.97 tokens per second)
0.47.839.871 I slot print_timing: id 3 | task 486 | eval time = 875.84 ms / 16 tokens ( 54.74 ms per token, 18.27 tokens per second)
0.47.839.872 I slot print_timing: id 3 | task 486 | total time = 1295.39 ms / 42 tokens
0.47.839.872 I slot print_timing: id 3 | task 486 | graphs reused = 441
0.47.839.901 I slot release: id 3 | task 486 | stop processing: n_tokens = 85, truncated = 0
0.47.839.908 I srv update_slots: all slots are idle
0.47.841.961 I srv operator(): Chat format: peg-gemma4
0.47.842.205 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.686 (> 0.100 thold), f_keep = 0.565
0.47.842.241 I slot launch_slot_: id 3 | task 505 | processing task, is_child = 0
0.47.842.242 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.47.842.243 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.47.842.252 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.47.842.253 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.47.842.260 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.47.842.261 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.47.842.271 I slot update_slots: id 3 | task 505 | Checking checkpoint with [0, 44] against 0...
0.47.854.986 W slot update_slots: id 3 | task 505 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.50.178.993 I slot print_timing: id 3 | task 505 | prompt eval time = 419.85 ms / 26 tokens ( 16.15 ms per token, 61.93 tokens per second)
0.50.178.996 I slot print_timing: id 3 | task 505 | eval time = 1916.86 ms / 34 tokens ( 56.38 ms per token, 17.74 tokens per second)
0.50.178.997 I slot print_timing: id 3 | task 505 | total time = 2336.71 ms / 60 tokens
0.50.178.997 I slot print_timing: id 3 | task 505 | graphs reused = 473
0.50.179.028 I slot release: id 3 | task 505 | stop processing: n_tokens = 103, truncated = 0
0.50.179.037 I srv update_slots: all slots are idle
0.50.181.362 I srv operator(): Chat format: peg-gemma4
0.50.181.591 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.667 (> 0.100 thold), f_keep = 0.466
0.50.181.593 I srv get_availabl: updating prompt cache
0.50.181.621 W srv prompt_save: - saving prompt with length 103, total state size = 88.519 MiB (draft: 0.000 MiB)
0.50.265.809 I srv load: - looking for better prompt, base f_keep = 0.466, sim = 0.667
0.50.265.821 I srv update: - cache state: 7 prompts, 925.899 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
0.50.265.822 I srv update: - prompt 0x64c421629450: 124 tokens, checkpoints: 1, 141.725 MiB
0.50.265.823 I srv update: - prompt 0x64c4217a4e70: 131 tokens, checkpoints: 1, 147.740 MiB
0.50.265.823 I srv update: - prompt 0x64c4214e6780: 103 tokens, checkpoints: 1, 123.677 MiB
0.50.265.824 I srv update: - prompt 0x64c4217fcdf0: 122 tokens, checkpoints: 1, 140.006 MiB
0.50.265.824 I srv update: - prompt 0x64c421760090: 102 tokens, checkpoints: 1, 122.818 MiB
0.50.265.825 I srv update: - prompt 0x64c42185fbc0: 106 tokens, checkpoints: 1, 126.256 MiB
0.50.265.826 I srv update: - prompt 0x64c422141a60: 103 tokens, checkpoints: 1, 123.677 MiB
0.50.265.827 I srv get_availabl: prompt cache update took 84.23 ms
0.50.265.917 I slot launch_slot_: id 3 | task 542 | processing task, is_child = 0
0.50.265.919 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.50.265.920 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.50.265.931 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.50.265.931 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.50.265.938 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.50.265.939 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.50.265.953 I slot update_slots: id 3 | task 542 | Checking checkpoint with [0, 44] against 0...
0.50.278.873 W slot update_slots: id 3 | task 542 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.51.795.804 I slot print_timing: id 3 | task 542 | prompt eval time = 420.56 ms / 28 tokens ( 15.02 ms per token, 66.58 tokens per second)
0.51.795.807 I slot print_timing: id 3 | task 542 | eval time = 1109.29 ms / 20 tokens ( 55.46 ms per token, 18.03 tokens per second)
0.51.795.808 I slot print_timing: id 3 | task 542 | total time = 1529.85 ms / 48 tokens
0.51.795.809 I slot print_timing: id 3 | task 542 | graphs reused = 491
0.51.795.839 I slot release: id 3 | task 542 | stop processing: n_tokens = 91, truncated = 0
0.51.795.846 I srv update_slots: all slots are idle
0.51.798.087 I srv operator(): Chat format: peg-gemma4
0.51.798.314 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.706 (> 0.100 thold), f_keep = 0.527
0.51.798.364 I slot launch_slot_: id 3 | task 565 | processing task, is_child = 0
0.51.798.365 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.51.798.366 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.51.798.375 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.51.798.376 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.51.798.382 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.51.798.383 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.51.798.393 I slot update_slots: id 3 | task 565 | Checking checkpoint with [0, 44] against 0...
0.51.811.221 W slot update_slots: id 3 | task 565 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.52.862.873 I slot print_timing: id 3 | task 565 | prompt eval time = 419.25 ms / 24 tokens ( 17.47 ms per token, 57.25 tokens per second)
0.52.862.876 I slot print_timing: id 3 | task 565 | eval time = 645.23 ms / 12 tokens ( 53.77 ms per token, 18.60 tokens per second)
0.52.862.877 I slot print_timing: id 3 | task 565 | total time = 1064.47 ms / 36 tokens
0.52.862.877 I slot print_timing: id 3 | task 565 | graphs reused = 501
0.52.862.912 I slot release: id 3 | task 565 | stop processing: n_tokens = 79, truncated = 0
0.52.862.920 I srv update_slots: all slots are idle
0.52.865.231 I srv operator(): Chat format: peg-gemma4
0.52.865.462 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.667 (> 0.100 thold), f_keep = 0.608
0.52.865.513 I slot launch_slot_: id 3 | task 580 | processing task, is_child = 0
0.52.865.515 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.52.865.515 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.52.865.524 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.52.865.525 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.52.865.531 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.52.865.532 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.52.865.542 I slot update_slots: id 3 | task 580 | Checking checkpoint with [0, 44] against 0...
0.52.878.311 W slot update_slots: id 3 | task 580 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.55.205.954 I slot print_timing: id 3 | task 580 | prompt eval time = 420.15 ms / 28 tokens ( 15.01 ms per token, 66.64 tokens per second)
0.55.205.959 I slot print_timing: id 3 | task 580 | eval time = 1920.26 ms / 34 tokens ( 56.48 ms per token, 17.71 tokens per second)
0.55.205.959 I slot print_timing: id 3 | task 580 | total time = 2340.41 ms / 62 tokens
0.55.205.960 I slot print_timing: id 3 | task 580 | graphs reused = 533
0.55.205.992 I slot release: id 3 | task 580 | stop processing: n_tokens = 105, truncated = 0
0.55.206.000 I srv update_slots: all slots are idle
0.55.207.998 I srv operator(): Chat format: peg-gemma4
0.55.208.224 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.716 (> 0.100 thold), f_keep = 0.457
0.55.208.225 I srv get_availabl: updating prompt cache
0.55.208.251 W srv prompt_save: - saving prompt with length 105, total state size = 90.238 MiB (draft: 0.000 MiB)
0.55.293.534 I srv load: - looking for better prompt, base f_keep = 0.457, sim = 0.716
0.55.293.542 I srv load: - found better prompt with f_keep = 0.476, sim = 0.731
0.55.331.062 I srv update: - cache state: 7 prompts, 927.618 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
0.55.331.066 I srv update: - prompt 0x64c421629450: 124 tokens, checkpoints: 1, 141.725 MiB
0.55.331.066 I srv update: - prompt 0x64c4217a4e70: 131 tokens, checkpoints: 1, 147.740 MiB
0.55.331.067 I srv update: - prompt 0x64c4217fcdf0: 122 tokens, checkpoints: 1, 140.006 MiB
0.55.331.068 I srv update: - prompt 0x64c421760090: 102 tokens, checkpoints: 1, 122.818 MiB
0.55.331.068 I srv update: - prompt 0x64c42185fbc0: 106 tokens, checkpoints: 1, 126.256 MiB
0.55.331.069 I srv update: - prompt 0x64c422141a60: 103 tokens, checkpoints: 1, 123.677 MiB
0.55.331.069 I srv update: - prompt 0x64c42173afb0: 105 tokens, checkpoints: 1, 125.396 MiB
0.55.331.070 I srv get_availabl: prompt cache update took 122.84 ms
0.55.331.161 I slot launch_slot_: id 3 | task 617 | processing task, is_child = 0
0.55.331.162 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.55.331.162 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.55.331.173 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.55.331.173 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.55.331.180 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.55.331.181 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.55.331.197 I slot update_slots: id 3 | task 617 | Checking checkpoint with [0, 44] against 0...
0.55.344.012 W slot update_slots: id 3 | task 617 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.56.454.152 I slot print_timing: id 3 | task 617 | prompt eval time = 419.38 ms / 23 tokens ( 18.23 ms per token, 54.84 tokens per second)
0.56.454.156 I slot print_timing: id 3 | task 617 | eval time = 703.57 ms / 13 tokens ( 54.12 ms per token, 18.48 tokens per second)
0.56.454.157 I slot print_timing: id 3 | task 617 | total time = 1122.95 ms / 36 tokens
0.56.454.158 I slot print_timing: id 3 | task 617 | graphs reused = 544
0.56.454.191 I slot release: id 3 | task 617 | stop processing: n_tokens = 79, truncated = 0
0.56.454.199 I srv update_slots: all slots are idle
0.56.455.849 I srv operator(): Chat format: peg-gemma4
0.56.456.073 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.738 (> 0.100 thold), f_keep = 0.608
0.56.456.134 I slot launch_slot_: id 3 | task 633 | processing task, is_child = 0
0.56.456.136 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.56.456.136 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.56.456.146 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.56.456.146 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.56.456.153 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.56.456.153 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.56.456.163 I slot update_slots: id 3 | task 633 | Checking checkpoint with [0, 44] against 0...
0.56.469.247 W slot update_slots: id 3 | task 633 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.57.306.215 I slot print_timing: id 3 | task 633 | prompt eval time = 319.71 ms / 21 tokens ( 15.22 ms per token, 65.68 tokens per second)
0.57.306.219 I slot print_timing: id 3 | task 633 | eval time = 530.34 ms / 10 tokens ( 53.03 ms per token, 18.86 tokens per second)
0.57.306.220 I slot print_timing: id 3 | task 633 | total time = 850.05 ms / 31 tokens
0.57.306.221 I slot print_timing: id 3 | task 633 | graphs reused = 552
0.57.306.254 I slot release: id 3 | task 633 | stop processing: n_tokens = 74, truncated = 0
0.57.306.262 I srv update_slots: all slots are idle
0.57.307.867 I srv operator(): Chat format: peg-gemma4
0.57.308.091 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.754 (> 0.100 thold), f_keep = 0.662
0.57.308.155 I slot launch_slot_: id 3 | task 646 | processing task, is_child = 0
0.57.308.156 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.57.308.157 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.57.308.165 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.57.308.166 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.57.308.172 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.57.308.173 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.57.308.182 I slot update_slots: id 3 | task 646 | Checking checkpoint with [0, 44] against 0...
0.57.320.880 W slot update_slots: id 3 | task 646 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.58.270.000 I slot print_timing: id 3 | task 646 | prompt eval time = 319.44 ms / 21 tokens ( 15.21 ms per token, 65.74 tokens per second)
0.58.270.004 I slot print_timing: id 3 | task 646 | eval time = 642.37 ms / 12 tokens ( 53.53 ms per token, 18.68 tokens per second)
0.58.270.005 I slot print_timing: id 3 | task 646 | total time = 961.81 ms / 33 tokens
0.58.270.006 I slot print_timing: id 3 | task 646 | graphs reused = 562
0.58.270.040 I slot release: id 3 | task 646 | stop processing: n_tokens = 76, truncated = 0
0.58.270.048 I srv update_slots: all slots are idle
0.58.272.551 I srv operator(): Chat format: peg-gemma4
0.58.272.783 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.750 (> 0.100 thold), f_keep = 0.632
0.58.272.818 I slot launch_slot_: id 3 | task 661 | processing task, is_child = 0
0.58.272.819 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.58.272.820 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.58.272.828 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.58.272.829 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.58.272.835 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.58.272.835 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.58.272.845 I slot update_slots: id 3 | task 661 | Checking checkpoint with [0, 44] against 0...
0.58.286.040 W slot update_slots: id 3 | task 661 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
0.59.292.027 I slot print_timing: id 3 | task 661 | prompt eval time = 315.24 ms / 20 tokens ( 15.76 ms per token, 63.44 tokens per second)
0.59.292.030 I slot print_timing: id 3 | task 661 | eval time = 703.94 ms / 13 tokens ( 54.15 ms per token, 18.47 tokens per second)
0.59.292.030 I slot print_timing: id 3 | task 661 | total time = 1019.17 ms / 33 tokens
0.59.292.031 I slot print_timing: id 3 | task 661 | graphs reused = 573
0.59.292.063 I slot release: id 3 | task 661 | stop processing: n_tokens = 76, truncated = 0
0.59.292.071 I srv update_slots: all slots are idle
0.59.294.259 I srv operator(): Chat format: peg-gemma4
0.59.294.487 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.686 (> 0.100 thold), f_keep = 0.632
0.59.294.519 I slot launch_slot_: id 3 | task 677 | processing task, is_child = 0
0.59.294.521 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.59.294.521 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.59.294.531 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.59.294.531 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.59.294.538 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.59.294.538 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.59.294.548 I slot update_slots: id 3 | task 677 | Checking checkpoint with [0, 44] against 0...
0.59.307.102 W slot update_slots: id 3 | task 677 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.01.869.787 I slot print_timing: id 3 | task 677 | prompt eval time = 419.61 ms / 26 tokens ( 16.14 ms per token, 61.96 tokens per second)
1.01.869.790 I slot print_timing: id 3 | task 677 | eval time = 2155.63 ms / 38 tokens ( 56.73 ms per token, 17.63 tokens per second)
1.01.869.791 I slot print_timing: id 3 | task 677 | total time = 2575.23 ms / 64 tokens
1.01.869.791 I slot print_timing: id 3 | task 677 | graphs reused = 609
1.01.869.823 I slot release: id 3 | task 677 | stop processing: n_tokens = 107, truncated = 0
1.01.869.831 I srv update_slots: all slots are idle
1.01.871.770 I srv operator(): Chat format: peg-gemma4
1.01.872.000 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.706 (> 0.100 thold), f_keep = 0.449
1.01.872.002 I srv get_availabl: updating prompt cache
1.01.872.040 W srv prompt_save: - saving prompt with length 107, total state size = 91.957 MiB (draft: 0.000 MiB)
1.01.957.750 I srv load: - looking for better prompt, base f_keep = 0.449, sim = 0.706
1.01.957.756 I srv load: - found better prompt with f_keep = 0.486, sim = 0.750
1.01.995.706 I srv update: - cache state: 7 prompts, 929.337 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.01.995.709 I srv update: - prompt 0x64c421629450: 124 tokens, checkpoints: 1, 141.725 MiB
1.01.995.710 I srv update: - prompt 0x64c4217a4e70: 131 tokens, checkpoints: 1, 147.740 MiB
1.01.995.711 I srv update: - prompt 0x64c4217fcdf0: 122 tokens, checkpoints: 1, 140.006 MiB
1.01.995.711 I srv update: - prompt 0x64c421760090: 102 tokens, checkpoints: 1, 122.818 MiB
1.01.995.712 I srv update: - prompt 0x64c42185fbc0: 106 tokens, checkpoints: 1, 126.256 MiB
1.01.995.712 I srv update: - prompt 0x64c422141a60: 103 tokens, checkpoints: 1, 123.677 MiB
1.01.995.713 I srv update: - prompt 0x64c42229b420: 107 tokens, checkpoints: 1, 127.115 MiB
1.01.995.714 I srv get_availabl: prompt cache update took 123.71 ms
1.01.995.791 I slot launch_slot_: id 3 | task 718 | processing task, is_child = 0
1.01.995.793 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.01.995.794 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.01.995.805 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.01.995.805 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.01.995.812 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.01.995.813 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.01.995.827 I slot update_slots: id 3 | task 718 | Checking checkpoint with [0, 44] against 0...
1.02.008.469 W slot update_slots: id 3 | task 718 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.03.408.704 I slot print_timing: id 3 | task 718 | prompt eval time = 419.48 ms / 24 tokens ( 17.48 ms per token, 57.21 tokens per second)
1.03.408.708 I slot print_timing: id 3 | task 718 | eval time = 993.39 ms / 18 tokens ( 55.19 ms per token, 18.12 tokens per second)
1.03.408.709 I slot print_timing: id 3 | task 718 | total time = 1412.87 ms / 42 tokens
1.03.408.710 I slot print_timing: id 3 | task 718 | graphs reused = 625
1.03.408.743 I slot release: id 3 | task 718 | stop processing: n_tokens = 85, truncated = 0
1.03.408.751 I srv update_slots: all slots are idle
1.03.411.545 I srv operator(): Chat format: peg-gemma4
1.03.411.792 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.649 (> 0.100 thold), f_keep = 0.565
1.03.411.826 I slot launch_slot_: id 3 | task 739 | processing task, is_child = 0
1.03.411.827 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.03.411.828 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.03.411.840 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.03.411.840 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.03.411.850 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.03.411.851 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.03.411.864 I slot update_slots: id 3 | task 739 | Checking checkpoint with [0, 44] against 0...
1.03.424.716 W slot update_slots: id 3 | task 739 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.05.217.116 I slot print_timing: id 3 | task 739 | prompt eval time = 464.46 ms / 30 tokens ( 15.48 ms per token, 64.59 tokens per second)
1.05.217.120 I slot print_timing: id 3 | task 739 | eval time = 1340.79 ms / 24 tokens ( 55.87 ms per token, 17.90 tokens per second)
1.05.217.121 I slot print_timing: id 3 | task 739 | total time = 1805.25 ms / 54 tokens
1.05.217.121 I slot print_timing: id 3 | task 739 | graphs reused = 647
1.05.217.159 I slot release: id 3 | task 739 | stop processing: n_tokens = 97, truncated = 0
1.05.217.167 I srv update_slots: all slots are idle
1.05.219.462 I srv operator(): Chat format: peg-gemma4
1.05.219.712 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.649 (> 0.100 thold), f_keep = 0.495
1.05.219.714 I srv get_availabl: updating prompt cache
1.05.219.750 W srv prompt_save: - saving prompt with length 97, total state size = 83.363 MiB (draft: 0.000 MiB)
1.05.301.565 I srv load: - looking for better prompt, base f_keep = 0.495, sim = 0.649
1.05.301.578 I srv update: - cache state: 8 prompts, 1047.858 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.05.301.579 I srv update: - prompt 0x64c421629450: 124 tokens, checkpoints: 1, 141.725 MiB
1.05.301.583 I srv update: - prompt 0x64c4217a4e70: 131 tokens, checkpoints: 1, 147.740 MiB
1.05.301.583 I srv update: - prompt 0x64c4217fcdf0: 122 tokens, checkpoints: 1, 140.006 MiB
1.05.301.584 I srv update: - prompt 0x64c421760090: 102 tokens, checkpoints: 1, 122.818 MiB
1.05.301.584 I srv update: - prompt 0x64c42185fbc0: 106 tokens, checkpoints: 1, 126.256 MiB
1.05.301.585 I srv update: - prompt 0x64c422141a60: 103 tokens, checkpoints: 1, 123.677 MiB
1.05.301.585 I srv update: - prompt 0x64c42229b420: 107 tokens, checkpoints: 1, 127.115 MiB
1.05.301.588 I srv update: - prompt 0x64c42182ee50: 97 tokens, checkpoints: 1, 118.521 MiB
1.05.301.589 I srv get_availabl: prompt cache update took 81.87 ms
1.05.301.694 I slot launch_slot_: id 3 | task 766 | processing task, is_child = 0
1.05.301.696 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.05.301.697 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.05.301.709 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.05.301.709 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.05.301.716 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.05.301.716 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.05.301.732 I slot update_slots: id 3 | task 766 | Checking checkpoint with [0, 44] against 0...
1.05.314.787 W slot update_slots: id 3 | task 766 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.06.992.308 I slot print_timing: id 3 | task 766 | prompt eval time = 464.59 ms / 30 tokens ( 15.49 ms per token, 64.57 tokens per second)
1.06.992.312 I slot print_timing: id 3 | task 766 | eval time = 1225.98 ms / 22 tokens ( 55.73 ms per token, 17.94 tokens per second)
1.06.992.312 I slot print_timing: id 3 | task 766 | total time = 1690.57 ms / 52 tokens
1.06.992.313 I slot print_timing: id 3 | task 766 | graphs reused = 667
1.06.992.351 I slot release: id 3 | task 766 | stop processing: n_tokens = 95, truncated = 0
1.06.992.360 I srv update_slots: all slots are idle
1.06.994.502 I srv operator(): Chat format: peg-gemma4
1.06.994.751 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.750 (> 0.100 thold), f_keep = 0.505
1.06.994.785 I slot launch_slot_: id 3 | task 791 | processing task, is_child = 0
1.06.994.786 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.06.994.786 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.06.994.795 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.06.994.795 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.06.994.802 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.06.994.802 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.06.994.813 I slot update_slots: id 3 | task 791 | Checking checkpoint with [0, 44] against 0...
1.07.007.726 W slot update_slots: id 3 | task 791 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.07.782.059 I slot print_timing: id 3 | task 791 | prompt eval time = 315.53 ms / 20 tokens ( 15.78 ms per token, 63.39 tokens per second)
1.07.782.062 I slot print_timing: id 3 | task 791 | eval time = 471.71 ms / 9 tokens ( 52.41 ms per token, 19.08 tokens per second)
1.07.782.063 I slot print_timing: id 3 | task 791 | total time = 787.24 ms / 29 tokens
1.07.782.064 I slot print_timing: id 3 | task 791 | graphs reused = 674
1.07.782.118 I slot release: id 3 | task 791 | stop processing: n_tokens = 72, truncated = 0
1.07.782.126 I srv update_slots: all slots are idle
1.07.784.227 I srv operator(): Chat format: peg-gemma4
1.07.784.453 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.706 (> 0.100 thold), f_keep = 0.667
1.07.784.487 I slot launch_slot_: id 3 | task 803 | processing task, is_child = 0
1.07.784.489 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.07.784.489 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.07.784.498 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.07.784.499 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.07.784.505 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.07.784.506 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.07.784.515 I slot update_slots: id 3 | task 803 | Checking checkpoint with [0, 44] against 0...
1.07.797.445 W slot update_slots: id 3 | task 803 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.08.909.111 I slot print_timing: id 3 | task 803 | prompt eval time = 420.22 ms / 24 tokens ( 17.51 ms per token, 57.11 tokens per second)
1.08.909.115 I slot print_timing: id 3 | task 803 | eval time = 704.37 ms / 13 tokens ( 54.18 ms per token, 18.46 tokens per second)
1.08.909.116 I slot print_timing: id 3 | task 803 | total time = 1124.59 ms / 37 tokens
1.08.909.116 I slot print_timing: id 3 | task 803 | graphs reused = 685
1.08.909.153 I slot release: id 3 | task 803 | stop processing: n_tokens = 80, truncated = 0
1.08.909.161 I srv update_slots: all slots are idle
1.08.911.693 I srv operator(): Chat format: peg-gemma4
1.08.911.931 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.686 (> 0.100 thold), f_keep = 0.600
1.08.911.983 I slot launch_slot_: id 3 | task 819 | processing task, is_child = 0
1.08.911.985 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.08.911.985 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.08.911.995 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.08.911.995 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.08.912.002 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.08.912.002 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.08.912.013 I slot update_slots: id 3 | task 819 | Checking checkpoint with [0, 44] against 0...
1.08.924.775 W slot update_slots: id 3 | task 819 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.10.441.996 I slot print_timing: id 3 | task 819 | prompt eval time = 420.39 ms / 26 tokens ( 16.17 ms per token, 61.85 tokens per second)
1.10.442.000 I slot print_timing: id 3 | task 819 | eval time = 1109.58 ms / 20 tokens ( 55.48 ms per token, 18.02 tokens per second)
1.10.442.000 I slot print_timing: id 3 | task 819 | total time = 1529.98 ms / 46 tokens
1.10.442.001 I slot print_timing: id 3 | task 819 | graphs reused = 703
1.10.442.033 I slot release: id 3 | task 819 | stop processing: n_tokens = 89, truncated = 0
1.10.442.041 I srv update_slots: all slots are idle
1.10.444.179 I srv operator(): Chat format: peg-gemma4
1.10.444.402 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.593 (> 0.100 thold), f_keep = 0.539
1.10.444.437 I slot launch_slot_: id 3 | task 842 | processing task, is_child = 0
1.10.444.439 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.10.444.439 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.10.444.447 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.10.444.447 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.10.444.454 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.10.444.454 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.10.444.464 I slot update_slots: id 3 | task 842 | Checking checkpoint with [0, 44] against 0...
1.10.457.344 W slot update_slots: id 3 | task 842 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.16.559.228 I slot print_timing: id 3 | task 842 | prompt eval time = 480.10 ms / 37 tokens ( 12.98 ms per token, 77.07 tokens per second)
1.16.559.231 I slot print_timing: id 3 | task 842 | eval time = 5634.65 ms / 98 tokens ( 57.50 ms per token, 17.39 tokens per second)
1.16.559.232 I slot print_timing: id 3 | task 842 | total time = 6114.76 ms / 135 tokens
1.16.559.232 I slot print_timing: id 3 | task 842 | graphs reused = 799
1.16.559.265 I slot release: id 3 | task 842 | stop processing: n_tokens = 178, truncated = 0
1.16.559.276 I srv update_slots: all slots are idle
1.16.561.428 I srv operator(): Chat format: peg-gemma4
1.16.561.658 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.681 (> 0.100 thold), f_keep = 0.275
1.16.561.660 I srv get_availabl: updating prompt cache
1.16.561.700 W srv prompt_save: - saving prompt with length 178, total state size = 152.974 MiB (draft: 0.000 MiB)
1.16.692.113 I srv load: - looking for better prompt, base f_keep = 0.275, sim = 0.681
1.16.692.124 I srv update: - cache state: 9 prompts, 1235.990 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.16.692.126 I srv update: - prompt 0x64c421629450: 124 tokens, checkpoints: 1, 141.725 MiB
1.16.692.126 I srv update: - prompt 0x64c4217a4e70: 131 tokens, checkpoints: 1, 147.740 MiB
1.16.692.127 I srv update: - prompt 0x64c4217fcdf0: 122 tokens, checkpoints: 1, 140.006 MiB
1.16.692.140 I srv update: - prompt 0x64c421760090: 102 tokens, checkpoints: 1, 122.818 MiB
1.16.692.141 I srv update: - prompt 0x64c42185fbc0: 106 tokens, checkpoints: 1, 126.256 MiB
1.16.692.142 I srv update: - prompt 0x64c422141a60: 103 tokens, checkpoints: 1, 123.677 MiB
1.16.692.142 I srv update: - prompt 0x64c42229b420: 107 tokens, checkpoints: 1, 127.115 MiB
1.16.692.143 I srv update: - prompt 0x64c42182ee50: 97 tokens, checkpoints: 1, 118.521 MiB
1.16.692.144 I srv update: - prompt 0x64c4214e6780: 178 tokens, checkpoints: 1, 188.132 MiB
1.16.692.145 I srv get_availabl: prompt cache update took 130.48 ms
1.16.692.233 I slot launch_slot_: id 3 | task 943 | processing task, is_child = 0
1.16.692.234 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.16.692.235 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.16.692.248 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.16.692.248 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.16.692.256 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.16.692.257 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.16.692.275 I slot update_slots: id 3 | task 943 | Checking checkpoint with [0, 44] against 0...
1.16.705.195 W slot update_slots: id 3 | task 943 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.20.892.370 I slot print_timing: id 3 | task 943 | prompt eval time = 421.94 ms / 28 tokens ( 15.07 ms per token, 66.36 tokens per second)
1.20.892.374 I slot print_timing: id 3 | task 943 | eval time = 3778.15 ms / 66 tokens ( 57.24 ms per token, 17.47 tokens per second)
1.20.892.374 I slot print_timing: id 3 | task 943 | total time = 4200.09 ms / 94 tokens
1.20.892.375 I slot print_timing: id 3 | task 943 | graphs reused = 863
1.20.892.407 I slot release: id 3 | task 943 | stop processing: n_tokens = 137, truncated = 0
1.20.892.415 I srv update_slots: all slots are idle
1.20.894.618 I srv operator(): Chat format: peg-gemma4
1.20.894.852 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.716 (> 0.100 thold), f_keep = 0.350
1.20.894.854 I srv get_availabl: updating prompt cache
1.20.894.880 W srv prompt_save: - saving prompt with length 137, total state size = 117.739 MiB (draft: 0.000 MiB)
1.21.008.358 I srv load: - looking for better prompt, base f_keep = 0.350, sim = 0.716
1.21.008.370 I srv update: - cache state: 10 prompts, 1388.887 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.21.008.371 I srv update: - prompt 0x64c421629450: 124 tokens, checkpoints: 1, 141.725 MiB
1.21.008.371 I srv update: - prompt 0x64c4217a4e70: 131 tokens, checkpoints: 1, 147.740 MiB
1.21.008.372 I srv update: - prompt 0x64c4217fcdf0: 122 tokens, checkpoints: 1, 140.006 MiB
1.21.008.373 I srv update: - prompt 0x64c421760090: 102 tokens, checkpoints: 1, 122.818 MiB
1.21.008.374 I srv update: - prompt 0x64c42185fbc0: 106 tokens, checkpoints: 1, 126.256 MiB
1.21.008.375 I srv update: - prompt 0x64c422141a60: 103 tokens, checkpoints: 1, 123.677 MiB
1.21.008.376 I srv update: - prompt 0x64c42229b420: 107 tokens, checkpoints: 1, 127.115 MiB
1.21.008.376 I srv update: - prompt 0x64c42182ee50: 97 tokens, checkpoints: 1, 118.521 MiB
1.21.008.377 I srv update: - prompt 0x64c4214e6780: 178 tokens, checkpoints: 1, 188.132 MiB
1.21.008.377 I srv update: - prompt 0x64c42152f140: 137 tokens, checkpoints: 1, 152.897 MiB
1.21.008.379 I srv get_availabl: prompt cache update took 113.52 ms
1.21.008.457 I slot launch_slot_: id 3 | task 1012 | processing task, is_child = 0
1.21.008.458 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.21.008.459 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.21.008.471 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.21.008.471 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.21.008.478 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.21.008.478 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.21.008.493 I slot update_slots: id 3 | task 1012 | Checking checkpoint with [0, 44] against 0...
1.21.021.339 W slot update_slots: id 3 | task 1012 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.25.728.360 I slot print_timing: id 3 | task 1012 | prompt eval time = 419.75 ms / 23 tokens ( 18.25 ms per token, 54.79 tokens per second)
1.25.728.364 I slot print_timing: id 3 | task 1012 | eval time = 4300.11 ms / 75 tokens ( 57.33 ms per token, 17.44 tokens per second)
1.25.728.364 I slot print_timing: id 3 | task 1012 | total time = 4719.86 ms / 98 tokens
1.25.728.365 I slot print_timing: id 3 | task 1012 | graphs reused = 936
1.25.728.400 I slot release: id 3 | task 1012 | stop processing: n_tokens = 141, truncated = 0
1.25.728.408 I srv update_slots: all slots are idle
1.25.730.520 I srv operator(): Chat format: peg-gemma4
1.25.730.739 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.658 (> 0.100 thold), f_keep = 0.340
1.25.730.740 I srv get_availabl: updating prompt cache
1.25.730.769 W srv prompt_save: - saving prompt with length 141, total state size = 121.177 MiB (draft: 0.000 MiB)
1.25.846.258 I srv load: - looking for better prompt, base f_keep = 0.340, sim = 0.658
1.25.846.265 I srv load: - found better prompt with f_keep = 0.395, sim = 0.671
1.25.889.844 I srv update: - cache state: 10 prompts, 1403.496 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.25.889.849 I srv update: - prompt 0x64c4217a4e70: 131 tokens, checkpoints: 1, 147.740 MiB
1.25.889.850 I srv update: - prompt 0x64c4217fcdf0: 122 tokens, checkpoints: 1, 140.006 MiB
1.25.889.851 I srv update: - prompt 0x64c421760090: 102 tokens, checkpoints: 1, 122.818 MiB
1.25.889.851 I srv update: - prompt 0x64c42185fbc0: 106 tokens, checkpoints: 1, 126.256 MiB
1.25.889.852 I srv update: - prompt 0x64c422141a60: 103 tokens, checkpoints: 1, 123.677 MiB
1.25.889.852 I srv update: - prompt 0x64c42229b420: 107 tokens, checkpoints: 1, 127.115 MiB
1.25.889.853 I srv update: - prompt 0x64c42182ee50: 97 tokens, checkpoints: 1, 118.521 MiB
1.25.889.853 I srv update: - prompt 0x64c4214e6780: 178 tokens, checkpoints: 1, 188.132 MiB
1.25.889.854 I srv update: - prompt 0x64c42152f140: 137 tokens, checkpoints: 1, 152.897 MiB
1.25.889.854 I srv update: - prompt 0x64c42173afb0: 141 tokens, checkpoints: 1, 156.334 MiB
1.25.889.856 I srv get_availabl: prompt cache update took 159.11 ms
1.25.889.954 I slot launch_slot_: id 3 | task 1090 | processing task, is_child = 0
1.25.889.956 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.25.889.956 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.25.889.968 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.25.889.968 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.25.889.975 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.25.889.975 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.25.889.992 I slot update_slots: id 3 | task 1090 | Checking checkpoint with [0, 44] against 0...
1.25.903.107 W slot update_slots: id 3 | task 1090 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.28.988.197 I slot print_timing: id 3 | task 1090 | prompt eval time = 421.82 ms / 29 tokens ( 14.55 ms per token, 68.75 tokens per second)
1.28.988.202 I slot print_timing: id 3 | task 1090 | eval time = 2676.38 ms / 47 tokens ( 56.94 ms per token, 17.56 tokens per second)
1.28.988.203 I slot print_timing: id 3 | task 1090 | total time = 3098.20 ms / 76 tokens
1.28.988.203 I slot print_timing: id 3 | task 1090 | graphs reused = 981
1.28.988.243 I slot release: id 3 | task 1090 | stop processing: n_tokens = 119, truncated = 0
1.28.988.253 I srv update_slots: all slots are idle
1.28.990.287 I srv operator(): Chat format: peg-gemma4
1.28.990.519 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.681 (> 0.100 thold), f_keep = 0.412
1.28.990.521 I srv get_availabl: updating prompt cache
1.28.990.554 W srv prompt_save: - saving prompt with length 119, total state size = 102.270 MiB (draft: 0.000 MiB)
1.29.083.953 I srv load: - looking for better prompt, base f_keep = 0.412, sim = 0.681
1.29.083.962 I srv load: - found better prompt with f_keep = 0.418, sim = 0.708
1.29.126.740 I srv update: - cache state: 10 prompts, 1400.918 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.29.126.744 I srv update: - prompt 0x64c4217a4e70: 131 tokens, checkpoints: 1, 147.740 MiB
1.29.126.745 I srv update: - prompt 0x64c421760090: 102 tokens, checkpoints: 1, 122.818 MiB
1.29.126.745 I srv update: - prompt 0x64c42185fbc0: 106 tokens, checkpoints: 1, 126.256 MiB
1.29.126.746 I srv update: - prompt 0x64c422141a60: 103 tokens, checkpoints: 1, 123.677 MiB
1.29.126.746 I srv update: - prompt 0x64c42229b420: 107 tokens, checkpoints: 1, 127.115 MiB
1.29.126.747 I srv update: - prompt 0x64c42182ee50: 97 tokens, checkpoints: 1, 118.521 MiB
1.29.126.747 I srv update: - prompt 0x64c4214e6780: 178 tokens, checkpoints: 1, 188.132 MiB
1.29.126.748 I srv update: - prompt 0x64c42152f140: 137 tokens, checkpoints: 1, 152.897 MiB
1.29.126.748 I srv update: - prompt 0x64c42173afb0: 141 tokens, checkpoints: 1, 156.334 MiB
1.29.126.749 I srv update: - prompt 0x64c422297690: 119 tokens, checkpoints: 1, 137.428 MiB
1.29.126.750 I srv get_availabl: prompt cache update took 136.23 ms
1.29.126.831 I slot launch_slot_: id 3 | task 1140 | processing task, is_child = 0
1.29.126.833 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.29.126.833 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.29.126.844 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.29.126.845 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.29.126.851 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.29.126.852 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.29.126.866 I slot update_slots: id 3 | task 1140 | Checking checkpoint with [0, 44] against 0...
1.29.139.783 W slot update_slots: id 3 | task 1140 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.30.946.209 I slot print_timing: id 3 | task 1140 | prompt eval time = 420.82 ms / 28 tokens ( 15.03 ms per token, 66.54 tokens per second)
1.30.946.213 I slot print_timing: id 3 | task 1140 | eval time = 1398.52 ms / 25 tokens ( 55.94 ms per token, 17.88 tokens per second)
1.30.946.214 I slot print_timing: id 3 | task 1140 | total time = 1819.34 ms / 53 tokens
1.30.946.214 I slot print_timing: id 3 | task 1140 | graphs reused = 1004
1.30.946.245 I slot release: id 3 | task 1140 | stop processing: n_tokens = 96, truncated = 0
1.30.946.253 I srv update_slots: all slots are idle
1.30.948.338 I srv operator(): Chat format: peg-gemma4
1.30.948.583 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.727 (> 0.100 thold), f_keep = 0.500
1.30.948.626 I slot launch_slot_: id 3 | task 1168 | processing task, is_child = 0
1.30.948.628 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.30.948.628 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.30.948.638 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.30.948.638 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.30.948.647 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.30.948.647 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.30.948.659 I slot update_slots: id 3 | task 1168 | Checking checkpoint with [0, 44] against 0...
1.30.961.256 W slot update_slots: id 3 | task 1168 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.33.870.169 I slot print_timing: id 3 | task 1168 | prompt eval time = 418.99 ms / 22 tokens ( 19.05 ms per token, 52.51 tokens per second)
1.33.870.171 I slot print_timing: id 3 | task 1168 | eval time = 2502.51 ms / 44 tokens ( 56.88 ms per token, 17.58 tokens per second)
1.33.870.172 I slot print_timing: id 3 | task 1168 | total time = 2921.50 ms / 66 tokens
1.33.870.173 I slot print_timing: id 3 | task 1168 | graphs reused = 1046
1.33.870.205 I slot release: id 3 | task 1168 | stop processing: n_tokens = 109, truncated = 0
1.33.870.213 I srv update_slots: all slots are idle
1.33.872.370 I srv operator(): Chat format: peg-gemma4
1.33.872.600 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.750 (> 0.100 thold), f_keep = 0.440
1.33.872.602 I srv get_availabl: updating prompt cache
1.33.872.627 W srv prompt_save: - saving prompt with length 109, total state size = 93.676 MiB (draft: 0.000 MiB)
1.33.960.250 I srv load: - looking for better prompt, base f_keep = 0.440, sim = 0.750
1.33.960.262 I srv update: - cache state: 11 prompts, 1529.752 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.33.960.263 I srv update: - prompt 0x64c4217a4e70: 131 tokens, checkpoints: 1, 147.740 MiB
1.33.960.264 I srv update: - prompt 0x64c421760090: 102 tokens, checkpoints: 1, 122.818 MiB
1.33.960.264 I srv update: - prompt 0x64c42185fbc0: 106 tokens, checkpoints: 1, 126.256 MiB
1.33.960.265 I srv update: - prompt 0x64c422141a60: 103 tokens, checkpoints: 1, 123.677 MiB
1.33.960.265 I srv update: - prompt 0x64c42229b420: 107 tokens, checkpoints: 1, 127.115 MiB
1.33.960.266 I srv update: - prompt 0x64c42182ee50: 97 tokens, checkpoints: 1, 118.521 MiB
1.33.960.267 I srv update: - prompt 0x64c4214e6780: 178 tokens, checkpoints: 1, 188.132 MiB
1.33.960.267 I srv update: - prompt 0x64c42152f140: 137 tokens, checkpoints: 1, 152.897 MiB
1.33.960.268 I srv update: - prompt 0x64c42173afb0: 141 tokens, checkpoints: 1, 156.334 MiB
1.33.960.268 I srv update: - prompt 0x64c422297690: 119 tokens, checkpoints: 1, 137.428 MiB
1.33.960.270 I srv update: - prompt 0x64c421629450: 109 tokens, checkpoints: 1, 128.834 MiB
1.33.960.272 I srv get_availabl: prompt cache update took 87.67 ms
1.33.960.368 I slot launch_slot_: id 3 | task 1215 | processing task, is_child = 0
1.33.960.369 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.33.960.370 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.33.960.383 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.33.960.383 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.33.960.390 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.33.960.390 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.33.960.406 I slot update_slots: id 3 | task 1215 | Checking checkpoint with [0, 44] against 0...
1.33.973.230 W slot update_slots: id 3 | task 1215 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.35.385.058 I slot print_timing: id 3 | task 1215 | prompt eval time = 314.81 ms / 20 tokens ( 15.74 ms per token, 63.53 tokens per second)
1.35.385.061 I slot print_timing: id 3 | task 1215 | eval time = 1109.84 ms / 20 tokens ( 55.49 ms per token, 18.02 tokens per second)
1.35.385.062 I slot print_timing: id 3 | task 1215 | total time = 1424.65 ms / 40 tokens
1.35.385.063 I slot print_timing: id 3 | task 1215 | graphs reused = 1064
1.35.385.093 I slot release: id 3 | task 1215 | stop processing: n_tokens = 83, truncated = 0
1.35.385.102 I srv update_slots: all slots are idle
1.35.387.277 I srv operator(): Chat format: peg-gemma4
1.35.387.504 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.696 (> 0.100 thold), f_keep = 0.578
1.35.387.557 I slot launch_slot_: id 3 | task 1238 | processing task, is_child = 0
1.35.387.558 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.35.387.559 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.35.387.567 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.35.387.567 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.35.387.574 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.35.387.574 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.35.387.585 I slot update_slots: id 3 | task 1238 | Checking checkpoint with [0, 44] against 0...
1.35.400.286 W slot update_slots: id 3 | task 1238 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.40.453.078 I slot print_timing: id 3 | task 1238 | prompt eval time = 419.38 ms / 25 tokens ( 16.78 ms per token, 59.61 tokens per second)
1.40.453.081 I slot print_timing: id 3 | task 1238 | eval time = 4646.10 ms / 81 tokens ( 57.36 ms per token, 17.43 tokens per second)
1.40.453.082 I slot print_timing: id 3 | task 1238 | total time = 5065.49 ms / 106 tokens
1.40.453.082 I slot print_timing: id 3 | task 1238 | graphs reused = 1143
1.40.453.112 I slot release: id 3 | task 1238 | stop processing: n_tokens = 149, truncated = 0
1.40.453.119 I srv update_slots: all slots are idle
1.40.455.173 I srv operator(): Chat format: peg-gemma4
1.40.455.408 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.716 (> 0.100 thold), f_keep = 0.322
1.40.455.409 I srv get_availabl: updating prompt cache
1.40.455.437 W srv prompt_save: - saving prompt with length 149, total state size = 128.052 MiB (draft: 0.000 MiB)
1.40.571.582 I srv load: - looking for better prompt, base f_keep = 0.322, sim = 0.716
1.40.571.589 I srv load: - found better prompt with f_keep = 0.382, sim = 0.746
1.40.618.890 I srv update: - cache state: 11 prompts, 1545.221 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.40.618.894 I srv update: - prompt 0x64c421760090: 102 tokens, checkpoints: 1, 122.818 MiB
1.40.618.895 I srv update: - prompt 0x64c42185fbc0: 106 tokens, checkpoints: 1, 126.256 MiB
1.40.618.896 I srv update: - prompt 0x64c422141a60: 103 tokens, checkpoints: 1, 123.677 MiB
1.40.618.897 I srv update: - prompt 0x64c42229b420: 107 tokens, checkpoints: 1, 127.115 MiB
1.40.618.897 I srv update: - prompt 0x64c42182ee50: 97 tokens, checkpoints: 1, 118.521 MiB
1.40.618.898 I srv update: - prompt 0x64c4214e6780: 178 tokens, checkpoints: 1, 188.132 MiB
1.40.618.899 I srv update: - prompt 0x64c42152f140: 137 tokens, checkpoints: 1, 152.897 MiB
1.40.618.900 I srv update: - prompt 0x64c42173afb0: 141 tokens, checkpoints: 1, 156.334 MiB
1.40.618.900 I srv update: - prompt 0x64c422297690: 119 tokens, checkpoints: 1, 137.428 MiB
1.40.618.901 I srv update: - prompt 0x64c421629450: 109 tokens, checkpoints: 1, 128.834 MiB
1.40.618.903 I srv update: - prompt 0x64c421e0e420: 149 tokens, checkpoints: 1, 163.210 MiB
1.40.618.905 I srv get_availabl: prompt cache update took 163.49 ms
1.40.618.990 I slot launch_slot_: id 3 | task 1322 | processing task, is_child = 0
1.40.618.991 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.40.618.992 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.40.619.004 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.40.619.005 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.40.619.014 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.40.619.014 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.40.619.033 I slot update_slots: id 3 | task 1322 | Checking checkpoint with [0, 44] against 0...
1.40.631.775 W slot update_slots: id 3 | task 1322 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.45.454.241 I slot print_timing: id 3 | task 1322 | prompt eval time = 419.56 ms / 23 tokens ( 18.24 ms per token, 54.82 tokens per second)
1.45.454.245 I slot print_timing: id 3 | task 1322 | eval time = 4415.64 ms / 77 tokens ( 57.35 ms per token, 17.44 tokens per second)
1.45.454.245 I slot print_timing: id 3 | task 1322 | total time = 4835.20 ms / 100 tokens
1.45.454.246 I slot print_timing: id 3 | task 1322 | graphs reused = 1218
1.45.454.276 I slot release: id 3 | task 1322 | stop processing: n_tokens = 143, truncated = 0
1.45.454.285 I srv update_slots: all slots are idle
1.45.456.515 I srv operator(): Chat format: peg-gemma4
1.45.456.751 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.754 (> 0.100 thold), f_keep = 0.343
1.45.456.753 I srv get_availabl: updating prompt cache
1.45.456.780 W srv prompt_save: - saving prompt with length 143, total state size = 122.895 MiB (draft: 0.000 MiB)
1.45.634.002 I srv load: - looking for better prompt, base f_keep = 0.343, sim = 0.754
1.45.634.013 I srv update: - cache state: 12 prompts, 1703.274 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.45.634.015 I srv update: - prompt 0x64c421760090: 102 tokens, checkpoints: 1, 122.818 MiB
1.45.634.015 I srv update: - prompt 0x64c42185fbc0: 106 tokens, checkpoints: 1, 126.256 MiB
1.45.634.016 I srv update: - prompt 0x64c422141a60: 103 tokens, checkpoints: 1, 123.677 MiB
1.45.634.017 I srv update: - prompt 0x64c42229b420: 107 tokens, checkpoints: 1, 127.115 MiB
1.45.634.018 I srv update: - prompt 0x64c42182ee50: 97 tokens, checkpoints: 1, 118.521 MiB
1.45.634.021 I srv update: - prompt 0x64c4214e6780: 178 tokens, checkpoints: 1, 188.132 MiB
1.45.634.021 I srv update: - prompt 0x64c42152f140: 137 tokens, checkpoints: 1, 152.897 MiB
1.45.634.022 I srv update: - prompt 0x64c42173afb0: 141 tokens, checkpoints: 1, 156.334 MiB
1.45.634.022 I srv update: - prompt 0x64c422297690: 119 tokens, checkpoints: 1, 137.428 MiB
1.45.634.023 I srv update: - prompt 0x64c421629450: 109 tokens, checkpoints: 1, 128.834 MiB
1.45.634.023 I srv update: - prompt 0x64c421e0e420: 149 tokens, checkpoints: 1, 163.210 MiB
1.45.634.026 I srv update: - prompt 0x64c41f5dc470: 143 tokens, checkpoints: 1, 158.053 MiB
1.45.634.027 I srv get_availabl: prompt cache update took 177.27 ms
1.45.634.109 I slot launch_slot_: id 3 | task 1402 | processing task, is_child = 0
1.45.634.109 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.45.634.110 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.45.634.123 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.45.634.124 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.45.634.148 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.45.634.148 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.45.634.172 I slot update_slots: id 3 | task 1402 | Checking checkpoint with [0, 44] against 0...
1.45.647.030 W slot update_slots: id 3 | task 1402 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.48.687.246 I slot print_timing: id 3 | task 1402 | prompt eval time = 319.79 ms / 21 tokens ( 15.23 ms per token, 65.67 tokens per second)
1.48.687.249 I slot print_timing: id 3 | task 1402 | eval time = 2733.28 ms / 48 tokens ( 56.94 ms per token, 17.56 tokens per second)
1.48.687.250 I slot print_timing: id 3 | task 1402 | total time = 3053.07 ms / 69 tokens
1.48.687.251 I slot print_timing: id 3 | task 1402 | graphs reused = 1264
1.48.687.281 I slot release: id 3 | task 1402 | stop processing: n_tokens = 112, truncated = 0
1.48.687.290 I srv update_slots: all slots are idle
1.48.689.369 I srv operator(): Chat format: peg-gemma4
1.48.689.605 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.696 (> 0.100 thold), f_keep = 0.429
1.48.689.606 I srv get_availabl: updating prompt cache
1.48.689.634 W srv prompt_save: - saving prompt with length 112, total state size = 96.254 MiB (draft: 0.000 MiB)
1.48.778.741 I srv load: - looking for better prompt, base f_keep = 0.429, sim = 0.696
1.48.778.752 I srv load: - found better prompt with f_keep = 0.476, sim = 0.710
1.48.815.931 I srv update: - cache state: 12 prompts, 1711.009 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.48.815.935 I srv update: - prompt 0x64c421760090: 102 tokens, checkpoints: 1, 122.818 MiB
1.48.815.935 I srv update: - prompt 0x64c42185fbc0: 106 tokens, checkpoints: 1, 126.256 MiB
1.48.815.936 I srv update: - prompt 0x64c42229b420: 107 tokens, checkpoints: 1, 127.115 MiB
1.48.815.937 I srv update: - prompt 0x64c42182ee50: 97 tokens, checkpoints: 1, 118.521 MiB
1.48.815.937 I srv update: - prompt 0x64c4214e6780: 178 tokens, checkpoints: 1, 188.132 MiB
1.48.815.938 I srv update: - prompt 0x64c42152f140: 137 tokens, checkpoints: 1, 152.897 MiB
1.48.815.938 I srv update: - prompt 0x64c42173afb0: 141 tokens, checkpoints: 1, 156.334 MiB
1.48.815.939 I srv update: - prompt 0x64c422297690: 119 tokens, checkpoints: 1, 137.428 MiB
1.48.815.939 I srv update: - prompt 0x64c421629450: 109 tokens, checkpoints: 1, 128.834 MiB
1.48.815.940 I srv update: - prompt 0x64c421e0e420: 149 tokens, checkpoints: 1, 163.210 MiB
1.48.815.940 I srv update: - prompt 0x64c41f5dc470: 143 tokens, checkpoints: 1, 158.053 MiB
1.48.815.941 I srv update: - prompt 0x64c4217fcdf0: 112 tokens, checkpoints: 1, 131.412 MiB
1.48.815.942 I srv get_availabl: prompt cache update took 126.33 ms
1.48.816.028 I slot launch_slot_: id 3 | task 1453 | processing task, is_child = 0
1.48.816.029 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.48.816.030 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.48.816.041 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.48.816.042 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.48.816.049 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.48.816.049 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.48.816.065 I slot update_slots: id 3 | task 1453 | Checking checkpoint with [0, 44] against 0...
1.48.828.942 W slot update_slots: id 3 | task 1453 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.52.491.220 I slot print_timing: id 3 | task 1453 | prompt eval time = 419.94 ms / 25 tokens ( 16.80 ms per token, 59.53 tokens per second)
1.52.491.223 I slot print_timing: id 3 | task 1453 | eval time = 3255.21 ms / 57 tokens ( 57.11 ms per token, 17.51 tokens per second)
1.52.491.224 I slot print_timing: id 3 | task 1453 | total time = 3675.15 ms / 82 tokens
1.52.491.224 I slot print_timing: id 3 | task 1453 | graphs reused = 1319
1.52.491.255 I slot release: id 3 | task 1453 | stop processing: n_tokens = 125, truncated = 0
1.52.491.263 I srv update_slots: all slots are idle
1.52.493.352 I srv operator(): Chat format: peg-gemma4
1.52.493.590 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.750 (> 0.100 thold), f_keep = 0.384
1.52.493.591 I srv get_availabl: updating prompt cache
1.52.493.619 W srv prompt_save: - saving prompt with length 125, total state size = 107.426 MiB (draft: 0.000 MiB)
1.52.592.402 I srv load: - looking for better prompt, base f_keep = 0.384, sim = 0.750
1.52.592.412 I srv load: - found better prompt with f_keep = 0.462, sim = 0.766
1.52.630.947 I srv update: - cache state: 12 prompts, 1727.338 MiB (limits: 8192.000 MiB, 8192 tokens, 8192 est)
1.52.630.952 I srv update: - prompt 0x64c421760090: 102 tokens, checkpoints: 1, 122.818 MiB
1.52.630.953 I srv update: - prompt 0x64c42229b420: 107 tokens, checkpoints: 1, 127.115 MiB
1.52.630.954 I srv update: - prompt 0x64c42182ee50: 97 tokens, checkpoints: 1, 118.521 MiB
1.52.630.954 I srv update: - prompt 0x64c4214e6780: 178 tokens, checkpoints: 1, 188.132 MiB
1.52.630.955 I srv update: - prompt 0x64c42152f140: 137 tokens, checkpoints: 1, 152.897 MiB
1.52.630.955 I srv update: - prompt 0x64c42173afb0: 141 tokens, checkpoints: 1, 156.334 MiB
1.52.630.956 I srv update: - prompt 0x64c422297690: 119 tokens, checkpoints: 1, 137.428 MiB
1.52.630.956 I srv update: - prompt 0x64c421629450: 109 tokens, checkpoints: 1, 128.834 MiB
1.52.630.957 I srv update: - prompt 0x64c421e0e420: 149 tokens, checkpoints: 1, 163.210 MiB
1.52.630.957 I srv update: - prompt 0x64c41f5dc470: 143 tokens, checkpoints: 1, 158.053 MiB
1.52.630.958 I srv update: - prompt 0x64c4217fcdf0: 112 tokens, checkpoints: 1, 131.412 MiB
1.52.630.958 I srv update: - prompt 0x64c4217a4e70: 125 tokens, checkpoints: 1, 142.584 MiB
1.52.630.960 I srv get_availabl: prompt cache update took 137.37 ms
1.52.631.045 I slot launch_slot_: id 3 | task 1513 | processing task, is_child = 0
1.52.631.047 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.52.631.047 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.52.631.058 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.52.631.058 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.52.631.065 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.52.631.066 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.52.631.080 I slot update_slots: id 3 | task 1513 | Checking checkpoint with [0, 44] against 0...
1.52.643.654 W slot update_slots: id 3 | task 1513 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 35.158 MiB)
1.56.781.075 I slot print_timing: id 3 | task 1513 | prompt eval time = 314.31 ms / 20 tokens ( 15.72 ms per token, 63.63 tokens per second)
1.56.781.078 I slot print_timing: id 3 | task 1513 | eval time = 3835.68 ms / 67 tokens ( 57.25 ms per token, 17.47 tokens per second)
1.56.781.079 I slot print_timing: id 3 | task 1513 | total time = 4149.99 ms / 87 tokens
1.56.781.079 I slot print_timing: id 3 | task 1513 | graphs reused = 1384
1.56.781.109 I slot release: id 3 | task 1513 | stop processing: n_tokens = 130, truncated = 0
1.56.781.116 I srv update_slots: all slots are idle
1.56.781.652 I srv operator(): operator(): cleaning up before exit...
Reference in New Issue Copy Permalink