1101 lines
106 KiB
Plaintext
1101 lines
106 KiB
Plaintext
0.00.066.204 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg)
|
|
0.00.066.207 I device_info:
|
|
0.00.066.225 I - ROCm0 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
|
|
0.00.066.229 I - ROCm1 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
|
|
0.00.066.235 I - CPU : AMD Ryzen 9 3900X 12-Core Processor (128730 MiB, 128730 MiB free)
|
|
0.00.066.290 I system_info: n_threads = 12 (n_threads_batch = 12) / 24 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 |
|
|
0.00.066.294 I srv llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true
|
|
0.00.066.331 I srv init: running without SSL
|
|
0.00.066.390 I srv init: using 23 threads for HTTP server
|
|
0.00.066.707 I srv start: binding port with default address family
|
|
0.00.067.927 I srv llama_server: loading model
|
|
0.00.067.936 I srv load_model: loading model '/home/qrf/.cache/llama.cpp/google_gemma-4-26B-A4B-it-Q4_K_M.gguf'
|
|
0.00.067.999 I common_init_result: fitting params to device memory ...
|
|
0.00.068.001 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on)
|
|
0.01.831.649 W load: control-looking token: 212 '</s>' was not control-type; this is probably a bug in the model. its type will be overridden
|
|
0.01.832.189 W load: control-looking token: 50 '<|tool_response>' was not control-type; this is probably a bug in the model. its type will be overridden
|
|
0.01.859.584 W load: special_eog_ids contains '<|tool_response>', removing '</s>' token from EOG list
|
|
0.10.067.334 W llama_context: n_ctx_seq (8192) < n_ctx_train (262144) -- the full capacity of the model will not be utilized
|
|
0.10.150.441 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
|
|
0.10.332.845 I srv load_model: initializing slots, n_slots = 4
|
|
0.10.380.066 W common_speculative_init: no implementations specified for speculative decoding
|
|
0.10.380.071 I slot load_model: id 0 | task -1 | new slot, n_ctx = 8192
|
|
0.10.380.074 I slot load_model: id 1 | task -1 | new slot, n_ctx = 8192
|
|
0.10.380.075 I slot load_model: id 2 | task -1 | new slot, n_ctx = 8192
|
|
0.10.380.075 I slot load_model: id 3 | task -1 | new slot, n_ctx = 8192
|
|
0.10.380.134 I srv load_model: prompt cache is enabled, size limit: 8192 MiB
|
|
0.10.380.134 I srv load_model: use `--cache-ram 0` to disable the prompt cache
|
|
0.10.380.135 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391
|
|
0.10.380.135 I srv load_model: context checkpoints enabled, max = 32, min spacing = 256
|
|
0.10.380.166 I srv init: idle slots will be saved to prompt cache and cleared upon starting a new task
|
|
0.10.387.717 I init: chat template, example_format: '<|turn>system
|
|
<|think|>
|
|
You are a helpful assistant<turn|>
|
|
<|turn>user
|
|
Hello<turn|>
|
|
<|turn>model
|
|
Hi there<turn|>
|
|
<|turn>user
|
|
How are you?<turn|>
|
|
<|turn>model
|
|
'
|
|
0.10.388.467 I srv init: init: chat template, thinking = 1
|
|
0.10.388.504 I srv llama_server: model loaded
|
|
0.10.388.507 I srv llama_server: server is listening on http://127.0.0.1:8090
|
|
0.10.388.511 I srv update_slots: all slots are idle
|
|
0.14.966.743 I srv operator(): Chat format: peg-gemma4
|
|
0.14.967.060 I slot get_availabl: id 3 | task -1 | selected slot by LRU, t_last = -1
|
|
0.14.967.063 I srv get_availabl: updating prompt cache
|
|
0.14.967.070 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000
|
|
0.14.967.075 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 8192 tokens, 8589934592 est)
|
|
0.14.967.076 I srv get_availabl: prompt cache update took 0.01 ms
|
|
0.14.967.155 I slot launch_slot_: id 3 | task 0 | processing task, is_child = 0
|
|
0.14.967.155 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.14.967.162 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.14.967.175 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.14.967.175 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.14.967.183 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.14.967.183 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.15.630.388 I slot create_check: id 3 | task 0 | created context checkpoint 1 of 32 (pos_min = 0, pos_max = 44, n_tokens = 45, size = 8.790 MiB)
|
|
0.16.819.094 I slot print_timing: id 3 | task 0 | prompt eval time = 780.24 ms / 73 tokens ( 10.69 ms per token, 93.56 tokens per second)
|
|
0.16.819.097 I slot print_timing: id 3 | task 0 | eval time = 1071.64 ms / 60 tokens ( 17.86 ms per token, 55.99 tokens per second)
|
|
0.16.819.098 I slot print_timing: id 3 | task 0 | total time = 1851.88 ms / 133 tokens
|
|
0.16.819.102 I slot print_timing: id 3 | task 0 | graphs reused = 59
|
|
0.16.819.159 I slot release: id 3 | task 0 | stop processing: n_tokens = 132, truncated = 0
|
|
0.16.819.163 I srv update_slots: all slots are idle
|
|
0.16.821.552 I srv operator(): Chat format: peg-gemma4
|
|
0.16.821.778 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.738 (> 0.100 thold), f_keep = 0.364
|
|
0.16.821.779 I srv get_availabl: updating prompt cache
|
|
0.16.821.808 W srv prompt_save: - saving prompt with length 132, total state size = 28.363 MiB (draft: 0.000 MiB)
|
|
0.16.845.901 I srv load: - looking for better prompt, base f_keep = 0.364, sim = 0.738
|
|
0.16.845.908 I srv update: - cache state: 1 prompts, 37.153 MiB (limits: 8192.000 MiB, 8192 tokens, 29104 est)
|
|
0.16.845.909 I srv update: - prompt 0x62cb905c65c0: 132 tokens, checkpoints: 1, 37.153 MiB
|
|
0.16.845.910 I srv get_availabl: prompt cache update took 24.13 ms
|
|
0.16.846.006 I slot launch_slot_: id 3 | task 63 | processing task, is_child = 0
|
|
0.16.846.007 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.16.846.008 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.16.846.021 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.16.846.021 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.16.846.028 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.16.846.028 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.16.846.044 I slot update_slots: id 3 | task 63 | Checking checkpoint with [0, 44] against 0...
|
|
0.16.850.312 W slot update_slots: id 3 | task 63 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.17.638.155 I slot print_timing: id 3 | task 63 | prompt eval time = 99.27 ms / 21 tokens ( 4.73 ms per token, 211.54 tokens per second)
|
|
0.17.638.159 I slot print_timing: id 3 | task 63 | eval time = 692.84 ms / 39 tokens ( 17.77 ms per token, 56.29 tokens per second)
|
|
0.17.638.160 I slot print_timing: id 3 | task 63 | total time = 792.11 ms / 60 tokens
|
|
0.17.638.160 I slot print_timing: id 3 | task 63 | graphs reused = 96
|
|
0.17.638.192 I slot release: id 3 | task 63 | stop processing: n_tokens = 103, truncated = 0
|
|
0.17.638.200 I srv update_slots: all slots are idle
|
|
0.17.640.429 I srv operator(): Chat format: peg-gemma4
|
|
0.17.640.661 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.696 (> 0.100 thold), f_keep = 0.466
|
|
0.17.640.662 I srv get_availabl: updating prompt cache
|
|
0.17.640.685 W srv prompt_save: - saving prompt with length 103, total state size = 22.132 MiB (draft: 0.000 MiB)
|
|
0.17.662.532 I srv load: - looking for better prompt, base f_keep = 0.466, sim = 0.696
|
|
0.17.662.540 I srv update: - cache state: 2 prompts, 68.075 MiB (limits: 8192.000 MiB, 8192 tokens, 28279 est)
|
|
0.17.662.541 I srv update: - prompt 0x62cb905c65c0: 132 tokens, checkpoints: 1, 37.153 MiB
|
|
0.17.662.541 I srv update: - prompt 0x62cb90929c00: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.17.662.542 I srv get_availabl: prompt cache update took 21.88 ms
|
|
0.17.662.628 I slot launch_slot_: id 3 | task 105 | processing task, is_child = 0
|
|
0.17.662.628 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.17.662.629 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.17.662.641 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.17.662.641 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.17.662.648 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.17.662.648 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.17.662.663 I slot update_slots: id 3 | task 105 | Checking checkpoint with [0, 44] against 0...
|
|
0.17.666.898 W slot update_slots: id 3 | task 105 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.18.465.057 I slot print_timing: id 3 | task 105 | prompt eval time = 127.34 ms / 25 tokens ( 5.09 ms per token, 196.33 tokens per second)
|
|
0.18.465.061 I slot print_timing: id 3 | task 105 | eval time = 675.05 ms / 38 tokens ( 17.76 ms per token, 56.29 tokens per second)
|
|
0.18.465.061 I slot print_timing: id 3 | task 105 | total time = 802.39 ms / 63 tokens
|
|
0.18.465.062 I slot print_timing: id 3 | task 105 | graphs reused = 132
|
|
0.18.465.092 I slot release: id 3 | task 105 | stop processing: n_tokens = 106, truncated = 0
|
|
0.18.465.100 I srv update_slots: all slots are idle
|
|
0.18.467.237 I srv operator(): Chat format: peg-gemma4
|
|
0.18.467.460 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.721 (> 0.100 thold), f_keep = 0.462
|
|
0.18.467.461 I srv get_availabl: updating prompt cache
|
|
0.18.467.486 W srv prompt_save: - saving prompt with length 106, total state size = 22.777 MiB (draft: 0.000 MiB)
|
|
0.18.490.250 I srv load: - looking for better prompt, base f_keep = 0.462, sim = 0.721
|
|
0.18.490.262 I srv update: - cache state: 3 prompts, 99.642 MiB (limits: 8192.000 MiB, 8192 tokens, 28035 est)
|
|
0.18.490.263 I srv update: - prompt 0x62cb905c65c0: 132 tokens, checkpoints: 1, 37.153 MiB
|
|
0.18.490.264 I srv update: - prompt 0x62cb90929c00: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.18.490.265 I srv update: - prompt 0x62cb97f28460: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.18.490.266 I srv get_availabl: prompt cache update took 22.80 ms
|
|
0.18.490.367 I slot launch_slot_: id 3 | task 146 | processing task, is_child = 0
|
|
0.18.490.369 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.18.490.370 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.18.490.383 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.18.490.383 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.18.490.391 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.18.490.392 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.18.490.409 I slot update_slots: id 3 | task 146 | Checking checkpoint with [0, 44] against 0...
|
|
0.18.494.535 W slot update_slots: id 3 | task 146 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.19.762.110 I slot print_timing: id 3 | task 146 | prompt eval time = 129.23 ms / 24 tokens ( 5.38 ms per token, 185.72 tokens per second)
|
|
0.19.762.115 I slot print_timing: id 3 | task 146 | eval time = 1142.47 ms / 64 tokens ( 17.85 ms per token, 56.02 tokens per second)
|
|
0.19.762.115 I slot print_timing: id 3 | task 146 | total time = 1271.70 ms / 88 tokens
|
|
0.19.762.116 I slot print_timing: id 3 | task 146 | graphs reused = 194
|
|
0.19.762.155 I slot release: id 3 | task 146 | stop processing: n_tokens = 131, truncated = 0
|
|
0.19.762.163 I srv update_slots: all slots are idle
|
|
0.19.764.418 I srv operator(): Chat format: peg-gemma4
|
|
0.19.764.650 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.710 (> 0.100 thold), f_keep = 0.374
|
|
0.19.764.651 I srv get_availabl: updating prompt cache
|
|
0.19.764.677 W srv prompt_save: - saving prompt with length 131, total state size = 28.148 MiB (draft: 0.000 MiB)
|
|
0.19.791.765 I srv load: - looking for better prompt, base f_keep = 0.374, sim = 0.710
|
|
0.19.791.771 I srv load: - found better prompt with f_keep = 0.386, sim = 0.739
|
|
0.19.804.456 I srv update: - cache state: 3 prompts, 99.427 MiB (limits: 8192.000 MiB, 8192 tokens, 28013 est)
|
|
0.19.804.459 I srv update: - prompt 0x62cb90929c00: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.19.804.460 I srv update: - prompt 0x62cb97f28460: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.19.804.461 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.19.804.462 I srv get_availabl: prompt cache update took 39.81 ms
|
|
0.19.804.543 I slot launch_slot_: id 3 | task 213 | processing task, is_child = 0
|
|
0.19.804.545 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.19.804.546 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.19.804.557 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.19.804.558 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.19.804.565 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.19.804.565 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.19.804.580 I slot update_slots: id 3 | task 213 | Checking checkpoint with [0, 44] against 0...
|
|
0.19.808.908 W slot update_slots: id 3 | task 213 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.20.843.159 I slot print_timing: id 3 | task 213 | prompt eval time = 126.14 ms / 25 tokens ( 5.05 ms per token, 198.19 tokens per second)
|
|
0.20.843.162 I slot print_timing: id 3 | task 213 | eval time = 912.44 ms / 51 tokens ( 17.89 ms per token, 55.89 tokens per second)
|
|
0.20.843.162 I slot print_timing: id 3 | task 213 | total time = 1038.58 ms / 76 tokens
|
|
0.20.843.163 I slot print_timing: id 3 | task 213 | graphs reused = 243
|
|
0.20.843.193 I slot release: id 3 | task 213 | stop processing: n_tokens = 119, truncated = 0
|
|
0.20.843.200 I srv update_slots: all slots are idle
|
|
0.20.845.556 I srv operator(): Chat format: peg-gemma4
|
|
0.20.845.785 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.716 (> 0.100 thold), f_keep = 0.403
|
|
0.20.845.787 I srv get_availabl: updating prompt cache
|
|
0.20.845.825 W srv prompt_save: - saving prompt with length 119, total state size = 25.570 MiB (draft: 0.000 MiB)
|
|
0.20.868.118 I srv load: - looking for better prompt, base f_keep = 0.403, sim = 0.716
|
|
0.20.868.124 I srv load: - found better prompt with f_keep = 0.476, sim = 0.731
|
|
0.20.876.437 I srv update: - cache state: 3 prompts, 102.865 MiB (limits: 8192.000 MiB, 8192 tokens, 28351 est)
|
|
0.20.876.441 I srv update: - prompt 0x62cb97f28460: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.20.876.441 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.20.876.442 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.20.876.443 I srv get_availabl: prompt cache update took 30.66 ms
|
|
0.20.876.530 I slot launch_slot_: id 3 | task 267 | processing task, is_child = 0
|
|
0.20.876.533 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.20.876.534 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.20.876.547 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.20.876.547 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.20.876.555 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.20.876.555 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.20.876.572 I slot update_slots: id 3 | task 267 | Checking checkpoint with [0, 44] against 0...
|
|
0.20.880.787 W slot update_slots: id 3 | task 267 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.21.736.062 I slot print_timing: id 3 | task 267 | prompt eval time = 127.53 ms / 23 tokens ( 5.54 ms per token, 180.35 tokens per second)
|
|
0.21.736.066 I slot print_timing: id 3 | task 267 | eval time = 731.96 ms / 41 tokens ( 17.85 ms per token, 56.01 tokens per second)
|
|
0.21.736.067 I slot print_timing: id 3 | task 267 | total time = 859.49 ms / 64 tokens
|
|
0.21.736.067 I slot print_timing: id 3 | task 267 | graphs reused = 282
|
|
0.21.736.099 I slot release: id 3 | task 267 | stop processing: n_tokens = 107, truncated = 0
|
|
0.21.736.108 I srv update_slots: all slots are idle
|
|
0.21.738.210 I srv operator(): Chat format: peg-gemma4
|
|
0.21.738.439 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.649 (> 0.100 thold), f_keep = 0.449
|
|
0.21.738.441 I srv get_availabl: updating prompt cache
|
|
0.21.738.464 W srv prompt_save: - saving prompt with length 107, total state size = 22.991 MiB (draft: 0.000 MiB)
|
|
0.21.750.331 I srv load: - looking for better prompt, base f_keep = 0.449, sim = 0.649
|
|
0.21.750.335 I srv load: - found better prompt with f_keep = 0.462, sim = 0.662
|
|
0.21.758.894 I srv update: - cache state: 3 prompts, 103.080 MiB (limits: 8192.000 MiB, 8192 tokens, 28371 est)
|
|
0.21.758.898 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.21.758.898 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.21.758.899 I srv update: - prompt 0x62cb8f0a5980: 107 tokens, checkpoints: 1, 31.782 MiB
|
|
0.21.758.900 I srv get_availabl: prompt cache update took 20.46 ms
|
|
0.21.758.979 I slot launch_slot_: id 3 | task 311 | processing task, is_child = 0
|
|
0.21.758.980 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.21.758.981 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.21.758.991 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.21.758.992 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.21.758.998 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.21.758.999 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.21.759.015 I slot update_slots: id 3 | task 311 | Checking checkpoint with [0, 44] against 0...
|
|
0.21.762.917 W slot update_slots: id 3 | task 311 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.22.418.972 I slot print_timing: id 3 | task 311 | prompt eval time = 147.63 ms / 30 tokens ( 4.92 ms per token, 203.21 tokens per second)
|
|
0.22.418.976 I slot print_timing: id 3 | task 311 | eval time = 512.32 ms / 29 tokens ( 17.67 ms per token, 56.61 tokens per second)
|
|
0.22.418.977 I slot print_timing: id 3 | task 311 | total time = 659.95 ms / 59 tokens
|
|
0.22.418.978 I slot print_timing: id 3 | task 311 | graphs reused = 309
|
|
0.22.419.011 I slot release: id 3 | task 311 | stop processing: n_tokens = 102, truncated = 0
|
|
0.22.419.020 I srv update_slots: all slots are idle
|
|
0.22.421.290 I srv operator(): Chat format: peg-gemma4
|
|
0.22.421.537 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.778 (> 0.100 thold), f_keep = 0.480
|
|
0.22.421.539 I srv get_availabl: updating prompt cache
|
|
0.22.421.562 W srv prompt_save: - saving prompt with length 102, total state size = 21.917 MiB (draft: 0.000 MiB)
|
|
0.22.432.888 I srv load: - looking for better prompt, base f_keep = 0.480, sim = 0.778
|
|
0.22.432.897 I srv update: - cache state: 4 prompts, 133.787 MiB (limits: 8192.000 MiB, 8192 tokens, 28105 est)
|
|
0.22.432.898 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.22.432.899 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.22.432.899 I srv update: - prompt 0x62cb8f0a5980: 107 tokens, checkpoints: 1, 31.782 MiB
|
|
0.22.432.900 I srv update: - prompt 0x62cb97f283b0: 102 tokens, checkpoints: 1, 30.707 MiB
|
|
0.22.432.901 I srv get_availabl: prompt cache update took 11.36 ms
|
|
0.22.432.992 I slot launch_slot_: id 3 | task 343 | processing task, is_child = 0
|
|
0.22.432.993 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.22.432.993 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.22.433.005 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.22.433.005 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.22.433.013 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.22.433.013 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.22.433.030 I slot update_slots: id 3 | task 343 | Checking checkpoint with [0, 44] against 0...
|
|
0.22.437.066 W slot update_slots: id 3 | task 343 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.23.600.095 I slot print_timing: id 3 | task 343 | prompt eval time = 96.74 ms / 19 tokens ( 5.09 ms per token, 196.41 tokens per second)
|
|
0.23.600.099 I slot print_timing: id 3 | task 343 | eval time = 1070.32 ms / 60 tokens ( 17.84 ms per token, 56.06 tokens per second)
|
|
0.23.600.100 I slot print_timing: id 3 | task 343 | total time = 1167.06 ms / 79 tokens
|
|
0.23.600.100 I slot print_timing: id 3 | task 343 | graphs reused = 367
|
|
0.23.600.131 I slot release: id 3 | task 343 | stop processing: n_tokens = 122, truncated = 0
|
|
0.23.600.149 I srv update_slots: all slots are idle
|
|
0.23.602.365 I srv operator(): Chat format: peg-gemma4
|
|
0.23.602.837 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.649 (> 0.100 thold), f_keep = 0.393
|
|
0.23.602.839 I srv get_availabl: updating prompt cache
|
|
0.23.602.870 W srv prompt_save: - saving prompt with length 122, total state size = 26.214 MiB (draft: 0.000 MiB)
|
|
0.23.628.129 I srv load: - looking for better prompt, base f_keep = 0.393, sim = 0.649
|
|
0.23.628.135 I srv load: - found better prompt with f_keep = 0.458, sim = 0.662
|
|
0.23.636.649 I srv update: - cache state: 4 prompts, 137.010 MiB (limits: 8192.000 MiB, 8192 tokens, 28340 est)
|
|
0.23.636.653 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.23.636.654 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.23.636.655 I srv update: - prompt 0x62cb97f283b0: 102 tokens, checkpoints: 1, 30.707 MiB
|
|
0.23.636.655 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.23.636.656 I srv get_availabl: prompt cache update took 33.82 ms
|
|
0.23.636.743 I slot launch_slot_: id 3 | task 406 | processing task, is_child = 0
|
|
0.23.636.745 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.23.636.746 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.23.636.759 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.23.636.759 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.23.636.769 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.23.636.769 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.23.636.791 I slot update_slots: id 3 | task 406 | Checking checkpoint with [0, 44] against 0...
|
|
0.23.640.761 W slot update_slots: id 3 | task 406 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.24.348.177 I slot print_timing: id 3 | task 406 | prompt eval time = 144.93 ms / 30 tokens ( 4.83 ms per token, 207.00 tokens per second)
|
|
0.24.348.180 I slot print_timing: id 3 | task 406 | eval time = 566.45 ms / 32 tokens ( 17.70 ms per token, 56.49 tokens per second)
|
|
0.24.348.181 I slot print_timing: id 3 | task 406 | total time = 711.38 ms / 62 tokens
|
|
0.24.348.182 I slot print_timing: id 3 | task 406 | graphs reused = 397
|
|
0.24.348.216 I slot release: id 3 | task 406 | stop processing: n_tokens = 105, truncated = 0
|
|
0.24.348.227 I srv update_slots: all slots are idle
|
|
0.24.350.329 I srv operator(): Chat format: peg-gemma4
|
|
0.24.350.580 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.696 (> 0.100 thold), f_keep = 0.457
|
|
0.24.350.582 I srv get_availabl: updating prompt cache
|
|
0.24.350.607 W srv prompt_save: - saving prompt with length 105, total state size = 22.562 MiB (draft: 0.000 MiB)
|
|
0.24.362.298 I srv load: - looking for better prompt, base f_keep = 0.457, sim = 0.696
|
|
0.24.362.302 I srv load: - found better prompt with f_keep = 0.480, sim = 0.710
|
|
0.24.370.582 I srv update: - cache state: 4 prompts, 137.655 MiB (limits: 8192.000 MiB, 8192 tokens, 28386 est)
|
|
0.24.370.586 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.24.370.587 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.24.370.588 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.24.370.588 I srv update: - prompt 0x62cb9445f1d0: 105 tokens, checkpoints: 1, 31.352 MiB
|
|
0.24.370.589 I srv get_availabl: prompt cache update took 20.01 ms
|
|
0.24.370.671 I slot launch_slot_: id 3 | task 441 | processing task, is_child = 0
|
|
0.24.370.673 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.24.370.674 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.24.370.687 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.24.370.687 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.24.370.694 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.24.370.694 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.24.370.711 I slot update_slots: id 3 | task 441 | Checking checkpoint with [0, 44] against 0...
|
|
0.24.374.535 W slot update_slots: id 3 | task 441 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.25.739.799 I slot print_timing: id 3 | task 441 | prompt eval time = 128.17 ms / 25 tokens ( 5.13 ms per token, 195.05 tokens per second)
|
|
0.25.739.803 I slot print_timing: id 3 | task 441 | eval time = 1240.91 ms / 70 tokens ( 17.73 ms per token, 56.41 tokens per second)
|
|
0.25.739.803 I slot print_timing: id 3 | task 441 | total time = 1369.08 ms / 95 tokens
|
|
0.25.739.804 I slot print_timing: id 3 | task 441 | graphs reused = 465
|
|
0.25.739.836 I slot release: id 3 | task 441 | stop processing: n_tokens = 138, truncated = 0
|
|
0.25.739.844 I srv update_slots: all slots are idle
|
|
0.25.741.992 I srv operator(): Chat format: peg-gemma4
|
|
0.25.742.225 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.649 (> 0.100 thold), f_keep = 0.348
|
|
0.25.742.226 I srv get_availabl: updating prompt cache
|
|
0.25.742.252 W srv prompt_save: - saving prompt with length 138, total state size = 29.652 MiB (draft: 0.000 MiB)
|
|
0.25.759.489 I srv load: - looking for better prompt, base f_keep = 0.348, sim = 0.649
|
|
0.25.759.498 I srv update: - cache state: 5 prompts, 176.097 MiB (limits: 8192.000 MiB, 8192 tokens, 28609 est)
|
|
0.25.759.499 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.25.759.499 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.25.759.500 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.25.759.500 I srv update: - prompt 0x62cb9445f1d0: 105 tokens, checkpoints: 1, 31.352 MiB
|
|
0.25.759.501 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.25.759.502 I srv get_availabl: prompt cache update took 17.27 ms
|
|
0.25.759.597 I slot launch_slot_: id 3 | task 514 | processing task, is_child = 0
|
|
0.25.759.598 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.25.759.599 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.25.759.610 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.25.759.610 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.25.759.617 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.25.759.617 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.25.759.634 I slot update_slots: id 3 | task 514 | Checking checkpoint with [0, 44] against 0...
|
|
0.25.763.839 W slot update_slots: id 3 | task 514 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.26.612.782 I slot print_timing: id 3 | task 514 | prompt eval time = 145.99 ms / 30 tokens ( 4.87 ms per token, 205.49 tokens per second)
|
|
0.26.612.786 I slot print_timing: id 3 | task 514 | eval time = 707.15 ms / 40 tokens ( 17.68 ms per token, 56.57 tokens per second)
|
|
0.26.612.786 I slot print_timing: id 3 | task 514 | total time = 853.14 ms / 70 tokens
|
|
0.26.612.787 I slot print_timing: id 3 | task 514 | graphs reused = 503
|
|
0.26.612.819 I slot release: id 3 | task 514 | stop processing: n_tokens = 113, truncated = 0
|
|
0.26.612.826 I srv update_slots: all slots are idle
|
|
0.26.615.199 I srv operator(): Chat format: peg-gemma4
|
|
0.26.615.431 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.696 (> 0.100 thold), f_keep = 0.425
|
|
0.26.615.433 I srv get_availabl: updating prompt cache
|
|
0.26.615.458 W srv prompt_save: - saving prompt with length 113, total state size = 24.281 MiB (draft: 0.000 MiB)
|
|
0.26.639.351 I srv load: - looking for better prompt, base f_keep = 0.425, sim = 0.696
|
|
0.26.639.361 I srv update: - cache state: 6 prompts, 209.168 MiB (limits: 8192.000 MiB, 8192 tokens, 28511 est)
|
|
0.26.639.362 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.26.639.363 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.26.639.363 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.26.639.364 I srv update: - prompt 0x62cb9445f1d0: 105 tokens, checkpoints: 1, 31.352 MiB
|
|
0.26.639.365 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.26.639.366 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.26.639.370 I srv get_availabl: prompt cache update took 23.94 ms
|
|
0.26.639.457 I slot launch_slot_: id 3 | task 557 | processing task, is_child = 0
|
|
0.26.639.461 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.26.639.462 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.26.639.474 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.26.639.474 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.26.639.481 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.26.639.481 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.26.639.497 I slot update_slots: id 3 | task 557 | Checking checkpoint with [0, 44] against 0...
|
|
0.26.643.537 W slot update_slots: id 3 | task 557 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.27.436.770 I slot print_timing: id 3 | task 557 | prompt eval time = 126.00 ms / 25 tokens ( 5.04 ms per token, 198.41 tokens per second)
|
|
0.27.436.773 I slot print_timing: id 3 | task 557 | eval time = 671.27 ms / 38 tokens ( 17.66 ms per token, 56.61 tokens per second)
|
|
0.27.436.774 I slot print_timing: id 3 | task 557 | total time = 797.27 ms / 63 tokens
|
|
0.27.436.775 I slot print_timing: id 3 | task 557 | graphs reused = 539
|
|
0.27.436.806 I slot release: id 3 | task 557 | stop processing: n_tokens = 106, truncated = 0
|
|
0.27.436.814 I srv update_slots: all slots are idle
|
|
0.27.438.927 I srv operator(): Chat format: peg-gemma4
|
|
0.27.439.147 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.686 (> 0.100 thold), f_keep = 0.453
|
|
0.27.439.149 I srv get_availabl: updating prompt cache
|
|
0.27.439.177 W srv prompt_save: - saving prompt with length 106, total state size = 22.777 MiB (draft: 0.000 MiB)
|
|
0.27.461.584 I srv load: - looking for better prompt, base f_keep = 0.453, sim = 0.686
|
|
0.27.461.592 I srv update: - cache state: 7 prompts, 240.735 MiB (limits: 8192.000 MiB, 8192 tokens, 28380 est)
|
|
0.27.461.593 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.27.461.594 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.27.461.594 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.27.461.595 I srv update: - prompt 0x62cb9445f1d0: 105 tokens, checkpoints: 1, 31.352 MiB
|
|
0.27.461.596 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.27.461.596 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.27.461.597 I srv update: - prompt 0x62cb97bdf550: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.27.461.598 I srv get_availabl: prompt cache update took 22.45 ms
|
|
0.27.461.685 I slot launch_slot_: id 3 | task 598 | processing task, is_child = 0
|
|
0.27.461.685 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.27.461.686 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.27.461.696 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.27.461.696 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.27.461.703 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.27.461.703 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.27.461.719 I slot update_slots: id 3 | task 598 | Checking checkpoint with [0, 44] against 0...
|
|
0.27.465.824 W slot update_slots: id 3 | task 598 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.27.866.781 I slot print_timing: id 3 | task 598 | prompt eval time = 128.75 ms / 26 tokens ( 4.95 ms per token, 201.94 tokens per second)
|
|
0.27.866.785 I slot print_timing: id 3 | task 598 | eval time = 276.30 ms / 16 tokens ( 17.27 ms per token, 57.91 tokens per second)
|
|
0.27.866.786 I slot print_timing: id 3 | task 598 | total time = 405.06 ms / 42 tokens
|
|
0.27.866.787 I slot print_timing: id 3 | task 598 | graphs reused = 553
|
|
0.27.866.818 I slot release: id 3 | task 598 | stop processing: n_tokens = 85, truncated = 0
|
|
0.27.866.827 I srv update_slots: all slots are idle
|
|
0.27.869.030 I srv operator(): Chat format: peg-gemma4
|
|
0.27.869.264 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.686 (> 0.100 thold), f_keep = 0.565
|
|
0.27.869.324 I slot launch_slot_: id 3 | task 617 | processing task, is_child = 0
|
|
0.27.869.326 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.27.869.327 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.27.869.336 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.27.869.336 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.27.869.343 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.27.869.343 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.27.869.354 I slot update_slots: id 3 | task 617 | Checking checkpoint with [0, 44] against 0...
|
|
0.27.873.630 W slot update_slots: id 3 | task 617 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.28.597.416 I slot print_timing: id 3 | task 617 | prompt eval time = 127.37 ms / 26 tokens ( 4.90 ms per token, 204.12 tokens per second)
|
|
0.28.597.419 I slot print_timing: id 3 | task 617 | eval time = 600.68 ms / 34 tokens ( 17.67 ms per token, 56.60 tokens per second)
|
|
0.28.597.420 I slot print_timing: id 3 | task 617 | total time = 728.06 ms / 60 tokens
|
|
0.28.597.421 I slot print_timing: id 3 | task 617 | graphs reused = 585
|
|
0.28.597.457 I slot release: id 3 | task 617 | stop processing: n_tokens = 103, truncated = 0
|
|
0.28.597.465 I srv update_slots: all slots are idle
|
|
0.28.599.737 I srv operator(): Chat format: peg-gemma4
|
|
0.28.600.177 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.667 (> 0.100 thold), f_keep = 0.466
|
|
0.28.600.178 I srv get_availabl: updating prompt cache
|
|
0.28.600.203 W srv prompt_save: - saving prompt with length 103, total state size = 22.132 MiB (draft: 0.000 MiB)
|
|
0.28.622.500 I srv load: - looking for better prompt, base f_keep = 0.466, sim = 0.667
|
|
0.28.622.512 I srv update: - cache state: 8 prompts, 271.657 MiB (limits: 8192.000 MiB, 8192 tokens, 28255 est)
|
|
0.28.622.513 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.28.622.514 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.28.622.514 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.28.622.515 I srv update: - prompt 0x62cb9445f1d0: 105 tokens, checkpoints: 1, 31.352 MiB
|
|
0.28.622.515 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.28.622.516 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.28.622.517 I srv update: - prompt 0x62cb97bdf550: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.28.622.522 I srv update: - prompt 0x62cb97f3f080: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.28.622.523 I srv get_availabl: prompt cache update took 22.34 ms
|
|
0.28.622.611 I slot launch_slot_: id 3 | task 654 | processing task, is_child = 0
|
|
0.28.622.612 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.28.622.612 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.28.622.624 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.28.622.624 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.28.622.631 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.28.622.631 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.28.622.646 I slot update_slots: id 3 | task 654 | Checking checkpoint with [0, 44] against 0...
|
|
0.28.626.897 W slot update_slots: id 3 | task 654 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.29.445.799 I slot print_timing: id 3 | task 654 | prompt eval time = 130.89 ms / 28 tokens ( 4.67 ms per token, 213.92 tokens per second)
|
|
0.29.445.803 I slot print_timing: id 3 | task 654 | eval time = 692.26 ms / 39 tokens ( 17.75 ms per token, 56.34 tokens per second)
|
|
0.29.445.803 I slot print_timing: id 3 | task 654 | total time = 823.15 ms / 67 tokens
|
|
0.29.445.804 I slot print_timing: id 3 | task 654 | graphs reused = 622
|
|
0.29.445.838 I slot release: id 3 | task 654 | stop processing: n_tokens = 110, truncated = 0
|
|
0.29.445.847 I srv update_slots: all slots are idle
|
|
0.29.448.149 I srv operator(): Chat format: peg-gemma4
|
|
0.29.448.407 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.706 (> 0.100 thold), f_keep = 0.436
|
|
0.29.448.409 I srv get_availabl: updating prompt cache
|
|
0.29.448.442 W srv prompt_save: - saving prompt with length 110, total state size = 23.636 MiB (draft: 0.000 MiB)
|
|
0.29.471.862 I srv load: - looking for better prompt, base f_keep = 0.436, sim = 0.706
|
|
0.29.471.869 I srv load: - found better prompt with f_keep = 0.467, sim = 0.721
|
|
0.29.480.199 I srv update: - cache state: 8 prompts, 272.732 MiB (limits: 8192.000 MiB, 8192 tokens, 28294 est)
|
|
0.29.480.203 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.29.480.204 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.29.480.204 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.29.480.205 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.29.480.205 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.29.480.206 I srv update: - prompt 0x62cb97bdf550: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.29.480.206 I srv update: - prompt 0x62cb97f3f080: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.29.480.207 I srv update: - prompt 0x62cb90929c00: 110 tokens, checkpoints: 1, 32.426 MiB
|
|
0.29.480.208 I srv get_availabl: prompt cache update took 31.80 ms
|
|
0.29.480.287 I slot launch_slot_: id 3 | task 696 | processing task, is_child = 0
|
|
0.29.480.288 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.29.480.289 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.29.480.300 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.29.480.300 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.29.480.308 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.29.480.308 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.29.480.323 I slot update_slots: id 3 | task 696 | Checking checkpoint with [0, 44] against 0...
|
|
0.29.484.078 W slot update_slots: id 3 | task 696 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.30.189.781 I slot print_timing: id 3 | task 696 | prompt eval time = 125.49 ms / 24 tokens ( 5.23 ms per token, 191.25 tokens per second)
|
|
0.30.189.784 I slot print_timing: id 3 | task 696 | eval time = 583.96 ms / 33 tokens ( 17.70 ms per token, 56.51 tokens per second)
|
|
0.30.189.785 I slot print_timing: id 3 | task 696 | total time = 709.45 ms / 57 tokens
|
|
0.30.189.785 I slot print_timing: id 3 | task 696 | graphs reused = 653
|
|
0.30.189.817 I slot release: id 3 | task 696 | stop processing: n_tokens = 100, truncated = 0
|
|
0.30.189.824 I srv update_slots: all slots are idle
|
|
0.30.191.906 I srv operator(): Chat format: peg-gemma4
|
|
0.30.192.125 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.667 (> 0.100 thold), f_keep = 0.480
|
|
0.30.192.127 I srv get_availabl: updating prompt cache
|
|
0.30.192.152 W srv prompt_save: - saving prompt with length 100, total state size = 21.487 MiB (draft: 0.000 MiB)
|
|
0.30.203.444 I srv load: - looking for better prompt, base f_keep = 0.480, sim = 0.667
|
|
0.30.203.455 I srv update: - cache state: 9 prompts, 303.009 MiB (limits: 8192.000 MiB, 8192 tokens, 28170 est)
|
|
0.30.203.458 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.30.203.458 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.30.203.459 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.30.203.459 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.30.203.460 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.30.203.460 I srv update: - prompt 0x62cb97bdf550: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.30.203.461 I srv update: - prompt 0x62cb97f3f080: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.30.203.461 I srv update: - prompt 0x62cb90929c00: 110 tokens, checkpoints: 1, 32.426 MiB
|
|
0.30.203.462 I srv update: - prompt 0x62cb906f0770: 100 tokens, checkpoints: 1, 30.278 MiB
|
|
0.30.203.464 I srv get_availabl: prompt cache update took 11.34 ms
|
|
0.30.203.558 I slot launch_slot_: id 3 | task 732 | processing task, is_child = 0
|
|
0.30.203.559 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.30.203.560 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.30.203.572 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.30.203.572 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.30.203.579 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.30.203.579 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.30.203.595 I slot update_slots: id 3 | task 732 | Checking checkpoint with [0, 44] against 0...
|
|
0.30.207.939 W slot update_slots: id 3 | task 732 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.31.059.846 I slot print_timing: id 3 | task 732 | prompt eval time = 128.86 ms / 28 tokens ( 4.60 ms per token, 217.29 tokens per second)
|
|
0.31.059.849 I slot print_timing: id 3 | task 732 | eval time = 727.38 ms / 41 tokens ( 17.74 ms per token, 56.37 tokens per second)
|
|
0.31.059.850 I slot print_timing: id 3 | task 732 | total time = 856.25 ms / 69 tokens
|
|
0.31.059.851 I slot print_timing: id 3 | task 732 | graphs reused = 692
|
|
0.31.059.889 I slot release: id 3 | task 732 | stop processing: n_tokens = 112, truncated = 0
|
|
0.31.059.899 I srv update_slots: all slots are idle
|
|
0.31.062.148 I srv operator(): Chat format: peg-gemma4
|
|
0.31.062.378 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.716 (> 0.100 thold), f_keep = 0.429
|
|
0.31.062.380 I srv get_availabl: updating prompt cache
|
|
0.31.062.416 W srv prompt_save: - saving prompt with length 112, total state size = 24.066 MiB (draft: 0.000 MiB)
|
|
0.31.086.076 I srv load: - looking for better prompt, base f_keep = 0.429, sim = 0.716
|
|
0.31.086.085 I srv load: - found better prompt with f_keep = 0.490, sim = 0.731
|
|
0.31.094.174 I srv update: - cache state: 9 prompts, 305.588 MiB (limits: 8192.000 MiB, 8192 tokens, 28254 est)
|
|
0.31.094.178 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.31.094.179 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.31.094.180 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.31.094.180 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.31.094.181 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.31.094.182 I srv update: - prompt 0x62cb97bdf550: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.31.094.183 I srv update: - prompt 0x62cb97f3f080: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.31.094.183 I srv update: - prompt 0x62cb90929c00: 110 tokens, checkpoints: 1, 32.426 MiB
|
|
0.31.094.184 I srv update: - prompt 0x62cb9387d0a0: 112 tokens, checkpoints: 1, 32.856 MiB
|
|
0.31.094.185 I srv get_availabl: prompt cache update took 31.80 ms
|
|
0.31.094.288 I slot launch_slot_: id 3 | task 776 | processing task, is_child = 0
|
|
0.31.094.291 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.31.094.292 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.31.094.307 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.31.094.308 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.31.094.317 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.31.094.318 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.31.094.338 I slot update_slots: id 3 | task 776 | Checking checkpoint with [0, 44] against 0...
|
|
0.31.098.267 W slot update_slots: id 3 | task 776 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.31.443.858 I slot print_timing: id 3 | task 776 | prompt eval time = 125.52 ms / 23 tokens ( 5.46 ms per token, 183.24 tokens per second)
|
|
0.31.443.862 I slot print_timing: id 3 | task 776 | eval time = 224.00 ms / 13 tokens ( 17.23 ms per token, 58.04 tokens per second)
|
|
0.31.443.863 I slot print_timing: id 3 | task 776 | total time = 349.52 ms / 36 tokens
|
|
0.31.443.863 I slot print_timing: id 3 | task 776 | graphs reused = 703
|
|
0.31.443.903 I slot release: id 3 | task 776 | stop processing: n_tokens = 79, truncated = 0
|
|
0.31.443.912 I srv update_slots: all slots are idle
|
|
0.31.446.099 I srv operator(): Chat format: peg-gemma4
|
|
0.31.446.329 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.738 (> 0.100 thold), f_keep = 0.608
|
|
0.31.446.388 I slot launch_slot_: id 3 | task 792 | processing task, is_child = 0
|
|
0.31.446.390 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.31.446.392 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.31.446.401 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.31.446.402 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.31.446.410 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.31.446.410 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.31.446.422 I slot update_slots: id 3 | task 792 | Checking checkpoint with [0, 44] against 0...
|
|
0.31.450.833 W slot update_slots: id 3 | task 792 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.31.894.867 I slot print_timing: id 3 | task 792 | prompt eval time = 99.14 ms / 21 tokens ( 4.72 ms per token, 211.82 tokens per second)
|
|
0.31.894.870 I slot print_timing: id 3 | task 792 | eval time = 349.30 ms / 20 tokens ( 17.46 ms per token, 57.26 tokens per second)
|
|
0.31.894.871 I slot print_timing: id 3 | task 792 | total time = 448.44 ms / 41 tokens
|
|
0.31.894.872 I slot print_timing: id 3 | task 792 | graphs reused = 721
|
|
0.31.894.939 I slot release: id 3 | task 792 | stop processing: n_tokens = 84, truncated = 0
|
|
0.31.894.949 I srv update_slots: all slots are idle
|
|
0.31.896.803 I srv operator(): Chat format: peg-gemma4
|
|
0.31.897.023 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.754 (> 0.100 thold), f_keep = 0.583
|
|
0.31.897.081 I slot launch_slot_: id 3 | task 815 | processing task, is_child = 0
|
|
0.31.897.083 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.31.897.084 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.31.897.093 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.31.897.093 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.31.897.101 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.31.897.101 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.31.897.113 I slot update_slots: id 3 | task 815 | Checking checkpoint with [0, 44] against 0...
|
|
0.31.901.461 W slot update_slots: id 3 | task 815 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.32.201.846 I slot print_timing: id 3 | task 815 | prompt eval time = 98.36 ms / 21 tokens ( 4.68 ms per token, 213.49 tokens per second)
|
|
0.32.201.850 I slot print_timing: id 3 | task 815 | eval time = 206.36 ms / 12 tokens ( 17.20 ms per token, 58.15 tokens per second)
|
|
0.32.201.851 I slot print_timing: id 3 | task 815 | total time = 304.73 ms / 33 tokens
|
|
0.32.201.851 I slot print_timing: id 3 | task 815 | graphs reused = 731
|
|
0.32.201.890 I slot release: id 3 | task 815 | stop processing: n_tokens = 76, truncated = 0
|
|
0.32.201.900 I srv update_slots: all slots are idle
|
|
0.32.204.126 I srv operator(): Chat format: peg-gemma4
|
|
0.32.204.571 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.750 (> 0.100 thold), f_keep = 0.632
|
|
0.32.204.611 I slot launch_slot_: id 3 | task 830 | processing task, is_child = 0
|
|
0.32.204.613 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.32.204.615 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.32.204.625 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.32.204.625 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.32.204.633 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.32.204.633 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.32.204.645 I slot update_slots: id 3 | task 830 | Checking checkpoint with [0, 44] against 0...
|
|
0.32.209.019 W slot update_slots: id 3 | task 830 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.32.525.837 I slot print_timing: id 3 | task 830 | prompt eval time = 97.13 ms / 20 tokens ( 4.86 ms per token, 205.91 tokens per second)
|
|
0.32.525.841 I slot print_timing: id 3 | task 830 | eval time = 224.06 ms / 13 tokens ( 17.24 ms per token, 58.02 tokens per second)
|
|
0.32.525.842 I slot print_timing: id 3 | task 830 | total time = 321.19 ms / 33 tokens
|
|
0.32.525.843 I slot print_timing: id 3 | task 830 | graphs reused = 742
|
|
0.32.525.880 I slot release: id 3 | task 830 | stop processing: n_tokens = 76, truncated = 0
|
|
0.32.525.889 I srv update_slots: all slots are idle
|
|
0.32.527.792 I srv operator(): Chat format: peg-gemma4
|
|
0.32.528.014 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.686 (> 0.100 thold), f_keep = 0.632
|
|
0.32.528.073 I slot launch_slot_: id 3 | task 846 | processing task, is_child = 0
|
|
0.32.528.075 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.32.528.076 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.32.528.086 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.32.528.086 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.32.528.094 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.32.528.095 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.32.528.107 I slot update_slots: id 3 | task 846 | Checking checkpoint with [0, 44] against 0...
|
|
0.32.532.433 W slot update_slots: id 3 | task 846 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.32.913.862 I slot print_timing: id 3 | task 846 | prompt eval time = 126.55 ms / 26 tokens ( 4.87 ms per token, 205.45 tokens per second)
|
|
0.32.913.866 I slot print_timing: id 3 | task 846 | eval time = 259.20 ms / 15 tokens ( 17.28 ms per token, 57.87 tokens per second)
|
|
0.32.913.867 I slot print_timing: id 3 | task 846 | total time = 385.75 ms / 41 tokens
|
|
0.32.913.867 I slot print_timing: id 3 | task 846 | graphs reused = 755
|
|
0.32.913.906 I slot release: id 3 | task 846 | stop processing: n_tokens = 84, truncated = 0
|
|
0.32.913.916 I srv update_slots: all slots are idle
|
|
0.32.915.953 I srv operator(): Chat format: peg-gemma4
|
|
0.32.916.183 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.706 (> 0.100 thold), f_keep = 0.571
|
|
0.32.916.246 I slot launch_slot_: id 3 | task 864 | processing task, is_child = 0
|
|
0.32.916.248 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.32.916.249 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.32.916.258 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.32.916.258 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.32.916.266 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.32.916.267 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.32.916.279 I slot update_slots: id 3 | task 864 | Checking checkpoint with [0, 44] against 0...
|
|
0.32.920.533 W slot update_slots: id 3 | task 864 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.33.355.876 I slot print_timing: id 3 | task 864 | prompt eval time = 126.21 ms / 24 tokens ( 5.26 ms per token, 190.15 tokens per second)
|
|
0.33.355.879 I slot print_timing: id 3 | task 864 | eval time = 313.38 ms / 18 tokens ( 17.41 ms per token, 57.44 tokens per second)
|
|
0.33.355.880 I slot print_timing: id 3 | task 864 | total time = 439.59 ms / 42 tokens
|
|
0.33.355.881 I slot print_timing: id 3 | task 864 | graphs reused = 771
|
|
0.33.355.920 I slot release: id 3 | task 864 | stop processing: n_tokens = 85, truncated = 0
|
|
0.33.355.930 I srv update_slots: all slots are idle
|
|
0.33.358.043 I srv operator(): Chat format: peg-gemma4
|
|
0.33.358.308 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.649 (> 0.100 thold), f_keep = 0.565
|
|
0.33.358.365 I slot launch_slot_: id 3 | task 885 | processing task, is_child = 0
|
|
0.33.358.367 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.33.358.368 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.33.358.377 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.33.358.377 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.33.358.385 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.33.358.386 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.33.358.397 I slot update_slots: id 3 | task 885 | Checking checkpoint with [0, 44] against 0...
|
|
0.33.362.830 W slot update_slots: id 3 | task 885 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.33.926.856 I slot print_timing: id 3 | task 885 | prompt eval time = 146.75 ms / 30 tokens ( 4.89 ms per token, 204.43 tokens per second)
|
|
0.33.926.860 I slot print_timing: id 3 | task 885 | eval time = 421.70 ms / 24 tokens ( 17.57 ms per token, 56.91 tokens per second)
|
|
0.33.926.861 I slot print_timing: id 3 | task 885 | total time = 568.45 ms / 54 tokens
|
|
0.33.926.862 I slot print_timing: id 3 | task 885 | graphs reused = 793
|
|
0.33.926.902 I slot release: id 3 | task 885 | stop processing: n_tokens = 97, truncated = 0
|
|
0.33.926.910 I srv update_slots: all slots are idle
|
|
0.33.929.102 I srv operator(): Chat format: peg-gemma4
|
|
0.33.929.339 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.649 (> 0.100 thold), f_keep = 0.495
|
|
0.33.929.342 I srv get_availabl: updating prompt cache
|
|
0.33.929.374 W srv prompt_save: - saving prompt with length 97, total state size = 20.843 MiB (draft: 0.000 MiB)
|
|
0.33.940.684 I srv load: - looking for better prompt, base f_keep = 0.495, sim = 0.649
|
|
0.33.940.698 I srv update: - cache state: 10 prompts, 335.220 MiB (limits: 8192.000 MiB, 8192 tokens, 28127 est)
|
|
0.33.940.699 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.33.940.699 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.33.940.700 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.33.940.701 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.33.940.701 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.33.940.702 I srv update: - prompt 0x62cb97bdf550: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.33.940.703 I srv update: - prompt 0x62cb97f3f080: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.33.940.703 I srv update: - prompt 0x62cb90929c00: 110 tokens, checkpoints: 1, 32.426 MiB
|
|
0.33.940.704 I srv update: - prompt 0x62cb9387d0a0: 112 tokens, checkpoints: 1, 32.856 MiB
|
|
0.33.940.705 I srv update: - prompt 0x62cb909a8da0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.33.940.706 I srv get_availabl: prompt cache update took 11.36 ms
|
|
0.33.940.813 I slot launch_slot_: id 3 | task 912 | processing task, is_child = 0
|
|
0.33.940.814 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.33.940.815 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.33.940.829 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.33.940.829 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.33.940.837 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.33.940.837 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.33.940.854 I slot update_slots: id 3 | task 912 | Checking checkpoint with [0, 44] against 0...
|
|
0.33.944.960 W slot update_slots: id 3 | task 912 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.34.508.843 I slot print_timing: id 3 | task 912 | prompt eval time = 146.44 ms / 30 tokens ( 4.88 ms per token, 204.86 tokens per second)
|
|
0.34.508.847 I slot print_timing: id 3 | task 912 | eval time = 421.54 ms / 24 tokens ( 17.56 ms per token, 56.93 tokens per second)
|
|
0.34.508.847 I slot print_timing: id 3 | task 912 | total time = 567.98 ms / 54 tokens
|
|
0.34.508.848 I slot print_timing: id 3 | task 912 | graphs reused = 815
|
|
0.34.508.890 I slot release: id 3 | task 912 | stop processing: n_tokens = 97, truncated = 0
|
|
0.34.508.899 I srv update_slots: all slots are idle
|
|
0.34.510.816 I srv operator(): Chat format: peg-gemma4
|
|
0.34.511.048 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.750 (> 0.100 thold), f_keep = 0.495
|
|
0.34.511.050 I srv get_availabl: updating prompt cache
|
|
0.34.511.084 W srv prompt_save: - saving prompt with length 97, total state size = 20.843 MiB (draft: 0.000 MiB)
|
|
0.34.532.487 I srv load: - looking for better prompt, base f_keep = 0.495, sim = 0.750
|
|
0.34.532.501 I srv update: - cache state: 11 prompts, 364.853 MiB (limits: 8192.000 MiB, 8192 tokens, 28021 est)
|
|
0.34.532.502 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.34.532.503 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.34.532.503 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.34.532.504 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.34.532.505 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.34.532.505 I srv update: - prompt 0x62cb97bdf550: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.34.532.506 I srv update: - prompt 0x62cb97f3f080: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.34.532.507 I srv update: - prompt 0x62cb90929c00: 110 tokens, checkpoints: 1, 32.426 MiB
|
|
0.34.532.507 I srv update: - prompt 0x62cb9387d0a0: 112 tokens, checkpoints: 1, 32.856 MiB
|
|
0.34.532.508 I srv update: - prompt 0x62cb909a8da0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.34.532.508 I srv update: - prompt 0x62cb903b73b0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.34.532.509 I srv get_availabl: prompt cache update took 21.46 ms
|
|
0.34.532.610 I slot launch_slot_: id 3 | task 939 | processing task, is_child = 0
|
|
0.34.532.611 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.34.532.612 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.34.532.624 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.34.532.624 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.34.532.635 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.34.532.635 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.34.532.653 I slot update_slots: id 3 | task 939 | Checking checkpoint with [0, 44] against 0...
|
|
0.34.536.953 W slot update_slots: id 3 | task 939 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.34.781.931 I slot print_timing: id 3 | task 939 | prompt eval time = 98.10 ms / 20 tokens ( 4.90 ms per token, 203.88 tokens per second)
|
|
0.34.781.936 I slot print_timing: id 3 | task 939 | eval time = 151.17 ms / 9 tokens ( 16.80 ms per token, 59.53 tokens per second)
|
|
0.34.781.937 I slot print_timing: id 3 | task 939 | total time = 249.27 ms / 29 tokens
|
|
0.34.781.938 I slot print_timing: id 3 | task 939 | graphs reused = 822
|
|
0.34.781.976 I slot release: id 3 | task 939 | stop processing: n_tokens = 72, truncated = 0
|
|
0.34.781.985 I srv update_slots: all slots are idle
|
|
0.34.784.052 I srv operator(): Chat format: peg-gemma4
|
|
0.34.784.284 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.706 (> 0.100 thold), f_keep = 0.667
|
|
0.34.784.342 I slot launch_slot_: id 3 | task 951 | processing task, is_child = 0
|
|
0.34.784.344 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.34.784.345 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.34.784.355 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.34.784.355 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.34.784.363 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.34.784.363 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.34.784.375 I slot update_slots: id 3 | task 951 | Checking checkpoint with [0, 44] against 0...
|
|
0.34.788.848 W slot update_slots: id 3 | task 951 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.35.133.874 I slot print_timing: id 3 | task 951 | prompt eval time = 126.16 ms / 24 tokens ( 5.26 ms per token, 190.24 tokens per second)
|
|
0.35.133.879 I slot print_timing: id 3 | task 951 | eval time = 223.34 ms / 13 tokens ( 17.18 ms per token, 58.21 tokens per second)
|
|
0.35.133.880 I slot print_timing: id 3 | task 951 | total time = 349.49 ms / 37 tokens
|
|
0.35.133.880 I slot print_timing: id 3 | task 951 | graphs reused = 833
|
|
0.35.133.921 I slot release: id 3 | task 951 | stop processing: n_tokens = 80, truncated = 0
|
|
0.35.133.931 I srv update_slots: all slots are idle
|
|
0.35.135.981 I srv operator(): Chat format: peg-gemma4
|
|
0.35.136.209 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.686 (> 0.100 thold), f_keep = 0.600
|
|
0.35.136.270 I slot launch_slot_: id 3 | task 967 | processing task, is_child = 0
|
|
0.35.136.272 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.35.136.273 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.35.136.284 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.35.136.285 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.35.136.293 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.35.136.293 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.35.136.306 I slot update_slots: id 3 | task 967 | Checking checkpoint with [0, 44] against 0...
|
|
0.35.140.597 W slot update_slots: id 3 | task 967 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.35.542.918 I slot print_timing: id 3 | task 967 | prompt eval time = 129.00 ms / 26 tokens ( 4.96 ms per token, 201.55 tokens per second)
|
|
0.35.542.922 I slot print_timing: id 3 | task 967 | eval time = 277.61 ms / 16 tokens ( 17.35 ms per token, 57.64 tokens per second)
|
|
0.35.542.923 I slot print_timing: id 3 | task 967 | total time = 406.61 ms / 42 tokens
|
|
0.35.542.924 I slot print_timing: id 3 | task 967 | graphs reused = 847
|
|
0.35.542.963 I slot release: id 3 | task 967 | stop processing: n_tokens = 85, truncated = 0
|
|
0.35.542.972 I srv update_slots: all slots are idle
|
|
0.35.545.221 I srv operator(): Chat format: peg-gemma4
|
|
0.35.545.460 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.593 (> 0.100 thold), f_keep = 0.565
|
|
0.35.545.501 I slot launch_slot_: id 3 | task 986 | processing task, is_child = 0
|
|
0.35.545.503 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.35.545.504 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.35.545.514 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.35.545.515 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.35.545.522 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.35.545.523 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.35.545.535 I slot update_slots: id 3 | task 986 | Checking checkpoint with [0, 44] against 0...
|
|
0.35.549.945 W slot update_slots: id 3 | task 986 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.37.871.884 I slot print_timing: id 3 | task 986 | prompt eval time = 157.86 ms / 37 tokens ( 4.27 ms per token, 234.38 tokens per second)
|
|
0.37.871.887 I slot print_timing: id 3 | task 986 | eval time = 2168.48 ms / 121 tokens ( 17.92 ms per token, 55.80 tokens per second)
|
|
0.37.871.888 I slot print_timing: id 3 | task 986 | total time = 2326.34 ms / 158 tokens
|
|
0.37.871.888 I slot print_timing: id 3 | task 986 | graphs reused = 966
|
|
0.37.871.921 I slot release: id 3 | task 986 | stop processing: n_tokens = 201, truncated = 0
|
|
0.37.871.929 I srv update_slots: all slots are idle
|
|
0.37.874.102 I srv operator(): Chat format: peg-gemma4
|
|
0.37.874.348 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.681 (> 0.100 thold), f_keep = 0.244
|
|
0.37.874.350 I srv get_availabl: updating prompt cache
|
|
0.37.874.378 W srv prompt_save: - saving prompt with length 201, total state size = 43.189 MiB (draft: 0.000 MiB)
|
|
0.37.911.774 I srv load: - looking for better prompt, base f_keep = 0.244, sim = 0.681
|
|
0.37.911.791 I srv update: - cache state: 12 prompts, 416.833 MiB (limits: 8192.000 MiB, 8192 tokens, 28477 est)
|
|
0.37.911.792 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.37.911.793 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.37.911.793 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.37.911.794 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.37.911.795 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.37.911.795 I srv update: - prompt 0x62cb97bdf550: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.37.911.796 I srv update: - prompt 0x62cb97f3f080: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.37.911.797 I srv update: - prompt 0x62cb90929c00: 110 tokens, checkpoints: 1, 32.426 MiB
|
|
0.37.911.800 I srv update: - prompt 0x62cb9387d0a0: 112 tokens, checkpoints: 1, 32.856 MiB
|
|
0.37.911.801 I srv update: - prompt 0x62cb909a8da0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.37.911.802 I srv update: - prompt 0x62cb903b73b0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.37.911.803 I srv update: - prompt 0x62cb98865830: 201 tokens, checkpoints: 1, 51.979 MiB
|
|
0.37.911.804 I srv get_availabl: prompt cache update took 37.45 ms
|
|
0.37.911.910 I slot launch_slot_: id 3 | task 1110 | processing task, is_child = 0
|
|
0.37.911.911 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.37.911.912 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.37.911.926 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.37.911.927 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.37.911.935 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.37.911.935 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.37.911.956 I slot update_slots: id 3 | task 1110 | Checking checkpoint with [0, 44] against 0...
|
|
0.37.916.088 W slot update_slots: id 3 | task 1110 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.39.312.871 I slot print_timing: id 3 | task 1110 | prompt eval time = 132.99 ms / 28 tokens ( 4.75 ms per token, 210.54 tokens per second)
|
|
0.39.312.875 I slot print_timing: id 3 | task 1110 | eval time = 1267.92 ms / 71 tokens ( 17.86 ms per token, 56.00 tokens per second)
|
|
0.39.312.875 I slot print_timing: id 3 | task 1110 | total time = 1400.91 ms / 99 tokens
|
|
0.39.312.876 I slot print_timing: id 3 | task 1110 | graphs reused = 1035
|
|
0.39.312.910 I slot release: id 3 | task 1110 | stop processing: n_tokens = 142, truncated = 0
|
|
0.39.312.918 I srv update_slots: all slots are idle
|
|
0.39.315.187 I srv operator(): Chat format: peg-gemma4
|
|
0.39.315.437 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.716 (> 0.100 thold), f_keep = 0.338
|
|
0.39.315.439 I srv get_availabl: updating prompt cache
|
|
0.39.315.464 W srv prompt_save: - saving prompt with length 142, total state size = 30.512 MiB (draft: 0.000 MiB)
|
|
0.39.343.878 I srv load: - looking for better prompt, base f_keep = 0.338, sim = 0.716
|
|
0.39.343.894 I srv update: - cache state: 13 prompts, 456.134 MiB (limits: 8192.000 MiB, 8192 tokens, 28573 est)
|
|
0.39.343.895 I srv update: - prompt 0x62cb90786750: 131 tokens, checkpoints: 1, 36.938 MiB
|
|
0.39.343.896 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.39.343.898 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.39.343.899 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.39.343.900 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.39.343.901 I srv update: - prompt 0x62cb97bdf550: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.39.343.902 I srv update: - prompt 0x62cb97f3f080: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.39.343.902 I srv update: - prompt 0x62cb90929c00: 110 tokens, checkpoints: 1, 32.426 MiB
|
|
0.39.343.903 I srv update: - prompt 0x62cb9387d0a0: 112 tokens, checkpoints: 1, 32.856 MiB
|
|
0.39.343.903 I srv update: - prompt 0x62cb909a8da0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.39.343.904 I srv update: - prompt 0x62cb903b73b0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.39.343.905 I srv update: - prompt 0x62cb98865830: 201 tokens, checkpoints: 1, 51.979 MiB
|
|
0.39.343.905 I srv update: - prompt 0x62cb9077aed0: 142 tokens, checkpoints: 1, 39.302 MiB
|
|
0.39.343.907 I srv get_availabl: prompt cache update took 28.47 ms
|
|
0.39.344.009 I slot launch_slot_: id 3 | task 1184 | processing task, is_child = 0
|
|
0.39.344.010 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.39.344.011 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.39.344.026 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.39.344.026 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.39.344.035 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.39.344.035 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.39.344.053 I slot update_slots: id 3 | task 1184 | Checking checkpoint with [0, 44] against 0...
|
|
0.39.348.106 W slot update_slots: id 3 | task 1184 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.40.682.869 I slot print_timing: id 3 | task 1184 | prompt eval time = 124.70 ms / 23 tokens ( 5.42 ms per token, 184.44 tokens per second)
|
|
0.40.682.874 I slot print_timing: id 3 | task 1184 | eval time = 1214.11 ms / 68 tokens ( 17.85 ms per token, 56.01 tokens per second)
|
|
0.40.682.875 I slot print_timing: id 3 | task 1184 | total time = 1338.81 ms / 91 tokens
|
|
0.40.682.876 I slot print_timing: id 3 | task 1184 | graphs reused = 1101
|
|
0.40.682.917 I slot release: id 3 | task 1184 | stop processing: n_tokens = 134, truncated = 0
|
|
0.40.682.929 I srv update_slots: all slots are idle
|
|
0.40.685.003 I srv operator(): Chat format: peg-gemma4
|
|
0.40.685.260 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.658 (> 0.100 thold), f_keep = 0.358
|
|
0.40.685.261 I srv get_availabl: updating prompt cache
|
|
0.40.685.285 W srv prompt_save: - saving prompt with length 134, total state size = 28.793 MiB (draft: 0.000 MiB)
|
|
0.40.712.132 I srv load: - looking for better prompt, base f_keep = 0.358, sim = 0.658
|
|
0.40.712.147 I srv load: - found better prompt with f_keep = 0.374, sim = 0.671
|
|
0.40.724.404 I srv update: - cache state: 13 prompts, 456.779 MiB (limits: 8192.000 MiB, 8192 tokens, 28587 est)
|
|
0.40.724.408 I srv update: - prompt 0x62cb90504ba0: 119 tokens, checkpoints: 1, 34.360 MiB
|
|
0.40.724.409 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.40.724.410 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.40.724.411 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.40.724.411 I srv update: - prompt 0x62cb97bdf550: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.40.724.412 I srv update: - prompt 0x62cb97f3f080: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.40.724.413 I srv update: - prompt 0x62cb90929c00: 110 tokens, checkpoints: 1, 32.426 MiB
|
|
0.40.724.413 I srv update: - prompt 0x62cb9387d0a0: 112 tokens, checkpoints: 1, 32.856 MiB
|
|
0.40.724.414 I srv update: - prompt 0x62cb909a8da0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.40.724.414 I srv update: - prompt 0x62cb903b73b0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.40.724.415 I srv update: - prompt 0x62cb98865830: 201 tokens, checkpoints: 1, 51.979 MiB
|
|
0.40.724.416 I srv update: - prompt 0x62cb9077aed0: 142 tokens, checkpoints: 1, 39.302 MiB
|
|
0.40.724.416 I srv update: - prompt 0x62cb90646960: 134 tokens, checkpoints: 1, 37.583 MiB
|
|
0.40.724.418 I srv get_availabl: prompt cache update took 39.16 ms
|
|
0.40.724.512 I slot launch_slot_: id 3 | task 1255 | processing task, is_child = 0
|
|
0.40.724.513 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.40.724.514 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.40.724.526 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.40.724.527 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.40.724.535 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.40.724.535 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.40.724.553 I slot update_slots: id 3 | task 1255 | Checking checkpoint with [0, 44] against 0...
|
|
0.40.728.716 W slot update_slots: id 3 | task 1255 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.41.888.915 I slot print_timing: id 3 | task 1255 | prompt eval time = 130.95 ms / 29 tokens ( 4.52 ms per token, 221.46 tokens per second)
|
|
0.41.888.918 I slot print_timing: id 3 | task 1255 | eval time = 1033.41 ms / 58 tokens ( 17.82 ms per token, 56.13 tokens per second)
|
|
0.41.888.919 I slot print_timing: id 3 | task 1255 | total time = 1164.36 ms / 87 tokens
|
|
0.41.888.920 I slot print_timing: id 3 | task 1255 | graphs reused = 1157
|
|
0.41.888.954 I slot release: id 3 | task 1255 | stop processing: n_tokens = 130, truncated = 0
|
|
0.41.888.964 I srv update_slots: all slots are idle
|
|
0.41.891.362 I srv operator(): Chat format: peg-gemma4
|
|
0.41.891.592 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.681 (> 0.100 thold), f_keep = 0.377
|
|
0.41.891.594 I srv get_availabl: updating prompt cache
|
|
0.41.891.620 W srv prompt_save: - saving prompt with length 130, total state size = 27.933 MiB (draft: 0.000 MiB)
|
|
0.41.914.930 I srv load: - looking for better prompt, base f_keep = 0.377, sim = 0.681
|
|
0.41.914.941 I srv load: - found better prompt with f_keep = 0.429, sim = 0.708
|
|
0.41.924.258 I srv update: - cache state: 13 prompts, 459.143 MiB (limits: 8192.000 MiB, 8192 tokens, 28636 est)
|
|
0.41.924.262 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.41.924.262 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.41.924.263 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.41.924.263 I srv update: - prompt 0x62cb97bdf550: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.41.924.264 I srv update: - prompt 0x62cb97f3f080: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.41.924.264 I srv update: - prompt 0x62cb90929c00: 110 tokens, checkpoints: 1, 32.426 MiB
|
|
0.41.924.265 I srv update: - prompt 0x62cb9387d0a0: 112 tokens, checkpoints: 1, 32.856 MiB
|
|
0.41.924.265 I srv update: - prompt 0x62cb909a8da0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.41.924.266 I srv update: - prompt 0x62cb903b73b0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.41.924.266 I srv update: - prompt 0x62cb98865830: 201 tokens, checkpoints: 1, 51.979 MiB
|
|
0.41.924.267 I srv update: - prompt 0x62cb9077aed0: 142 tokens, checkpoints: 1, 39.302 MiB
|
|
0.41.924.267 I srv update: - prompt 0x62cb90646960: 134 tokens, checkpoints: 1, 37.583 MiB
|
|
0.41.924.268 I srv update: - prompt 0x62cb8f0a5980: 130 tokens, checkpoints: 1, 36.724 MiB
|
|
0.41.924.269 I srv get_availabl: prompt cache update took 32.67 ms
|
|
0.41.924.361 I slot launch_slot_: id 3 | task 1316 | processing task, is_child = 0
|
|
0.41.924.362 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.41.924.362 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.41.924.376 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.41.924.376 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.41.924.386 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.41.924.386 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.41.924.405 I slot update_slots: id 3 | task 1316 | Checking checkpoint with [0, 44] against 0...
|
|
0.41.928.669 W slot update_slots: id 3 | task 1316 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.42.500.916 I slot print_timing: id 3 | task 1316 | prompt eval time = 133.75 ms / 28 tokens ( 4.78 ms per token, 209.34 tokens per second)
|
|
0.42.500.919 I slot print_timing: id 3 | task 1316 | eval time = 442.75 ms / 25 tokens ( 17.71 ms per token, 56.47 tokens per second)
|
|
0.42.500.920 I slot print_timing: id 3 | task 1316 | total time = 576.51 ms / 53 tokens
|
|
0.42.500.920 I slot print_timing: id 3 | task 1316 | graphs reused = 1180
|
|
0.42.500.955 I slot release: id 3 | task 1316 | stop processing: n_tokens = 96, truncated = 0
|
|
0.42.500.965 I srv update_slots: all slots are idle
|
|
0.42.503.226 I srv operator(): Chat format: peg-gemma4
|
|
0.42.503.457 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.727 (> 0.100 thold), f_keep = 0.500
|
|
0.42.503.520 I slot launch_slot_: id 3 | task 1344 | processing task, is_child = 0
|
|
0.42.503.522 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.42.503.523 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.42.503.534 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.42.503.535 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.42.503.545 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.42.503.546 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.42.503.562 I slot update_slots: id 3 | task 1344 | Checking checkpoint with [0, 44] against 0...
|
|
0.42.507.967 W slot update_slots: id 3 | task 1344 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.43.357.890 I slot print_timing: id 3 | task 1344 | prompt eval time = 126.12 ms / 22 tokens ( 5.73 ms per token, 174.44 tokens per second)
|
|
0.43.357.893 I slot print_timing: id 3 | task 1344 | eval time = 728.21 ms / 41 tokens ( 17.76 ms per token, 56.30 tokens per second)
|
|
0.43.357.894 I slot print_timing: id 3 | task 1344 | total time = 854.32 ms / 63 tokens
|
|
0.43.357.894 I slot print_timing: id 3 | task 1344 | graphs reused = 1219
|
|
0.43.357.930 I slot release: id 3 | task 1344 | stop processing: n_tokens = 106, truncated = 0
|
|
0.43.357.939 I srv update_slots: all slots are idle
|
|
0.43.360.014 I srv operator(): Chat format: peg-gemma4
|
|
0.43.360.241 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.750 (> 0.100 thold), f_keep = 0.453
|
|
0.43.360.242 I srv get_availabl: updating prompt cache
|
|
0.43.360.274 W srv prompt_save: - saving prompt with length 106, total state size = 22.777 MiB (draft: 0.000 MiB)
|
|
0.43.371.917 I srv load: - looking for better prompt, base f_keep = 0.453, sim = 0.750
|
|
0.43.371.930 I srv update: - cache state: 14 prompts, 490.709 MiB (limits: 8192.000 MiB, 8192 tokens, 28563 est)
|
|
0.43.371.931 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.43.371.932 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.43.371.933 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.43.371.933 I srv update: - prompt 0x62cb97bdf550: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.43.371.934 I srv update: - prompt 0x62cb97f3f080: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.43.371.934 I srv update: - prompt 0x62cb90929c00: 110 tokens, checkpoints: 1, 32.426 MiB
|
|
0.43.371.935 I srv update: - prompt 0x62cb9387d0a0: 112 tokens, checkpoints: 1, 32.856 MiB
|
|
0.43.371.935 I srv update: - prompt 0x62cb909a8da0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.43.371.936 I srv update: - prompt 0x62cb903b73b0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.43.371.936 I srv update: - prompt 0x62cb98865830: 201 tokens, checkpoints: 1, 51.979 MiB
|
|
0.43.371.937 I srv update: - prompt 0x62cb9077aed0: 142 tokens, checkpoints: 1, 39.302 MiB
|
|
0.43.371.937 I srv update: - prompt 0x62cb90646960: 134 tokens, checkpoints: 1, 37.583 MiB
|
|
0.43.371.938 I srv update: - prompt 0x62cb8f0a5980: 130 tokens, checkpoints: 1, 36.724 MiB
|
|
0.43.371.938 I srv update: - prompt 0x62cb905e49d0: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.43.371.939 I srv get_availabl: prompt cache update took 11.70 ms
|
|
0.43.372.041 I slot launch_slot_: id 3 | task 1388 | processing task, is_child = 0
|
|
0.43.372.042 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.43.372.043 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.43.372.056 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.43.372.056 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.43.372.066 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.43.372.066 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.43.372.084 I slot update_slots: id 3 | task 1388 | Checking checkpoint with [0, 44] against 0...
|
|
0.43.376.145 W slot update_slots: id 3 | task 1388 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.43.818.991 I slot print_timing: id 3 | task 1388 | prompt eval time = 97.02 ms / 20 tokens ( 4.85 ms per token, 206.14 tokens per second)
|
|
0.43.818.995 I slot print_timing: id 3 | task 1388 | eval time = 349.88 ms / 20 tokens ( 17.49 ms per token, 57.16 tokens per second)
|
|
0.43.818.995 I slot print_timing: id 3 | task 1388 | total time = 446.90 ms / 40 tokens
|
|
0.43.818.996 I slot print_timing: id 3 | task 1388 | graphs reused = 1237
|
|
0.43.819.028 I slot release: id 3 | task 1388 | stop processing: n_tokens = 83, truncated = 0
|
|
0.43.819.035 I srv update_slots: all slots are idle
|
|
0.43.821.277 I srv operator(): Chat format: peg-gemma4
|
|
0.43.821.529 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.696 (> 0.100 thold), f_keep = 0.578
|
|
0.43.821.584 I slot launch_slot_: id 3 | task 1411 | processing task, is_child = 0
|
|
0.43.821.586 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.43.821.587 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.43.821.596 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.43.821.596 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.43.821.603 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.43.821.603 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.43.821.613 I slot update_slots: id 3 | task 1411 | Checking checkpoint with [0, 44] against 0...
|
|
0.43.826.145 W slot update_slots: id 3 | task 1411 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.45.351.903 I slot print_timing: id 3 | task 1411 | prompt eval time = 129.43 ms / 25 tokens ( 5.18 ms per token, 193.15 tokens per second)
|
|
0.45.351.906 I slot print_timing: id 3 | task 1411 | eval time = 1400.85 ms / 78 tokens ( 17.96 ms per token, 55.68 tokens per second)
|
|
0.45.351.907 I slot print_timing: id 3 | task 1411 | total time = 1530.28 ms / 103 tokens
|
|
0.45.351.908 I slot print_timing: id 3 | task 1411 | graphs reused = 1313
|
|
0.45.351.942 I slot release: id 3 | task 1411 | stop processing: n_tokens = 146, truncated = 0
|
|
0.45.351.952 I srv update_slots: all slots are idle
|
|
0.45.354.279 I srv operator(): Chat format: peg-gemma4
|
|
0.45.354.502 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.716 (> 0.100 thold), f_keep = 0.329
|
|
0.45.354.503 I srv get_availabl: updating prompt cache
|
|
0.45.354.537 W srv prompt_save: - saving prompt with length 146, total state size = 31.371 MiB (draft: 0.000 MiB)
|
|
0.45.383.574 I srv load: - looking for better prompt, base f_keep = 0.329, sim = 0.716
|
|
0.45.383.583 I srv load: - found better prompt with f_keep = 0.455, sim = 0.761
|
|
0.45.392.397 I srv update: - cache state: 14 prompts, 498.015 MiB (limits: 8192.000 MiB, 8192 tokens, 28704 est)
|
|
0.45.392.401 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.45.392.402 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.45.392.402 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.45.392.403 I srv update: - prompt 0x62cb97bdf550: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.45.392.403 I srv update: - prompt 0x62cb97f3f080: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.45.392.404 I srv update: - prompt 0x62cb90929c00: 110 tokens, checkpoints: 1, 32.426 MiB
|
|
0.45.392.404 I srv update: - prompt 0x62cb909a8da0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.45.392.405 I srv update: - prompt 0x62cb903b73b0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.45.392.405 I srv update: - prompt 0x62cb98865830: 201 tokens, checkpoints: 1, 51.979 MiB
|
|
0.45.392.406 I srv update: - prompt 0x62cb9077aed0: 142 tokens, checkpoints: 1, 39.302 MiB
|
|
0.45.392.406 I srv update: - prompt 0x62cb90646960: 134 tokens, checkpoints: 1, 37.583 MiB
|
|
0.45.392.407 I srv update: - prompt 0x62cb8f0a5980: 130 tokens, checkpoints: 1, 36.724 MiB
|
|
0.45.392.407 I srv update: - prompt 0x62cb905e49d0: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.45.392.408 I srv update: - prompt 0x62cb8d8beef0: 146 tokens, checkpoints: 1, 40.161 MiB
|
|
0.45.392.409 I srv get_availabl: prompt cache update took 37.91 ms
|
|
0.45.392.498 I slot launch_slot_: id 3 | task 1492 | processing task, is_child = 0
|
|
0.45.392.499 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.45.392.500 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.45.392.514 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.45.392.514 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.45.392.524 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.45.392.524 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.45.392.544 I slot update_slots: id 3 | task 1492 | Checking checkpoint with [0, 44] against 0...
|
|
0.45.396.637 W slot update_slots: id 3 | task 1492 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.46.772.006 I slot print_timing: id 3 | task 1492 | prompt eval time = 124.92 ms / 23 tokens ( 5.43 ms per token, 184.12 tokens per second)
|
|
0.46.772.009 I slot print_timing: id 3 | task 1492 | eval time = 1254.54 ms / 70 tokens ( 17.92 ms per token, 55.80 tokens per second)
|
|
0.46.772.010 I slot print_timing: id 3 | task 1492 | total time = 1379.46 ms / 93 tokens
|
|
0.46.772.010 I slot print_timing: id 3 | task 1492 | graphs reused = 1381
|
|
0.46.772.043 I slot release: id 3 | task 1492 | stop processing: n_tokens = 136, truncated = 0
|
|
0.46.772.051 I srv update_slots: all slots are idle
|
|
0.46.774.169 I srv operator(): Chat format: peg-gemma4
|
|
0.46.774.411 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.754 (> 0.100 thold), f_keep = 0.360
|
|
0.46.774.412 I srv get_availabl: updating prompt cache
|
|
0.46.774.436 W srv prompt_save: - saving prompt with length 136, total state size = 29.223 MiB (draft: 0.000 MiB)
|
|
0.46.799.255 I srv load: - looking for better prompt, base f_keep = 0.360, sim = 0.754
|
|
0.46.799.270 I srv update: - cache state: 15 prompts, 536.028 MiB (limits: 8192.000 MiB, 8192 tokens, 28746 est)
|
|
0.46.799.274 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.46.799.274 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.46.799.275 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.46.799.275 I srv update: - prompt 0x62cb97bdf550: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.46.799.276 I srv update: - prompt 0x62cb97f3f080: 103 tokens, checkpoints: 1, 30.922 MiB
|
|
0.46.799.276 I srv update: - prompt 0x62cb90929c00: 110 tokens, checkpoints: 1, 32.426 MiB
|
|
0.46.799.277 I srv update: - prompt 0x62cb909a8da0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.46.799.278 I srv update: - prompt 0x62cb903b73b0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.46.799.279 I srv update: - prompt 0x62cb98865830: 201 tokens, checkpoints: 1, 51.979 MiB
|
|
0.46.799.279 I srv update: - prompt 0x62cb9077aed0: 142 tokens, checkpoints: 1, 39.302 MiB
|
|
0.46.799.279 I srv update: - prompt 0x62cb90646960: 134 tokens, checkpoints: 1, 37.583 MiB
|
|
0.46.799.280 I srv update: - prompt 0x62cb8f0a5980: 130 tokens, checkpoints: 1, 36.724 MiB
|
|
0.46.799.280 I srv update: - prompt 0x62cb905e49d0: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.46.799.281 I srv update: - prompt 0x62cb8d8beef0: 146 tokens, checkpoints: 1, 40.161 MiB
|
|
0.46.799.282 I srv update: - prompt 0x62cb906f0770: 136 tokens, checkpoints: 1, 38.013 MiB
|
|
0.46.799.283 I srv get_availabl: prompt cache update took 24.87 ms
|
|
0.46.799.381 I slot launch_slot_: id 3 | task 1565 | processing task, is_child = 0
|
|
0.46.799.382 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.46.799.382 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.46.799.394 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.46.799.394 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.46.799.401 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.46.799.401 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.46.799.416 I slot update_slots: id 3 | task 1565 | Checking checkpoint with [0, 44] against 0...
|
|
0.46.803.657 W slot update_slots: id 3 | task 1565 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.47.860.981 I slot print_timing: id 3 | task 1565 | prompt eval time = 99.48 ms / 21 tokens ( 4.74 ms per token, 211.10 tokens per second)
|
|
0.47.860.984 I slot print_timing: id 3 | task 1565 | eval time = 962.08 ms / 54 tokens ( 17.82 ms per token, 56.13 tokens per second)
|
|
0.47.860.985 I slot print_timing: id 3 | task 1565 | total time = 1061.56 ms / 75 tokens
|
|
0.47.860.985 I slot print_timing: id 3 | task 1565 | graphs reused = 1433
|
|
0.47.861.020 I slot release: id 3 | task 1565 | stop processing: n_tokens = 118, truncated = 0
|
|
0.47.861.029 I srv update_slots: all slots are idle
|
|
0.47.863.236 I srv operator(): Chat format: peg-gemma4
|
|
0.47.863.497 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.696 (> 0.100 thold), f_keep = 0.407
|
|
0.47.863.499 I srv get_availabl: updating prompt cache
|
|
0.47.863.522 W srv prompt_save: - saving prompt with length 118, total state size = 25.355 MiB (draft: 0.000 MiB)
|
|
0.47.885.241 I srv load: - looking for better prompt, base f_keep = 0.407, sim = 0.696
|
|
0.47.885.250 I srv load: - found better prompt with f_keep = 0.476, sim = 0.710
|
|
0.47.893.554 I srv update: - cache state: 15 prompts, 539.251 MiB (limits: 8192.000 MiB, 8192 tokens, 28802 est)
|
|
0.47.893.558 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.47.893.559 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.47.893.559 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.47.893.560 I srv update: - prompt 0x62cb97bdf550: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.47.893.561 I srv update: - prompt 0x62cb90929c00: 110 tokens, checkpoints: 1, 32.426 MiB
|
|
0.47.893.561 I srv update: - prompt 0x62cb909a8da0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.47.893.562 I srv update: - prompt 0x62cb903b73b0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.47.893.562 I srv update: - prompt 0x62cb98865830: 201 tokens, checkpoints: 1, 51.979 MiB
|
|
0.47.893.563 I srv update: - prompt 0x62cb9077aed0: 142 tokens, checkpoints: 1, 39.302 MiB
|
|
0.47.893.563 I srv update: - prompt 0x62cb90646960: 134 tokens, checkpoints: 1, 37.583 MiB
|
|
0.47.893.564 I srv update: - prompt 0x62cb8f0a5980: 130 tokens, checkpoints: 1, 36.724 MiB
|
|
0.47.893.565 I srv update: - prompt 0x62cb905e49d0: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.47.893.565 I srv update: - prompt 0x62cb8d8beef0: 146 tokens, checkpoints: 1, 40.161 MiB
|
|
0.47.893.566 I srv update: - prompt 0x62cb906f0770: 136 tokens, checkpoints: 1, 38.013 MiB
|
|
0.47.893.566 I srv update: - prompt 0x62cb97bfc6a0: 118 tokens, checkpoints: 1, 34.145 MiB
|
|
0.47.893.568 I srv get_availabl: prompt cache update took 30.07 ms
|
|
0.47.893.651 I slot launch_slot_: id 3 | task 1622 | processing task, is_child = 0
|
|
0.47.893.651 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.47.893.653 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.47.893.665 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.47.893.665 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.47.893.672 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.47.893.672 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.47.893.687 I slot update_slots: id 3 | task 1622 | Checking checkpoint with [0, 44] against 0...
|
|
0.47.897.676 W slot update_slots: id 3 | task 1622 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.48.875.065 I slot print_timing: id 3 | task 1622 | prompt eval time = 127.72 ms / 25 tokens ( 5.11 ms per token, 195.73 tokens per second)
|
|
0.48.875.068 I slot print_timing: id 3 | task 1622 | eval time = 853.65 ms / 48 tokens ( 17.78 ms per token, 56.23 tokens per second)
|
|
0.48.875.069 I slot print_timing: id 3 | task 1622 | total time = 981.37 ms / 73 tokens
|
|
0.48.875.070 I slot print_timing: id 3 | task 1622 | graphs reused = 1479
|
|
0.48.875.105 I slot release: id 3 | task 1622 | stop processing: n_tokens = 116, truncated = 0
|
|
0.48.875.115 I srv update_slots: all slots are idle
|
|
0.48.877.128 I srv operator(): Chat format: peg-gemma4
|
|
0.48.877.375 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.750 (> 0.100 thold), f_keep = 0.414
|
|
0.48.877.377 I srv get_availabl: updating prompt cache
|
|
0.48.877.401 W srv prompt_save: - saving prompt with length 116, total state size = 24.925 MiB (draft: 0.000 MiB)
|
|
0.48.898.946 I srv load: - looking for better prompt, base f_keep = 0.414, sim = 0.750
|
|
0.48.898.955 I srv load: - found better prompt with f_keep = 0.462, sim = 0.766
|
|
0.48.907.459 I srv update: - cache state: 15 prompts, 541.399 MiB (limits: 8192.000 MiB, 8192 tokens, 28839 est)
|
|
0.48.907.462 I srv update: - prompt 0x62cb9051f450: 122 tokens, checkpoints: 1, 35.005 MiB
|
|
0.48.907.463 I srv update: - prompt 0x62cb909aad20: 138 tokens, checkpoints: 1, 38.442 MiB
|
|
0.48.907.464 I srv update: - prompt 0x62cb9050ff70: 113 tokens, checkpoints: 1, 33.071 MiB
|
|
0.48.907.464 I srv update: - prompt 0x62cb90929c00: 110 tokens, checkpoints: 1, 32.426 MiB
|
|
0.48.907.465 I srv update: - prompt 0x62cb909a8da0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.48.907.465 I srv update: - prompt 0x62cb903b73b0: 97 tokens, checkpoints: 1, 29.633 MiB
|
|
0.48.907.466 I srv update: - prompt 0x62cb98865830: 201 tokens, checkpoints: 1, 51.979 MiB
|
|
0.48.907.466 I srv update: - prompt 0x62cb9077aed0: 142 tokens, checkpoints: 1, 39.302 MiB
|
|
0.48.907.467 I srv update: - prompt 0x62cb90646960: 134 tokens, checkpoints: 1, 37.583 MiB
|
|
0.48.907.467 I srv update: - prompt 0x62cb8f0a5980: 130 tokens, checkpoints: 1, 36.724 MiB
|
|
0.48.907.468 I srv update: - prompt 0x62cb905e49d0: 106 tokens, checkpoints: 1, 31.567 MiB
|
|
0.48.907.468 I srv update: - prompt 0x62cb8d8beef0: 146 tokens, checkpoints: 1, 40.161 MiB
|
|
0.48.907.469 I srv update: - prompt 0x62cb906f0770: 136 tokens, checkpoints: 1, 38.013 MiB
|
|
0.48.907.469 I srv update: - prompt 0x62cb97bfc6a0: 118 tokens, checkpoints: 1, 34.145 MiB
|
|
0.48.907.469 I srv update: - prompt 0x62cb90512af0: 116 tokens, checkpoints: 1, 33.715 MiB
|
|
0.48.907.471 I srv get_availabl: prompt cache update took 30.09 ms
|
|
0.48.907.554 I slot launch_slot_: id 3 | task 1673 | processing task, is_child = 0
|
|
0.48.907.555 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.48.907.556 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.48.907.569 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.48.907.569 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.48.907.576 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.48.907.577 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.48.907.593 I slot update_slots: id 3 | task 1673 | Checking checkpoint with [0, 44] against 0...
|
|
0.48.911.680 W slot update_slots: id 3 | task 1673 | restored context checkpoint (pos_min = 0, pos_max = 44, n_tokens = 45, n_past = 44, size = 8.790 MiB)
|
|
0.50.274.005 I slot print_timing: id 3 | task 1673 | prompt eval time = 98.36 ms / 20 tokens ( 4.92 ms per token, 203.34 tokens per second)
|
|
0.50.274.009 I slot print_timing: id 3 | task 1673 | eval time = 1268.05 ms / 71 tokens ( 17.86 ms per token, 55.99 tokens per second)
|
|
0.50.274.009 I slot print_timing: id 3 | task 1673 | total time = 1366.41 ms / 91 tokens
|
|
0.50.274.010 I slot print_timing: id 3 | task 1673 | graphs reused = 1548
|
|
0.50.274.044 I slot release: id 3 | task 1673 | stop processing: n_tokens = 134, truncated = 0
|
|
0.50.274.052 I srv update_slots: all slots are idle
|
|
0.50.274.565 I srv operator(): operator(): cleaning up before exit...
|