786 lines
73 KiB
Plaintext
786 lines
73 KiB
Plaintext
0.00.066.145 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg)
|
|
0.00.066.148 I device_info:
|
|
0.00.066.169 I - ROCm0 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
|
|
0.00.066.179 I - ROCm1 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
|
|
0.00.066.186 I - CPU : AMD Ryzen 9 3900X 12-Core Processor (128730 MiB, 128730 MiB free)
|
|
0.00.066.247 I system_info: n_threads = 12 (n_threads_batch = 12) / 24 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 |
|
|
0.00.066.251 I srv llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true
|
|
0.00.066.306 I srv init: running without SSL
|
|
0.00.066.377 I srv init: using 23 threads for HTTP server
|
|
0.00.066.720 I srv start: binding port with default address family
|
|
0.00.067.929 I srv llama_server: loading model
|
|
0.00.067.938 I srv load_model: loading model '/home/qrf/.cache/llama.cpp/Ministral-3-14B-Reasoning-2512-Q5_K_M.gguf'
|
|
0.00.067.989 I common_init_result: fitting params to device memory ...
|
|
0.00.067.991 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on)
|
|
0.10.571.051 W llama_context: setting new yarn_attn_factor = 1.0000 (mscale == 1.0, mscale_all_dim = 1.0)
|
|
0.10.571.065 W llama_context: n_ctx_seq (8192) < n_ctx_train (262144) -- the full capacity of the model will not be utilized
|
|
0.10.598.091 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
|
|
0.10.749.363 I srv load_model: initializing slots, n_slots = 4
|
|
0.10.791.228 W common_speculative_init: no implementations specified for speculative decoding
|
|
0.10.791.231 I slot load_model: id 0 | task -1 | new slot, n_ctx = 8192
|
|
0.10.791.234 I slot load_model: id 1 | task -1 | new slot, n_ctx = 8192
|
|
0.10.791.234 I slot load_model: id 2 | task -1 | new slot, n_ctx = 8192
|
|
0.10.791.235 I slot load_model: id 3 | task -1 | new slot, n_ctx = 8192
|
|
0.10.791.393 I srv load_model: prompt cache is enabled, size limit: 8192 MiB
|
|
0.10.791.394 I srv load_model: use `--cache-ram 0` to disable the prompt cache
|
|
0.10.791.394 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391
|
|
0.10.791.395 I srv load_model: context checkpoints enabled, max = 32, min spacing = 256
|
|
0.10.791.563 I srv init: idle slots will be saved to prompt cache and cleared upon starting a new task
|
|
0.10.796.572 I init: chat template, example_format: '[SYSTEM_PROMPT]You are a helpful assistant[/SYSTEM_PROMPT][INST]Hello[/INST]Hi there</s>[INST]How are you?[/INST]'
|
|
0.10.796.985 I srv init: init: chat template, thinking = 1
|
|
0.10.797.160 I srv llama_server: model loaded
|
|
0.10.797.164 I srv llama_server: server is listening on http://127.0.0.1:8090
|
|
0.10.797.173 I srv update_slots: all slots are idle
|
|
0.15.051.093 I srv operator(): Chat format: peg-native
|
|
0.15.051.290 I slot get_availabl: id 3 | task -1 | selected slot by LRU, t_last = -1
|
|
0.15.051.304 I srv get_availabl: updating prompt cache
|
|
0.15.051.311 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000
|
|
0.15.051.316 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 8192 tokens, 8589934592 est)
|
|
0.15.051.317 I srv get_availabl: prompt cache update took 0.01 ms
|
|
0.15.051.372 I slot launch_slot_: id 3 | task 0 | processing task, is_child = 0
|
|
0.15.051.372 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.15.051.374 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.15.051.384 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.15.051.384 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.15.051.389 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.15.051.390 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.16.506.851 I slot print_timing: id 3 | task 0 | prompt eval time = 289.66 ms / 64 tokens ( 4.53 ms per token, 220.95 tokens per second)
|
|
0.16.506.855 I slot print_timing: id 3 | task 0 | eval time = 1165.77 ms / 38 tokens ( 30.68 ms per token, 32.60 tokens per second)
|
|
0.16.506.855 I slot print_timing: id 3 | task 0 | total time = 1455.43 ms / 102 tokens
|
|
0.16.506.859 I slot print_timing: id 3 | task 0 | graphs reused = 0
|
|
0.16.507.518 I slot release: id 3 | task 0 | stop processing: n_tokens = 101, truncated = 0
|
|
0.16.507.540 I srv update_slots: all slots are idle
|
|
0.16.511.228 I srv operator(): Chat format: peg-native
|
|
0.16.511.353 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.818 (> 0.100 thold), f_keep = 0.446
|
|
0.16.511.356 I srv get_availabl: updating prompt cache
|
|
0.16.511.381 W srv prompt_save: - saving prompt with length 101, total state size = 15.783 MiB (draft: 0.000 MiB)
|
|
0.16.525.213 I srv load: - looking for better prompt, base f_keep = 0.446, sim = 0.818
|
|
0.16.525.220 I srv update: - cache state: 1 prompts, 15.783 MiB (limits: 8192.000 MiB, 8192 tokens, 52421 est)
|
|
0.16.525.221 I srv update: - prompt 0x56fafae5ee50: 101 tokens, checkpoints: 0, 15.783 MiB
|
|
0.16.525.222 I srv get_availabl: prompt cache update took 13.87 ms
|
|
0.16.525.265 I slot launch_slot_: id 3 | task 39 | processing task, is_child = 0
|
|
0.16.525.266 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.16.525.266 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.16.525.274 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.16.525.274 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.16.525.279 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.16.525.279 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.17.138.065 I slot print_timing: id 3 | task 39 | prompt eval time = 171.72 ms / 10 tokens ( 17.17 ms per token, 58.23 tokens per second)
|
|
0.17.138.080 I slot print_timing: id 3 | task 39 | eval time = 441.05 ms / 15 tokens ( 29.40 ms per token, 34.01 tokens per second)
|
|
0.17.138.081 I slot print_timing: id 3 | task 39 | total time = 612.77 ms / 25 tokens
|
|
0.17.138.081 I slot print_timing: id 3 | task 39 | graphs reused = 0
|
|
0.17.138.158 I slot release: id 3 | task 39 | stop processing: n_tokens = 69, truncated = 0
|
|
0.17.138.165 I srv update_slots: all slots are idle
|
|
0.17.141.715 I srv operator(): Chat format: peg-native
|
|
0.17.141.812 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.776 (> 0.100 thold), f_keep = 0.652
|
|
0.17.141.831 I slot launch_slot_: id 3 | task 55 | processing task, is_child = 0
|
|
0.17.141.834 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.17.141.834 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.17.141.840 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.17.141.840 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.17.141.844 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.17.141.845 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.18.036.862 I slot print_timing: id 3 | task 55 | prompt eval time = 171.14 ms / 13 tokens ( 13.16 ms per token, 75.96 tokens per second)
|
|
0.18.036.880 I slot print_timing: id 3 | task 55 | eval time = 723.86 ms / 24 tokens ( 30.16 ms per token, 33.16 tokens per second)
|
|
0.18.036.880 I slot print_timing: id 3 | task 55 | total time = 895.00 ms / 37 tokens
|
|
0.18.036.881 I slot print_timing: id 3 | task 55 | graphs reused = 0
|
|
0.18.036.944 I slot release: id 3 | task 55 | stop processing: n_tokens = 81, truncated = 0
|
|
0.18.036.950 I srv update_slots: all slots are idle
|
|
0.18.040.652 I srv operator(): Chat format: peg-native
|
|
0.18.040.772 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.807 (> 0.100 thold), f_keep = 0.568
|
|
0.18.040.789 I slot launch_slot_: id 3 | task 80 | processing task, is_child = 0
|
|
0.18.040.790 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.18.040.790 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.18.040.796 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.18.040.797 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.18.040.801 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.18.040.801 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.19.347.026 I slot print_timing: id 3 | task 80 | prompt eval time = 171.20 ms / 11 tokens ( 15.56 ms per token, 64.25 tokens per second)
|
|
0.19.347.041 I slot print_timing: id 3 | task 80 | eval time = 1135.01 ms / 37 tokens ( 30.68 ms per token, 32.60 tokens per second)
|
|
0.19.347.042 I slot print_timing: id 3 | task 80 | total time = 1306.21 ms / 48 tokens
|
|
0.19.347.043 I slot print_timing: id 3 | task 80 | graphs reused = 0
|
|
0.19.347.093 I slot release: id 3 | task 80 | stop processing: n_tokens = 93, truncated = 0
|
|
0.19.347.100 I srv update_slots: all slots are idle
|
|
0.19.350.688 I srv operator(): Chat format: peg-native
|
|
0.19.350.805 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.780 (> 0.100 thold), f_keep = 0.495
|
|
0.19.350.807 I srv get_availabl: updating prompt cache
|
|
0.19.350.822 W srv prompt_save: - saving prompt with length 93, total state size = 14.533 MiB (draft: 0.000 MiB)
|
|
0.19.364.081 I srv load: - looking for better prompt, base f_keep = 0.495, sim = 0.780
|
|
0.19.364.087 I srv update: - cache state: 2 prompts, 30.317 MiB (limits: 8192.000 MiB, 8192 tokens, 52421 est)
|
|
0.19.364.088 I srv update: - prompt 0x56fafae5ee50: 101 tokens, checkpoints: 0, 15.783 MiB
|
|
0.19.364.089 I srv update: - prompt 0x56fafb501360: 93 tokens, checkpoints: 0, 14.533 MiB
|
|
0.19.364.090 I srv get_availabl: prompt cache update took 13.28 ms
|
|
0.19.364.117 I slot launch_slot_: id 3 | task 118 | processing task, is_child = 0
|
|
0.19.364.117 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.19.364.145 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.19.364.151 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.19.364.152 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.19.364.156 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.19.364.157 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.20.197.265 I slot print_timing: id 3 | task 118 | prompt eval time = 171.43 ms / 13 tokens ( 13.19 ms per token, 75.83 tokens per second)
|
|
0.20.197.268 I slot print_timing: id 3 | task 118 | eval time = 661.66 ms / 22 tokens ( 30.08 ms per token, 33.25 tokens per second)
|
|
0.20.197.269 I slot print_timing: id 3 | task 118 | total time = 833.09 ms / 35 tokens
|
|
0.20.197.270 I slot print_timing: id 3 | task 118 | graphs reused = 0
|
|
0.20.197.289 I slot release: id 3 | task 118 | stop processing: n_tokens = 80, truncated = 0
|
|
0.20.197.303 I srv update_slots: all slots are idle
|
|
0.20.201.316 I srv operator(): Chat format: peg-native
|
|
0.20.201.423 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.789 (> 0.100 thold), f_keep = 0.562
|
|
0.20.201.443 I slot launch_slot_: id 3 | task 141 | processing task, is_child = 0
|
|
0.20.201.445 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.20.201.460 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.20.201.469 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.20.201.470 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.20.201.475 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.20.201.476 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.20.468.008 I slot print_timing: id 3 | task 141 | prompt eval time = 171.56 ms / 12 tokens ( 14.30 ms per token, 69.95 tokens per second)
|
|
0.20.468.011 I slot print_timing: id 3 | task 141 | eval time = 94.96 ms / 4 tokens ( 23.74 ms per token, 42.12 tokens per second)
|
|
0.20.468.031 I slot print_timing: id 3 | task 141 | total time = 266.52 ms / 16 tokens
|
|
0.20.468.037 I slot print_timing: id 3 | task 141 | graphs reused = 0
|
|
0.20.468.204 I slot release: id 3 | task 141 | stop processing: n_tokens = 60, truncated = 0
|
|
0.20.468.211 I srv update_slots: all slots are idle
|
|
0.20.471.030 I srv operator(): Chat format: peg-native
|
|
0.20.471.136 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.714 (> 0.100 thold), f_keep = 0.750
|
|
0.20.471.155 I slot launch_slot_: id 3 | task 146 | processing task, is_child = 0
|
|
0.20.471.155 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.20.471.168 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.20.471.174 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.20.471.175 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.20.471.180 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.20.471.180 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.21.882.917 I slot print_timing: id 3 | task 146 | prompt eval time = 213.91 ms / 18 tokens ( 11.88 ms per token, 84.15 tokens per second)
|
|
0.21.882.920 I slot print_timing: id 3 | task 146 | eval time = 1197.81 ms / 39 tokens ( 30.71 ms per token, 32.56 tokens per second)
|
|
0.21.882.921 I slot print_timing: id 3 | task 146 | total time = 1411.72 ms / 57 tokens
|
|
0.21.882.922 I slot print_timing: id 3 | task 146 | graphs reused = 0
|
|
0.21.882.980 I slot release: id 3 | task 146 | stop processing: n_tokens = 101, truncated = 0
|
|
0.21.882.986 I srv update_slots: all slots are idle
|
|
0.21.886.143 I srv operator(): Chat format: peg-native
|
|
0.21.886.252 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.868 (> 0.100 thold), f_keep = 0.455
|
|
0.21.886.254 I srv get_availabl: updating prompt cache
|
|
0.21.886.269 W srv prompt_save: - saving prompt with length 101, total state size = 15.783 MiB (draft: 0.000 MiB)
|
|
0.21.900.306 I srv load: - looking for better prompt, base f_keep = 0.455, sim = 0.868
|
|
0.21.900.310 I srv load: - found better prompt with f_keep = 0.465, sim = 0.887
|
|
0.21.908.639 I srv update: - cache state: 2 prompts, 30.317 MiB (limits: 8192.000 MiB, 8192 tokens, 52421 est)
|
|
0.21.908.643 I srv update: - prompt 0x56fafb501360: 93 tokens, checkpoints: 0, 14.533 MiB
|
|
0.21.908.643 I srv update: - prompt 0x56fafb4e6880: 101 tokens, checkpoints: 0, 15.783 MiB
|
|
0.21.908.644 I srv get_availabl: prompt cache update took 22.39 ms
|
|
0.21.908.673 I slot launch_slot_: id 3 | task 186 | processing task, is_child = 0
|
|
0.21.908.674 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.21.908.675 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.21.908.682 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.21.908.682 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.21.908.687 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.21.908.687 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.23.677.219 I slot print_timing: id 3 | task 186 | prompt eval time = 94.44 ms / 6 tokens ( 15.74 ms per token, 63.54 tokens per second)
|
|
0.23.677.223 I slot print_timing: id 3 | task 186 | eval time = 1674.08 ms / 54 tokens ( 31.00 ms per token, 32.26 tokens per second)
|
|
0.23.677.236 I slot print_timing: id 3 | task 186 | total time = 1768.51 ms / 60 tokens
|
|
0.23.677.237 I slot print_timing: id 3 | task 186 | graphs reused = 0
|
|
0.23.677.254 I slot release: id 3 | task 186 | stop processing: n_tokens = 106, truncated = 0
|
|
0.23.677.262 I srv update_slots: all slots are idle
|
|
0.23.680.829 I srv operator(): Chat format: peg-native
|
|
0.23.680.940 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.714 (> 0.100 thold), f_keep = 0.425
|
|
0.23.680.942 I srv get_availabl: updating prompt cache
|
|
0.23.680.960 W srv prompt_save: - saving prompt with length 106, total state size = 16.565 MiB (draft: 0.000 MiB)
|
|
0.23.695.348 I srv load: - looking for better prompt, base f_keep = 0.425, sim = 0.714
|
|
0.23.695.357 I srv update: - cache state: 3 prompts, 46.881 MiB (limits: 8192.000 MiB, 8192 tokens, 52421 est)
|
|
0.23.695.357 I srv update: - prompt 0x56fafb501360: 93 tokens, checkpoints: 0, 14.533 MiB
|
|
0.23.695.358 I srv update: - prompt 0x56fafb4e6880: 101 tokens, checkpoints: 0, 15.783 MiB
|
|
0.23.695.359 I srv update: - prompt 0x56fafaea9bd0: 106 tokens, checkpoints: 0, 16.565 MiB
|
|
0.23.695.360 I srv get_availabl: prompt cache update took 14.42 ms
|
|
0.23.695.391 I slot launch_slot_: id 3 | task 241 | processing task, is_child = 0
|
|
0.23.695.426 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.23.695.428 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.23.695.435 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.23.695.435 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.23.695.440 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.23.695.440 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.24.762.869 I slot print_timing: id 3 | task 241 | prompt eval time = 214.26 ms / 18 tokens ( 11.90 ms per token, 84.01 tokens per second)
|
|
0.24.762.873 I slot print_timing: id 3 | task 241 | eval time = 853.15 ms / 28 tokens ( 30.47 ms per token, 32.82 tokens per second)
|
|
0.24.762.873 I slot print_timing: id 3 | task 241 | total time = 1067.41 ms / 46 tokens
|
|
0.24.762.874 I slot print_timing: id 3 | task 241 | graphs reused = 0
|
|
0.24.762.941 I slot release: id 3 | task 241 | stop processing: n_tokens = 90, truncated = 0
|
|
0.24.762.946 I srv update_slots: all slots are idle
|
|
0.24.766.018 I srv operator(): Chat format: peg-native
|
|
0.24.766.124 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.776 (> 0.100 thold), f_keep = 0.500
|
|
0.24.766.143 I slot launch_slot_: id 3 | task 270 | processing task, is_child = 0
|
|
0.24.766.154 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.24.766.156 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.24.766.162 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.24.766.163 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.24.766.167 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.24.766.167 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.27.553.909 I slot print_timing: id 3 | task 270 | prompt eval time = 171.40 ms / 13 tokens ( 13.18 ms per token, 75.85 tokens per second)
|
|
0.27.553.913 I slot print_timing: id 3 | task 270 | eval time = 2616.33 ms / 84 tokens ( 31.15 ms per token, 32.11 tokens per second)
|
|
0.27.553.914 I slot print_timing: id 3 | task 270 | total time = 2787.73 ms / 97 tokens
|
|
0.27.553.914 I slot print_timing: id 3 | task 270 | graphs reused = 0
|
|
0.27.553.932 I slot release: id 3 | task 270 | stop processing: n_tokens = 141, truncated = 0
|
|
0.27.553.939 I srv update_slots: all slots are idle
|
|
0.27.558.064 I srv operator(): Chat format: peg-native
|
|
0.27.558.177 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.714 (> 0.100 thold), f_keep = 0.319
|
|
0.27.558.179 I srv get_availabl: updating prompt cache
|
|
0.27.558.207 W srv prompt_save: - saving prompt with length 141, total state size = 22.034 MiB (draft: 0.000 MiB)
|
|
0.27.576.586 I srv load: - looking for better prompt, base f_keep = 0.319, sim = 0.714
|
|
0.27.576.634 I srv update: - cache state: 4 prompts, 68.915 MiB (limits: 8192.000 MiB, 8192 tokens, 52422 est)
|
|
0.27.576.635 I srv update: - prompt 0x56fafb501360: 93 tokens, checkpoints: 0, 14.533 MiB
|
|
0.27.576.635 I srv update: - prompt 0x56fafb4e6880: 101 tokens, checkpoints: 0, 15.783 MiB
|
|
0.27.576.636 I srv update: - prompt 0x56fafaea9bd0: 106 tokens, checkpoints: 0, 16.565 MiB
|
|
0.27.576.636 I srv update: - prompt 0x56fafb5211d0: 141 tokens, checkpoints: 0, 22.034 MiB
|
|
0.27.576.638 I srv get_availabl: prompt cache update took 18.46 ms
|
|
0.27.576.669 I slot launch_slot_: id 3 | task 355 | processing task, is_child = 0
|
|
0.27.576.675 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.27.576.676 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.27.576.683 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.27.576.683 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.27.576.688 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.27.576.688 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.28.768.937 I slot print_timing: id 3 | task 355 | prompt eval time = 214.07 ms / 18 tokens ( 11.89 ms per token, 84.08 tokens per second)
|
|
0.28.768.940 I slot print_timing: id 3 | task 355 | eval time = 978.15 ms / 32 tokens ( 30.57 ms per token, 32.71 tokens per second)
|
|
0.28.768.941 I slot print_timing: id 3 | task 355 | total time = 1192.22 ms / 50 tokens
|
|
0.28.768.941 I slot print_timing: id 3 | task 355 | graphs reused = 0
|
|
0.28.769.013 I slot release: id 3 | task 355 | stop processing: n_tokens = 94, truncated = 0
|
|
0.28.769.027 I srv update_slots: all slots are idle
|
|
0.28.771.865 I srv operator(): Chat format: peg-native
|
|
0.28.771.969 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.776 (> 0.100 thold), f_keep = 0.479
|
|
0.28.771.971 I srv get_availabl: updating prompt cache
|
|
0.28.771.987 W srv prompt_save: - saving prompt with length 94, total state size = 14.690 MiB (draft: 0.000 MiB)
|
|
0.28.784.970 I srv load: - looking for better prompt, base f_keep = 0.479, sim = 0.776
|
|
0.28.784.975 I srv load: - found better prompt with f_keep = 0.495, sim = 0.793
|
|
0.28.792.823 I srv update: - cache state: 4 prompts, 69.071 MiB (limits: 8192.000 MiB, 8192 tokens, 52422 est)
|
|
0.28.792.826 I srv update: - prompt 0x56fafb4e6880: 101 tokens, checkpoints: 0, 15.783 MiB
|
|
0.28.792.827 I srv update: - prompt 0x56fafaea9bd0: 106 tokens, checkpoints: 0, 16.565 MiB
|
|
0.28.792.854 I srv update: - prompt 0x56fafb5211d0: 141 tokens, checkpoints: 0, 22.034 MiB
|
|
0.28.792.856 I srv update: - prompt 0x56fafb4e55f0: 94 tokens, checkpoints: 0, 14.690 MiB
|
|
0.28.792.857 I srv get_availabl: prompt cache update took 20.89 ms
|
|
0.28.792.887 I slot launch_slot_: id 3 | task 388 | processing task, is_child = 0
|
|
0.28.792.888 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.28.792.889 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.28.792.895 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.28.792.896 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.28.792.900 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.28.792.900 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.30.164.983 I slot print_timing: id 3 | task 388 | prompt eval time = 171.94 ms / 12 tokens ( 14.33 ms per token, 69.79 tokens per second)
|
|
0.30.164.987 I slot print_timing: id 3 | task 388 | eval time = 1200.12 ms / 39 tokens ( 30.77 ms per token, 32.50 tokens per second)
|
|
0.30.164.988 I slot print_timing: id 3 | task 388 | total time = 1372.06 ms / 51 tokens
|
|
0.30.164.989 I slot print_timing: id 3 | task 388 | graphs reused = 0
|
|
0.30.165.078 I slot release: id 3 | task 388 | stop processing: n_tokens = 96, truncated = 0
|
|
0.30.165.098 I srv update_slots: all slots are idle
|
|
0.30.168.658 I srv operator(): Chat format: peg-native
|
|
0.30.168.777 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.750 (> 0.100 thold), f_keep = 0.469
|
|
0.30.168.779 I srv get_availabl: updating prompt cache
|
|
0.30.168.806 W srv prompt_save: - saving prompt with length 96, total state size = 15.002 MiB (draft: 0.000 MiB)
|
|
0.30.182.210 I srv load: - looking for better prompt, base f_keep = 0.469, sim = 0.750
|
|
0.30.182.216 I srv update: - cache state: 5 prompts, 84.073 MiB (limits: 8192.000 MiB, 8192 tokens, 52422 est)
|
|
0.30.182.217 I srv update: - prompt 0x56fafb4e6880: 101 tokens, checkpoints: 0, 15.783 MiB
|
|
0.30.182.217 I srv update: - prompt 0x56fafaea9bd0: 106 tokens, checkpoints: 0, 16.565 MiB
|
|
0.30.182.218 I srv update: - prompt 0x56fafb5211d0: 141 tokens, checkpoints: 0, 22.034 MiB
|
|
0.30.182.219 I srv update: - prompt 0x56fafb4e55f0: 94 tokens, checkpoints: 0, 14.690 MiB
|
|
0.30.182.219 I srv update: - prompt 0x56fafb4eb5f0: 96 tokens, checkpoints: 0, 15.002 MiB
|
|
0.30.182.220 I srv get_availabl: prompt cache update took 13.44 ms
|
|
0.30.182.249 I slot launch_slot_: id 3 | task 428 | processing task, is_child = 0
|
|
0.30.182.250 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.30.182.283 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.30.182.291 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.30.182.291 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.30.182.302 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.30.182.303 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.30.859.247 I slot print_timing: id 3 | task 428 | prompt eval time = 171.84 ms / 15 tokens ( 11.46 ms per token, 87.29 tokens per second)
|
|
0.30.859.251 I slot print_timing: id 3 | task 428 | eval time = 505.09 ms / 17 tokens ( 29.71 ms per token, 33.66 tokens per second)
|
|
0.30.859.251 I slot print_timing: id 3 | task 428 | total time = 676.92 ms / 32 tokens
|
|
0.30.859.252 I slot print_timing: id 3 | task 428 | graphs reused = 0
|
|
0.30.859.268 I slot release: id 3 | task 428 | stop processing: n_tokens = 76, truncated = 0
|
|
0.30.859.274 I srv update_slots: all slots are idle
|
|
0.30.862.184 I srv operator(): Chat format: peg-native
|
|
0.30.862.308 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.763 (> 0.100 thold), f_keep = 0.592
|
|
0.30.862.325 I slot launch_slot_: id 3 | task 446 | processing task, is_child = 0
|
|
0.30.862.326 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.30.862.340 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.30.862.346 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.30.862.347 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.30.862.351 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.30.862.351 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.31.979.915 I slot print_timing: id 3 | task 446 | prompt eval time = 171.31 ms / 14 tokens ( 12.24 ms per token, 81.72 tokens per second)
|
|
0.31.979.919 I slot print_timing: id 3 | task 446 | eval time = 946.24 ms / 31 tokens ( 30.52 ms per token, 32.76 tokens per second)
|
|
0.31.979.919 I slot print_timing: id 3 | task 446 | total time = 1117.55 ms / 45 tokens
|
|
0.31.979.920 I slot print_timing: id 3 | task 446 | graphs reused = 0
|
|
0.31.979.980 I slot release: id 3 | task 446 | stop processing: n_tokens = 89, truncated = 0
|
|
0.31.979.990 I srv update_slots: all slots are idle
|
|
0.31.982.529 I srv operator(): Chat format: peg-native
|
|
0.31.982.647 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.738 (> 0.100 thold), f_keep = 0.506
|
|
0.31.982.689 I slot launch_slot_: id 3 | task 478 | processing task, is_child = 0
|
|
0.31.982.690 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.31.982.691 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.31.982.703 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.31.982.703 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.31.982.708 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.31.982.708 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.32.754.271 I slot print_timing: id 3 | task 478 | prompt eval time = 172.53 ms / 16 tokens ( 10.78 ms per token, 92.74 tokens per second)
|
|
0.32.754.274 I slot print_timing: id 3 | task 478 | eval time = 599.02 ms / 20 tokens ( 29.95 ms per token, 33.39 tokens per second)
|
|
0.32.754.275 I slot print_timing: id 3 | task 478 | total time = 771.55 ms / 36 tokens
|
|
0.32.754.276 I slot print_timing: id 3 | task 478 | graphs reused = 0
|
|
0.32.754.370 I slot release: id 3 | task 478 | stop processing: n_tokens = 80, truncated = 0
|
|
0.32.754.376 I srv update_slots: all slots are idle
|
|
0.32.756.850 I srv operator(): Chat format: peg-native
|
|
0.32.756.943 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.789 (> 0.100 thold), f_keep = 0.562
|
|
0.32.756.962 I slot launch_slot_: id 3 | task 499 | processing task, is_child = 0
|
|
0.32.756.962 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.32.756.964 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.32.756.984 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.32.756.984 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.32.756.989 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.32.756.989 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.33.782.938 I slot print_timing: id 3 | task 499 | prompt eval time = 171.18 ms / 12 tokens ( 14.26 ms per token, 70.10 tokens per second)
|
|
0.33.782.942 I slot print_timing: id 3 | task 499 | eval time = 854.75 ms / 28 tokens ( 30.53 ms per token, 32.76 tokens per second)
|
|
0.33.782.943 I slot print_timing: id 3 | task 499 | total time = 1025.93 ms / 40 tokens
|
|
0.33.782.944 I slot print_timing: id 3 | task 499 | graphs reused = 0
|
|
0.33.783.008 I slot release: id 3 | task 499 | stop processing: n_tokens = 84, truncated = 0
|
|
0.33.783.018 I srv update_slots: all slots are idle
|
|
0.33.785.929 I srv operator(): Chat format: peg-native
|
|
0.33.786.057 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.738 (> 0.100 thold), f_keep = 0.536
|
|
0.33.786.076 I slot launch_slot_: id 3 | task 528 | processing task, is_child = 0
|
|
0.33.786.079 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.33.786.080 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.33.786.098 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.33.786.099 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.33.786.103 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.33.786.103 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.34.970.237 I slot print_timing: id 3 | task 528 | prompt eval time = 172.78 ms / 16 tokens ( 10.80 ms per token, 92.60 tokens per second)
|
|
0.34.970.240 I slot print_timing: id 3 | task 528 | eval time = 1011.34 ms / 33 tokens ( 30.65 ms per token, 32.63 tokens per second)
|
|
0.34.970.241 I slot print_timing: id 3 | task 528 | total time = 1184.12 ms / 49 tokens
|
|
0.34.970.242 I slot print_timing: id 3 | task 528 | graphs reused = 0
|
|
0.34.970.322 I slot release: id 3 | task 528 | stop processing: n_tokens = 93, truncated = 0
|
|
0.34.970.331 I srv update_slots: all slots are idle
|
|
0.34.972.943 I srv operator(): Chat format: peg-native
|
|
0.34.973.050 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.804 (> 0.100 thold), f_keep = 0.484
|
|
0.34.973.052 I srv get_availabl: updating prompt cache
|
|
0.34.973.069 W srv prompt_save: - saving prompt with length 93, total state size = 14.533 MiB (draft: 0.000 MiB)
|
|
0.34.986.276 I srv load: - looking for better prompt, base f_keep = 0.484, sim = 0.804
|
|
0.34.986.321 I srv update: - cache state: 6 prompts, 98.607 MiB (limits: 8192.000 MiB, 8192 tokens, 52421 est)
|
|
0.34.986.324 I srv update: - prompt 0x56fafb4e6880: 101 tokens, checkpoints: 0, 15.783 MiB
|
|
0.34.986.325 I srv update: - prompt 0x56fafaea9bd0: 106 tokens, checkpoints: 0, 16.565 MiB
|
|
0.34.986.326 I srv update: - prompt 0x56fafb5211d0: 141 tokens, checkpoints: 0, 22.034 MiB
|
|
0.34.986.327 I srv update: - prompt 0x56fafb4e55f0: 94 tokens, checkpoints: 0, 14.690 MiB
|
|
0.34.986.327 I srv update: - prompt 0x56fafb4eb5f0: 96 tokens, checkpoints: 0, 15.002 MiB
|
|
0.34.986.328 I srv update: - prompt 0x56fafb606f90: 93 tokens, checkpoints: 0, 14.533 MiB
|
|
0.34.986.329 I srv get_availabl: prompt cache update took 13.28 ms
|
|
0.34.986.361 I slot launch_slot_: id 3 | task 562 | processing task, is_child = 0
|
|
0.34.986.363 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.34.986.363 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.34.986.370 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.34.986.371 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.34.986.375 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.34.986.376 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.35.348.272 I slot print_timing: id 3 | task 562 | prompt eval time = 171.71 ms / 11 tokens ( 15.61 ms per token, 64.06 tokens per second)
|
|
0.35.348.275 I slot print_timing: id 3 | task 562 | eval time = 190.15 ms / 7 tokens ( 27.16 ms per token, 36.81 tokens per second)
|
|
0.35.348.276 I slot print_timing: id 3 | task 562 | total time = 361.87 ms / 18 tokens
|
|
0.35.348.276 I slot print_timing: id 3 | task 562 | graphs reused = 0
|
|
0.35.348.398 I slot release: id 3 | task 562 | stop processing: n_tokens = 62, truncated = 0
|
|
0.35.348.406 I srv update_slots: all slots are idle
|
|
0.35.351.399 I srv operator(): Chat format: peg-native
|
|
0.35.351.507 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.818 (> 0.100 thold), f_keep = 0.726
|
|
0.35.351.525 I slot launch_slot_: id 3 | task 570 | processing task, is_child = 0
|
|
0.35.351.526 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.35.351.526 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.35.351.532 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.35.351.532 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.35.351.537 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.35.351.537 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.35.838.891 I slot print_timing: id 3 | task 570 | prompt eval time = 171.40 ms / 10 tokens ( 17.14 ms per token, 58.34 tokens per second)
|
|
0.35.838.894 I slot print_timing: id 3 | task 570 | eval time = 315.93 ms / 11 tokens ( 28.72 ms per token, 34.82 tokens per second)
|
|
0.35.838.895 I slot print_timing: id 3 | task 570 | total time = 487.33 ms / 21 tokens
|
|
0.35.838.895 I slot print_timing: id 3 | task 570 | graphs reused = 0
|
|
0.35.838.911 I slot release: id 3 | task 570 | stop processing: n_tokens = 65, truncated = 0
|
|
0.35.838.916 I srv update_slots: all slots are idle
|
|
0.35.841.547 I srv operator(): Chat format: peg-native
|
|
0.35.841.666 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.852 (> 0.100 thold), f_keep = 0.708
|
|
0.35.841.681 I slot launch_slot_: id 3 | task 582 | processing task, is_child = 0
|
|
0.35.841.681 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.35.841.682 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.35.841.688 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.35.841.688 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.35.841.692 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.35.841.693 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.36.366.287 I slot print_timing: id 3 | task 582 | prompt eval time = 176.20 ms / 8 tokens ( 22.02 ms per token, 45.40 tokens per second)
|
|
0.36.366.290 I slot print_timing: id 3 | task 582 | eval time = 348.37 ms / 12 tokens ( 29.03 ms per token, 34.45 tokens per second)
|
|
0.36.366.290 I slot print_timing: id 3 | task 582 | total time = 524.57 ms / 20 tokens
|
|
0.36.366.291 I slot print_timing: id 3 | task 582 | graphs reused = 0
|
|
0.36.366.320 I slot release: id 3 | task 582 | stop processing: n_tokens = 65, truncated = 0
|
|
0.36.366.328 I srv update_slots: all slots are idle
|
|
0.36.368.918 I srv operator(): Chat format: peg-native
|
|
0.36.369.024 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.849 (> 0.100 thold), f_keep = 0.692
|
|
0.36.369.040 I slot launch_slot_: id 3 | task 595 | processing task, is_child = 0
|
|
0.36.369.040 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.36.369.041 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.36.369.047 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.36.369.047 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.36.369.052 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.36.369.052 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.36.735.248 I slot print_timing: id 3 | task 595 | prompt eval time = 176.01 ms / 8 tokens ( 22.00 ms per token, 45.45 tokens per second)
|
|
0.36.735.251 I slot print_timing: id 3 | task 595 | eval time = 190.16 ms / 7 tokens ( 27.17 ms per token, 36.81 tokens per second)
|
|
0.36.735.251 I slot print_timing: id 3 | task 595 | total time = 366.17 ms / 15 tokens
|
|
0.36.735.252 I slot print_timing: id 3 | task 595 | graphs reused = 0
|
|
0.36.735.374 I slot release: id 3 | task 595 | stop processing: n_tokens = 59, truncated = 0
|
|
0.36.735.379 I srv update_slots: all slots are idle
|
|
0.36.738.114 I srv operator(): Chat format: peg-native
|
|
0.36.738.248 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.776 (> 0.100 thold), f_keep = 0.763
|
|
0.36.738.263 I slot launch_slot_: id 3 | task 603 | processing task, is_child = 0
|
|
0.36.738.263 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.36.738.264 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.36.738.270 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.36.738.270 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.36.738.274 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.36.738.275 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.37.289.322 I slot print_timing: id 3 | task 603 | prompt eval time = 171.09 ms / 13 tokens ( 13.16 ms per token, 75.98 tokens per second)
|
|
0.37.289.325 I slot print_timing: id 3 | task 603 | eval time = 379.92 ms / 13 tokens ( 29.22 ms per token, 34.22 tokens per second)
|
|
0.37.289.326 I slot print_timing: id 3 | task 603 | total time = 551.01 ms / 26 tokens
|
|
0.37.289.327 I slot print_timing: id 3 | task 603 | graphs reused = 0
|
|
0.37.289.438 I slot release: id 3 | task 603 | stop processing: n_tokens = 70, truncated = 0
|
|
0.37.289.446 I srv update_slots: all slots are idle
|
|
0.37.292.698 I srv operator(): Chat format: peg-native
|
|
0.37.292.803 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.789 (> 0.100 thold), f_keep = 0.643
|
|
0.37.292.822 I slot launch_slot_: id 3 | task 617 | processing task, is_child = 0
|
|
0.37.292.823 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.37.292.827 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.37.292.834 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.37.292.834 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.37.292.839 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.37.292.840 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.38.000.916 I slot print_timing: id 3 | task 617 | prompt eval time = 171.12 ms / 12 tokens ( 14.26 ms per token, 70.13 tokens per second)
|
|
0.38.000.919 I slot print_timing: id 3 | task 617 | eval time = 536.93 ms / 18 tokens ( 29.83 ms per token, 33.52 tokens per second)
|
|
0.38.000.920 I slot print_timing: id 3 | task 617 | total time = 708.05 ms / 30 tokens
|
|
0.38.000.920 I slot print_timing: id 3 | task 617 | graphs reused = 0
|
|
0.38.001.046 I slot release: id 3 | task 617 | stop processing: n_tokens = 74, truncated = 0
|
|
0.38.001.054 I srv update_slots: all slots are idle
|
|
0.38.003.897 I srv operator(): Chat format: peg-native
|
|
0.38.003.995 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.714 (> 0.100 thold), f_keep = 0.608
|
|
0.38.004.014 I slot launch_slot_: id 3 | task 636 | processing task, is_child = 0
|
|
0.38.004.015 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.38.004.015 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.38.004.025 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.38.004.026 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.38.004.030 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.38.004.030 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.38.951.974 I slot print_timing: id 3 | task 636 | prompt eval time = 213.92 ms / 18 tokens ( 11.88 ms per token, 84.14 tokens per second)
|
|
0.38.951.977 I slot print_timing: id 3 | task 636 | eval time = 733.99 ms / 24 tokens ( 30.58 ms per token, 32.70 tokens per second)
|
|
0.38.951.978 I slot print_timing: id 3 | task 636 | total time = 947.91 ms / 42 tokens
|
|
0.38.951.978 I slot print_timing: id 3 | task 636 | graphs reused = 0
|
|
0.38.952.003 I slot release: id 3 | task 636 | stop processing: n_tokens = 86, truncated = 0
|
|
0.38.952.009 I srv update_slots: all slots are idle
|
|
0.38.954.888 I srv operator(): Chat format: peg-native
|
|
0.38.954.987 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.726 (> 0.100 thold), f_keep = 0.523
|
|
0.38.955.008 I slot launch_slot_: id 3 | task 661 | processing task, is_child = 0
|
|
0.38.955.010 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.38.955.011 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.38.955.017 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.38.955.017 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.38.955.022 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.38.955.022 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.39.833.084 I slot print_timing: id 3 | task 661 | prompt eval time = 213.74 ms / 17 tokens ( 12.57 ms per token, 79.54 tokens per second)
|
|
0.39.833.087 I slot print_timing: id 3 | task 661 | eval time = 664.29 ms / 22 tokens ( 30.20 ms per token, 33.12 tokens per second)
|
|
0.39.833.105 I slot print_timing: id 3 | task 661 | total time = 878.03 ms / 39 tokens
|
|
0.39.833.106 I slot print_timing: id 3 | task 661 | graphs reused = 0
|
|
0.39.833.162 I slot release: id 3 | task 661 | stop processing: n_tokens = 83, truncated = 0
|
|
0.39.833.170 I srv update_slots: all slots are idle
|
|
0.39.835.716 I srv operator(): Chat format: peg-native
|
|
0.39.835.820 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.849 (> 0.100 thold), f_keep = 0.542
|
|
0.39.835.838 I slot launch_slot_: id 3 | task 684 | processing task, is_child = 0
|
|
0.39.835.842 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.39.835.843 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.39.835.848 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.39.835.849 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.39.835.853 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.39.835.853 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.40.138.932 I slot print_timing: id 3 | task 684 | prompt eval time = 176.03 ms / 8 tokens ( 22.00 ms per token, 45.45 tokens per second)
|
|
0.40.138.935 I slot print_timing: id 3 | task 684 | eval time = 127.02 ms / 5 tokens ( 25.40 ms per token, 39.36 tokens per second)
|
|
0.40.138.936 I slot print_timing: id 3 | task 684 | total time = 303.06 ms / 13 tokens
|
|
0.40.138.936 I slot print_timing: id 3 | task 684 | graphs reused = 0
|
|
0.40.139.012 I slot release: id 3 | task 684 | stop processing: n_tokens = 57, truncated = 0
|
|
0.40.139.017 I srv update_slots: all slots are idle
|
|
0.40.141.921 I srv operator(): Chat format: peg-native
|
|
0.40.142.022 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.789 (> 0.100 thold), f_keep = 0.789
|
|
0.40.142.037 I slot launch_slot_: id 3 | task 690 | processing task, is_child = 0
|
|
0.40.142.037 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.40.142.038 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.40.142.043 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.40.142.043 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.40.142.048 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.40.142.048 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.40.788.290 I slot print_timing: id 3 | task 690 | prompt eval time = 171.33 ms / 12 tokens ( 14.28 ms per token, 70.04 tokens per second)
|
|
0.40.788.300 I slot print_timing: id 3 | task 690 | eval time = 474.90 ms / 16 tokens ( 29.68 ms per token, 33.69 tokens per second)
|
|
0.40.788.301 I slot print_timing: id 3 | task 690 | total time = 646.23 ms / 28 tokens
|
|
0.40.788.302 I slot print_timing: id 3 | task 690 | graphs reused = 0
|
|
0.40.788.364 I slot release: id 3 | task 690 | stop processing: n_tokens = 72, truncated = 0
|
|
0.40.788.370 I srv update_slots: all slots are idle
|
|
0.40.790.934 I srv operator(): Chat format: peg-native
|
|
0.40.791.036 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.763 (> 0.100 thold), f_keep = 0.625
|
|
0.40.791.051 I slot launch_slot_: id 3 | task 707 | processing task, is_child = 0
|
|
0.40.791.052 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.40.791.053 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.40.791.059 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.40.791.059 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.40.791.063 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.40.791.064 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.41.564.058 I slot print_timing: id 3 | task 707 | prompt eval time = 171.40 ms / 14 tokens ( 12.24 ms per token, 81.68 tokens per second)
|
|
0.41.564.061 I slot print_timing: id 3 | task 707 | eval time = 601.58 ms / 20 tokens ( 30.08 ms per token, 33.25 tokens per second)
|
|
0.41.564.062 I slot print_timing: id 3 | task 707 | total time = 772.98 ms / 34 tokens
|
|
0.41.564.062 I slot print_timing: id 3 | task 707 | graphs reused = 0
|
|
0.41.564.078 I slot release: id 3 | task 707 | stop processing: n_tokens = 78, truncated = 0
|
|
0.41.564.084 I srv update_slots: all slots are idle
|
|
0.41.566.781 I srv operator(): Chat format: peg-native
|
|
0.41.566.883 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.643 (> 0.100 thold), f_keep = 0.577
|
|
0.41.566.898 I slot launch_slot_: id 3 | task 728 | processing task, is_child = 0
|
|
0.41.566.899 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.41.566.899 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.41.566.905 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.41.566.905 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.41.566.909 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.41.566.910 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.42.051.025 I slot print_timing: id 3 | task 728 | prompt eval time = 230.98 ms / 25 tokens ( 9.24 ms per token, 108.23 tokens per second)
|
|
0.42.051.028 I slot print_timing: id 3 | task 728 | eval time = 253.12 ms / 9 tokens ( 28.12 ms per token, 35.56 tokens per second)
|
|
0.42.051.028 I slot print_timing: id 3 | task 728 | total time = 484.10 ms / 34 tokens
|
|
0.42.051.029 I slot print_timing: id 3 | task 728 | graphs reused = 0
|
|
0.42.051.114 I slot release: id 3 | task 728 | stop processing: n_tokens = 78, truncated = 0
|
|
0.42.051.121 I srv update_slots: all slots are idle
|
|
0.42.053.424 I srv operator(): Chat format: peg-native
|
|
0.42.053.529 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.754 (> 0.100 thold), f_keep = 0.590
|
|
0.42.053.547 I slot launch_slot_: id 3 | task 738 | processing task, is_child = 0
|
|
0.42.053.547 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.42.053.548 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.42.053.554 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.42.053.554 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.42.053.559 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.42.053.559 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.44.000.342 I slot print_timing: id 3 | task 738 | prompt eval time = 171.59 ms / 15 tokens ( 11.44 ms per token, 87.42 tokens per second)
|
|
0.44.000.345 I slot print_timing: id 3 | task 738 | eval time = 1775.18 ms / 57 tokens ( 31.14 ms per token, 32.11 tokens per second)
|
|
0.44.000.346 I slot print_timing: id 3 | task 738 | total time = 1946.77 ms / 72 tokens
|
|
0.44.000.347 I slot print_timing: id 3 | task 738 | graphs reused = 0
|
|
0.44.000.365 I slot release: id 3 | task 738 | stop processing: n_tokens = 117, truncated = 0
|
|
0.44.000.373 I srv update_slots: all slots are idle
|
|
0.44.002.923 I srv operator(): Chat format: peg-native
|
|
0.44.003.027 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.804 (> 0.100 thold), f_keep = 0.385
|
|
0.44.003.029 I srv get_availabl: updating prompt cache
|
|
0.44.003.044 W srv prompt_save: - saving prompt with length 117, total state size = 18.284 MiB (draft: 0.000 MiB)
|
|
0.44.018.636 I srv load: - looking for better prompt, base f_keep = 0.385, sim = 0.804
|
|
0.44.018.643 I srv update: - cache state: 7 prompts, 116.890 MiB (limits: 8192.000 MiB, 8192 tokens, 52422 est)
|
|
0.44.018.644 I srv update: - prompt 0x56fafb4e6880: 101 tokens, checkpoints: 0, 15.783 MiB
|
|
0.44.018.645 I srv update: - prompt 0x56fafaea9bd0: 106 tokens, checkpoints: 0, 16.565 MiB
|
|
0.44.018.645 I srv update: - prompt 0x56fafb5211d0: 141 tokens, checkpoints: 0, 22.034 MiB
|
|
0.44.018.646 I srv update: - prompt 0x56fafb4e55f0: 94 tokens, checkpoints: 0, 14.690 MiB
|
|
0.44.018.646 I srv update: - prompt 0x56fafb4eb5f0: 96 tokens, checkpoints: 0, 15.002 MiB
|
|
0.44.018.647 I srv update: - prompt 0x56fafb606f90: 93 tokens, checkpoints: 0, 14.533 MiB
|
|
0.44.018.647 I srv update: - prompt 0x56fafaeaa0a0: 117 tokens, checkpoints: 0, 18.284 MiB
|
|
0.44.018.648 I srv get_availabl: prompt cache update took 15.62 ms
|
|
0.44.018.680 I slot launch_slot_: id 3 | task 796 | processing task, is_child = 0
|
|
0.44.018.681 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.44.018.681 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.44.018.689 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.44.018.689 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.44.018.694 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.44.018.694 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.46.376.365 I slot print_timing: id 3 | task 796 | prompt eval time = 171.59 ms / 11 tokens ( 15.60 ms per token, 64.11 tokens per second)
|
|
0.46.376.368 I slot print_timing: id 3 | task 796 | eval time = 2186.07 ms / 70 tokens ( 31.23 ms per token, 32.02 tokens per second)
|
|
0.46.376.369 I slot print_timing: id 3 | task 796 | total time = 2357.65 ms / 81 tokens
|
|
0.46.376.369 I slot print_timing: id 3 | task 796 | graphs reused = 0
|
|
0.46.376.388 I slot release: id 3 | task 796 | stop processing: n_tokens = 125, truncated = 0
|
|
0.46.376.396 I srv update_slots: all slots are idle
|
|
0.46.378.874 I srv operator(): Chat format: peg-native
|
|
0.46.378.976 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.738 (> 0.100 thold), f_keep = 0.360
|
|
0.46.378.978 I srv get_availabl: updating prompt cache
|
|
0.46.378.995 W srv prompt_save: - saving prompt with length 125, total state size = 19.534 MiB (draft: 0.000 MiB)
|
|
0.46.395.640 I srv load: - looking for better prompt, base f_keep = 0.360, sim = 0.738
|
|
0.46.395.647 I srv load: - found better prompt with f_keep = 0.455, sim = 0.754
|
|
0.46.403.679 I srv update: - cache state: 7 prompts, 120.640 MiB (limits: 8192.000 MiB, 8192 tokens, 52422 est)
|
|
0.46.403.683 I srv update: - prompt 0x56fafaea9bd0: 106 tokens, checkpoints: 0, 16.565 MiB
|
|
0.46.403.684 I srv update: - prompt 0x56fafb5211d0: 141 tokens, checkpoints: 0, 22.034 MiB
|
|
0.46.403.685 I srv update: - prompt 0x56fafb4e55f0: 94 tokens, checkpoints: 0, 14.690 MiB
|
|
0.46.403.685 I srv update: - prompt 0x56fafb4eb5f0: 96 tokens, checkpoints: 0, 15.002 MiB
|
|
0.46.403.686 I srv update: - prompt 0x56fafb606f90: 93 tokens, checkpoints: 0, 14.533 MiB
|
|
0.46.403.686 I srv update: - prompt 0x56fafaeaa0a0: 117 tokens, checkpoints: 0, 18.284 MiB
|
|
0.46.403.687 I srv update: - prompt 0x56fafb528080: 125 tokens, checkpoints: 0, 19.534 MiB
|
|
0.46.403.688 I srv get_availabl: prompt cache update took 24.71 ms
|
|
0.46.403.718 I slot launch_slot_: id 3 | task 867 | processing task, is_child = 0
|
|
0.46.403.718 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.46.403.719 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.46.403.726 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.46.403.726 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.46.403.731 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.46.403.731 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.48.351.002 I slot print_timing: id 3 | task 867 | prompt eval time = 171.68 ms / 15 tokens ( 11.45 ms per token, 87.37 tokens per second)
|
|
0.48.351.006 I slot print_timing: id 3 | task 867 | eval time = 1775.57 ms / 57 tokens ( 31.15 ms per token, 32.10 tokens per second)
|
|
0.48.351.006 I slot print_timing: id 3 | task 867 | total time = 1947.25 ms / 72 tokens
|
|
0.48.351.007 I slot print_timing: id 3 | task 867 | graphs reused = 0
|
|
0.48.351.027 I slot release: id 3 | task 867 | stop processing: n_tokens = 117, truncated = 0
|
|
0.48.351.033 I srv update_slots: all slots are idle
|
|
0.48.353.760 I srv operator(): Chat format: peg-native
|
|
0.48.353.869 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.754 (> 0.100 thold), f_keep = 0.393
|
|
0.48.353.872 I srv get_availabl: updating prompt cache
|
|
0.48.353.891 W srv prompt_save: - saving prompt with length 117, total state size = 18.284 MiB (draft: 0.000 MiB)
|
|
0.48.369.554 I srv load: - looking for better prompt, base f_keep = 0.393, sim = 0.754
|
|
0.48.369.559 I srv load: - found better prompt with f_keep = 0.516, sim = 0.787
|
|
0.48.376.111 I srv update: - cache state: 7 prompts, 124.391 MiB (limits: 8192.000 MiB, 8192 tokens, 52422 est)
|
|
0.48.376.114 I srv update: - prompt 0x56fafaea9bd0: 106 tokens, checkpoints: 0, 16.565 MiB
|
|
0.48.376.115 I srv update: - prompt 0x56fafb5211d0: 141 tokens, checkpoints: 0, 22.034 MiB
|
|
0.48.376.115 I srv update: - prompt 0x56fafb4e55f0: 94 tokens, checkpoints: 0, 14.690 MiB
|
|
0.48.376.116 I srv update: - prompt 0x56fafb4eb5f0: 96 tokens, checkpoints: 0, 15.002 MiB
|
|
0.48.376.116 I srv update: - prompt 0x56fafaeaa0a0: 117 tokens, checkpoints: 0, 18.284 MiB
|
|
0.48.376.117 I srv update: - prompt 0x56fafb528080: 125 tokens, checkpoints: 0, 19.534 MiB
|
|
0.48.376.117 I srv update: - prompt 0x56fafb4e5f30: 117 tokens, checkpoints: 0, 18.284 MiB
|
|
0.48.376.118 I srv get_availabl: prompt cache update took 22.25 ms
|
|
0.48.376.147 I slot launch_slot_: id 3 | task 925 | processing task, is_child = 0
|
|
0.48.376.148 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.48.376.149 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.48.376.155 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.48.376.156 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.48.376.160 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.48.376.160 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.49.466.992 I slot print_timing: id 3 | task 925 | prompt eval time = 171.42 ms / 13 tokens ( 13.19 ms per token, 75.84 tokens per second)
|
|
0.49.466.995 I slot print_timing: id 3 | task 925 | eval time = 919.40 ms / 30 tokens ( 30.65 ms per token, 32.63 tokens per second)
|
|
0.49.466.996 I slot print_timing: id 3 | task 925 | total time = 1090.82 ms / 43 tokens
|
|
0.49.466.997 I slot print_timing: id 3 | task 925 | graphs reused = 0
|
|
0.49.467.014 I slot release: id 3 | task 925 | stop processing: n_tokens = 90, truncated = 0
|
|
0.49.467.022 I srv update_slots: all slots are idle
|
|
0.49.469.570 I srv operator(): Chat format: peg-native
|
|
0.49.469.675 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.818 (> 0.100 thold), f_keep = 0.500
|
|
0.49.469.691 I slot launch_slot_: id 3 | task 956 | processing task, is_child = 0
|
|
0.49.469.691 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.49.469.692 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.49.469.698 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.49.469.698 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.49.469.703 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.49.469.703 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.50.593.087 I slot print_timing: id 3 | task 956 | prompt eval time = 171.49 ms / 10 tokens ( 17.15 ms per token, 58.31 tokens per second)
|
|
0.50.593.091 I slot print_timing: id 3 | task 956 | eval time = 951.88 ms / 31 tokens ( 30.71 ms per token, 32.57 tokens per second)
|
|
0.50.593.091 I slot print_timing: id 3 | task 956 | total time = 1123.37 ms / 41 tokens
|
|
0.50.593.092 I slot print_timing: id 3 | task 956 | graphs reused = 0
|
|
0.50.593.108 I slot release: id 3 | task 956 | stop processing: n_tokens = 85, truncated = 0
|
|
0.50.593.114 I srv update_slots: all slots are idle
|
|
0.50.595.514 I srv operator(): Chat format: peg-native
|
|
0.50.595.621 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.865 (> 0.100 thold), f_keep = 0.529
|
|
0.50.595.637 I slot launch_slot_: id 3 | task 988 | processing task, is_child = 0
|
|
0.50.595.637 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.50.595.638 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.50.595.644 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.50.595.644 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.50.595.649 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.50.595.649 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.51.304.971 I slot print_timing: id 3 | task 988 | prompt eval time = 105.98 ms / 7 tokens ( 15.14 ms per token, 66.05 tokens per second)
|
|
0.51.304.974 I slot print_timing: id 3 | task 988 | eval time = 603.33 ms / 20 tokens ( 30.17 ms per token, 33.15 tokens per second)
|
|
0.51.304.974 I slot print_timing: id 3 | task 988 | total time = 709.31 ms / 27 tokens
|
|
0.51.304.975 I slot print_timing: id 3 | task 988 | graphs reused = 0
|
|
0.51.305.043 I slot release: id 3 | task 988 | stop processing: n_tokens = 71, truncated = 0
|
|
0.51.305.050 I srv update_slots: all slots are idle
|
|
0.51.307.467 I srv operator(): Chat format: peg-native
|
|
0.51.307.580 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.776 (> 0.100 thold), f_keep = 0.634
|
|
0.51.307.596 I slot launch_slot_: id 3 | task 1009 | processing task, is_child = 0
|
|
0.51.307.597 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.51.307.598 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.51.307.604 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.51.307.604 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.51.307.608 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.51.307.609 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.53.733.416 I slot print_timing: id 3 | task 1009 | prompt eval time = 171.41 ms / 13 tokens ( 13.19 ms per token, 75.84 tokens per second)
|
|
0.53.733.419 I slot print_timing: id 3 | task 1009 | eval time = 2254.38 ms / 72 tokens ( 31.31 ms per token, 31.94 tokens per second)
|
|
0.53.733.419 I slot print_timing: id 3 | task 1009 | total time = 2425.79 ms / 85 tokens
|
|
0.53.733.420 I slot print_timing: id 3 | task 1009 | graphs reused = 0
|
|
0.53.733.438 I slot release: id 3 | task 1009 | stop processing: n_tokens = 129, truncated = 0
|
|
0.53.733.446 I srv update_slots: all slots are idle
|
|
0.53.735.886 I srv operator(): Chat format: peg-native
|
|
0.53.735.995 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.804 (> 0.100 thold), f_keep = 0.349
|
|
0.53.735.997 I srv get_availabl: updating prompt cache
|
|
0.53.736.016 W srv prompt_save: - saving prompt with length 129, total state size = 20.159 MiB (draft: 0.000 MiB)
|
|
0.53.753.542 I srv load: - looking for better prompt, base f_keep = 0.349, sim = 0.804
|
|
0.53.753.547 I srv load: - found better prompt with f_keep = 0.443, sim = 0.839
|
|
0.53.762.005 I srv update: - cache state: 7 prompts, 127.985 MiB (limits: 8192.000 MiB, 8192 tokens, 52422 est)
|
|
0.53.762.009 I srv update: - prompt 0x56fafb5211d0: 141 tokens, checkpoints: 0, 22.034 MiB
|
|
0.53.762.009 I srv update: - prompt 0x56fafb4e55f0: 94 tokens, checkpoints: 0, 14.690 MiB
|
|
0.53.762.010 I srv update: - prompt 0x56fafb4eb5f0: 96 tokens, checkpoints: 0, 15.002 MiB
|
|
0.53.762.010 I srv update: - prompt 0x56fafaeaa0a0: 117 tokens, checkpoints: 0, 18.284 MiB
|
|
0.53.762.011 I srv update: - prompt 0x56fafb528080: 125 tokens, checkpoints: 0, 19.534 MiB
|
|
0.53.762.011 I srv update: - prompt 0x56fafb4e5f30: 117 tokens, checkpoints: 0, 18.284 MiB
|
|
0.53.762.012 I srv update: - prompt 0x56fafb7a1070: 129 tokens, checkpoints: 0, 20.159 MiB
|
|
0.53.762.013 I srv get_availabl: prompt cache update took 26.02 ms
|
|
0.53.762.042 I slot launch_slot_: id 3 | task 1082 | processing task, is_child = 0
|
|
0.53.762.043 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.53.762.044 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.53.762.051 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.53.762.052 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.53.762.056 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.53.762.056 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.55.973.062 I slot print_timing: id 3 | task 1082 | prompt eval time = 171.73 ms / 9 tokens ( 19.08 ms per token, 52.41 tokens per second)
|
|
0.55.973.065 I slot print_timing: id 3 | task 1082 | eval time = 2039.26 ms / 65 tokens ( 31.37 ms per token, 31.87 tokens per second)
|
|
0.55.973.066 I slot print_timing: id 3 | task 1082 | total time = 2210.99 ms / 74 tokens
|
|
0.55.973.066 I slot print_timing: id 3 | task 1082 | graphs reused = 0
|
|
0.55.973.084 I slot release: id 3 | task 1082 | stop processing: n_tokens = 120, truncated = 0
|
|
0.55.973.092 I srv update_slots: all slots are idle
|
|
0.55.976.239 I srv operator(): Chat format: peg-native
|
|
0.55.976.409 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.836 (> 0.100 thold), f_keep = 0.383
|
|
0.55.976.411 I srv get_availabl: updating prompt cache
|
|
0.55.976.428 W srv prompt_save: - saving prompt with length 120, total state size = 18.752 MiB (draft: 0.000 MiB)
|
|
0.55.992.592 I srv load: - looking for better prompt, base f_keep = 0.383, sim = 0.836
|
|
0.55.992.601 I srv update: - cache state: 8 prompts, 146.737 MiB (limits: 8192.000 MiB, 8192 tokens, 52422 est)
|
|
0.55.992.602 I srv update: - prompt 0x56fafb5211d0: 141 tokens, checkpoints: 0, 22.034 MiB
|
|
0.55.992.607 I srv update: - prompt 0x56fafb4e55f0: 94 tokens, checkpoints: 0, 14.690 MiB
|
|
0.55.992.607 I srv update: - prompt 0x56fafb4eb5f0: 96 tokens, checkpoints: 0, 15.002 MiB
|
|
0.55.992.608 I srv update: - prompt 0x56fafaeaa0a0: 117 tokens, checkpoints: 0, 18.284 MiB
|
|
0.55.992.608 I srv update: - prompt 0x56fafb528080: 125 tokens, checkpoints: 0, 19.534 MiB
|
|
0.55.992.609 I srv update: - prompt 0x56fafb4e5f30: 117 tokens, checkpoints: 0, 18.284 MiB
|
|
0.55.992.609 I srv update: - prompt 0x56fafb7a1070: 129 tokens, checkpoints: 0, 20.159 MiB
|
|
0.55.992.610 I srv update: - prompt 0x56fafb047bc0: 120 tokens, checkpoints: 0, 18.752 MiB
|
|
0.55.992.611 I srv get_availabl: prompt cache update took 16.20 ms
|
|
0.55.992.642 I slot launch_slot_: id 3 | task 1148 | processing task, is_child = 0
|
|
0.55.992.643 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.55.992.644 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.55.992.651 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.55.992.651 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.55.992.656 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.55.992.656 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.57.537.277 I slot print_timing: id 3 | task 1148 | prompt eval time = 171.71 ms / 9 tokens ( 19.08 ms per token, 52.41 tokens per second)
|
|
0.57.537.281 I slot print_timing: id 3 | task 1148 | eval time = 1372.89 ms / 44 tokens ( 31.20 ms per token, 32.05 tokens per second)
|
|
0.57.537.281 I slot print_timing: id 3 | task 1148 | total time = 1544.60 ms / 53 tokens
|
|
0.57.537.283 I slot print_timing: id 3 | task 1148 | graphs reused = 0
|
|
0.57.537.364 I slot release: id 3 | task 1148 | stop processing: n_tokens = 98, truncated = 0
|
|
0.57.537.371 I srv update_slots: all slots are idle
|
|
0.57.539.934 I srv operator(): Chat format: peg-native
|
|
0.57.540.042 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.776 (> 0.100 thold), f_keep = 0.459
|
|
0.57.540.044 I srv get_availabl: updating prompt cache
|
|
0.57.540.058 W srv prompt_save: - saving prompt with length 98, total state size = 15.315 MiB (draft: 0.000 MiB)
|
|
0.57.548.280 I srv load: - looking for better prompt, base f_keep = 0.459, sim = 0.776
|
|
0.57.548.289 I srv update: - cache state: 9 prompts, 162.052 MiB (limits: 8192.000 MiB, 8192 tokens, 52422 est)
|
|
0.57.548.290 I srv update: - prompt 0x56fafb5211d0: 141 tokens, checkpoints: 0, 22.034 MiB
|
|
0.57.548.291 I srv update: - prompt 0x56fafb4e55f0: 94 tokens, checkpoints: 0, 14.690 MiB
|
|
0.57.548.305 I srv update: - prompt 0x56fafb4eb5f0: 96 tokens, checkpoints: 0, 15.002 MiB
|
|
0.57.548.305 I srv update: - prompt 0x56fafaeaa0a0: 117 tokens, checkpoints: 0, 18.284 MiB
|
|
0.57.548.307 I srv update: - prompt 0x56fafb528080: 125 tokens, checkpoints: 0, 19.534 MiB
|
|
0.57.548.307 I srv update: - prompt 0x56fafb4e5f30: 117 tokens, checkpoints: 0, 18.284 MiB
|
|
0.57.548.308 I srv update: - prompt 0x56fafb7a1070: 129 tokens, checkpoints: 0, 20.159 MiB
|
|
0.57.548.309 I srv update: - prompt 0x56fafb047bc0: 120 tokens, checkpoints: 0, 18.752 MiB
|
|
0.57.548.310 I srv update: - prompt 0x56fafb51bb80: 98 tokens, checkpoints: 0, 15.315 MiB
|
|
0.57.548.310 I srv get_availabl: prompt cache update took 8.27 ms
|
|
0.57.548.336 I slot launch_slot_: id 3 | task 1193 | processing task, is_child = 0
|
|
0.57.548.337 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.57.548.337 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.57.548.343 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.57.548.343 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.57.548.347 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.57.548.348 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.58.454.040 I slot print_timing: id 3 | task 1193 | prompt eval time = 171.57 ms / 13 tokens ( 13.20 ms per token, 75.77 tokens per second)
|
|
0.58.454.044 I slot print_timing: id 3 | task 1193 | eval time = 734.11 ms / 24 tokens ( 30.59 ms per token, 32.69 tokens per second)
|
|
0.58.454.045 I slot print_timing: id 3 | task 1193 | total time = 905.68 ms / 37 tokens
|
|
0.58.454.046 I slot print_timing: id 3 | task 1193 | graphs reused = 0
|
|
0.58.454.063 I slot release: id 3 | task 1193 | stop processing: n_tokens = 81, truncated = 0
|
|
0.58.454.071 I srv update_slots: all slots are idle
|
|
0.58.456.794 I srv operator(): Chat format: peg-native
|
|
0.58.456.901 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.833 (> 0.100 thold), f_keep = 0.556
|
|
0.58.456.919 I slot launch_slot_: id 3 | task 1218 | processing task, is_child = 0
|
|
0.58.456.920 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.58.456.921 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.58.456.927 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.58.456.928 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.58.456.933 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.58.456.933 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.00.772.054 I slot print_timing: id 3 | task 1218 | prompt eval time = 171.57 ms / 9 tokens ( 19.06 ms per token, 52.46 tokens per second)
|
|
1.00.772.058 I slot print_timing: id 3 | task 1218 | eval time = 2143.54 ms / 68 tokens ( 31.52 ms per token, 31.72 tokens per second)
|
|
1.00.772.059 I slot print_timing: id 3 | task 1218 | total time = 2315.11 ms / 77 tokens
|
|
1.00.772.060 I slot print_timing: id 3 | task 1218 | graphs reused = 0
|
|
1.00.772.077 I slot release: id 3 | task 1218 | stop processing: n_tokens = 121, truncated = 0
|
|
1.00.772.085 I srv update_slots: all slots are idle
|
|
1.00.772.799 I srv operator(): operator(): cleaning up before exit...
|