1026 lines
97 KiB
Plaintext
1026 lines
97 KiB
Plaintext
0.00.065.603 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg)
|
|
0.00.065.605 I device_info:
|
|
0.00.065.625 I - ROCm0 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
|
|
0.00.065.629 I - ROCm1 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
|
|
0.00.065.634 I - CPU : AMD Ryzen 9 3900X 12-Core Processor (128730 MiB, 128730 MiB free)
|
|
0.00.065.693 I system_info: n_threads = 12 (n_threads_batch = 12) / 24 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 |
|
|
0.00.065.697 I srv llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true
|
|
0.00.065.740 I srv init: running without SSL
|
|
0.00.065.812 I srv init: using 23 threads for HTTP server
|
|
0.00.066.157 I srv start: binding port with default address family
|
|
0.00.067.376 I srv llama_server: loading model
|
|
0.00.067.386 I srv load_model: loading model '/home/qrf/.cache/llama.cpp/GLM-4.6V-UD-IQ2_M.gguf'
|
|
0.00.067.441 I common_init_result: fitting params to device memory ...
|
|
0.00.067.442 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on)
|
|
0.01.156.098 W load: special_eot_id is not in special_eog_ids - the tokenizer config may be incorrect
|
|
0.01.156.103 W load: special_eom_id is not in special_eog_ids - the tokenizer config may be incorrect
|
|
0.22.976.990 W llama_context: n_ctx_seq (8192) < n_ctx_train (131072) -- the full capacity of the model will not be utilized
|
|
0.23.149.036 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
|
|
0.23.356.763 I srv load_model: initializing slots, n_slots = 4
|
|
0.23.429.512 W common_speculative_init: no implementations specified for speculative decoding
|
|
0.23.429.518 I slot load_model: id 0 | task -1 | new slot, n_ctx = 8192
|
|
0.23.429.523 I slot load_model: id 1 | task -1 | new slot, n_ctx = 8192
|
|
0.23.429.523 I slot load_model: id 2 | task -1 | new slot, n_ctx = 8192
|
|
0.23.429.524 I slot load_model: id 3 | task -1 | new slot, n_ctx = 8192
|
|
0.23.429.577 I srv load_model: prompt cache is enabled, size limit: 8192 MiB
|
|
0.23.429.578 I srv load_model: use `--cache-ram 0` to disable the prompt cache
|
|
0.23.429.578 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391
|
|
0.23.429.579 I srv load_model: context checkpoints enabled, max = 32, min spacing = 256
|
|
0.23.429.597 I srv init: idle slots will be saved to prompt cache and cleared upon starting a new task
|
|
0.23.441.725 I init: chat template, example_format: '[gMASK]<sop><|system|>
|
|
You are a helpful assistant<|user|>
|
|
Hello<|assistant|>
|
|
<think></think>
|
|
Hi there<|user|>
|
|
How are you?<|assistant|>
|
|
'
|
|
0.23.450.938 I srv init: init: chat template, thinking = 1
|
|
0.23.450.972 I srv llama_server: model loaded
|
|
0.23.450.974 I srv llama_server: server is listening on http://127.0.0.1:8090
|
|
0.23.450.980 I srv update_slots: all slots are idle
|
|
0.24.979.021 I srv operator(): Chat format: peg-native
|
|
0.24.979.232 I slot get_availabl: id 3 | task -1 | selected slot by LRU, t_last = -1
|
|
0.24.979.235 I srv get_availabl: updating prompt cache
|
|
0.24.979.241 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000
|
|
0.24.979.245 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 8192 tokens, 8589934592 est)
|
|
0.24.979.246 I srv get_availabl: prompt cache update took 0.01 ms
|
|
0.24.979.291 I slot launch_slot_: id 3 | task 0 | processing task, is_child = 0
|
|
0.24.979.292 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.24.979.293 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.24.979.305 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.24.979.306 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.24.979.313 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.24.979.313 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.28.386.102 I slot print_timing: id 3 | task 0 | prompt eval time = 1670.00 ms / 71 tokens ( 23.52 ms per token, 42.51 tokens per second)
|
|
0.28.386.106 I slot print_timing: id 3 | task 0 | eval time = 1736.76 ms / 55 tokens ( 31.58 ms per token, 31.67 tokens per second)
|
|
0.28.386.106 I slot print_timing: id 3 | task 0 | total time = 3406.76 ms / 126 tokens
|
|
0.28.386.111 I slot print_timing: id 3 | task 0 | graphs reused = 54
|
|
0.28.386.152 I slot release: id 3 | task 0 | stop processing: n_tokens = 125, truncated = 0
|
|
0.28.386.156 I srv update_slots: all slots are idle
|
|
0.28.396.940 I srv operator(): Chat format: peg-native
|
|
0.28.397.110 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.746 (> 0.100 thold), f_keep = 0.376
|
|
0.28.397.110 I srv get_availabl: updating prompt cache
|
|
0.28.397.136 W srv prompt_save: - saving prompt with length 125, total state size = 22.464 MiB (draft: 0.000 MiB)
|
|
0.28.411.885 I srv load: - looking for better prompt, base f_keep = 0.376, sim = 0.746
|
|
0.28.411.893 I srv update: - cache state: 1 prompts, 22.464 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
0.28.411.894 I srv update: - prompt 0x5ec73dc44880: 125 tokens, checkpoints: 0, 22.464 MiB
|
|
0.28.411.895 I srv get_availabl: prompt cache update took 14.78 ms
|
|
0.28.411.969 I slot launch_slot_: id 3 | task 57 | processing task, is_child = 0
|
|
0.28.411.972 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.28.411.973 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.28.411.979 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.28.411.980 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.28.411.985 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.28.411.985 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.30.864.393 I slot print_timing: id 3 | task 57 | prompt eval time = 366.01 ms / 16 tokens ( 22.88 ms per token, 43.71 tokens per second)
|
|
0.30.864.396 I slot print_timing: id 3 | task 57 | eval time = 2086.38 ms / 66 tokens ( 31.61 ms per token, 31.63 tokens per second)
|
|
0.30.864.396 I slot print_timing: id 3 | task 57 | total time = 2452.39 ms / 82 tokens
|
|
0.30.864.397 I slot print_timing: id 3 | task 57 | graphs reused = 118
|
|
0.30.864.447 I slot release: id 3 | task 57 | stop processing: n_tokens = 128, truncated = 0
|
|
0.30.864.456 I srv update_slots: all slots are idle
|
|
0.30.875.658 I srv operator(): Chat format: peg-native
|
|
0.30.875.837 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.723 (> 0.100 thold), f_keep = 0.367
|
|
0.30.875.840 I srv get_availabl: updating prompt cache
|
|
0.30.875.867 W srv prompt_save: - saving prompt with length 128, total state size = 23.004 MiB (draft: 0.000 MiB)
|
|
0.30.895.791 I srv load: - looking for better prompt, base f_keep = 0.367, sim = 0.723
|
|
0.30.895.795 I srv load: - found better prompt with f_keep = 0.400, sim = 0.769
|
|
0.30.905.134 I srv update: - cache state: 1 prompts, 23.004 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
0.30.905.138 I srv update: - prompt 0x5ec73dc30f10: 128 tokens, checkpoints: 0, 23.004 MiB
|
|
0.30.905.139 I srv get_availabl: prompt cache update took 29.30 ms
|
|
0.30.905.202 I slot launch_slot_: id 3 | task 124 | processing task, is_child = 0
|
|
0.30.905.204 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.30.905.205 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.30.905.212 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.30.905.213 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.30.905.217 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.30.905.217 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.32.705.371 I slot print_timing: id 3 | task 124 | prompt eval time = 354.62 ms / 15 tokens ( 23.64 ms per token, 42.30 tokens per second)
|
|
0.32.705.375 I slot print_timing: id 3 | task 124 | eval time = 1445.52 ms / 46 tokens ( 31.42 ms per token, 31.82 tokens per second)
|
|
0.32.705.376 I slot print_timing: id 3 | task 124 | total time = 1800.14 ms / 61 tokens
|
|
0.32.705.376 I slot print_timing: id 3 | task 124 | graphs reused = 162
|
|
0.32.705.406 I slot release: id 3 | task 124 | stop processing: n_tokens = 110, truncated = 0
|
|
0.32.705.414 I srv update_slots: all slots are idle
|
|
0.32.716.505 I srv operator(): Chat format: peg-native
|
|
0.32.716.671 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.750 (> 0.100 thold), f_keep = 0.436
|
|
0.32.716.673 I srv get_availabl: updating prompt cache
|
|
0.32.716.692 W srv prompt_save: - saving prompt with length 110, total state size = 19.769 MiB (draft: 0.000 MiB)
|
|
0.32.727.136 I srv load: - looking for better prompt, base f_keep = 0.436, sim = 0.750
|
|
0.32.727.143 I srv update: - cache state: 2 prompts, 42.772 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
0.32.727.144 I srv update: - prompt 0x5ec73dc30f10: 128 tokens, checkpoints: 0, 23.004 MiB
|
|
0.32.727.144 I srv update: - prompt 0x5ec7416d09d0: 110 tokens, checkpoints: 0, 19.769 MiB
|
|
0.32.727.145 I srv get_availabl: prompt cache update took 10.47 ms
|
|
0.32.727.209 I slot launch_slot_: id 3 | task 171 | processing task, is_child = 0
|
|
0.32.727.211 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.32.727.212 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.32.727.218 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.32.727.218 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.32.727.223 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.32.727.223 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.36.108.533 I slot print_timing: id 3 | task 171 | prompt eval time = 365.71 ms / 16 tokens ( 22.86 ms per token, 43.75 tokens per second)
|
|
0.36.108.536 I slot print_timing: id 3 | task 171 | eval time = 3015.58 ms / 95 tokens ( 31.74 ms per token, 31.50 tokens per second)
|
|
0.36.108.537 I slot print_timing: id 3 | task 171 | total time = 3381.29 ms / 111 tokens
|
|
0.36.108.538 I slot print_timing: id 3 | task 171 | graphs reused = 255
|
|
0.36.108.568 I slot release: id 3 | task 171 | stop processing: n_tokens = 158, truncated = 0
|
|
0.36.108.575 I srv update_slots: all slots are idle
|
|
0.36.119.601 I srv operator(): Chat format: peg-native
|
|
0.36.119.765 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.727 (> 0.100 thold), f_keep = 0.304
|
|
0.36.119.767 I srv get_availabl: updating prompt cache
|
|
0.36.119.788 W srv prompt_save: - saving prompt with length 158, total state size = 28.395 MiB (draft: 0.000 MiB)
|
|
0.36.143.930 I srv load: - looking for better prompt, base f_keep = 0.304, sim = 0.727
|
|
0.36.143.935 I srv load: - found better prompt with f_keep = 0.455, sim = 0.758
|
|
0.36.152.523 I srv update: - cache state: 2 prompts, 51.398 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
0.36.152.527 I srv update: - prompt 0x5ec73dc30f10: 128 tokens, checkpoints: 0, 23.004 MiB
|
|
0.36.152.527 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
0.36.152.528 I srv get_availabl: prompt cache update took 32.76 ms
|
|
0.36.152.586 I slot launch_slot_: id 3 | task 267 | processing task, is_child = 0
|
|
0.36.152.587 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.36.152.588 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.36.152.595 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.36.152.595 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.36.152.600 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.36.152.600 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.38.384.388 I slot print_timing: id 3 | task 267 | prompt eval time = 352.63 ms / 16 tokens ( 22.04 ms per token, 45.37 tokens per second)
|
|
0.38.384.392 I slot print_timing: id 3 | task 267 | eval time = 1879.14 ms / 60 tokens ( 31.32 ms per token, 31.93 tokens per second)
|
|
0.38.384.392 I slot print_timing: id 3 | task 267 | total time = 2231.77 ms / 76 tokens
|
|
0.38.384.393 I slot print_timing: id 3 | task 267 | graphs reused = 313
|
|
0.38.384.428 I slot release: id 3 | task 267 | stop processing: n_tokens = 125, truncated = 0
|
|
0.38.384.436 I srv update_slots: all slots are idle
|
|
0.38.395.682 I srv operator(): Chat format: peg-native
|
|
0.38.395.853 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.712 (> 0.100 thold), f_keep = 0.376
|
|
0.38.395.856 I srv get_availabl: updating prompt cache
|
|
0.38.395.876 W srv prompt_save: - saving prompt with length 125, total state size = 22.464 MiB (draft: 0.000 MiB)
|
|
0.38.407.274 I srv load: - looking for better prompt, base f_keep = 0.376, sim = 0.712
|
|
0.38.407.282 I srv update: - cache state: 3 prompts, 73.863 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
0.38.407.283 I srv update: - prompt 0x5ec73dc30f10: 128 tokens, checkpoints: 0, 23.004 MiB
|
|
0.38.407.284 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
0.38.407.285 I srv update: - prompt 0x5ec73d9fb000: 125 tokens, checkpoints: 0, 22.464 MiB
|
|
0.38.407.286 I srv get_availabl: prompt cache update took 11.43 ms
|
|
0.38.407.355 I slot launch_slot_: id 3 | task 328 | processing task, is_child = 0
|
|
0.38.407.357 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.38.407.357 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.38.407.365 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.38.407.365 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.38.407.370 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.38.407.370 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.39.331.340 I slot print_timing: id 3 | task 328 | prompt eval time = 504.26 ms / 19 tokens ( 26.54 ms per token, 37.68 tokens per second)
|
|
0.39.331.344 I slot print_timing: id 3 | task 328 | eval time = 419.69 ms / 14 tokens ( 29.98 ms per token, 33.36 tokens per second)
|
|
0.39.331.344 I slot print_timing: id 3 | task 328 | total time = 923.95 ms / 33 tokens
|
|
0.39.331.345 I slot print_timing: id 3 | task 328 | graphs reused = 325
|
|
0.39.331.377 I slot release: id 3 | task 328 | stop processing: n_tokens = 79, truncated = 0
|
|
0.39.331.385 I srv update_slots: all slots are idle
|
|
0.39.342.562 I srv operator(): Chat format: peg-native
|
|
0.39.342.731 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.671 (> 0.100 thold), f_keep = 0.595
|
|
0.39.342.760 I slot launch_slot_: id 3 | task 343 | processing task, is_child = 0
|
|
0.39.342.760 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.39.342.761 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.39.342.767 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.39.342.767 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.39.342.772 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.39.342.772 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.40.941.169 I slot print_timing: id 3 | task 343 | prompt eval time = 544.41 ms / 23 tokens ( 23.67 ms per token, 42.25 tokens per second)
|
|
0.40.941.173 I slot print_timing: id 3 | task 343 | eval time = 1053.97 ms / 34 tokens ( 31.00 ms per token, 32.26 tokens per second)
|
|
0.40.941.173 I slot print_timing: id 3 | task 343 | total time = 1598.38 ms / 57 tokens
|
|
0.40.941.174 I slot print_timing: id 3 | task 343 | graphs reused = 357
|
|
0.40.941.207 I slot release: id 3 | task 343 | stop processing: n_tokens = 103, truncated = 0
|
|
0.40.941.215 I srv update_slots: all slots are idle
|
|
0.40.952.145 I srv operator(): Chat format: peg-native
|
|
0.40.952.316 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.800 (> 0.100 thold), f_keep = 0.466
|
|
0.40.952.317 I srv get_availabl: updating prompt cache
|
|
0.40.952.339 W srv prompt_save: - saving prompt with length 103, total state size = 18.511 MiB (draft: 0.000 MiB)
|
|
0.40.968.831 I srv load: - looking for better prompt, base f_keep = 0.466, sim = 0.800
|
|
0.40.968.839 I srv update: - cache state: 4 prompts, 92.373 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
0.40.968.840 I srv update: - prompt 0x5ec73dc30f10: 128 tokens, checkpoints: 0, 23.004 MiB
|
|
0.40.968.840 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
0.40.968.841 I srv update: - prompt 0x5ec73d9fb000: 125 tokens, checkpoints: 0, 22.464 MiB
|
|
0.40.968.842 I srv update: - prompt 0x5ec7416d09d0: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
0.40.968.843 I srv get_availabl: prompt cache update took 16.53 ms
|
|
0.40.968.902 I slot launch_slot_: id 3 | task 378 | processing task, is_child = 0
|
|
0.40.968.903 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.40.968.904 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.40.968.920 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.40.968.920 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.40.968.925 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.40.968.925 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.43.865.500 I slot print_timing: id 3 | task 378 | prompt eval time = 322.83 ms / 12 tokens ( 26.90 ms per token, 37.17 tokens per second)
|
|
0.43.865.503 I slot print_timing: id 3 | task 378 | eval time = 2573.73 ms / 82 tokens ( 31.39 ms per token, 31.86 tokens per second)
|
|
0.43.865.504 I slot print_timing: id 3 | task 378 | total time = 2896.56 ms / 94 tokens
|
|
0.43.865.505 I slot print_timing: id 3 | task 378 | graphs reused = 437
|
|
0.43.865.534 I slot release: id 3 | task 378 | stop processing: n_tokens = 141, truncated = 0
|
|
0.43.865.542 I srv update_slots: all slots are idle
|
|
0.43.876.734 I srv operator(): Chat format: peg-native
|
|
0.43.876.904 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.653 (> 0.100 thold), f_keep = 0.333
|
|
0.43.876.906 I srv get_availabl: updating prompt cache
|
|
0.43.876.933 W srv prompt_save: - saving prompt with length 141, total state size = 25.340 MiB (draft: 0.000 MiB)
|
|
0.43.897.942 I srv load: - looking for better prompt, base f_keep = 0.333, sim = 0.653
|
|
0.43.897.948 I srv load: - found better prompt with f_keep = 0.375, sim = 0.667
|
|
0.43.907.135 I srv update: - cache state: 4 prompts, 94.710 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
0.43.907.139 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
0.43.907.139 I srv update: - prompt 0x5ec73d9fb000: 125 tokens, checkpoints: 0, 22.464 MiB
|
|
0.43.907.140 I srv update: - prompt 0x5ec7416d09d0: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
0.43.907.141 I srv update: - prompt 0x5ec73dc06c00: 141 tokens, checkpoints: 0, 25.340 MiB
|
|
0.43.907.142 I srv get_availabl: prompt cache update took 30.24 ms
|
|
0.43.907.197 I slot launch_slot_: id 3 | task 461 | processing task, is_child = 0
|
|
0.43.907.198 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.43.907.198 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.43.907.205 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.43.907.205 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.43.907.210 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.43.907.210 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.45.537.379 I slot print_timing: id 3 | task 461 | prompt eval time = 544.09 ms / 24 tokens ( 22.67 ms per token, 44.11 tokens per second)
|
|
0.45.537.382 I slot print_timing: id 3 | task 461 | eval time = 1086.06 ms / 35 tokens ( 31.03 ms per token, 32.23 tokens per second)
|
|
0.45.537.383 I slot print_timing: id 3 | task 461 | total time = 1630.15 ms / 59 tokens
|
|
0.45.537.384 I slot print_timing: id 3 | task 461 | graphs reused = 470
|
|
0.45.537.414 I slot release: id 3 | task 461 | stop processing: n_tokens = 106, truncated = 0
|
|
0.45.537.421 I srv update_slots: all slots are idle
|
|
0.45.548.617 I srv operator(): Chat format: peg-native
|
|
0.45.548.783 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.723 (> 0.100 thold), f_keep = 0.443
|
|
0.45.548.785 I srv get_availabl: updating prompt cache
|
|
0.45.548.803 W srv prompt_save: - saving prompt with length 106, total state size = 19.050 MiB (draft: 0.000 MiB)
|
|
0.45.558.545 I srv load: - looking for better prompt, base f_keep = 0.443, sim = 0.723
|
|
0.45.558.550 I srv load: - found better prompt with f_keep = 0.466, sim = 0.738
|
|
0.45.566.939 I srv update: - cache state: 4 prompts, 95.249 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
0.45.566.943 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
0.45.566.943 I srv update: - prompt 0x5ec73d9fb000: 125 tokens, checkpoints: 0, 22.464 MiB
|
|
0.45.566.944 I srv update: - prompt 0x5ec73dc06c00: 141 tokens, checkpoints: 0, 25.340 MiB
|
|
0.45.566.944 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
0.45.566.946 I srv get_availabl: prompt cache update took 18.16 ms
|
|
0.45.567.001 I slot launch_slot_: id 3 | task 497 | processing task, is_child = 0
|
|
0.45.567.002 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.45.567.003 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.45.567.010 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.45.567.010 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.45.567.014 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.45.567.015 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.47.905.180 I slot print_timing: id 3 | task 497 | prompt eval time = 492.81 ms / 17 tokens ( 28.99 ms per token, 34.50 tokens per second)
|
|
0.47.905.183 I slot print_timing: id 3 | task 497 | eval time = 1845.33 ms / 59 tokens ( 31.28 ms per token, 31.97 tokens per second)
|
|
0.47.905.184 I slot print_timing: id 3 | task 497 | total time = 2338.15 ms / 76 tokens
|
|
0.47.905.185 I slot print_timing: id 3 | task 497 | graphs reused = 527
|
|
0.47.905.220 I slot release: id 3 | task 497 | stop processing: n_tokens = 123, truncated = 0
|
|
0.47.905.230 I srv update_slots: all slots are idle
|
|
0.47.916.212 I srv operator(): Chat format: peg-native
|
|
0.47.916.382 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.662 (> 0.100 thold), f_keep = 0.382
|
|
0.47.916.384 I srv get_availabl: updating prompt cache
|
|
0.47.916.408 W srv prompt_save: - saving prompt with length 123, total state size = 22.105 MiB (draft: 0.000 MiB)
|
|
0.47.927.704 I srv load: - looking for better prompt, base f_keep = 0.382, sim = 0.662
|
|
0.47.927.711 I srv update: - cache state: 5 prompts, 117.354 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
0.47.927.711 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
0.47.927.712 I srv update: - prompt 0x5ec73d9fb000: 125 tokens, checkpoints: 0, 22.464 MiB
|
|
0.47.927.713 I srv update: - prompt 0x5ec73dc06c00: 141 tokens, checkpoints: 0, 25.340 MiB
|
|
0.47.927.713 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
0.47.927.714 I srv update: - prompt 0x5ec73dacf5e0: 123 tokens, checkpoints: 0, 22.105 MiB
|
|
0.47.927.715 I srv get_availabl: prompt cache update took 11.33 ms
|
|
0.47.927.782 I slot launch_slot_: id 3 | task 557 | processing task, is_child = 0
|
|
0.47.927.783 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.47.927.784 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.47.927.792 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.47.927.792 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.47.927.797 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.47.927.797 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.49.507.281 I slot print_timing: id 3 | task 557 | prompt eval time = 557.11 ms / 24 tokens ( 23.21 ms per token, 43.08 tokens per second)
|
|
0.49.507.285 I slot print_timing: id 3 | task 557 | eval time = 1022.36 ms / 33 tokens ( 30.98 ms per token, 32.28 tokens per second)
|
|
0.49.507.285 I slot print_timing: id 3 | task 557 | total time = 1579.47 ms / 57 tokens
|
|
0.49.507.286 I slot print_timing: id 3 | task 557 | graphs reused = 558
|
|
0.49.507.317 I slot release: id 3 | task 557 | stop processing: n_tokens = 103, truncated = 0
|
|
0.49.507.323 I srv update_slots: all slots are idle
|
|
0.49.518.203 I srv operator(): Chat format: peg-native
|
|
0.49.518.370 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.712 (> 0.100 thold), f_keep = 0.456
|
|
0.49.518.372 I srv get_availabl: updating prompt cache
|
|
0.49.518.392 W srv prompt_save: - saving prompt with length 103, total state size = 18.511 MiB (draft: 0.000 MiB)
|
|
0.49.534.708 I srv load: - looking for better prompt, base f_keep = 0.456, sim = 0.712
|
|
0.49.534.717 I srv update: - cache state: 6 prompts, 135.865 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
0.49.534.718 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
0.49.534.719 I srv update: - prompt 0x5ec73d9fb000: 125 tokens, checkpoints: 0, 22.464 MiB
|
|
0.49.534.719 I srv update: - prompt 0x5ec73dc06c00: 141 tokens, checkpoints: 0, 25.340 MiB
|
|
0.49.534.720 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
0.49.534.720 I srv update: - prompt 0x5ec73dacf5e0: 123 tokens, checkpoints: 0, 22.105 MiB
|
|
0.49.534.721 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
0.49.534.722 I srv get_availabl: prompt cache update took 16.35 ms
|
|
0.49.534.786 I slot launch_slot_: id 3 | task 591 | processing task, is_child = 0
|
|
0.49.534.787 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.49.534.787 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.49.534.794 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.49.534.795 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.49.534.799 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.49.534.799 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.51.376.292 I slot print_timing: id 3 | task 591 | prompt eval time = 499.73 ms / 19 tokens ( 26.30 ms per token, 38.02 tokens per second)
|
|
0.51.376.296 I slot print_timing: id 3 | task 591 | eval time = 1341.74 ms / 43 tokens ( 31.20 ms per token, 32.05 tokens per second)
|
|
0.51.376.297 I slot print_timing: id 3 | task 591 | total time = 1841.47 ms / 62 tokens
|
|
0.51.376.297 I slot print_timing: id 3 | task 591 | graphs reused = 599
|
|
0.51.376.328 I slot release: id 3 | task 591 | stop processing: n_tokens = 108, truncated = 0
|
|
0.51.376.337 I srv update_slots: all slots are idle
|
|
0.51.387.417 I srv operator(): Chat format: peg-native
|
|
0.51.387.585 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.701 (> 0.100 thold), f_keep = 0.435
|
|
0.51.387.587 I srv get_availabl: updating prompt cache
|
|
0.51.387.616 W srv prompt_save: - saving prompt with length 108, total state size = 19.409 MiB (draft: 0.000 MiB)
|
|
0.51.404.686 I srv load: - looking for better prompt, base f_keep = 0.435, sim = 0.701
|
|
0.51.404.694 I srv update: - cache state: 7 prompts, 155.274 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
0.51.404.695 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
0.51.404.696 I srv update: - prompt 0x5ec73d9fb000: 125 tokens, checkpoints: 0, 22.464 MiB
|
|
0.51.404.696 I srv update: - prompt 0x5ec73dc06c00: 141 tokens, checkpoints: 0, 25.340 MiB
|
|
0.51.404.697 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
0.51.404.697 I srv update: - prompt 0x5ec73dacf5e0: 123 tokens, checkpoints: 0, 22.105 MiB
|
|
0.51.404.698 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
0.51.404.698 I srv update: - prompt 0x5ec7416d09d0: 108 tokens, checkpoints: 0, 19.409 MiB
|
|
0.51.404.700 I srv get_availabl: prompt cache update took 17.11 ms
|
|
0.51.404.763 I slot launch_slot_: id 3 | task 635 | processing task, is_child = 0
|
|
0.51.404.764 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.51.404.765 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.51.404.772 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.51.404.772 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.51.404.783 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.51.404.783 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.52.377.015 I slot print_timing: id 3 | task 635 | prompt eval time = 517.29 ms / 20 tokens ( 25.86 ms per token, 38.66 tokens per second)
|
|
0.52.377.019 I slot print_timing: id 3 | task 635 | eval time = 454.92 ms / 15 tokens ( 30.33 ms per token, 32.97 tokens per second)
|
|
0.52.377.019 I slot print_timing: id 3 | task 635 | total time = 972.22 ms / 35 tokens
|
|
0.52.377.020 I slot print_timing: id 3 | task 635 | graphs reused = 612
|
|
0.52.377.050 I slot release: id 3 | task 635 | stop processing: n_tokens = 81, truncated = 0
|
|
0.52.377.058 I srv update_slots: all slots are idle
|
|
0.52.388.008 I srv operator(): Chat format: peg-native
|
|
0.52.388.180 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.712 (> 0.100 thold), f_keep = 0.580
|
|
0.52.388.211 I slot launch_slot_: id 3 | task 651 | processing task, is_child = 0
|
|
0.52.388.211 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.52.388.212 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.52.388.218 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.52.388.218 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.52.388.223 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.52.388.223 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.55.103.442 I slot print_timing: id 3 | task 651 | prompt eval time = 487.88 ms / 19 tokens ( 25.68 ms per token, 38.94 tokens per second)
|
|
0.55.103.446 I slot print_timing: id 3 | task 651 | eval time = 2227.32 ms / 71 tokens ( 31.37 ms per token, 31.88 tokens per second)
|
|
0.55.103.447 I slot print_timing: id 3 | task 651 | total time = 2715.20 ms / 90 tokens
|
|
0.55.103.448 I slot print_timing: id 3 | task 651 | graphs reused = 681
|
|
0.55.103.485 I slot release: id 3 | task 651 | stop processing: n_tokens = 136, truncated = 0
|
|
0.55.103.493 I srv update_slots: all slots are idle
|
|
0.55.114.778 I srv operator(): Chat format: peg-native
|
|
0.55.114.953 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.691 (> 0.100 thold), f_keep = 0.346
|
|
0.55.114.956 I srv get_availabl: updating prompt cache
|
|
0.55.114.978 W srv prompt_save: - saving prompt with length 136, total state size = 24.441 MiB (draft: 0.000 MiB)
|
|
0.55.135.553 I srv load: - looking for better prompt, base f_keep = 0.346, sim = 0.691
|
|
0.55.135.561 I srv load: - found better prompt with f_keep = 0.384, sim = 0.706
|
|
0.55.144.732 I srv update: - cache state: 7 prompts, 157.251 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
0.55.144.738 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
0.55.144.739 I srv update: - prompt 0x5ec73dc06c00: 141 tokens, checkpoints: 0, 25.340 MiB
|
|
0.55.144.739 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
0.55.144.740 I srv update: - prompt 0x5ec73dacf5e0: 123 tokens, checkpoints: 0, 22.105 MiB
|
|
0.55.144.740 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
0.55.144.741 I srv update: - prompt 0x5ec7416d09d0: 108 tokens, checkpoints: 0, 19.409 MiB
|
|
0.55.144.742 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
0.55.144.743 I srv get_availabl: prompt cache update took 29.79 ms
|
|
0.55.144.805 I slot launch_slot_: id 3 | task 723 | processing task, is_child = 0
|
|
0.55.144.806 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.55.144.806 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.55.144.813 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.55.144.814 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.55.144.818 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.55.144.819 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.56.195.307 I slot print_timing: id 3 | task 723 | prompt eval time = 503.88 ms / 20 tokens ( 25.19 ms per token, 39.69 tokens per second)
|
|
0.56.195.310 I slot print_timing: id 3 | task 723 | eval time = 546.59 ms / 18 tokens ( 30.37 ms per token, 32.93 tokens per second)
|
|
0.56.195.311 I slot print_timing: id 3 | task 723 | total time = 1050.47 ms / 38 tokens
|
|
0.56.195.311 I slot print_timing: id 3 | task 723 | graphs reused = 697
|
|
0.56.195.344 I slot release: id 3 | task 723 | stop processing: n_tokens = 85, truncated = 0
|
|
0.56.195.351 I srv update_slots: all slots are idle
|
|
0.56.206.265 I srv operator(): Chat format: peg-native
|
|
0.56.206.431 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.723 (> 0.100 thold), f_keep = 0.553
|
|
0.56.206.465 I slot launch_slot_: id 3 | task 742 | processing task, is_child = 0
|
|
0.56.206.466 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.56.206.467 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.56.206.473 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.56.206.473 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.56.206.477 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.56.206.478 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.57.093.628 I slot print_timing: id 3 | task 742 | prompt eval time = 498.40 ms / 18 tokens ( 27.69 ms per token, 36.12 tokens per second)
|
|
0.57.093.632 I slot print_timing: id 3 | task 742 | eval time = 388.73 ms / 13 tokens ( 29.90 ms per token, 33.44 tokens per second)
|
|
0.57.093.633 I slot print_timing: id 3 | task 742 | total time = 887.14 ms / 31 tokens
|
|
0.57.093.634 I slot print_timing: id 3 | task 742 | graphs reused = 708
|
|
0.57.093.667 I slot release: id 3 | task 742 | stop processing: n_tokens = 77, truncated = 0
|
|
0.57.093.676 I srv update_slots: all slots are idle
|
|
0.57.105.395 I srv operator(): Chat format: peg-native
|
|
0.57.105.558 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.691 (> 0.100 thold), f_keep = 0.610
|
|
0.57.105.590 I slot launch_slot_: id 3 | task 756 | processing task, is_child = 0
|
|
0.57.105.591 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.57.105.591 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.57.105.597 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.57.105.597 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.57.105.602 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.57.105.602 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
0.58.725.113 I slot print_timing: id 3 | task 756 | prompt eval time = 502.05 ms / 21 tokens ( 23.91 ms per token, 41.83 tokens per second)
|
|
0.58.725.117 I slot print_timing: id 3 | task 756 | eval time = 1117.45 ms / 36 tokens ( 31.04 ms per token, 32.22 tokens per second)
|
|
0.58.725.117 I slot print_timing: id 3 | task 756 | total time = 1619.50 ms / 57 tokens
|
|
0.58.725.118 I slot print_timing: id 3 | task 756 | graphs reused = 742
|
|
0.58.725.150 I slot release: id 3 | task 756 | stop processing: n_tokens = 103, truncated = 0
|
|
0.58.725.160 I srv update_slots: all slots are idle
|
|
0.58.736.013 I srv operator(): Chat format: peg-native
|
|
0.58.736.179 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.746 (> 0.100 thold), f_keep = 0.456
|
|
0.58.736.181 I srv get_availabl: updating prompt cache
|
|
0.58.736.200 W srv prompt_save: - saving prompt with length 103, total state size = 18.511 MiB (draft: 0.000 MiB)
|
|
0.58.745.650 I srv load: - looking for better prompt, base f_keep = 0.456, sim = 0.746
|
|
0.58.745.661 I srv update: - cache state: 8 prompts, 175.762 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
0.58.745.662 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
0.58.745.662 I srv update: - prompt 0x5ec73dc06c00: 141 tokens, checkpoints: 0, 25.340 MiB
|
|
0.58.745.663 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
0.58.745.663 I srv update: - prompt 0x5ec73dacf5e0: 123 tokens, checkpoints: 0, 22.105 MiB
|
|
0.58.745.664 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
0.58.745.664 I srv update: - prompt 0x5ec7416d09d0: 108 tokens, checkpoints: 0, 19.409 MiB
|
|
0.58.745.665 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
0.58.745.665 I srv update: - prompt 0x5ec73d9fb000: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
0.58.745.666 I srv get_availabl: prompt cache update took 9.48 ms
|
|
0.58.745.726 I slot launch_slot_: id 3 | task 793 | processing task, is_child = 0
|
|
0.58.745.727 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
0.58.745.727 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
0.58.745.734 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
0.58.745.734 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
0.58.745.739 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
0.58.745.739 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.00.568.536 I slot print_timing: id 3 | task 793 | prompt eval time = 356.46 ms / 16 tokens ( 22.28 ms per token, 44.89 tokens per second)
|
|
1.00.568.540 I slot print_timing: id 3 | task 793 | eval time = 1466.32 ms / 47 tokens ( 31.20 ms per token, 32.05 tokens per second)
|
|
1.00.568.541 I slot print_timing: id 3 | task 793 | total time = 1822.78 ms / 63 tokens
|
|
1.00.568.542 I slot print_timing: id 3 | task 793 | graphs reused = 787
|
|
1.00.568.574 I slot release: id 3 | task 793 | stop processing: n_tokens = 109, truncated = 0
|
|
1.00.568.582 I srv update_slots: all slots are idle
|
|
1.00.579.719 I srv operator(): Chat format: peg-native
|
|
1.00.579.897 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.758 (> 0.100 thold), f_keep = 0.431
|
|
1.00.579.899 I srv get_availabl: updating prompt cache
|
|
1.00.579.925 W srv prompt_save: - saving prompt with length 109, total state size = 19.589 MiB (draft: 0.000 MiB)
|
|
1.00.596.801 I srv load: - looking for better prompt, base f_keep = 0.431, sim = 0.758
|
|
1.00.596.807 I srv load: - found better prompt with f_keep = 0.444, sim = 0.774
|
|
1.00.605.291 I srv update: - cache state: 8 prompts, 175.941 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
1.00.605.294 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
1.00.605.295 I srv update: - prompt 0x5ec73dc06c00: 141 tokens, checkpoints: 0, 25.340 MiB
|
|
1.00.605.295 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
1.00.605.296 I srv update: - prompt 0x5ec73dacf5e0: 123 tokens, checkpoints: 0, 22.105 MiB
|
|
1.00.605.296 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.00.605.297 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
1.00.605.297 I srv update: - prompt 0x5ec73d9fb000: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.00.605.298 I srv update: - prompt 0x5ec7459da2a0: 109 tokens, checkpoints: 0, 19.589 MiB
|
|
1.00.605.299 I srv get_availabl: prompt cache update took 25.40 ms
|
|
1.00.605.352 I slot launch_slot_: id 3 | task 841 | processing task, is_child = 0
|
|
1.00.605.353 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.00.605.354 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.00.605.360 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.00.605.361 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.00.605.365 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.00.605.365 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.02.254.101 I slot print_timing: id 3 | task 841 | prompt eval time = 339.26 ms / 14 tokens ( 24.23 ms per token, 41.27 tokens per second)
|
|
1.02.254.104 I slot print_timing: id 3 | task 841 | eval time = 1309.46 ms / 42 tokens ( 31.18 ms per token, 32.07 tokens per second)
|
|
1.02.254.105 I slot print_timing: id 3 | task 841 | total time = 1648.72 ms / 56 tokens
|
|
1.02.254.106 I slot print_timing: id 3 | task 841 | graphs reused = 827
|
|
1.02.254.134 I slot release: id 3 | task 841 | stop processing: n_tokens = 103, truncated = 0
|
|
1.02.254.142 I srv update_slots: all slots are idle
|
|
1.02.264.706 I srv operator(): Chat format: peg-native
|
|
1.02.264.875 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.762 (> 0.100 thold), f_keep = 0.466
|
|
1.02.264.877 I srv get_availabl: updating prompt cache
|
|
1.02.264.897 W srv prompt_save: - saving prompt with length 103, total state size = 18.511 MiB (draft: 0.000 MiB)
|
|
1.02.274.593 I srv load: - looking for better prompt, base f_keep = 0.466, sim = 0.762
|
|
1.02.274.599 I srv load: - found better prompt with f_keep = 0.485, sim = 0.794
|
|
1.02.282.350 I srv update: - cache state: 8 prompts, 175.941 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
1.02.282.355 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
1.02.282.356 I srv update: - prompt 0x5ec73dc06c00: 141 tokens, checkpoints: 0, 25.340 MiB
|
|
1.02.282.356 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
1.02.282.357 I srv update: - prompt 0x5ec73dacf5e0: 123 tokens, checkpoints: 0, 22.105 MiB
|
|
1.02.282.357 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.02.282.358 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
1.02.282.359 I srv update: - prompt 0x5ec7459da2a0: 109 tokens, checkpoints: 0, 19.589 MiB
|
|
1.02.282.359 I srv update: - prompt 0x5ec73dad2d70: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.02.282.360 I srv get_availabl: prompt cache update took 17.48 ms
|
|
1.02.282.418 I slot launch_slot_: id 3 | task 884 | processing task, is_child = 0
|
|
1.02.282.419 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.02.282.420 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.02.282.427 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.02.282.427 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.02.282.432 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.02.282.432 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.03.049.372 I slot print_timing: id 3 | task 884 | prompt eval time = 315.10 ms / 13 tokens ( 24.24 ms per token, 41.26 tokens per second)
|
|
1.03.049.376 I slot print_timing: id 3 | task 884 | eval time = 451.82 ms / 15 tokens ( 30.12 ms per token, 33.20 tokens per second)
|
|
1.03.049.376 I slot print_timing: id 3 | task 884 | total time = 766.92 ms / 28 tokens
|
|
1.03.049.377 I slot print_timing: id 3 | task 884 | graphs reused = 840
|
|
1.03.049.407 I slot release: id 3 | task 884 | stop processing: n_tokens = 77, truncated = 0
|
|
1.03.049.414 I srv update_slots: all slots are idle
|
|
1.03.060.624 I srv operator(): Chat format: peg-native
|
|
1.03.060.790 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.758 (> 0.100 thold), f_keep = 0.610
|
|
1.03.060.833 I slot launch_slot_: id 3 | task 900 | processing task, is_child = 0
|
|
1.03.060.835 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.03.060.836 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.03.060.842 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.03.060.842 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.03.060.847 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.03.060.847 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.03.835.432 I slot print_timing: id 3 | task 900 | prompt eval time = 353.82 ms / 15 tokens ( 23.59 ms per token, 42.39 tokens per second)
|
|
1.03.835.435 I slot print_timing: id 3 | task 900 | eval time = 420.75 ms / 14 tokens ( 30.05 ms per token, 33.27 tokens per second)
|
|
1.03.835.436 I slot print_timing: id 3 | task 900 | total time = 774.57 ms / 29 tokens
|
|
1.03.835.436 I slot print_timing: id 3 | task 900 | graphs reused = 852
|
|
1.03.835.465 I slot release: id 3 | task 900 | stop processing: n_tokens = 75, truncated = 0
|
|
1.03.835.472 I srv update_slots: all slots are idle
|
|
1.03.846.208 I srv operator(): Chat format: peg-native
|
|
1.03.846.372 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.723 (> 0.100 thold), f_keep = 0.627
|
|
1.03.846.409 I slot launch_slot_: id 3 | task 915 | processing task, is_child = 0
|
|
1.03.846.410 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.03.846.410 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.03.846.416 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.03.846.416 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.03.846.420 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.03.846.421 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.06.464.823 I slot print_timing: id 3 | task 915 | prompt eval time = 484.04 ms / 18 tokens ( 26.89 ms per token, 37.19 tokens per second)
|
|
1.06.464.827 I slot print_timing: id 3 | task 915 | eval time = 2134.35 ms / 68 tokens ( 31.39 ms per token, 31.86 tokens per second)
|
|
1.06.464.828 I slot print_timing: id 3 | task 915 | total time = 2618.39 ms / 86 tokens
|
|
1.06.464.828 I slot print_timing: id 3 | task 915 | graphs reused = 918
|
|
1.06.464.859 I slot release: id 3 | task 915 | stop processing: n_tokens = 132, truncated = 0
|
|
1.06.464.867 I srv update_slots: all slots are idle
|
|
1.06.475.633 I srv operator(): Chat format: peg-native
|
|
1.06.475.817 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.734 (> 0.100 thold), f_keep = 0.356
|
|
1.06.475.819 I srv get_availabl: updating prompt cache
|
|
1.06.475.843 W srv prompt_save: - saving prompt with length 132, total state size = 23.722 MiB (draft: 0.000 MiB)
|
|
1.06.495.906 I srv load: - looking for better prompt, base f_keep = 0.356, sim = 0.734
|
|
1.06.495.919 I srv load: - found better prompt with f_keep = 0.407, sim = 0.781
|
|
1.06.505.139 I srv update: - cache state: 8 prompts, 177.559 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
1.06.505.144 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
1.06.505.144 I srv update: - prompt 0x5ec73dc06c00: 141 tokens, checkpoints: 0, 25.340 MiB
|
|
1.06.505.145 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
1.06.505.145 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.06.505.146 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
1.06.505.146 I srv update: - prompt 0x5ec7459da2a0: 109 tokens, checkpoints: 0, 19.589 MiB
|
|
1.06.505.147 I srv update: - prompt 0x5ec73dad2d70: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.06.505.147 I srv update: - prompt 0x5ec73dbf9230: 132 tokens, checkpoints: 0, 23.722 MiB
|
|
1.06.505.148 I srv get_availabl: prompt cache update took 29.33 ms
|
|
1.06.505.210 I slot launch_slot_: id 3 | task 984 | processing task, is_child = 0
|
|
1.06.505.211 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.06.505.212 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.06.505.219 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.06.505.220 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.06.505.224 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.06.505.225 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.07.391.182 I slot print_timing: id 3 | task 984 | prompt eval time = 337.73 ms / 14 tokens ( 24.12 ms per token, 41.45 tokens per second)
|
|
1.07.391.186 I slot print_timing: id 3 | task 984 | eval time = 548.21 ms / 18 tokens ( 30.46 ms per token, 32.83 tokens per second)
|
|
1.07.391.186 I slot print_timing: id 3 | task 984 | total time = 885.94 ms / 32 tokens
|
|
1.07.391.187 I slot print_timing: id 3 | task 984 | graphs reused = 934
|
|
1.07.391.218 I slot release: id 3 | task 984 | stop processing: n_tokens = 81, truncated = 0
|
|
1.07.391.226 I srv update_slots: all slots are idle
|
|
1.07.401.933 I srv operator(): Chat format: peg-native
|
|
1.07.402.098 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.671 (> 0.100 thold), f_keep = 0.580
|
|
1.07.402.130 I slot launch_slot_: id 3 | task 1003 | processing task, is_child = 0
|
|
1.07.402.131 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.07.402.132 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.07.402.138 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.07.402.139 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.07.402.144 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.07.402.145 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.08.725.672 I slot print_timing: id 3 | task 1003 | prompt eval time = 552.92 ms / 23 tokens ( 24.04 ms per token, 41.60 tokens per second)
|
|
1.08.725.675 I slot print_timing: id 3 | task 1003 | eval time = 770.59 ms / 25 tokens ( 30.82 ms per token, 32.44 tokens per second)
|
|
1.08.725.676 I slot print_timing: id 3 | task 1003 | total time = 1323.51 ms / 48 tokens
|
|
1.08.725.677 I slot print_timing: id 3 | task 1003 | graphs reused = 957
|
|
1.08.725.709 I slot release: id 3 | task 1003 | stop processing: n_tokens = 94, truncated = 0
|
|
1.08.725.716 I srv update_slots: all slots are idle
|
|
1.08.736.632 I srv operator(): Chat format: peg-native
|
|
1.08.736.796 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.681 (> 0.100 thold), f_keep = 0.500
|
|
1.08.736.825 I slot launch_slot_: id 3 | task 1029 | processing task, is_child = 0
|
|
1.08.736.826 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.08.736.826 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.08.736.831 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.08.736.832 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.08.736.836 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.08.736.836 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.09.818.186 I slot print_timing: id 3 | task 1029 | prompt eval time = 532.56 ms / 22 tokens ( 24.21 ms per token, 41.31 tokens per second)
|
|
1.09.818.190 I slot print_timing: id 3 | task 1029 | eval time = 548.78 ms / 18 tokens ( 30.49 ms per token, 32.80 tokens per second)
|
|
1.09.818.190 I slot print_timing: id 3 | task 1029 | total time = 1081.34 ms / 40 tokens
|
|
1.09.818.191 I slot print_timing: id 3 | task 1029 | graphs reused = 973
|
|
1.09.818.220 I slot release: id 3 | task 1029 | stop processing: n_tokens = 86, truncated = 0
|
|
1.09.818.227 I srv update_slots: all slots are idle
|
|
1.09.829.289 I srv operator(): Chat format: peg-native
|
|
1.09.829.457 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.770 (> 0.100 thold), f_keep = 0.547
|
|
1.09.829.490 I slot launch_slot_: id 3 | task 1048 | processing task, is_child = 0
|
|
1.09.829.490 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.09.829.491 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.09.829.498 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.09.829.498 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.09.829.504 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.09.829.504 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.10.531.420 I slot print_timing: id 3 | task 1048 | prompt eval time = 343.43 ms / 14 tokens ( 24.53 ms per token, 40.76 tokens per second)
|
|
1.10.531.424 I slot print_timing: id 3 | task 1048 | eval time = 358.47 ms / 12 tokens ( 29.87 ms per token, 33.48 tokens per second)
|
|
1.10.531.424 I slot print_timing: id 3 | task 1048 | total time = 701.90 ms / 26 tokens
|
|
1.10.531.425 I slot print_timing: id 3 | task 1048 | graphs reused = 983
|
|
1.10.531.454 I slot release: id 3 | task 1048 | stop processing: n_tokens = 72, truncated = 0
|
|
1.10.531.461 I srv update_slots: all slots are idle
|
|
1.10.542.364 I srv operator(): Chat format: peg-native
|
|
1.10.542.532 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.734 (> 0.100 thold), f_keep = 0.653
|
|
1.10.542.565 I slot launch_slot_: id 3 | task 1061 | processing task, is_child = 0
|
|
1.10.542.566 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.10.542.567 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.10.542.574 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.10.542.574 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.10.542.587 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.10.542.587 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.11.487.055 I slot print_timing: id 3 | task 1061 | prompt eval time = 490.50 ms / 17 tokens ( 28.85 ms per token, 34.66 tokens per second)
|
|
1.11.487.058 I slot print_timing: id 3 | task 1061 | eval time = 453.95 ms / 15 tokens ( 30.26 ms per token, 33.04 tokens per second)
|
|
1.11.487.059 I slot print_timing: id 3 | task 1061 | total time = 944.45 ms / 32 tokens
|
|
1.11.487.059 I slot print_timing: id 3 | task 1061 | graphs reused = 996
|
|
1.11.487.089 I slot release: id 3 | task 1061 | stop processing: n_tokens = 78, truncated = 0
|
|
1.11.487.096 I srv update_slots: all slots are idle
|
|
1.11.498.220 I srv operator(): Chat format: peg-native
|
|
1.11.498.388 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.712 (> 0.100 thold), f_keep = 0.603
|
|
1.11.498.419 I slot launch_slot_: id 3 | task 1077 | processing task, is_child = 0
|
|
1.11.498.420 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.11.498.421 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.11.498.427 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.11.498.427 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.11.498.433 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.11.498.433 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.14.203.391 I slot print_timing: id 3 | task 1077 | prompt eval time = 501.31 ms / 19 tokens ( 26.38 ms per token, 37.90 tokens per second)
|
|
1.14.203.394 I slot print_timing: id 3 | task 1077 | eval time = 2203.64 ms / 70 tokens ( 31.48 ms per token, 31.77 tokens per second)
|
|
1.14.203.395 I slot print_timing: id 3 | task 1077 | total time = 2704.94 ms / 89 tokens
|
|
1.14.203.396 I slot print_timing: id 3 | task 1077 | graphs reused = 1064
|
|
1.14.203.427 I slot release: id 3 | task 1077 | stop processing: n_tokens = 135, truncated = 0
|
|
1.14.203.434 I srv update_slots: all slots are idle
|
|
1.14.214.269 I srv operator(): Chat format: peg-native
|
|
1.14.214.435 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.618 (> 0.100 thold), f_keep = 0.348
|
|
1.14.214.438 I srv get_availabl: updating prompt cache
|
|
1.14.214.458 W srv prompt_save: - saving prompt with length 135, total state size = 24.261 MiB (draft: 0.000 MiB)
|
|
1.14.235.032 I srv load: - looking for better prompt, base f_keep = 0.348, sim = 0.618
|
|
1.14.235.039 I srv load: - found better prompt with f_keep = 0.466, sim = 0.632
|
|
1.14.243.462 I srv update: - cache state: 8 prompts, 183.309 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
1.14.243.465 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
1.14.243.466 I srv update: - prompt 0x5ec73dc06c00: 141 tokens, checkpoints: 0, 25.340 MiB
|
|
1.14.243.467 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
1.14.243.467 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.14.243.468 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
1.14.243.468 I srv update: - prompt 0x5ec7459da2a0: 109 tokens, checkpoints: 0, 19.589 MiB
|
|
1.14.243.469 I srv update: - prompt 0x5ec73dbf9230: 132 tokens, checkpoints: 0, 23.722 MiB
|
|
1.14.243.469 I srv update: - prompt 0x5ec73da0b940: 135 tokens, checkpoints: 0, 24.261 MiB
|
|
1.14.243.470 I srv get_availabl: prompt cache update took 29.03 ms
|
|
1.14.243.534 I slot launch_slot_: id 3 | task 1148 | processing task, is_child = 0
|
|
1.14.243.534 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.14.243.535 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.14.243.541 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.14.243.542 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.14.243.547 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.14.243.547 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.17.980.402 I slot print_timing: id 3 | task 1148 | n_decoded = 100, tg = 31.65 t/s, tg_3s = 31.65 t/s
|
|
1.18.713.182 I slot print_timing: id 3 | task 1148 | prompt eval time = 577.57 ms / 28 tokens ( 20.63 ms per token, 48.48 tokens per second)
|
|
1.18.713.185 I slot print_timing: id 3 | task 1148 | eval time = 3892.05 ms / 123 tokens ( 31.64 ms per token, 31.60 tokens per second)
|
|
1.18.713.186 I slot print_timing: id 3 | task 1148 | total time = 4469.62 ms / 151 tokens
|
|
1.18.713.186 I slot print_timing: id 3 | task 1148 | graphs reused = 1185
|
|
1.18.713.218 I slot release: id 3 | task 1148 | stop processing: n_tokens = 198, truncated = 0
|
|
1.18.713.226 I srv update_slots: all slots are idle
|
|
1.18.724.125 I srv operator(): Chat format: peg-native
|
|
1.18.724.292 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.706 (> 0.100 thold), f_keep = 0.242
|
|
1.18.724.294 I srv get_availabl: updating prompt cache
|
|
1.18.724.319 W srv prompt_save: - saving prompt with length 198, total state size = 35.583 MiB (draft: 0.000 MiB)
|
|
1.18.752.965 I srv load: - looking for better prompt, base f_keep = 0.242, sim = 0.706
|
|
1.18.752.975 I srv update: - cache state: 9 prompts, 218.892 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
1.18.752.976 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
1.18.752.976 I srv update: - prompt 0x5ec73dc06c00: 141 tokens, checkpoints: 0, 25.340 MiB
|
|
1.18.752.977 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
1.18.752.977 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.18.752.978 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
1.18.752.979 I srv update: - prompt 0x5ec7459da2a0: 109 tokens, checkpoints: 0, 19.589 MiB
|
|
1.18.752.979 I srv update: - prompt 0x5ec73dbf9230: 132 tokens, checkpoints: 0, 23.722 MiB
|
|
1.18.752.979 I srv update: - prompt 0x5ec73da0b940: 135 tokens, checkpoints: 0, 24.261 MiB
|
|
1.18.752.980 I srv update: - prompt 0x5ec745bf1a90: 198 tokens, checkpoints: 0, 35.583 MiB
|
|
1.18.752.981 I srv get_availabl: prompt cache update took 28.69 ms
|
|
1.18.753.044 I slot launch_slot_: id 3 | task 1272 | processing task, is_child = 0
|
|
1.18.753.045 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.18.753.046 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.18.753.054 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.18.753.054 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.18.753.059 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.18.753.059 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.21.175.797 I slot print_timing: id 3 | task 1272 | prompt eval time = 532.56 ms / 20 tokens ( 26.63 ms per token, 37.55 tokens per second)
|
|
1.21.175.801 I slot print_timing: id 3 | task 1272 | eval time = 1890.16 ms / 60 tokens ( 31.50 ms per token, 31.74 tokens per second)
|
|
1.21.175.802 I slot print_timing: id 3 | task 1272 | total time = 2422.72 ms / 80 tokens
|
|
1.21.175.802 I slot print_timing: id 3 | task 1272 | graphs reused = 1243
|
|
1.21.175.832 I slot release: id 3 | task 1272 | stop processing: n_tokens = 127, truncated = 0
|
|
1.21.175.841 I srv update_slots: all slots are idle
|
|
1.21.186.643 I srv operator(): Chat format: peg-native
|
|
1.21.186.812 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.746 (> 0.100 thold), f_keep = 0.370
|
|
1.21.186.814 I srv get_availabl: updating prompt cache
|
|
1.21.186.834 W srv prompt_save: - saving prompt with length 127, total state size = 22.824 MiB (draft: 0.000 MiB)
|
|
1.21.198.429 I srv load: - looking for better prompt, base f_keep = 0.370, sim = 0.746
|
|
1.21.198.438 I srv update: - cache state: 10 prompts, 241.716 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
1.21.198.439 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
1.21.198.439 I srv update: - prompt 0x5ec73dc06c00: 141 tokens, checkpoints: 0, 25.340 MiB
|
|
1.21.198.440 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
1.21.198.440 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.21.198.441 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
1.21.198.441 I srv update: - prompt 0x5ec7459da2a0: 109 tokens, checkpoints: 0, 19.589 MiB
|
|
1.21.198.442 I srv update: - prompt 0x5ec73dbf9230: 132 tokens, checkpoints: 0, 23.722 MiB
|
|
1.21.198.442 I srv update: - prompt 0x5ec73da0b940: 135 tokens, checkpoints: 0, 24.261 MiB
|
|
1.21.198.443 I srv update: - prompt 0x5ec745bf1a90: 198 tokens, checkpoints: 0, 35.583 MiB
|
|
1.21.198.443 I srv update: - prompt 0x5ec73da95a30: 127 tokens, checkpoints: 0, 22.824 MiB
|
|
1.21.198.444 I srv get_availabl: prompt cache update took 11.63 ms
|
|
1.21.198.506 I slot launch_slot_: id 3 | task 1333 | processing task, is_child = 0
|
|
1.21.198.507 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.21.198.507 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.21.198.514 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.21.198.514 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.21.198.519 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.21.198.519 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.24.223.134 I slot print_timing: id 3 | task 1333 | prompt eval time = 368.18 ms / 16 tokens ( 23.01 ms per token, 43.46 tokens per second)
|
|
1.24.223.138 I slot print_timing: id 3 | task 1333 | eval time = 2656.42 ms / 84 tokens ( 31.62 ms per token, 31.62 tokens per second)
|
|
1.24.223.139 I slot print_timing: id 3 | task 1333 | total time = 3024.60 ms / 100 tokens
|
|
1.24.223.139 I slot print_timing: id 3 | task 1333 | graphs reused = 1325
|
|
1.24.223.169 I slot release: id 3 | task 1333 | stop processing: n_tokens = 146, truncated = 0
|
|
1.24.223.178 I srv update_slots: all slots are idle
|
|
1.24.234.417 I srv operator(): Chat format: peg-native
|
|
1.24.234.595 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.691 (> 0.100 thold), f_keep = 0.322
|
|
1.24.234.597 I srv get_availabl: updating prompt cache
|
|
1.24.234.618 W srv prompt_save: - saving prompt with length 146, total state size = 26.238 MiB (draft: 0.000 MiB)
|
|
1.24.256.582 I srv load: - looking for better prompt, base f_keep = 0.322, sim = 0.691
|
|
1.24.256.591 I srv load: - found better prompt with f_keep = 0.340, sim = 0.706
|
|
1.24.268.793 I srv update: - cache state: 10 prompts, 242.615 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
1.24.268.798 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
1.24.268.798 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
1.24.268.799 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.24.268.800 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
1.24.268.800 I srv update: - prompt 0x5ec7459da2a0: 109 tokens, checkpoints: 0, 19.589 MiB
|
|
1.24.268.801 I srv update: - prompt 0x5ec73dbf9230: 132 tokens, checkpoints: 0, 23.722 MiB
|
|
1.24.268.801 I srv update: - prompt 0x5ec73da0b940: 135 tokens, checkpoints: 0, 24.261 MiB
|
|
1.24.268.802 I srv update: - prompt 0x5ec745bf1a90: 198 tokens, checkpoints: 0, 35.583 MiB
|
|
1.24.268.802 I srv update: - prompt 0x5ec73da95a30: 127 tokens, checkpoints: 0, 22.824 MiB
|
|
1.24.268.803 I srv update: - prompt 0x5ec73dad6760: 146 tokens, checkpoints: 0, 26.238 MiB
|
|
1.24.268.804 I srv get_availabl: prompt cache update took 34.21 ms
|
|
1.24.268.861 I slot launch_slot_: id 3 | task 1418 | processing task, is_child = 0
|
|
1.24.268.861 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.24.268.862 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.24.268.870 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.24.268.870 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.24.268.875 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.24.268.875 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.26.230.180 I slot print_timing: id 3 | task 1418 | prompt eval time = 513.80 ms / 20 tokens ( 25.69 ms per token, 38.93 tokens per second)
|
|
1.26.230.184 I slot print_timing: id 3 | task 1418 | eval time = 1447.49 ms / 46 tokens ( 31.47 ms per token, 31.78 tokens per second)
|
|
1.26.230.185 I slot print_timing: id 3 | task 1418 | total time = 1961.28 ms / 66 tokens
|
|
1.26.230.185 I slot print_timing: id 3 | task 1418 | graphs reused = 1369
|
|
1.26.230.220 I slot release: id 3 | task 1418 | stop processing: n_tokens = 113, truncated = 0
|
|
1.26.230.229 I srv update_slots: all slots are idle
|
|
1.26.241.138 I srv operator(): Chat format: peg-native
|
|
1.26.241.309 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.676 (> 0.100 thold), f_keep = 0.425
|
|
1.26.241.311 I srv get_availabl: updating prompt cache
|
|
1.26.241.333 W srv prompt_save: - saving prompt with length 113, total state size = 20.308 MiB (draft: 0.000 MiB)
|
|
1.26.251.899 I srv load: - looking for better prompt, base f_keep = 0.425, sim = 0.676
|
|
1.26.251.910 I srv update: - cache state: 11 prompts, 262.923 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
1.26.251.915 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
1.26.251.916 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
1.26.251.917 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.26.251.917 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
1.26.251.918 I srv update: - prompt 0x5ec7459da2a0: 109 tokens, checkpoints: 0, 19.589 MiB
|
|
1.26.251.918 I srv update: - prompt 0x5ec73dbf9230: 132 tokens, checkpoints: 0, 23.722 MiB
|
|
1.26.251.919 I srv update: - prompt 0x5ec73da0b940: 135 tokens, checkpoints: 0, 24.261 MiB
|
|
1.26.251.919 I srv update: - prompt 0x5ec745bf1a90: 198 tokens, checkpoints: 0, 35.583 MiB
|
|
1.26.251.920 I srv update: - prompt 0x5ec73da95a30: 127 tokens, checkpoints: 0, 22.824 MiB
|
|
1.26.251.920 I srv update: - prompt 0x5ec73dad6760: 146 tokens, checkpoints: 0, 26.238 MiB
|
|
1.26.251.921 I srv update: - prompt 0x5ec745f55040: 113 tokens, checkpoints: 0, 20.308 MiB
|
|
1.26.251.922 I srv get_availabl: prompt cache update took 10.61 ms
|
|
1.26.251.989 I slot launch_slot_: id 3 | task 1465 | processing task, is_child = 0
|
|
1.26.251.990 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.26.251.991 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.26.251.998 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.26.251.998 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.26.252.003 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.26.252.003 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.28.835.181 I slot print_timing: id 3 | task 1465 | prompt eval time = 558.99 ms / 23 tokens ( 24.30 ms per token, 41.15 tokens per second)
|
|
1.28.835.184 I slot print_timing: id 3 | task 1465 | eval time = 2024.17 ms / 64 tokens ( 31.63 ms per token, 31.62 tokens per second)
|
|
1.28.835.185 I slot print_timing: id 3 | task 1465 | total time = 2583.16 ms / 87 tokens
|
|
1.28.835.186 I slot print_timing: id 3 | task 1465 | graphs reused = 1431
|
|
1.28.835.218 I slot release: id 3 | task 1465 | stop processing: n_tokens = 134, truncated = 0
|
|
1.28.835.227 I srv update_slots: all slots are idle
|
|
1.28.845.986 I srv operator(): Chat format: peg-native
|
|
1.28.846.157 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.746 (> 0.100 thold), f_keep = 0.351
|
|
1.28.846.159 I srv get_availabl: updating prompt cache
|
|
1.28.846.179 W srv prompt_save: - saving prompt with length 134, total state size = 24.082 MiB (draft: 0.000 MiB)
|
|
1.28.866.564 I srv load: - looking for better prompt, base f_keep = 0.351, sim = 0.746
|
|
1.28.866.575 I srv update: - cache state: 12 prompts, 287.004 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
1.28.866.576 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
1.28.866.577 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
1.28.866.578 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.28.866.578 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
1.28.866.579 I srv update: - prompt 0x5ec7459da2a0: 109 tokens, checkpoints: 0, 19.589 MiB
|
|
1.28.866.579 I srv update: - prompt 0x5ec73dbf9230: 132 tokens, checkpoints: 0, 23.722 MiB
|
|
1.28.866.580 I srv update: - prompt 0x5ec73da0b940: 135 tokens, checkpoints: 0, 24.261 MiB
|
|
1.28.866.580 I srv update: - prompt 0x5ec745bf1a90: 198 tokens, checkpoints: 0, 35.583 MiB
|
|
1.28.866.581 I srv update: - prompt 0x5ec73da95a30: 127 tokens, checkpoints: 0, 22.824 MiB
|
|
1.28.866.581 I srv update: - prompt 0x5ec73dad6760: 146 tokens, checkpoints: 0, 26.238 MiB
|
|
1.28.866.582 I srv update: - prompt 0x5ec745f55040: 113 tokens, checkpoints: 0, 20.308 MiB
|
|
1.28.866.582 I srv update: - prompt 0x5ec73dc24ba0: 134 tokens, checkpoints: 0, 24.082 MiB
|
|
1.28.866.583 I srv get_availabl: prompt cache update took 20.42 ms
|
|
1.28.866.651 I slot launch_slot_: id 3 | task 1530 | processing task, is_child = 0
|
|
1.28.866.652 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.28.866.653 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.28.866.659 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.28.866.660 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.28.866.664 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.28.866.664 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.30.552.185 I slot print_timing: id 3 | task 1530 | prompt eval time = 365.95 ms / 16 tokens ( 22.87 ms per token, 43.72 tokens per second)
|
|
1.30.552.188 I slot print_timing: id 3 | task 1530 | eval time = 1319.56 ms / 42 tokens ( 31.42 ms per token, 31.83 tokens per second)
|
|
1.30.552.189 I slot print_timing: id 3 | task 1530 | total time = 1685.50 ms / 58 tokens
|
|
1.30.552.190 I slot print_timing: id 3 | task 1530 | graphs reused = 1471
|
|
1.30.552.218 I slot release: id 3 | task 1530 | stop processing: n_tokens = 104, truncated = 0
|
|
1.30.552.227 I srv update_slots: all slots are idle
|
|
1.30.563.067 I srv operator(): Chat format: peg-native
|
|
1.30.563.239 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.797 (> 0.100 thold), f_keep = 0.452
|
|
1.30.563.242 I srv get_availabl: updating prompt cache
|
|
1.30.563.262 W srv prompt_save: - saving prompt with length 104, total state size = 18.691 MiB (draft: 0.000 MiB)
|
|
1.30.573.028 I srv load: - looking for better prompt, base f_keep = 0.452, sim = 0.797
|
|
1.30.573.038 I srv update: - cache state: 13 prompts, 305.695 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
1.30.573.039 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
1.30.573.040 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
1.30.573.041 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.30.573.041 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
1.30.573.042 I srv update: - prompt 0x5ec7459da2a0: 109 tokens, checkpoints: 0, 19.589 MiB
|
|
1.30.573.042 I srv update: - prompt 0x5ec73dbf9230: 132 tokens, checkpoints: 0, 23.722 MiB
|
|
1.30.573.043 I srv update: - prompt 0x5ec73da0b940: 135 tokens, checkpoints: 0, 24.261 MiB
|
|
1.30.573.043 I srv update: - prompt 0x5ec745bf1a90: 198 tokens, checkpoints: 0, 35.583 MiB
|
|
1.30.573.044 I srv update: - prompt 0x5ec73da95a30: 127 tokens, checkpoints: 0, 22.824 MiB
|
|
1.30.573.044 I srv update: - prompt 0x5ec73dad6760: 146 tokens, checkpoints: 0, 26.238 MiB
|
|
1.30.573.045 I srv update: - prompt 0x5ec745f55040: 113 tokens, checkpoints: 0, 20.308 MiB
|
|
1.30.573.045 I srv update: - prompt 0x5ec73dc24ba0: 134 tokens, checkpoints: 0, 24.082 MiB
|
|
1.30.573.046 I srv update: - prompt 0x5ec73dc06c00: 104 tokens, checkpoints: 0, 18.691 MiB
|
|
1.30.573.047 I srv get_availabl: prompt cache update took 9.80 ms
|
|
1.30.573.105 I slot launch_slot_: id 3 | task 1573 | processing task, is_child = 0
|
|
1.30.573.106 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.30.573.107 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.30.573.114 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.30.573.114 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.30.573.119 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.30.573.119 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.34.017.889 I slot print_timing: id 3 | task 1573 | n_decoded = 100, tg = 31.94 t/s, tg_3s = 31.94 t/s
|
|
1.34.491.888 I slot print_timing: id 3 | task 1573 | prompt eval time = 313.49 ms / 12 tokens ( 26.12 ms per token, 38.28 tokens per second)
|
|
1.34.491.892 I slot print_timing: id 3 | task 1573 | eval time = 3605.27 ms / 115 tokens ( 31.35 ms per token, 31.90 tokens per second)
|
|
1.34.491.892 I slot print_timing: id 3 | task 1573 | total time = 3918.75 ms / 127 tokens
|
|
1.34.491.893 I slot print_timing: id 3 | task 1573 | graphs reused = 1584
|
|
1.34.491.965 I slot release: id 3 | task 1573 | stop processing: n_tokens = 173, truncated = 0
|
|
1.34.491.973 I srv update_slots: all slots are idle
|
|
1.34.503.032 I srv operator(): Chat format: peg-native
|
|
1.34.503.197 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.701 (> 0.100 thold), f_keep = 0.272
|
|
1.34.503.199 I srv get_availabl: updating prompt cache
|
|
1.34.503.220 W srv prompt_save: - saving prompt with length 173, total state size = 31.090 MiB (draft: 0.000 MiB)
|
|
1.34.528.391 I srv load: - looking for better prompt, base f_keep = 0.272, sim = 0.701
|
|
1.34.528.404 I srv update: - cache state: 14 prompts, 336.785 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
1.34.528.404 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
1.34.528.405 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
1.34.528.406 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.34.528.406 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
1.34.528.407 I srv update: - prompt 0x5ec7459da2a0: 109 tokens, checkpoints: 0, 19.589 MiB
|
|
1.34.528.407 I srv update: - prompt 0x5ec73dbf9230: 132 tokens, checkpoints: 0, 23.722 MiB
|
|
1.34.528.408 I srv update: - prompt 0x5ec73da0b940: 135 tokens, checkpoints: 0, 24.261 MiB
|
|
1.34.528.408 I srv update: - prompt 0x5ec745bf1a90: 198 tokens, checkpoints: 0, 35.583 MiB
|
|
1.34.528.409 I srv update: - prompt 0x5ec73da95a30: 127 tokens, checkpoints: 0, 22.824 MiB
|
|
1.34.528.409 I srv update: - prompt 0x5ec73dad6760: 146 tokens, checkpoints: 0, 26.238 MiB
|
|
1.34.528.410 I srv update: - prompt 0x5ec745f55040: 113 tokens, checkpoints: 0, 20.308 MiB
|
|
1.34.528.410 I srv update: - prompt 0x5ec73dc24ba0: 134 tokens, checkpoints: 0, 24.082 MiB
|
|
1.34.528.411 I srv update: - prompt 0x5ec73dc06c00: 104 tokens, checkpoints: 0, 18.691 MiB
|
|
1.34.528.411 I srv update: - prompt 0x5ec745faa400: 173 tokens, checkpoints: 0, 31.090 MiB
|
|
1.34.528.413 I srv get_availabl: prompt cache update took 25.21 ms
|
|
1.34.528.479 I slot launch_slot_: id 3 | task 1689 | processing task, is_child = 0
|
|
1.34.528.479 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.34.528.480 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.34.528.488 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.34.528.488 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.34.528.493 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.34.528.493 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.37.521.849 I slot print_timing: id 3 | task 1689 | prompt eval time = 521.00 ms / 20 tokens ( 26.05 ms per token, 38.39 tokens per second)
|
|
1.37.521.853 I slot print_timing: id 3 | task 1689 | eval time = 2472.34 ms / 79 tokens ( 31.30 ms per token, 31.95 tokens per second)
|
|
1.37.521.853 I slot print_timing: id 3 | task 1689 | total time = 2993.34 ms / 99 tokens
|
|
1.37.521.854 I slot print_timing: id 3 | task 1689 | graphs reused = 1661
|
|
1.37.521.886 I slot release: id 3 | task 1689 | stop processing: n_tokens = 145, truncated = 0
|
|
1.37.521.896 I srv update_slots: all slots are idle
|
|
1.37.532.567 I srv operator(): Chat format: peg-native
|
|
1.37.532.735 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.746 (> 0.100 thold), f_keep = 0.324
|
|
1.37.532.737 I srv get_availabl: updating prompt cache
|
|
1.37.532.758 W srv prompt_save: - saving prompt with length 145, total state size = 26.059 MiB (draft: 0.000 MiB)
|
|
1.37.554.472 I srv load: - looking for better prompt, base f_keep = 0.324, sim = 0.746
|
|
1.37.554.482 I srv load: - found better prompt with f_keep = 0.378, sim = 0.762
|
|
1.37.564.115 I srv update: - cache state: 14 prompts, 340.020 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
1.37.564.119 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
1.37.564.120 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
1.37.564.121 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.37.564.121 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
1.37.564.122 I srv update: - prompt 0x5ec7459da2a0: 109 tokens, checkpoints: 0, 19.589 MiB
|
|
1.37.564.122 I srv update: - prompt 0x5ec73dbf9230: 132 tokens, checkpoints: 0, 23.722 MiB
|
|
1.37.564.123 I srv update: - prompt 0x5ec73da0b940: 135 tokens, checkpoints: 0, 24.261 MiB
|
|
1.37.564.123 I srv update: - prompt 0x5ec745bf1a90: 198 tokens, checkpoints: 0, 35.583 MiB
|
|
1.37.564.124 I srv update: - prompt 0x5ec73dad6760: 146 tokens, checkpoints: 0, 26.238 MiB
|
|
1.37.564.124 I srv update: - prompt 0x5ec745f55040: 113 tokens, checkpoints: 0, 20.308 MiB
|
|
1.37.564.125 I srv update: - prompt 0x5ec73dc24ba0: 134 tokens, checkpoints: 0, 24.082 MiB
|
|
1.37.564.125 I srv update: - prompt 0x5ec73dc06c00: 104 tokens, checkpoints: 0, 18.691 MiB
|
|
1.37.564.126 I srv update: - prompt 0x5ec745faa400: 173 tokens, checkpoints: 0, 31.090 MiB
|
|
1.37.564.126 I srv update: - prompt 0x5ec745f73340: 145 tokens, checkpoints: 0, 26.059 MiB
|
|
1.37.564.128 I srv get_availabl: prompt cache update took 31.39 ms
|
|
1.37.564.197 I slot launch_slot_: id 3 | task 1769 | processing task, is_child = 0
|
|
1.37.564.198 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.37.564.199 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.37.564.207 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.37.564.208 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.37.564.212 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.37.564.212 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.39.919.450 I slot print_timing: id 3 | task 1769 | prompt eval time = 355.36 ms / 15 tokens ( 23.69 ms per token, 42.21 tokens per second)
|
|
1.39.919.453 I slot print_timing: id 3 | task 1769 | eval time = 1999.87 ms / 64 tokens ( 31.25 ms per token, 32.00 tokens per second)
|
|
1.39.919.454 I slot print_timing: id 3 | task 1769 | total time = 2355.22 ms / 79 tokens
|
|
1.39.919.455 I slot print_timing: id 3 | task 1769 | graphs reused = 1723
|
|
1.39.919.485 I slot release: id 3 | task 1769 | stop processing: n_tokens = 126, truncated = 0
|
|
1.39.919.492 I srv update_slots: all slots are idle
|
|
1.39.930.244 I srv operator(): Chat format: peg-native
|
|
1.39.930.404 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.774 (> 0.100 thold), f_keep = 0.381
|
|
1.39.930.406 I srv get_availabl: updating prompt cache
|
|
1.39.930.427 W srv prompt_save: - saving prompt with length 126, total state size = 22.644 MiB (draft: 0.000 MiB)
|
|
1.39.941.648 I srv load: - looking for better prompt, base f_keep = 0.381, sim = 0.774
|
|
1.39.941.660 I srv update: - cache state: 15 prompts, 362.664 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
1.39.941.660 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
1.39.941.661 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
1.39.941.662 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.39.941.662 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
1.39.941.663 I srv update: - prompt 0x5ec7459da2a0: 109 tokens, checkpoints: 0, 19.589 MiB
|
|
1.39.941.663 I srv update: - prompt 0x5ec73dbf9230: 132 tokens, checkpoints: 0, 23.722 MiB
|
|
1.39.941.663 I srv update: - prompt 0x5ec73da0b940: 135 tokens, checkpoints: 0, 24.261 MiB
|
|
1.39.941.664 I srv update: - prompt 0x5ec745bf1a90: 198 tokens, checkpoints: 0, 35.583 MiB
|
|
1.39.941.664 I srv update: - prompt 0x5ec73dad6760: 146 tokens, checkpoints: 0, 26.238 MiB
|
|
1.39.941.665 I srv update: - prompt 0x5ec745f55040: 113 tokens, checkpoints: 0, 20.308 MiB
|
|
1.39.941.665 I srv update: - prompt 0x5ec73dc24ba0: 134 tokens, checkpoints: 0, 24.082 MiB
|
|
1.39.941.666 I srv update: - prompt 0x5ec73dc06c00: 104 tokens, checkpoints: 0, 18.691 MiB
|
|
1.39.941.666 I srv update: - prompt 0x5ec745faa400: 173 tokens, checkpoints: 0, 31.090 MiB
|
|
1.39.941.667 I srv update: - prompt 0x5ec745f73340: 145 tokens, checkpoints: 0, 26.059 MiB
|
|
1.39.941.667 I srv update: - prompt 0x5ec7453e20d0: 126 tokens, checkpoints: 0, 22.644 MiB
|
|
1.39.941.668 I srv get_availabl: prompt cache update took 11.26 ms
|
|
1.39.941.735 I slot launch_slot_: id 3 | task 1834 | processing task, is_child = 0
|
|
1.39.941.736 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.39.941.736 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.39.941.743 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.39.941.743 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.39.941.748 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.39.941.748 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.41.935.454 I slot print_timing: id 3 | task 1834 | prompt eval time = 339.36 ms / 14 tokens ( 24.24 ms per token, 41.25 tokens per second)
|
|
1.41.935.457 I slot print_timing: id 3 | task 1834 | eval time = 1654.33 ms / 53 tokens ( 31.21 ms per token, 32.04 tokens per second)
|
|
1.41.935.457 I slot print_timing: id 3 | task 1834 | total time = 1993.69 ms / 67 tokens
|
|
1.41.935.458 I slot print_timing: id 3 | task 1834 | graphs reused = 1774
|
|
1.41.935.489 I slot release: id 3 | task 1834 | stop processing: n_tokens = 114, truncated = 0
|
|
1.41.935.497 I srv update_slots: all slots are idle
|
|
1.41.946.557 I srv operator(): Chat format: peg-native
|
|
1.41.946.735 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.723 (> 0.100 thold), f_keep = 0.412
|
|
1.41.946.737 I srv get_availabl: updating prompt cache
|
|
1.41.946.763 W srv prompt_save: - saving prompt with length 114, total state size = 20.488 MiB (draft: 0.000 MiB)
|
|
1.41.965.085 I srv load: - looking for better prompt, base f_keep = 0.412, sim = 0.723
|
|
1.41.965.097 I srv update: - cache state: 16 prompts, 383.152 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
1.41.965.097 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
1.41.965.098 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
1.41.965.099 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.41.965.099 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
1.41.965.100 I srv update: - prompt 0x5ec7459da2a0: 109 tokens, checkpoints: 0, 19.589 MiB
|
|
1.41.965.100 I srv update: - prompt 0x5ec73dbf9230: 132 tokens, checkpoints: 0, 23.722 MiB
|
|
1.41.965.101 I srv update: - prompt 0x5ec73da0b940: 135 tokens, checkpoints: 0, 24.261 MiB
|
|
1.41.965.101 I srv update: - prompt 0x5ec745bf1a90: 198 tokens, checkpoints: 0, 35.583 MiB
|
|
1.41.965.101 I srv update: - prompt 0x5ec73dad6760: 146 tokens, checkpoints: 0, 26.238 MiB
|
|
1.41.965.102 I srv update: - prompt 0x5ec745f55040: 113 tokens, checkpoints: 0, 20.308 MiB
|
|
1.41.965.102 I srv update: - prompt 0x5ec73dc24ba0: 134 tokens, checkpoints: 0, 24.082 MiB
|
|
1.41.965.103 I srv update: - prompt 0x5ec73dc06c00: 104 tokens, checkpoints: 0, 18.691 MiB
|
|
1.41.965.103 I srv update: - prompt 0x5ec745faa400: 173 tokens, checkpoints: 0, 31.090 MiB
|
|
1.41.965.104 I srv update: - prompt 0x5ec745f73340: 145 tokens, checkpoints: 0, 26.059 MiB
|
|
1.41.965.104 I srv update: - prompt 0x5ec7453e20d0: 126 tokens, checkpoints: 0, 22.644 MiB
|
|
1.41.965.105 I srv update: - prompt 0x5ec7416d6080: 114 tokens, checkpoints: 0, 20.488 MiB
|
|
1.41.965.106 I srv get_availabl: prompt cache update took 18.37 ms
|
|
1.41.965.169 I slot launch_slot_: id 3 | task 1888 | processing task, is_child = 0
|
|
1.41.965.170 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.41.965.171 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.41.965.178 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.41.965.178 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.41.965.182 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.41.965.183 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.43.888.823 I slot print_timing: id 3 | task 1888 | prompt eval time = 488.64 ms / 18 tokens ( 27.15 ms per token, 36.84 tokens per second)
|
|
1.43.888.827 I slot print_timing: id 3 | task 1888 | eval time = 1434.98 ms / 46 tokens ( 31.20 ms per token, 32.06 tokens per second)
|
|
1.43.888.827 I slot print_timing: id 3 | task 1888 | total time = 1923.62 ms / 64 tokens
|
|
1.43.888.828 I slot print_timing: id 3 | task 1888 | graphs reused = 1818
|
|
1.43.888.862 I slot release: id 3 | task 1888 | stop processing: n_tokens = 110, truncated = 0
|
|
1.43.888.869 I srv update_slots: all slots are idle
|
|
1.43.899.526 I srv operator(): Chat format: peg-native
|
|
1.43.899.756 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.770 (> 0.100 thold), f_keep = 0.427
|
|
1.43.899.758 I srv get_availabl: updating prompt cache
|
|
1.43.899.779 W srv prompt_save: - saving prompt with length 110, total state size = 19.769 MiB (draft: 0.000 MiB)
|
|
1.43.917.554 I srv load: - looking for better prompt, base f_keep = 0.427, sim = 0.770
|
|
1.43.917.564 I srv update: - cache state: 17 prompts, 402.920 MiB (limits: 8192.000 MiB, 8192 tokens, 45583 est)
|
|
1.43.917.565 I srv update: - prompt 0x5ec73a38fe30: 158 tokens, checkpoints: 0, 28.395 MiB
|
|
1.43.917.566 I srv update: - prompt 0x5ec745bed910: 106 tokens, checkpoints: 0, 19.050 MiB
|
|
1.43.917.567 I srv update: - prompt 0x5ec73d7b8050: 103 tokens, checkpoints: 0, 18.511 MiB
|
|
1.43.917.567 I srv update: - prompt 0x5ec73dc96af0: 136 tokens, checkpoints: 0, 24.441 MiB
|
|
1.43.917.568 I srv update: - prompt 0x5ec7459da2a0: 109 tokens, checkpoints: 0, 19.589 MiB
|
|
1.43.917.568 I srv update: - prompt 0x5ec73dbf9230: 132 tokens, checkpoints: 0, 23.722 MiB
|
|
1.43.917.569 I srv update: - prompt 0x5ec73da0b940: 135 tokens, checkpoints: 0, 24.261 MiB
|
|
1.43.917.569 I srv update: - prompt 0x5ec745bf1a90: 198 tokens, checkpoints: 0, 35.583 MiB
|
|
1.43.917.569 I srv update: - prompt 0x5ec73dad6760: 146 tokens, checkpoints: 0, 26.238 MiB
|
|
1.43.917.570 I srv update: - prompt 0x5ec745f55040: 113 tokens, checkpoints: 0, 20.308 MiB
|
|
1.43.917.571 I srv update: - prompt 0x5ec73dc24ba0: 134 tokens, checkpoints: 0, 24.082 MiB
|
|
1.43.917.571 I srv update: - prompt 0x5ec73dc06c00: 104 tokens, checkpoints: 0, 18.691 MiB
|
|
1.43.917.572 I srv update: - prompt 0x5ec745faa400: 173 tokens, checkpoints: 0, 31.090 MiB
|
|
1.43.917.572 I srv update: - prompt 0x5ec745f73340: 145 tokens, checkpoints: 0, 26.059 MiB
|
|
1.43.917.572 I srv update: - prompt 0x5ec7453e20d0: 126 tokens, checkpoints: 0, 22.644 MiB
|
|
1.43.917.573 I srv update: - prompt 0x5ec7416d6080: 114 tokens, checkpoints: 0, 20.488 MiB
|
|
1.43.917.573 I srv update: - prompt 0x5ec73da8ade0: 110 tokens, checkpoints: 0, 19.769 MiB
|
|
1.43.917.574 I srv get_availabl: prompt cache update took 17.82 ms
|
|
1.43.917.636 I slot launch_slot_: id 3 | task 1935 | processing task, is_child = 0
|
|
1.43.917.637 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
|
|
1.43.917.639 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
|
|
1.43.917.646 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
|
|
1.43.917.646 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
|
|
1.43.917.650 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
|
|
1.43.917.651 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
|
|
1.46.970.198 I slot print_timing: id 3 | task 1935 | prompt eval time = 350.39 ms / 14 tokens ( 25.03 ms per token, 39.96 tokens per second)
|
|
1.46.970.201 I slot print_timing: id 3 | task 1935 | eval time = 2702.14 ms / 86 tokens ( 31.42 ms per token, 31.83 tokens per second)
|
|
1.46.970.202 I slot print_timing: id 3 | task 1935 | total time = 3052.53 ms / 100 tokens
|
|
1.46.970.202 I slot print_timing: id 3 | task 1935 | graphs reused = 1902
|
|
1.46.970.230 I slot release: id 3 | task 1935 | stop processing: n_tokens = 146, truncated = 0
|
|
1.46.970.239 I srv update_slots: all slots are idle
|
|
1.46.970.711 I srv operator(): operator(): cleaning up before exit...
|