qoherent/experiments-07-07-12-local-llm-knowledge-2
23
0
Fork 0
Code Issues Pull Requests Workflows Packages Projects Releases Wiki Activity
Push Tracker
experiments-07-07-12-local-.../results_agentic/gpt-oss-120b.server.log

476 lines
45 KiB
Plaintext
Raw Permalink Normal View History

G
readme report
2026-07-12 21:35:10 -04:00
0.00.065.577 I log_info: verbosity = 3 (adjust with the `-lv N` CLI arg)
0.00.065.580 I device_info:
0.00.065.600 I - ROCm0 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.065.604 I - ROCm1 : AMD Radeon Graphics (32752 MiB, 32728 MiB free)
0.00.065.611 I - CPU : AMD Ryzen 9 3900X 12-Core Processor (128730 MiB, 128730 MiB free)
0.00.065.670 I system_info: n_threads = 12 (n_threads_batch = 12) / 24 | ROCm : NO_VMM = 1 | PEER_MAX_BATCH_SIZE = 128 | CPU : SSE3 = 1 | SSSE3 = 1 | AVX = 1 | AVX2 = 1 | F16C = 1 | FMA = 1 | BMI2 = 1 | LLAMAFILE = 1 | OPENMP = 1 | REPACK = 1 |
0.00.065.675 I srv llama_server: n_parallel is set to auto, using n_parallel = 4 and kv_unified = true
0.00.065.714 I srv init: running without SSL
0.00.065.775 I srv init: using 23 threads for HTTP server
0.00.066.113 I srv start: binding port with default address family
0.00.067.307 I srv llama_server: loading model
0.00.067.314 I srv load_model: loading model '/home/qrf/.cache/llama.cpp/openai_gpt-oss-120b-Q4_K_M/openai_gpt-oss-120b-Q4_K_M-00001-of-00002.gguf'
0.00.067.367 I common_init_result: fitting params to device memory ...
0.00.067.371 I common_init_result: (for bugs during this step try to reproduce them with -fit off, or provide --verbose logs if the bug only occurs with -fit on)
0.08.024.260 W load: setting token '<|message|>' (200008) attribute to USER_DEFINED (16), old attributes: 8
0.08.024.265 W load: setting token '<|start|>' (200006) attribute to USER_DEFINED (16), old attributes: 8
0.08.024.265 W load: setting token '<|constrain|>' (200003) attribute to USER_DEFINED (16), old attributes: 8
0.08.025.436 W load: setting token '<|channel|>' (200005) attribute to USER_DEFINED (16), old attributes: 8
0.08.030.803 W load: special_eog_ids contains both '<|return|>' and '<|call|>', or '<|calls|>' and '<|flush|>' tokens, removing '<|end|>' token from EOG list
0.41.856.854 W llama_context: n_ctx_seq (32768) < n_ctx_train (131072) -- the full capacity of the model will not be utilized
0.42.084.131 I common_init_from_params: warming up the model with an empty run - please wait ... (--no-warmup to disable)
0.42.277.147 I srv load_model: initializing slots, n_slots = 4
0.42.324.006 W common_speculative_init: no implementations specified for speculative decoding
0.42.324.012 I slot load_model: id 0 | task -1 | new slot, n_ctx = 32768
0.42.324.016 I slot load_model: id 1 | task -1 | new slot, n_ctx = 32768
0.42.324.016 I slot load_model: id 2 | task -1 | new slot, n_ctx = 32768
0.42.324.017 I slot load_model: id 3 | task -1 | new slot, n_ctx = 32768
0.42.324.060 I srv load_model: prompt cache is enabled, size limit: 8192 MiB
0.42.324.060 I srv load_model: use `--cache-ram 0` to disable the prompt cache
0.42.324.061 I srv load_model: for more info see https://github.com/ggml-org/llama.cpp/pull/16391
0.42.324.061 I srv load_model: context checkpoints enabled, max = 32, min spacing = 256
0.42.324.828 I srv init: idle slots will be saved to prompt cache and cleared upon starting a new task
0.42.330.708 I init: chat template, example_format: '<|start|>system<|message|>You are ChatGPT, a large language model trained by OpenAI.
Knowledge cutoff: 2024-06
Current date: 2026-07-12
Reasoning: medium
# Valid channels: analysis, commentary, final. Channel must be included for every message.<|end|><|start|>developer<|message|># Instructions
You are a helpful assistant<|end|><|start|>user<|message|>Hello<|end|><|start|>assistant<|channel|>final<|message|>Hi there<|end|><|start|>user<|message|>How are you?<|end|><|start|>assistant'
0.42.331.287 I srv init: init: chat template, thinking = 1
0.42.331.324 I srv llama_server: model loaded
0.42.331.327 I srv llama_server: server is listening on http://127.0.0.1:8090
0.42.331.335 I srv update_slots: all slots are idle
0.44.999.222 I srv operator(): Chat format: peg-native
0.45.004.022 I slot get_availabl: id 3 | task -1 | selected slot by LRU, t_last = -1
0.45.004.025 I srv get_availabl: updating prompt cache
0.45.004.031 I srv load: - looking for better prompt, base f_keep = -1.000, sim = 0.000
0.45.004.036 I srv update: - cache state: 0 prompts, 0.000 MiB (limits: 8192.000 MiB, 32768 tokens, 8589934592 est)
0.45.004.037 I srv get_availabl: prompt cache update took 0.01 ms
0.45.005.026 I slot launch_slot_: id 3 | task 0 | processing task, is_child = 0
0.45.005.027 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.45.005.029 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.45.005.053 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.45.005.053 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.45.005.070 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.45.005.070 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.46.696.839 I slot create_check: id 3 | task 0 | created context checkpoint 1 of 32 (pos_min = 0, pos_max = 352, n_tokens = 353, size = 4.502 MiB)
0.50.471.309 I slot print_timing: id 3 | task 0 | n_decoded = 188, tg = 62.47 t/s, tg_3s = 62.47 t/s
0.52.573.483 I slot print_timing: id 3 | task 0 | prompt eval time = 2456.90 ms / 455 tokens ( 5.40 ms per token, 185.19 tokens per second)
0.52.573.487 I slot print_timing: id 3 | task 0 | eval time = 5111.48 ms / 319 tokens ( 16.02 ms per token, 62.41 tokens per second)
0.52.573.487 I slot print_timing: id 3 | task 0 | total time = 7568.38 ms / 774 tokens
0.52.573.491 I slot print_timing: id 3 | task 0 | graphs reused = 316
0.52.573.577 I slot release: id 3 | task 0 | stop processing: n_tokens = 773, truncated = 0
0.52.573.583 I srv update_slots: all slots are idle
0.52.589.246 I srv operator(): Chat format: peg-native
0.52.598.886 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.642 (> 0.100 thold), f_keep = 0.590
0.52.599.928 I slot launch_slot_: id 3 | task 322 | processing task, is_child = 0
0.52.599.930 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.52.599.931 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.52.599.954 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.52.599.954 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.52.599.977 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.52.599.978 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.53.597.643 I slot create_check: id 3 | task 322 | created context checkpoint 2 of 32 (pos_min = 0, pos_max = 669, n_tokens = 670, size = 4.502 MiB)
0.57.017.504 I slot print_timing: id 3 | task 322 | n_decoded = 188, tg = 62.49 t/s, tg_3s = 62.49 t/s
0.58.043.423 I slot print_timing: id 3 | task 322 | prompt eval time = 1409.23 ms / 254 tokens ( 5.55 ms per token, 180.24 tokens per second)
0.58.043.426 I slot print_timing: id 3 | task 322 | eval time = 4034.18 ms / 252 tokens ( 16.01 ms per token, 62.47 tokens per second)
0.58.043.426 I slot print_timing: id 3 | task 322 | total time = 5443.41 ms / 506 tokens
0.58.043.427 I slot print_timing: id 3 | task 322 | graphs reused = 565
0.58.043.487 I slot release: id 3 | task 322 | stop processing: n_tokens = 961, truncated = 0
0.58.043.495 I srv update_slots: all slots are idle
0.58.061.076 I srv operator(): Chat format: peg-native
0.58.073.601 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.759 (> 0.100 thold), f_keep = 0.740
0.58.074.733 I slot launch_slot_: id 3 | task 577 | processing task, is_child = 0
0.58.074.736 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.58.074.736 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.58.074.763 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.58.074.763 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.58.074.787 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.58.074.787 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
0.59.126.156 I slot create_check: id 3 | task 577 | created context checkpoint 3 of 32 (pos_min = 0, pos_max = 932, n_tokens = 933, size = 4.502 MiB)
0.59.774.530 I slot print_timing: id 3 | task 577 | prompt eval time = 1091.49 ms / 226 tokens ( 4.83 ms per token, 207.06 tokens per second)
0.59.774.535 I slot print_timing: id 3 | task 577 | eval time = 608.21 ms / 38 tokens ( 16.01 ms per token, 62.48 tokens per second)
0.59.774.535 I slot print_timing: id 3 | task 577 | total time = 1699.70 ms / 264 tokens
0.59.774.536 I slot print_timing: id 3 | task 577 | graphs reused = 601
0.59.774.617 I slot release: id 3 | task 577 | stop processing: n_tokens = 974, truncated = 0
0.59.774.627 I srv update_slots: all slots are idle
0.59.820.934 I srv operator(): Chat format: peg-native
0.59.838.881 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.920 (> 0.100 thold), f_keep = 0.963
0.59.839.767 I slot launch_slot_: id 3 | task 618 | processing task, is_child = 0
0.59.839.769 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
0.59.839.770 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
0.59.839.802 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
0.59.839.803 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
0.59.839.825 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
0.59.839.826 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.01.391.199 I slot print_timing: id 3 | task 618 | prompt eval time = 668.81 ms / 82 tokens ( 8.16 ms per token, 122.61 tokens per second)
1.01.391.203 I slot print_timing: id 3 | task 618 | eval time = 882.54 ms / 54 tokens ( 16.34 ms per token, 61.19 tokens per second)
1.01.391.203 I slot print_timing: id 3 | task 618 | total time = 1551.34 ms / 136 tokens
1.01.391.204 I slot print_timing: id 3 | task 618 | graphs reused = 652
1.01.391.287 I slot release: id 3 | task 618 | stop processing: n_tokens = 1073, truncated = 0
1.01.391.298 I srv update_slots: all slots are idle
1.01.417.883 I srv operator(): Chat format: peg-native
1.01.422.895 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.825 (> 0.100 thold), f_keep = 0.334
1.01.422.897 I srv get_availabl: updating prompt cache
1.01.423.000 W srv prompt_save: - saving prompt with length 1073, total state size = 42.237 MiB (draft: 0.000 MiB)
1.01.471.325 I srv load: - looking for better prompt, base f_keep = 0.334, sim = 0.825
1.01.471.331 I srv update: - cache state: 1 prompts, 55.743 MiB (limits: 8192.000 MiB, 32768 tokens, 157688 est)
1.01.471.332 I srv update: - prompt 0x5da9ea1fbe30: 1073 tokens, checkpoints: 3, 55.743 MiB
1.01.471.333 I srv get_availabl: prompt cache update took 48.44 ms
1.01.472.257 I slot launch_slot_: id 3 | task 675 | processing task, is_child = 0
1.01.472.259 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.01.472.260 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.01.472.283 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.01.472.283 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.01.472.301 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.01.472.303 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.01.472.328 W slot update_slots: id 3 | task 675 | erased invalidated context checkpoint (pos_min = 0, pos_max = 669, n_tokens = 670, n_swa = 128, pos_next = 358, size = 4.502 MiB)
1.01.472.333 W slot update_slots: id 3 | task 675 | erased invalidated context checkpoint (pos_min = 0, pos_max = 932, n_tokens = 933, n_swa = 128, pos_next = 358, size = 4.502 MiB)
1.02.516.254 I slot print_timing: id 3 | task 675 | prompt eval time = 525.36 ms / 76 tokens ( 6.91 ms per token, 144.66 tokens per second)
1.02.516.258 I slot print_timing: id 3 | task 675 | eval time = 518.57 ms / 33 tokens ( 15.71 ms per token, 63.64 tokens per second)
1.02.516.258 I slot print_timing: id 3 | task 675 | total time = 1043.92 ms / 109 tokens
1.02.516.259 I slot print_timing: id 3 | task 675 | graphs reused = 683
1.02.516.317 I slot release: id 3 | task 675 | stop processing: n_tokens = 466, truncated = 0
1.02.516.325 I srv update_slots: all slots are idle
1.02.530.219 I srv operator(): Chat format: peg-native
1.02.539.253 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.940 (> 0.100 thold), f_keep = 0.933
1.02.540.148 I slot launch_slot_: id 3 | task 710 | processing task, is_child = 0
1.02.540.150 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.02.540.150 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.02.540.172 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.02.540.173 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.02.540.190 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.02.540.191 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.03.338.241 I slot print_timing: id 3 | task 710 | prompt eval time = 232.38 ms / 28 tokens ( 8.30 ms per token, 120.49 tokens per second)
1.03.338.245 I slot print_timing: id 3 | task 710 | eval time = 565.64 ms / 36 tokens ( 15.71 ms per token, 63.64 tokens per second)
1.03.338.245 I slot print_timing: id 3 | task 710 | total time = 798.02 ms / 64 tokens
1.03.338.246 I slot print_timing: id 3 | task 710 | graphs reused = 717
1.03.338.298 I slot release: id 3 | task 710 | stop processing: n_tokens = 498, truncated = 0
1.03.338.308 I srv update_slots: all slots are idle
1.03.357.479 I srv operator(): Chat format: peg-native
1.03.370.569 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.808 (> 0.100 thold), f_keep = 0.932
1.03.371.633 I slot launch_slot_: id 3 | task 749 | processing task, is_child = 0
1.03.371.635 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.03.371.636 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.03.371.663 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.03.371.663 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.03.371.684 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.03.371.688 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.07.123.384 I slot print_timing: id 3 | task 749 | n_decoded = 189, tg = 62.71 t/s, tg_3s = 62.71 t/s
1.07.771.430 I slot print_timing: id 3 | task 749 | prompt eval time = 737.83 ms / 110 tokens ( 6.71 ms per token, 149.09 tokens per second)
1.07.771.434 I slot print_timing: id 3 | task 749 | eval time = 3661.89 ms / 229 tokens ( 15.99 ms per token, 62.54 tokens per second)
1.07.771.434 I slot print_timing: id 3 | task 749 | total time = 4399.71 ms / 339 tokens
1.07.771.435 I slot print_timing: id 3 | task 749 | graphs reused = 943
1.07.771.490 I slot release: id 3 | task 749 | stop processing: n_tokens = 802, truncated = 0
1.07.771.500 I srv update_slots: all slots are idle
1.07.795.129 I srv operator(): Chat format: peg-native
1.07.813.011 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.809 (> 0.100 thold), f_keep = 0.717
1.07.814.014 I slot launch_slot_: id 3 | task 981 | processing task, is_child = 0
1.07.814.015 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.07.814.016 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.07.814.034 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.07.814.034 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.07.814.050 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.07.814.050 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.08.598.379 I slot create_check: id 3 | task 981 | created context checkpoint 2 of 32 (pos_min = 358, pos_max = 692, n_tokens = 693, size = 4.502 MiB)
1.10.112.494 I slot print_timing: id 3 | task 981 | prompt eval time = 970.54 ms / 136 tokens ( 7.14 ms per token, 140.13 tokens per second)
1.10.112.498 I slot print_timing: id 3 | task 981 | eval time = 1327.88 ms / 83 tokens ( 16.00 ms per token, 62.51 tokens per second)
1.10.112.499 I slot print_timing: id 3 | task 981 | total time = 2298.42 ms / 219 tokens
1.10.112.499 I slot print_timing: id 3 | task 981 | graphs reused = 1023
1.10.112.567 I slot release: id 3 | task 981 | stop processing: n_tokens = 793, truncated = 0
1.10.112.577 I srv update_slots: all slots are idle
1.10.154.759 I srv operator(): Chat format: peg-native
1.10.176.616 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.944 (> 0.100 thold), f_keep = 0.898
1.10.177.698 I slot launch_slot_: id 3 | task 1067 | processing task, is_child = 0
1.10.177.701 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.10.177.701 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.10.177.730 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.10.177.731 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.10.177.753 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.10.177.753 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.11.282.471 I slot print_timing: id 3 | task 1067 | prompt eval time = 334.09 ms / 42 tokens ( 7.95 ms per token, 125.72 tokens per second)
1.11.282.475 I slot print_timing: id 3 | task 1067 | eval time = 770.60 ms / 48 tokens ( 16.05 ms per token, 62.29 tokens per second)
1.11.282.476 I slot print_timing: id 3 | task 1067 | total time = 1104.68 ms / 90 tokens
1.11.282.476 I slot print_timing: id 3 | task 1067 | graphs reused = 1068
1.11.282.545 I slot release: id 3 | task 1067 | stop processing: n_tokens = 801, truncated = 0
1.11.282.556 I srv update_slots: all slots are idle
1.11.308.227 I srv operator(): Chat format: peg-native
1.11.313.314 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.812 (> 0.100 thold), f_keep = 0.447
1.11.313.317 I srv get_availabl: updating prompt cache
1.11.313.382 W srv prompt_save: - saving prompt with length 801, total state size = 32.672 MiB (draft: 0.000 MiB)
1.11.342.065 I srv load: - looking for better prompt, base f_keep = 0.447, sim = 0.812
1.11.342.074 I srv update: - cache state: 2 prompts, 97.418 MiB (limits: 8192.000 MiB, 32768 tokens, 157586 est)
1.11.342.075 I srv update: - prompt 0x5da9ea1fbe30: 1073 tokens, checkpoints: 3, 55.743 MiB
1.11.342.075 I srv update: - prompt 0x5da9ea195b40: 801 tokens, checkpoints: 2, 41.675 MiB
1.11.342.076 I srv get_availabl: prompt cache update took 28.76 ms
1.11.343.017 I slot launch_slot_: id 3 | task 1118 | processing task, is_child = 0
1.11.343.019 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.11.343.020 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.11.343.046 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.11.343.047 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.11.343.064 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.11.343.064 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.11.343.089 I slot update_slots: id 3 | task 1118 | Checking checkpoint with [358, 692] against 230...
1.11.343.089 I slot update_slots: id 3 | task 1118 | Checking checkpoint with [0, 352] against 230...
1.11.345.613 W slot update_slots: id 3 | task 1118 | restored context checkpoint (pos_min = 0, pos_max = 352, n_tokens = 353, n_past = 352, size = 4.502 MiB)
1.11.345.615 W slot update_slots: id 3 | task 1118 | erased invalidated context checkpoint (pos_min = 358, pos_max = 692, n_tokens = 693, n_swa = 128, pos_next = 352, size = 4.502 MiB)
1.13.855.355 I slot print_timing: id 3 | task 1118 | prompt eval time = 639.99 ms / 89 tokens ( 7.19 ms per token, 139.07 tokens per second)
1.13.855.359 I slot print_timing: id 3 | task 1118 | eval time = 1872.28 ms / 117 tokens ( 16.00 ms per token, 62.49 tokens per second)
1.13.855.359 I slot print_timing: id 3 | task 1118 | total time = 2512.26 ms / 206 tokens
1.13.855.360 I slot print_timing: id 3 | task 1118 | graphs reused = 1181
1.13.855.410 I slot release: id 3 | task 1118 | stop processing: n_tokens = 557, truncated = 0
1.13.855.418 I srv update_slots: all slots are idle
1.13.870.015 I srv operator(): Chat format: peg-native
1.13.879.313 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.832 (> 0.100 thold), f_keep = 0.794
1.13.880.074 I slot launch_slot_: id 3 | task 1238 | processing task, is_child = 0
1.13.880.075 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.13.880.077 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.13.880.095 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.13.880.095 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.13.880.111 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.13.880.111 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.17.521.193 I slot print_timing: id 3 | task 1238 | n_decoded = 189, tg = 62.71 t/s, tg_3s = 62.71 t/s
1.17.991.416 I slot print_timing: id 3 | task 1238 | prompt eval time = 627.26 ms / 89 tokens ( 7.05 ms per token, 141.89 tokens per second)
1.17.991.419 I slot print_timing: id 3 | task 1238 | eval time = 3484.02 ms / 218 tokens ( 15.98 ms per token, 62.57 tokens per second)
1.17.991.419 I slot print_timing: id 3 | task 1238 | total time = 4111.28 ms / 307 tokens
1.17.991.420 I slot print_timing: id 3 | task 1238 | graphs reused = 1396
1.17.991.474 I slot release: id 3 | task 1238 | stop processing: n_tokens = 748, truncated = 0
1.17.991.484 I srv update_slots: all slots are idle
1.18.024.753 I srv operator(): Chat format: peg-native
1.18.038.451 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.933 (> 0.100 thold), f_keep = 0.711
1.18.039.317 I slot launch_slot_: id 3 | task 1459 | processing task, is_child = 0
1.18.039.319 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.18.039.320 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.18.039.340 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.18.039.340 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.18.039.357 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.18.039.357 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.21.292.219 I slot print_timing: id 3 | task 1459 | prompt eval time = 298.58 ms / 38 tokens ( 7.86 ms per token, 127.27 tokens per second)
1.21.292.222 I slot print_timing: id 3 | task 1459 | eval time = 2954.25 ms / 185 tokens ( 15.97 ms per token, 62.62 tokens per second)
1.21.292.223 I slot print_timing: id 3 | task 1459 | total time = 3252.83 ms / 223 tokens
1.21.292.223 I slot print_timing: id 3 | task 1459 | graphs reused = 1578
1.21.292.286 I slot release: id 3 | task 1459 | stop processing: n_tokens = 754, truncated = 0
1.21.292.297 I srv update_slots: all slots are idle
1.21.315.229 I srv operator(): Chat format: peg-native
1.21.333.109 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.880 (> 0.100 thold), f_keep = 0.757
1.21.334.068 I slot launch_slot_: id 3 | task 1647 | processing task, is_child = 0
1.21.334.070 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.21.334.070 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.21.334.094 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.21.334.094 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.21.334.111 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.21.334.112 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.21.942.613 I slot create_check: id 3 | task 1647 | created context checkpoint 2 of 32 (pos_min = 225, pos_max = 630, n_tokens = 631, size = 4.502 MiB)
1.23.761.318 I slot print_timing: id 3 | task 1647 | prompt eval time = 798.60 ms / 78 tokens ( 10.24 ms per token, 97.67 tokens per second)
1.23.761.321 I slot print_timing: id 3 | task 1647 | eval time = 1628.57 ms / 102 tokens ( 15.97 ms per token, 62.63 tokens per second)
1.23.761.322 I slot print_timing: id 3 | task 1647 | total time = 2427.17 ms / 180 tokens
1.23.761.323 I slot print_timing: id 3 | task 1647 | graphs reused = 1677
1.23.761.385 I slot release: id 3 | task 1647 | stop processing: n_tokens = 750, truncated = 0
1.23.761.393 I srv update_slots: all slots are idle
1.23.804.523 I srv operator(): Chat format: peg-native
1.23.826.172 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.942 (> 0.100 thold), f_keep = 0.867
1.23.827.160 I slot launch_slot_: id 3 | task 1752 | processing task, is_child = 0
1.23.827.162 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.23.827.162 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.23.827.183 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.23.827.183 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.23.827.200 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.23.827.200 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.24.897.134 I slot print_timing: id 3 | task 1752 | prompt eval time = 307.58 ms / 40 tokens ( 7.69 ms per token, 130.05 tokens per second)
1.24.897.137 I slot print_timing: id 3 | task 1752 | eval time = 762.33 ms / 48 tokens ( 15.88 ms per token, 62.96 tokens per second)
1.24.897.138 I slot print_timing: id 3 | task 1752 | total time = 1069.91 ms / 88 tokens
1.24.897.138 I slot print_timing: id 3 | task 1752 | graphs reused = 1723
1.24.897.199 I slot release: id 3 | task 1752 | stop processing: n_tokens = 737, truncated = 0
1.24.897.207 I srv update_slots: all slots are idle
1.24.921.217 I srv operator(): Chat format: peg-native
1.24.925.732 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.763 (> 0.100 thold), f_keep = 0.486
1.24.925.734 I srv get_availabl: updating prompt cache
1.24.925.818 W srv prompt_save: - saving prompt with length 737, total state size = 30.421 MiB (draft: 0.000 MiB)
1.24.953.257 I srv load: - looking for better prompt, base f_keep = 0.486, sim = 0.763
1.24.953.267 I srv update: - cache state: 3 prompts, 136.843 MiB (limits: 8192.000 MiB, 32768 tokens, 156305 est)
1.24.953.267 I srv update: - prompt 0x5da9ea1fbe30: 1073 tokens, checkpoints: 3, 55.743 MiB
1.24.953.268 I srv update: - prompt 0x5da9ea195b40: 801 tokens, checkpoints: 2, 41.675 MiB
1.24.953.268 I srv update: - prompt 0x5da9ea45de90: 737 tokens, checkpoints: 2, 39.425 MiB
1.24.953.270 I srv get_availabl: prompt cache update took 27.54 ms
1.24.954.158 I slot launch_slot_: id 3 | task 1803 | processing task, is_child = 0
1.24.954.160 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.24.954.161 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.24.954.189 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.24.954.189 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.24.954.206 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.24.954.207 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.24.954.231 W slot update_slots: id 3 | task 1803 | erased invalidated context checkpoint (pos_min = 225, pos_max = 630, n_tokens = 631, n_swa = 128, pos_next = 358, size = 4.502 MiB)
1.28.741.168 I slot print_timing: id 3 | task 1803 | n_decoded = 188, tg = 62.51 t/s, tg_3s = 62.51 t/s
1.29.525.073 I slot print_timing: id 3 | task 1803 | prompt eval time = 779.46 ms / 111 tokens ( 7.02 ms per token, 142.41 tokens per second)
1.29.525.076 I slot print_timing: id 3 | task 1803 | eval time = 3791.38 ms / 237 tokens ( 16.00 ms per token, 62.51 tokens per second)
1.29.525.076 I slot print_timing: id 3 | task 1803 | total time = 4570.84 ms / 348 tokens
1.29.525.077 I slot print_timing: id 3 | task 1803 | graphs reused = 1956
1.29.525.132 I slot release: id 3 | task 1803 | stop processing: n_tokens = 705, truncated = 0
1.29.525.142 I srv update_slots: all slots are idle
1.29.540.089 I srv operator(): Chat format: peg-native
1.29.549.666 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.695 (> 0.100 thold), f_keep = 0.667
1.29.550.652 I slot launch_slot_: id 3 | task 2042 | processing task, is_child = 0
1.29.550.654 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.29.550.655 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.29.550.678 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.29.550.679 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.29.550.698 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.29.550.699 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.30.445.535 I slot create_check: id 3 | task 2042 | created context checkpoint 2 of 32 (pos_min = 225, pos_max = 635, n_tokens = 636, size = 4.502 MiB)
1.33.866.460 I slot print_timing: id 3 | task 2042 | n_decoded = 187, tg = 62.26 t/s, tg_3s = 62.26 t/s
1.34.010.465 I slot print_timing: id 3 | task 2042 | prompt eval time = 1312.22 ms / 206 tokens ( 6.37 ms per token, 156.99 tokens per second)
1.34.010.468 I slot print_timing: id 3 | task 2042 | eval time = 3147.51 ms / 196 tokens ( 16.06 ms per token, 62.27 tokens per second)
1.34.010.468 I slot print_timing: id 3 | task 2042 | total time = 4459.74 ms / 402 tokens
1.34.010.469 I slot print_timing: id 3 | task 2042 | graphs reused = 2148
1.34.010.535 I slot release: id 3 | task 2042 | stop processing: n_tokens = 871, truncated = 0
1.34.010.543 I srv update_slots: all slots are idle
1.34.029.984 I srv operator(): Chat format: peg-native
1.34.044.218 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.767 (> 0.100 thold), f_keep = 0.777
1.34.045.185 I slot launch_slot_: id 3 | task 2241 | processing task, is_child = 0
1.34.045.187 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.34.045.188 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.34.045.210 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.34.045.210 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.34.045.228 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.34.045.228 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.38.116.131 I slot print_timing: id 3 | task 2241 | n_decoded = 187, tg = 62.15 t/s, tg_3s = 62.15 t/s
1.38.571.135 I slot print_timing: id 3 | task 2241 | prompt eval time = 1062.04 ms / 206 tokens ( 5.16 ms per token, 193.97 tokens per second)
1.38.571.138 I slot print_timing: id 3 | task 2241 | eval time = 3463.84 ms / 215 tokens ( 16.11 ms per token, 62.07 tokens per second)
1.38.571.139 I slot print_timing: id 3 | task 2241 | total time = 4525.88 ms / 421 tokens
1.38.571.139 I slot print_timing: id 3 | task 2241 | graphs reused = 2359
1.38.571.206 I slot release: id 3 | task 2241 | stop processing: n_tokens = 1097, truncated = 0
1.38.571.215 I srv update_slots: all slots are idle
1.38.595.813 I srv operator(): Chat format: peg-native
1.38.614.826 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.815 (> 0.100 thold), f_keep = 0.806
1.38.615.893 I slot launch_slot_: id 3 | task 2459 | processing task, is_child = 0
1.38.615.895 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.38.615.896 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.38.615.916 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.38.615.917 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.38.615.932 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.38.615.933 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.39.465.579 I slot create_check: id 3 | task 2459 | created context checkpoint 3 of 32 (pos_min = 225, pos_max = 1043, n_tokens = 1044, size = 4.502 MiB)
1.42.893.214 I slot print_timing: id 3 | task 2459 | n_decoded = 185, tg = 61.45 t/s, tg_3s = 61.45 t/s
1.45.895.575 I slot print_timing: id 3 | task 2459 | n_decoded = 367, tg = 61.03 t/s, tg_3s = 60.62 t/s
1.47.625.633 I slot print_timing: id 3 | task 2459 | prompt eval time = 1266.53 ms / 200 tokens ( 6.33 ms per token, 157.91 tokens per second)
1.47.625.637 I slot print_timing: id 3 | task 2459 | eval time = 7743.15 ms / 472 tokens ( 16.40 ms per token, 60.96 tokens per second)
1.47.625.637 I slot print_timing: id 3 | task 2459 | total time = 9009.68 ms / 672 tokens
1.47.625.638 I slot print_timing: id 3 | task 2459 | graphs reused = 2827
1.47.625.705 I slot release: id 3 | task 2459 | stop processing: n_tokens = 1555, truncated = 0
1.47.625.714 I srv update_slots: all slots are idle
1.47.654.453 I srv operator(): Chat format: peg-native
1.47.675.210 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.964 (> 0.100 thold), f_keep = 0.698
1.47.676.006 I slot launch_slot_: id 3 | task 2934 | processing task, is_child = 0
1.47.676.008 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.47.676.008 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.47.676.031 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.47.676.032 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.47.676.048 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.47.676.048 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.51.057.405 I slot print_timing: id 3 | task 2934 | n_decoded = 184, tg = 61.22 t/s, tg_3s = 61.22 t/s
1.51.453.408 I slot print_timing: id 3 | task 2934 | prompt eval time = 375.82 ms / 41 tokens ( 9.17 ms per token, 109.10 tokens per second)
1.51.453.411 I slot print_timing: id 3 | task 2934 | eval time = 3401.52 ms / 208 tokens ( 16.35 ms per token, 61.15 tokens per second)
1.51.453.412 I slot print_timing: id 3 | task 2934 | total time = 3777.34 ms / 249 tokens
1.51.453.413 I slot print_timing: id 3 | task 2934 | graphs reused = 3032
1.51.453.502 I slot release: id 3 | task 2934 | stop processing: n_tokens = 1333, truncated = 0
1.51.453.515 I srv update_slots: all slots are idle
1.51.486.169 I srv operator(): Chat format: peg-native
1.51.513.901 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.864 (> 0.100 thold), f_keep = 0.845
1.51.514.926 I slot launch_slot_: id 3 | task 3145 | processing task, is_child = 0
1.51.514.928 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.51.514.928 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.51.514.951 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.51.514.951 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.51.514.969 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.51.514.969 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.52.945.361 I slot print_timing: id 3 | task 3145 | prompt eval time = 962.85 ms / 177 tokens ( 5.44 ms per token, 183.83 tokens per second)
1.52.945.364 I slot print_timing: id 3 | task 3145 | eval time = 467.52 ms / 29 tokens ( 16.12 ms per token, 62.03 tokens per second)
1.52.945.364 I slot print_timing: id 3 | task 3145 | total time = 1430.36 ms / 206 tokens
1.52.945.365 I slot print_timing: id 3 | task 3145 | graphs reused = 3059
1.52.945.445 I slot release: id 3 | task 3145 | stop processing: n_tokens = 1332, truncated = 0
1.52.945.454 I srv update_slots: all slots are idle
1.53.001.260 I srv operator(): Chat format: peg-native
1.53.034.126 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.967 (> 0.100 thold), f_keep = 0.980
1.53.035.040 I slot launch_slot_: id 3 | task 3177 | processing task, is_child = 0
1.53.035.042 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.53.035.043 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.53.035.067 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.53.035.068 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.53.035.085 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.53.035.085 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.53.204.821 I slot create_check: id 3 | task 3177 | created context checkpoint 4 of 32 (pos_min = 531, pos_max = 1320, n_tokens = 1321, size = 4.502 MiB)
1.54.258.393 I slot print_timing: id 3 | task 3177 | prompt eval time = 425.04 ms / 44 tokens ( 9.66 ms per token, 103.52 tokens per second)
1.54.258.396 I slot print_timing: id 3 | task 3177 | eval time = 798.24 ms / 49 tokens ( 16.29 ms per token, 61.39 tokens per second)
1.54.258.397 I slot print_timing: id 3 | task 3177 | total time = 1223.28 ms / 93 tokens
1.54.258.397 I slot print_timing: id 3 | task 3177 | graphs reused = 3106
1.54.258.481 I slot release: id 3 | task 3177 | stop processing: n_tokens = 1397, truncated = 0
1.54.258.490 I srv update_slots: all slots are idle
1.54.282.760 I srv operator(): Chat format: peg-native
1.54.287.488 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.766 (> 0.100 thold), f_keep = 0.258
1.54.287.490 I srv get_availabl: updating prompt cache
1.54.287.591 W srv prompt_save: - saving prompt with length 1397, total state size = 53.632 MiB (draft: 0.000 MiB)
1.54.340.873 I srv load: - looking for better prompt, base f_keep = 0.258, sim = 0.766
1.54.340.882 I srv update: - cache state: 4 prompts, 208.482 MiB (limits: 8192.000 MiB, 32768 tokens, 157488 est)
1.54.340.883 I srv update: - prompt 0x5da9ea1fbe30: 1073 tokens, checkpoints: 3, 55.743 MiB
1.54.340.883 I srv update: - prompt 0x5da9ea195b40: 801 tokens, checkpoints: 2, 41.675 MiB
1.54.340.884 I srv update: - prompt 0x5da9ea45de90: 737 tokens, checkpoints: 2, 39.425 MiB
1.54.340.884 I srv update: - prompt 0x5da9ea099f30: 1397 tokens, checkpoints: 4, 71.639 MiB
1.54.340.885 I srv get_availabl: prompt cache update took 53.40 ms
1.54.341.823 I slot launch_slot_: id 3 | task 3229 | processing task, is_child = 0
1.54.341.826 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
1.54.341.827 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
1.54.341.852 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
1.54.341.853 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
1.54.341.878 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
1.54.341.878 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
1.54.341.912 I slot update_slots: id 3 | task 3229 | Checking checkpoint with [531, 1320] against 232...
1.54.341.914 I slot update_slots: id 3 | task 3229 | Checking checkpoint with [225, 1043] against 232...
1.54.341.914 I slot update_slots: id 3 | task 3229 | Checking checkpoint with [225, 635] against 232...
1.54.341.915 I slot update_slots: id 3 | task 3229 | Checking checkpoint with [0, 352] against 232...
1.54.344.628 W slot update_slots: id 3 | task 3229 | restored context checkpoint (pos_min = 0, pos_max = 352, n_tokens = 353, n_past = 352, size = 4.502 MiB)
1.54.344.631 W slot update_slots: id 3 | task 3229 | erased invalidated context checkpoint (pos_min = 225, pos_max = 635, n_tokens = 636, n_swa = 128, pos_next = 352, size = 4.502 MiB)
1.54.344.634 W slot update_slots: id 3 | task 3229 | erased invalidated context checkpoint (pos_min = 225, pos_max = 1043, n_tokens = 1044, n_swa = 128, pos_next = 352, size = 4.502 MiB)
1.54.344.635 W slot update_slots: id 3 | task 3229 | erased invalidated context checkpoint (pos_min = 531, pos_max = 1320, n_tokens = 1321, n_swa = 128, pos_next = 352, size = 4.502 MiB)
1.58.198.426 I slot print_timing: id 3 | task 3229 | n_decoded = 188, tg = 62.43 t/s, tg_3s = 62.43 t/s
2.00.244.218 I slot print_timing: id 3 | task 3229 | prompt eval time = 845.16 ms / 118 tokens ( 7.16 ms per token, 139.62 tokens per second)
2.00.244.221 I slot print_timing: id 3 | task 3229 | eval time = 5057.14 ms / 315 tokens ( 16.05 ms per token, 62.29 tokens per second)
2.00.244.222 I slot print_timing: id 3 | task 3229 | total time = 5902.30 ms / 433 tokens
2.00.244.222 I slot print_timing: id 3 | task 3229 | graphs reused = 3415
2.00.244.276 I slot release: id 3 | task 3229 | stop processing: n_tokens = 784, truncated = 0
2.00.244.286 I srv update_slots: all slots are idle
2.00.260.802 I srv operator(): Chat format: peg-native
2.00.270.575 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.612 (> 0.100 thold), f_keep = 0.601
2.00.271.679 I slot launch_slot_: id 3 | task 3547 | processing task, is_child = 0
2.00.271.681 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
2.00.271.682 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
2.00.271.709 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
2.00.271.709 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
2.00.271.731 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
2.00.271.731 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
2.01.371.200 I slot create_check: id 3 | task 3547 | created context checkpoint 2 of 32 (pos_min = 225, pos_max = 751, n_tokens = 752, size = 4.502 MiB)
2.02.221.167 I slot print_timing: id 3 | task 3547 | prompt eval time = 1281.20 ms / 299 tokens ( 4.28 ms per token, 233.37 tokens per second)
2.02.221.171 I slot print_timing: id 3 | task 3547 | eval time = 668.20 ms / 42 tokens ( 15.91 ms per token, 62.86 tokens per second)
2.02.221.171 I slot print_timing: id 3 | task 3547 | total time = 1949.40 ms / 341 tokens
2.02.221.172 I slot print_timing: id 3 | task 3547 | graphs reused = 3455
2.02.221.237 I slot release: id 3 | task 3547 | stop processing: n_tokens = 811, truncated = 0
2.02.221.244 I srv update_slots: all slots are idle
2.02.253.324 I srv operator(): Chat format: peg-native
2.02.265.973 I slot get_availabl: id 3 | task -1 | selected slot by LCP similarity, sim_best = 0.948 (> 0.100 thold), f_keep = 0.951
2.02.266.811 I slot launch_slot_: id 3 | task 3592 | processing task, is_child = 0
2.02.266.812 I slot process_sing: id 0 | task -1 | saving idle slot to prompt cache
2.02.266.813 I slot prompt_clear: id 0 | task -1 | clearing prompt with 0 tokens
2.02.266.834 I slot process_sing: id 1 | task -1 | saving idle slot to prompt cache
2.02.266.835 I slot prompt_clear: id 1 | task -1 | clearing prompt with 0 tokens
2.02.266.850 I slot process_sing: id 2 | task -1 | saving idle slot to prompt cache
2.02.266.851 I slot prompt_clear: id 2 | task -1 | clearing prompt with 0 tokens
2.03.424.633 I slot print_timing: id 3 | task 3592 | prompt eval time = 337.11 ms / 42 tokens ( 8.03 ms per token, 124.59 tokens per second)
2.03.424.638 I slot print_timing: id 3 | task 3592 | eval time = 820.64 ms / 51 tokens ( 16.09 ms per token, 62.15 tokens per second)
2.03.424.638 I slot print_timing: id 3 | task 3592 | total time = 1157.76 ms / 93 tokens
2.03.424.639 I slot print_timing: id 3 | task 3592 | graphs reused = 3504
2.03.424.715 I slot release: id 3 | task 3592 | stop processing: n_tokens = 863, truncated = 0
2.03.424.722 I srv update_slots: all slots are idle
2.03.441.744 I srv operator(): operator(): cleaning up before exit...
Reference in New Issue Copy Permalink