Loop id | Source Location | Source Function | Level | Max Thread Time / Walltime armclang_3 (%) | Exclusive Coverage armclang_3 (%) | Inclusive Coverage armclang_3 (%) | Max Exclusive Time Over Threads armclang_3 (s) | Max Inclusive Time Over Threads armclang_3 (s) | Exclusive Time w.r.t. Wall Time armclang_3 (s) | Inclusive Time w.r.t. Wall Time armclang_3 (s) | Nb Threads armclang_3 | Vectorization Ratio (%) | Vector Length Use (%) | Speedup If No Scalar Integer | Speedup If FP Vectorized | Speedup If Fully Vectorized | Speedup If Perfect Load Balancing armclang_3 | Stride 0 | Stride 1 | Stride n | Stride Unknown | Stride Indirect | Array Access Efficiency |
---|
379 | libggml-cpu.so - quants.c:322-329 [...] | ggml_vec_dot_q8_0_q8_0 | Single | 68.97 | 70.86 | 70.86 | 8.47 | 8.47 | 8.18 | 8.18 | 96 | 38.46 | 53.85 | 1.06 | 2.13 | 1.48 | 1.06 | 0 | 0 | 0 | 0 | 0 | 0.00 |
72 | libggml-cpu.so - ggml-cpu.c:533-2897 [...] | ggml_graph_compute_thread | Innermost | 1.14 | 0.51 | 0.51 | 0.14 | 0.14 | 0.06 | 0.06 | 80 | 0 | 50 | 1 | 1 | 1.08 | 2.04 | NA | NA | NA | NA | NA | 0.00 |
73 | libggml-cpu.so - ggml-cpu.c:533-2897 [...] | ggml_graph_compute_thread | Outermost | 1.02 | 0.34 | 0.85 | 0.13 | 0.26 | 0.04 | 0.10 | 94 | 0 | 41.07 | 1 | 1 | 4 | 3.16 | NA | NA | NA | NA | NA | 0.00 |
908 | libggml-cpu.so - vec.cpp:311-316 | ggml_vec_dot_f16 | Single | 1.26 | 0.30 | 0.30 | 0.16 | 0.16 | 0.03 | 0.03 | 32 | 100 | 100 | 1 | 1 | 1 | 1.51 | 2 | 0 | 0 | 0 | 0 | 100.00 |
56 | libggml-cpu.so - ggml-cpu.c:1125-1395 [...] | ggml_compute_forward_mul_mat | InBetween | 0.57 | 0.26 | 0.41 | 0.07 | 0.10 | 0.03 | 0.05 | 96 | 0 | 50.29 | 1 | 1 | 1.27 | 2.39 | NA | NA | NA | NA | NA | 0.00 |
1896 | libggml-cpu.so - ops.cpp:8793-8881 [...] | ggml_compute_forward_flash_attn_ext | InBetween | 0.73 | 0.17 | 0.30 | 0.09 | 0.18 | 0.02 | 0.04 | 32 | 8.42 | 38.16 | 2.26 | 2.5 | 1.18 | 1.6 | NA | NA | NA | NA | NA | 0.00 |
1908 | libggml-cpu.so - vec.h:491-497 | ggml_compute_forward_flash_attn_ext | Innermost | 0.69 | 0.14 | 0.14 | 0.09 | 0.09 | 0.02 | 0.02 | 32 | 100 | 100 | 1 | 1 | 1 | 1.83 | 2 | 0 | 0 | 0 | 0 | 100.00 |
53 | libggml-cpu.so - ggml-cpu.c:1183-1194 [...] | ggml_compute_forward_mul_mat | Innermost | 0.33 | 0.11 | 0.11 | 0.04 | 0.04 | 0.01 | 0.01 | 87 | 0 | 52.17 | 1 | 1 | 1.7 | 2.91 | 1 | 0 | 0 | 0 | 0 | 100.00 |
419 | libggml-base.so - ggml-impl.h:355-404 [...] | quantize_row_q8_0_ref | Innermost | 0.29 | 0.10 | 0.10 | 0.04 | 0.04 | 0.01 | 0.01 | 89 | 23.17 | 42 | 2.67 | 1 | 1.83 | 2.84 | NA | NA | NA | NA | NA | 0.00 |
1596 | libggml-cpu.so - ops.cpp:6220-6245 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Innermost | 0.20 | 0.07 | 0.07 | 0.03 | 0.03 | 0.01 | 0.01 | 82 | 27.27 | 36.36 | 1 | 1.88 | 3.05 | 2.66 | 2 | 0 | 0 | 1 | 0 | 83.33 |
54 | libggml-cpu.so - ggml-cpu.c:1125-1395 [...] | ggml_compute_forward_mul_mat | Innermost | 0.16 | 0.04 | 0.04 | 0.02 | 0.02 | 0.00 | 0.00 | 63 | 0 | 55 | 1 | 1 | 1 | 2.71 | NA | NA | NA | NA | NA | 0.00 |
916 | libggml-cpu.so - vec.h:1045-1072 [...] | ggml_vec_swiglu_f32 | Innermost | 1.95 | 0.02 | 0.02 | 0.24 | 0.24 | 0.00 | 0.00 | 2 | 83.33 | 91.67 | 1.04 | 1 | 1 | 1.96 | NA | NA | NA | NA | NA | 0.00 |
1591 | libggml-cpu.so - ops.cpp:6446-6456 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Innermost | 0.12 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 15 | 66.67 | 47.22 | 1.07 | 1.58 | 2.31 | 2.25 | 0 | 1 | 0 | 2 | 0 | 66.67 |
437 | libggml-cpu.so - binary-ops.cpp:10-32 [...] | ggml_compute_forward_add_non_quantized | Innermost | 0.81 | 0.01 | 0.01 | 0.10 | 0.10 | 0.00 | 0.00 | 1 | 0 | 30 | 1 | 1 | 4 | 1 | 0 | 0 | 0 | 3 | 0 | 50.00 |
58 | libggml-cpu.so - ggml-cpu.c:1289-1297 | ggml_compute_forward_mul_mat | Innermost | 0.04 | 0.01 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 19 | 0 | 50 | 1 | 1 | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 75.00 |
541 | libggml-cpu.so - binary-ops.cpp:18-32 [...] | ggml_compute_forward_mul | Innermost | 0.77 | 0.01 | 0.01 | 0.10 | 0.10 | 0.00 | 0.00 | 1 | 0 | 28.95 | 1 | 1 | 4 | 1 | 0 | 0 | 0 | 3 | 0 | 50.00 |
0 | libggml-cpu.so - ggml-cpu.c:3228-3229 [...] | ggml_cpu_fp32_to_fp16 | Single | 0.29 | 0.01 | 0.01 | 0.04 | 0.04 | 0.00 | 0.00 | 11 | 97.22 | 98.61 | 1 | 1 | 1 | 4.28 | 2 | 0 | 0 | 0 | 0 | 100.00 |
1587 | libggml-cpu.so - ops.cpp:6210-6462 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | InBetween | 0.04 | 0.01 | 0.08 | 0.01 | 0.03 | 0.00 | 0.01 | 15 | 6.58 | 52.3 | 5.92 | 1.7 | 1.35 | 1 | NA | NA | NA | NA | NA | 0.00 |
1588 | libggml-cpu.so - ops.cpp:6210-6484 [...] | ggml_compute_forward_rope_f32(ggml_compute_params const*, ggml_tensor*, bool) | Outermost | 0.04 | 0.01 | 0.09 | 0.01 | 0.03 | 0.00 | 0.01 | 11 | 0 | 43.5 | 1 | 1 | 2.74 | 1 | NA | NA | NA | NA | NA | 0.00 |
417 | libggml-base.so - ggml-quants.c:203-219 [...] | quantize_row_q8_0_ref | Outermost | 0.08 | 0.00 | 0.13 | 0.01 | 0.04 | 0.00 | 0.01 | 9 | 0 | 25 | 1 | 1 | 4 | 1.8 | NA | NA | NA | NA | NA | 0.00 |
3346 | exec - sampling.cpp:125-126 | common_sampler::set_logits(llama_context*, int) | Single | 0.29 | 0.00 | 0.00 | 0.04 | 0.04 | 0.00 | 0.00 | 1 | 75 | 87.5 | 1 | 1 | 1.1 | 1 | 0 | 1 | 0 | 1 | 0 | 75.00 |
407 | libggml-cpu.so - traits.cpp:13-17 [...] | ggml_cpu_extra_compute_forward | Single | 0.04 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 6 | 0 | 50 | 1 | 1 | 2 | 1 | 0 | 1 | 0 | 2 | 0 | 74.38 |
1893 | libggml-cpu.so - vec.h:375-751 [...] | ggml_compute_forward_flash_attn_ext | InBetween | 0.04 | 0.00 | 0.31 | 0.01 | 0.11 | 0.00 | 0.04 | 6 | 0 | 47.6 | 2.01 | 1.34 | 1.34 | 1 | NA | NA | NA | NA | NA | 0.00 |
445 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.02 | 0.01 | 0.01 | 0.00 | 0.00 | 5 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
449 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.02 | 0.01 | 0.01 | 0.00 | 0.00 | 5 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
429 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 5 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
1914 | libggml-cpu.so - vec.h:677-682 | ggml_compute_forward_flash_attn_ext | Innermost | 0.08 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 4 | 100 | 100 | 1 | 1 | 1 | 1.6 | 1 | 0 | 0 | 0 | 0 | 100.00 |
437 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.01 | 0.01 | 0.10 | 0.00 | 0.00 | 5 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
1354 | libggml-cpu.so - vec.h:677-682 | ggml_compute_forward_rms_norm | Innermost | 0.12 | 0.00 | 0.00 | 0.02 | 0.02 | 0.00 | 0.00 | 2 | 100 | 100 | 1 | 1 | 1 | 1.5 | 1 | 0 | 0 | 0 | 0 | 100.00 |
2502 | libllama.so - stl_heap.h:140-263 [...] | llama_token_data_array_partial_sort_inplace(llama_token_data_array*, int) | Outermost | 0.16 | 0.00 | 0.00 | 0.02 | 0.02 | 0.00 | 0.00 | 1 | 0 | 37.5 | 4.67 | 1 | 2.87 | 1 | NA | NA | NA | NA | NA | 0.00 |
1353 | libggml-cpu.so - ops.cpp:4325-4326 | ggml_compute_forward_rms_norm | Innermost | 0.16 | 0.00 | 0.00 | 0.02 | 0.02 | 0.00 | 0.00 | 1 | 91.67 | 87.5 | 1 | 1 | 1.11 | 1 | 0 | 1 | 0 | 0 | 0 | 100.00 |
443 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.01 | 0.00 | 0.01 | 0.00 | 0.00 | 3 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
1497 | libggml-cpu.so - ops.cpp:5352-5517 [...] | ggml_compute_forward_get_rows | Outermost | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 3 | 0 | 57.5 | 1 | 1 | 1 | 1 | NA | NA | NA | NA | NA | 0.00 |
436 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 3 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
95 | libggml-cpu.so - ggml-cpu.cpp:39-63 [...] | ggml_backend_cpu_get_extra_buffer_types() | Single | 0.04 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 3 | 0 | 62.5 | 1 | 1 | 1 | 1 | NA | NA | NA | NA | NA | 0.00 |
59 | libggml-cpu.so - ggml-cpu.c:1289-1297 | ggml_compute_forward_mul_mat | InBetween | 0.04 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 3 | 0 | 53.57 | 1 | 1 | 1.54 | 1 | 1 | 0 | 0 | 1 | 0 | 75.00 |
425 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 3 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
448 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.02 | 0.00 | 0.01 | 0.00 | 0.00 | 2 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
3373 | libllama.so - hashtable.h:2077-2077 [...] | std::_Hashtable<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const, unsigned char>, s... | Single | 0.08 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | 0 | 0 | 0 | 2 | 0 | 50.00 |
441 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 2 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
55 | libggml-cpu.so - ggml-cpu.c:1125-1395 [...] | ggml_compute_forward_mul_mat | Outermost | 0.04 | 0.00 | 0.41 | 0.01 | 0.07 | 0.00 | 0.05 | 2 | NA | NA | NA | NA | NA | 1 | NA | NA | NA | NA | NA | 0.00 |
60 | libggml-cpu.so - ggml-cpu.c:1289-1297 | ggml_compute_forward_mul_mat | Outermost | 0.04 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 2 | 0 | 50 | 1 | 1 | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 75.00 |
3084 | libllama.so - hashtable.h:2627-2644 [...] | std::_Hashtable<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::pair<std::pai... | Innermost | 0.08 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
433 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 2 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
431 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 2 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
1387 | exec - regex_executor.tcc:180-513 [...] | std::__detail::_Executor<__gnu_cxx::__normal_iterator<char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::allocator<std::__cxx11::sub_match<__gnu_cxx::__normal_iterator<ch... | Single | 0.08 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 1 | 0 | 35.31 | 1 | 1 | 7.38 | 1 | NA | NA | NA | NA | NA | 0.00 |
423 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.00 | 0.01 | 0.01 | 0.00 | 0.00 | 2 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
61 | libggml-cpu.so - ggml-cpu.c:2129-2860 [...] | ggml_graph_plan | Outermost | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 40.63 | 1 | 1 | 3.17 | 1 | NA | NA | NA | NA | NA | 0.00 |
3223 | libllama.so - new_allocator.h:172-172 [...] | llama_vocab::impl::~impl() | Single | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 45.83 | 1 | 1 | 1.7 | 1 | 0 | 0 | 0 | 1.5 | 0 | 50.00 |
435 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.01 | 0.00 | 0.01 | 0.00 | 0.00 | 1 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
3082 | libllama.so - hashtable.h:2074-2077 [...] | std::_Hashtable<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::pair<std::pai... | Single | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
432 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 1 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
447 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.02 | 0.00 | 0.01 | 0.00 | 0.00 | 1 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
1507 | libggml-cpu.so - ops.cpp:5311-5321 | ggml_compute_forward_get_rows | Single | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 54.17 | 1 | 1 | 2 | 1 | 3 | 0 | 0 | 2 | 1 | 66.67 |
2916 | libllama.so - new_allocator.h:172-172 [...] | llama_decode_text(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) | Single | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 40.44 | 1 | 1 | 4.39 | 1 | NA | NA | NA | NA | NA | 0.00 |
440 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.01 | 0.00 | 0.01 | 0.00 | 0.00 | 1 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
408 | libggml-cpu.so - traits.cpp:26-30 [...] | ggml_cpu_extra_work_size | Single | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 48.44 | 1 | 1 | 2.52 | 1 | 0 | 1 | 0 | 2 | 0 | 74.38 |
427 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.00 | 0.00 | 0.01 | 0.00 | 0.00 | 1 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
1074 | libggml-cpu.so - ops.cpp:711-713 | ggml_compute_forward_dup | Innermost | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | 1 | 0 | 0 | 1 | 0 | 75.00 |
1558 | libllama.so - llama-kv-cache.cpp:1239-1436 [...] | llama_kv_cache::set_input_kq_mask(ggml_tensor*, llama_ubatch const*, bool) const | Innermost | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 29.55 | 2.75 | 1 | 3.89 | 1 | NA | NA | NA | NA | NA | 0.00 |
446 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.02 | 0.00 | 0.01 | 0.00 | 0.00 | 1 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
1892 | libggml-cpu.so - ops.cpp:8885-8886 [...] | ggml_compute_forward_flash_attn_ext | Innermost | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 87.5 | 81.25 | 1 | 1 | 1 | 1 | 1 | 1 | 0 | 0 | 0 | 100.00 |
1355 | libggml-cpu.so - ops.cpp:4319-4338 [...] | ggml_compute_forward_rms_norm | InBetween | 0.04 | 0.00 | 0.00 | 0.00 | 0.04 | 0.00 | 0.00 | 1 | 8.35 | 51.92 | 1.82 | 1.24 | 1.48 | 1 | 0 | 0 | 0 | 2.33 | 0 | 50.00 |
434 | libggml-base.so - ggml-quants.c:203-212 [...] | quantize_row_q8_0_ref | InBetween | 0.04 | 0.00 | 0.01 | 0.01 | 0.01 | 0.00 | 0.00 | 1 | 0 | 25 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
3226 | libllama.so - new_allocator.h:172-172 [...] | std::_Hashtable<std::pair<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > >, std::pair<std::pai... | Single | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | NA | NA | NA | NA | NA | 0.00 |
2866 | libllama.so - char_traits.h:381-381 [...] | llama_vocab::impl::load(llama_model_loader&, LLM_KV const&) | Innermost | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 48.08 | 1 | 1 | 4 | 1 | NA | NA | NA | NA | NA | 0.00 |
1395 | libllama.so - ostream:578-673 [...] | gguf_kv_to_str[abi:cxx11](gguf_context const*, int) | Innermost | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 42.38 | 1 | 1 | 1 | 1 | NA | NA | NA | NA | NA | 0.00 |
2478 | libllama.so - llama-sampling.cpp:370-463 [...] | llama_sampler_chain_apply(llama_sampler*, llama_token_data_array*) | Single | 0.04 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 0.00 | 1 | 0 | 50 | 1 | 1 | 2 | 1 | 0 | 1 | 0 | 2 | 0 | 66.67 |