updted benchmarks
This commit is contained in:
@@ -1,8 +1,23 @@
|
||||
ggml_vulkan: Found 1 Vulkan devices:
|
||||
ggml_vulkan: 0 = Radeon 8060S Graphics (AMD open-source driver) | uma: 1 | fp16: 1 | bf16: 0 | warp size: 64 | shared memory: 32768 | int dot: 1 | matrix cores: KHR_coopmat
|
||||
| model | size | params | backend | ngl | fa | test | t/s |
|
||||
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
|
||||
| mistral3 14B BF16 | 25.16 GiB | 13.51 B | Vulkan | 99 | 1 | pp512 | 19.70 ± 0.00 |
|
||||
| mistral3 14B BF16 | 25.16 GiB | 13.51 B | Vulkan | 99 | 1 | tg128 | 8.24 ± 0.00 |
|
||||
|
||||
build: e0c93af2a (7938)
|
||||
/lib64/libggml-base.so.0(+0x3c25) [0x7f9947881c25]
|
||||
/lib64/libggml-base.so.0(ggml_print_backtrace+0x1eb) [0x7f9947881feb]
|
||||
/lib64/libggml-base.so.0(+0x16669) [0x7f9947894669]
|
||||
/lib64/libstdc++.so.6(+0x1ebfc) [0x7f9946ff8bfc]
|
||||
/lib64/libstdc++.so.6(_ZSt10unexpectedv+0x0) [0x7f9946fe2d3a]
|
||||
/lib64/libstdc++.so.6(+0x1eea8) [0x7f9946ff8ea8]
|
||||
/lib64/libggml-vulkan.so.0(+0x16b68) [0x7f994793eb68]
|
||||
/lib64/libggml-vulkan.so.0(+0xfcfd0) [0x7f9947a24fd0]
|
||||
/lib64/libggml-base.so.0(ggml_backend_sched_graph_compute_async+0x3b2) [0x7f994789d092]
|
||||
/lib64/libllama.so.0(_ZN13llama_context13graph_computeEP11ggml_cgraphb+0xa0) [0x7f994b1b2e70]
|
||||
/lib64/libllama.so.0(_ZN13llama_context14process_ubatchERK12llama_ubatch14llm_graph_typeP22llama_memory_context_iR11ggml_status+0xe5) [0x7f994b1b5445]
|
||||
/lib64/libllama.so.0(_ZN13llama_context6decodeERK11llama_batch+0x35f) [0x7f994b1bbaaf]
|
||||
/lib64/libllama.so.0(llama_decode+0xe) [0x7f994b1bd42e]
|
||||
/usr/sbin/llama-bench() [0x41cc3b]
|
||||
/usr/sbin/llama-bench() [0x419a10]
|
||||
/lib64/libc.so.6(+0x35b5) [0x7f9946cc95b5]
|
||||
/lib64/libc.so.6(__libc_start_main+0x88) [0x7f9946cc9668]
|
||||
/usr/sbin/llama-bench() [0x41b595]
|
||||
terminate called after throwing an instance of 'vk::DeviceLostError'
|
||||
what(): vk::Queue::submit: ErrorDeviceLost
|
||||
✖ ! [vulkan_amdvlk] Ministral-3-14B-Instruct-2512-BF16__fa1 failed (exit 0)
|
||||
|
||||
Reference in New Issue
Block a user