julian/amd-strix-halo-toolboxes
1
0
Fork 0
Code Issues Pull Requests 2 Actions Packages Projects Releases Wiki Activity

archvied old multi-node benchmarks

Browse Source
This commit is contained in:
Donato Capitella
2026-04-11 11:20:30 +01:00
parent 7aa6e6dea9
commit d74db71362
33 changed files with 1 additions and 1549 deletions
Download Patch File Download Diff File Expand all files Collapse all files
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__rocm-7_2__hblt0__longctx32768__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | n_ubatch | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | -: | --------------: | -------------------: |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 2048 | 1 | pp2048 @ d32768 | 18.17 ± 0.00 |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 2048 | 1 | tg32 @ d32768 | 3.73 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__rocm-7_2__hblt0__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 1 | pp512 | 97.96 ± 0.29 |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 1 | tg128 | 9.09 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__rocm-7_2__longctx32768__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | n_ubatch | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | -: | --------------: | -------------------: |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 2048 | 1 | pp2048 @ d32768 | 17.22 ± 0.00 |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 2048 | 1 | tg32 @ d32768 | 3.72 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__rocm-7_2__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 1 | pp512 | 73.57 ± 0.23 |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 1 | tg128 | 9.02 ± 0.01 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__rocm6_4_4__hblt0__longctx32768__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | n_ubatch | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | -: | --------------: | -------------------: |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 2048 | 1 | pp2048 @ d32768 | 18.79 ± 0.00 |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 2048 | 1 | tg32 @ d32768 | 4.13 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__rocm6_4_4__hblt0__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 1 | pp512 | 99.24 ± 0.14 |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 1 | tg128 | 8.55 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__rocm6_4_4__longctx32768__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | n_ubatch | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | -: | --------------: | -------------------: |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 2048 | 1 | pp2048 @ d32768 | 18.80 ± 0.00 |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 2048 | 1 | tg32 @ d32768 | 4.10 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__rocm6_4_4__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 1 | pp512 | 99.22 ± 0.25 |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 1 | tg128 | 8.55 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__rocm7-nightlies__hblt0__longctx32768__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | n_ubatch | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | -: | --------------: | -------------------: |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 2048 | 1 | pp2048 @ d32768 | 18.35 ± 0.00 |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 2048 | 1 | tg32 @ d32768 | 3.69 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__rocm7-nightlies__hblt0__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 1 | pp512 | 99.58 ± 0.65 |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 1 | tg128 | 9.04 ± 0.01 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__rocm7-nightlies__longctx32768__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | n_ubatch | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | -: | --------------: | -------------------: |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 2048 | 1 | pp2048 @ d32768 | 17.17 ± 0.00 |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 2048 | 1 | tg32 @ d32768 | 3.67 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__rocm7-nightlies__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 1 | pp512 | 72.73 ± 0.53 |
| glm4moe 355B.A32B Q4_K - Medium | 189.69 GiB | 356.79 B | ROCm,RPC | 99 | 1 | tg128 | 9.05 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__vulkan_amdvlk__longctx32768__rpc.log
+3
View File
@@ -0,0 +1,3 @@
ggml_vulkan: Found 1 Vulkan devices:
ggml_vulkan: 0 = Radeon 8060S Graphics (AMD open-source driver) | uma: 1 | fp16: 1 | bf16: 0 | warp size: 64 | shared memory: 32768 | int dot: 1 | matrix cores: KHR_coopmat
Failed to connect to 192.168.100.2:50052
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__vulkan_amdvlk__rpc.log
+19
View File
@@ -0,0 +1,19 @@
ggml_vulkan: Found 1 Vulkan devices:
ggml_vulkan: 0 = Radeon 8060S Graphics (AMD open-source driver) | uma: 1 | fp16: 1 | bf16: 0 | warp size: 64 | shared memory: 32768 | int dot: 1 | matrix cores: KHR_coopmat
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
/opt/llama.cpp/ggml/src/ggml-rpc/ggml-rpc.cpp:724: Remote RPC server crashed or returned malformed response
/lib64/libggml-base.so.0(+0x35a5) [0x7f14eecbd5a5]
/lib64/libggml-base.so.0(ggml_print_backtrace+0x1eb) [0x7f14eecbd96b]
/lib64/libggml-base.so.0(ggml_abort+0x11f) [0x7f14eecbdaef]
/lib64/libggml-rpc.so.0(+0x5b4a) [0x7f14f2311b4a]
/lib64/libggml-base.so.0(+0x174f2) [0x7f14eecd14f2]
/lib64/libggml-base.so.0(+0x177df) [0x7f14eecd17df]
/lib64/libggml-base.so.0(ggml_backend_alloc_ctx_tensors_from_buft+0x19) [0x7f14eecd2849]
/lib64/libllama.so.0(_ZN11llama_model12load_tensorsER18llama_model_loader+0x3c41) [0x7f14f257dbe1]
/lib64/libllama.so.0(+0x279e8) [0x7f14f24c79e8]
/lib64/libllama.so.0(llama_model_load_from_file+0xac) [0x7f14f24c884c]
/usr/sbin/llama-bench() [0x407fbd]
/lib64/libc.so.6(+0x35b5) [0x7f14ee1055b5]
/lib64/libc.so.6(__libc_start_main+0x88) [0x7f14ee105668]
/usr/sbin/llama-bench() [0x40a7b5]
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__vulkan_radv__longctx32768__rpc.log
+1
View File
@@ -0,0 +1 @@
Error: failed to start container llama-vulkan-radv
benchmark/results-rpc/29-30-2026/GLM-4.6-UD-Q4_K_XL-00001-of-00005__vulkan_radv__rpc.log
+1
View File
@@ -0,0 +1 @@
Error: failed to start container llama-vulkan-radv
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__rocm-7_2__hblt0__longctx32768__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | n_ubatch | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | -: | --------------: | -------------------: |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 2048 | 1 | pp2048 @ d32768 | 58.89 ± 0.00 |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 2048 | 1 | tg32 @ d32768 | 5.92 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__rocm-7_2__hblt0__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 1 | pp512 | 158.25 ± 0.52 |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 1 | tg128 | 19.04 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__rocm-7_2__longctx32768__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | n_ubatch | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | -: | --------------: | -------------------: |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 2048 | 1 | pp2048 @ d32768 | 59.95 ± 0.00 |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 2048 | 1 | tg32 @ d32768 | 5.91 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__rocm-7_2__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 1 | pp512 | 159.79 ± 0.35 |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 1 | tg128 | 19.05 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__rocm6_4_4__hblt0__longctx32768__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | n_ubatch | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | -: | --------------: | -------------------: |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 2048 | 1 | pp2048 @ d32768 | 64.41 ± 0.00 |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 2048 | 1 | tg32 @ d32768 | 6.41 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__rocm6_4_4__hblt0__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 1 | pp512 | 169.30 ± 0.95 |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 1 | tg128 | 18.93 ± 0.01 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__rocm6_4_4__longctx32768__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | n_ubatch | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | -: | --------------: | -------------------: |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 2048 | 1 | pp2048 @ d32768 | 65.69 ± 0.00 |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 2048 | 1 | tg32 @ d32768 | 6.47 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__rocm6_4_4__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 1 | pp512 | 169.50 ± 1.04 |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 1 | tg128 | 18.89 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__rocm7-nightlies__hblt0__longctx32768__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | n_ubatch | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | -: | --------------: | -------------------: |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 2048 | 1 | pp2048 @ d32768 | 60.88 ± 0.00 |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 2048 | 1 | tg32 @ d32768 | 6.10 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__rocm7-nightlies__hblt0__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 1 | pp512 | 171.03 ± 0.56 |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 1 | tg128 | 18.98 ± 0.02 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__rocm7-nightlies__longctx32768__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | n_ubatch | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -------: | -: | --------------: | -------------------: |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 2048 | 1 | pp2048 @ d32768 | 60.78 ± 0.00 |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 2048 | 1 | tg32 @ d32768 | 6.10 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__rocm7-nightlies__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_cuda_init: found 1 ROCm devices:
Device 0: Radeon 8060S Graphics, gfx1151 (0x1151), VMM: no, Wave Size: 32
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 1 | pp512 | 173.91 ± 0.29 |
| minimax-m2 230B.A10B Q6_K | 180.94 GiB | 228.69 B | ROCm,RPC | 99 | 1 | tg128 | 19.05 ± 0.00 |
build: e0c93af2a (7938)
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__vulkan_amdvlk__longctx32768__rpc.log
+8
View File
@@ -0,0 +1,8 @@
ggml_vulkan: Found 1 Vulkan devices:
ggml_vulkan: 0 = Radeon 8060S Graphics (AMD open-source driver) | uma: 1 | fp16: 1 | bf16: 0 | warp size: 64 | shared memory: 32768 | int dot: 1 | matrix cores: KHR_coopmat
Failed to connect to 192.168.100.2:50052
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
ggml_vulkan: Device memory allocation of size 990904320 failed.
ggml_vulkan: vk::Device::allocateMemory: ErrorOutOfHostMemory
main: error: failed to load model '/mnt/storage/MiniMax-M2-GGUF/UD-Q6_K_XL/MiniMax-M2-UD-Q6_K_XL-00001-of-00004.gguf'
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__vulkan_amdvlk__rpc.log
+19
View File
@@ -0,0 +1,19 @@
ggml_vulkan: Found 1 Vulkan devices:
ggml_vulkan: 0 = Radeon 8060S Graphics (AMD open-source driver) | uma: 1 | fp16: 1 | bf16: 0 | warp size: 64 | shared memory: 32768 | int dot: 1 | matrix cores: KHR_coopmat
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
/opt/llama.cpp/ggml/src/ggml-rpc/ggml-rpc.cpp:724: Remote RPC server crashed or returned malformed response
/lib64/libggml-base.so.0(+0x35a5) [0x7f12de48e5a5]
/lib64/libggml-base.so.0(ggml_print_backtrace+0x1eb) [0x7f12de48e96b]
/lib64/libggml-base.so.0(ggml_abort+0x11f) [0x7f12de48eaef]
/lib64/libggml-rpc.so.0(+0x5b4a) [0x7f12e1ae2b4a]
/lib64/libggml-base.so.0(+0x174f2) [0x7f12de4a24f2]
/lib64/libggml-base.so.0(+0x177df) [0x7f12de4a27df]
/lib64/libggml-base.so.0(ggml_backend_alloc_ctx_tensors_from_buft+0x19) [0x7f12de4a3849]
/lib64/libllama.so.0(_ZN11llama_model12load_tensorsER18llama_model_loader+0x3c41) [0x7f12e1d4ebe1]
/lib64/libllama.so.0(+0x279e8) [0x7f12e1c989e8]
/lib64/libllama.so.0(llama_model_load_from_file+0xac) [0x7f12e1c9984c]
/usr/sbin/llama-bench() [0x407fbd]
/lib64/libc.so.6(+0x35b5) [0x7f12dd8d65b5]
/lib64/libc.so.6(__libc_start_main+0x88) [0x7f12dd8d6668]
/usr/sbin/llama-bench() [0x40a7b5]
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__vulkan_radv__longctx32768__rpc.log
+15
View File
@@ -0,0 +1,15 @@
ggml_vulkan: Found 1 Vulkan devices:
ggml_vulkan: 0 = Radeon 8060S Graphics (RADV GFX1151) (radv) | uma: 1 | fp16: 1 | bf16: 0 | warp size: 64 | shared memory: 65536 | int dot: 1 | matrix cores: KHR_coopmat
Failed to connect to 192.168.100.2:50052
radv/amdgpu: Failed to allocate a buffer:
radv/amdgpu: size : 990904320 bytes
radv/amdgpu: alignment : 262144 bytes
radv/amdgpu: domains : 4
radv/amdgpu: Failed to allocate a buffer:
radv/amdgpu: size : 990904320 bytes
radv/amdgpu: alignment : 262144 bytes
radv/amdgpu: domains : 4
radv/amdgpu: Failed to allocate a buffer:
radv/amdgpu: size : 990904320 bytes
radv/amdgpu: alignment : 262144 bytes
radv/amdgpu: domains : 4
benchmark/results-rpc/29-30-2026/MiniMax-M2-UD-Q6_K_XL-00001-of-00004__vulkan_radv__rpc.log
+19
View File
@@ -0,0 +1,19 @@
ggml_vulkan: Found 1 Vulkan devices:
ggml_vulkan: 0 = Radeon 8060S Graphics (RADV GFX1151) (radv) | uma: 1 | fp16: 1 | bf16: 0 | warp size: 64 | shared memory: 65536 | int dot: 1 | matrix cores: KHR_coopmat
| model | size | params | backend | ngl | fa | test | t/s |
| ------------------------------ | ---------: | ---------: | ---------- | --: | -: | --------------: | -------------------: |
/opt/llama.cpp/ggml/src/ggml-rpc/ggml-rpc.cpp:724: Remote RPC server crashed or returned malformed response
/lib64/libggml-base.so.0(+0x35a5) [0x7f62e4d465a5]
/lib64/libggml-base.so.0(ggml_print_backtrace+0x1eb) [0x7f62e4d4696b]
/lib64/libggml-base.so.0(ggml_abort+0x11f) [0x7f62e4d46aef]
/lib64/libggml-rpc.so.0(+0x5b4a) [0x7f62e839ab4a]
/lib64/libggml-base.so.0(+0x174f2) [0x7f62e4d5a4f2]
/lib64/libggml-base.so.0(+0x177df) [0x7f62e4d5a7df]
/lib64/libggml-base.so.0(ggml_backend_alloc_ctx_tensors_from_buft+0x19) [0x7f62e4d5b849]
/lib64/libllama.so.0(_ZN11llama_model12load_tensorsER18llama_model_loader+0x3c41) [0x7f62e8631be1]
/lib64/libllama.so.0(+0x279e8) [0x7f62e857b9e8]
/lib64/libllama.so.0(llama_model_load_from_file+0xac) [0x7f62e857c84c]
/usr/sbin/llama-bench() [0x407fbd]
/lib64/libc.so.6(+0x35b5) [0x7f62e418e5b5]
/lib64/libc.so.6(__libc_start_main+0x88) [0x7f62e418e668]
/usr/sbin/llama-bench() [0x40a7b5]