julian/amd-strix-halo-toolboxes
1
0
Fork 0
Code Issues Pull Requests 2 Actions Packages Projects Releases Wiki Activity

Benchmark and container updates

Browse Source
This commit is contained in:
Donato Capitella
2025-08-03 13:05:52 +01:00
parent e295685041
commit e7e27e6cf3
130 changed files with 12111 additions and 267 deletions
Download Patch File Download Diff File Expand all files Collapse all files
benchmark/run_loadtime_benchmark.log
+277
View File
@@ -0,0 +1,277 @@
Found 11 models to test with llama-cli (3 runs each)
▶ [rocm7_rc] gemma-3-12b-it-UD-Q8_K_XL (runs: 3)
→ log : loadtime_results/gemma-3-12b-it-UD-Q8_K_XL__rocm7_rc.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_rc] gemma-3-12b-it-UD-Q8_K_XL avg=3.861s over 3 runs
▶ [rocm7_beta] gemma-3-12b-it-UD-Q8_K_XL (runs: 3)
→ log : loadtime_results/gemma-3-12b-it-UD-Q8_K_XL__rocm7_beta.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_beta] gemma-3-12b-it-UD-Q8_K_XL avg=3.434s over 3 runs
▶ [vulkan_radv] gemma-3-12b-it-UD-Q8_K_XL (runs: 3)
→ log : loadtime_results/gemma-3-12b-it-UD-Q8_K_XL__vulkan_radv.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_radv] gemma-3-12b-it-UD-Q8_K_XL avg=4.295s over 3 runs
▶ [vulkan_amdvlk] gemma-3-12b-it-UD-Q8_K_XL (runs: 3)
→ log : loadtime_results/gemma-3-12b-it-UD-Q8_K_XL__vulkan_amdvlk.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_amdvlk] gemma-3-12b-it-UD-Q8_K_XL avg=3.955s over 3 runs
▶ [rocm6_4_2] gemma-3-12b-it-UD-Q8_K_XL (runs: 3)
→ log : loadtime_results/gemma-3-12b-it-UD-Q8_K_XL__rocm6_4_2.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm6_4_2] gemma-3-12b-it-UD-Q8_K_XL avg=6.686s over 3 runs
▶ [rocm7_rc] gemma-3-27b-it-BF16-00001-of-00002 (runs: 3)
→ log : loadtime_results/gemma-3-27b-it-BF16-00001-of-00002__rocm7_rc.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_rc] gemma-3-27b-it-BF16-00001-of-00002 avg=10.417s over 3 runs
▶ [rocm7_beta] gemma-3-27b-it-BF16-00001-of-00002 (runs: 3)
→ log : loadtime_results/gemma-3-27b-it-BF16-00001-of-00002__rocm7_beta.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_beta] gemma-3-27b-it-BF16-00001-of-00002 avg=10.486s over 3 runs
▶ [vulkan_radv] gemma-3-27b-it-BF16-00001-of-00002 (runs: 3)
→ log : loadtime_results/gemma-3-27b-it-BF16-00001-of-00002__vulkan_radv.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_radv] gemma-3-27b-it-BF16-00001-of-00002 avg=13.579s over 3 runs
▶ [vulkan_amdvlk] gemma-3-27b-it-BF16-00001-of-00002 (runs: 3)
→ log : loadtime_results/gemma-3-27b-it-BF16-00001-of-00002__vulkan_amdvlk.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✖ [vulkan_amdvlk] gemma-3-27b-it-BF16-00001-of-00002 all runs failed
▶ [rocm6_4_2] gemma-3-27b-it-BF16-00001-of-00002 (runs: 3)
→ log : loadtime_results/gemma-3-27b-it-BF16-00001-of-00002__rocm6_4_2.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm6_4_2] gemma-3-27b-it-BF16-00001-of-00002 avg=12.495s over 3 runs
▶ [rocm7_rc] Kimi-Dev-72B-UD-Q8_K_XL-00001-of-00002 (runs: 3)
→ log : loadtime_results/Kimi-Dev-72B-UD-Q8_K_XL-00001-of-00002__rocm7_rc.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_rc] Kimi-Dev-72B-UD-Q8_K_XL-00001-of-00002 avg=26.362s over 3 runs
▶ [rocm7_beta] Kimi-Dev-72B-UD-Q8_K_XL-00001-of-00002 (runs: 3)
→ log : loadtime_results/Kimi-Dev-72B-UD-Q8_K_XL-00001-of-00002__rocm7_beta.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_beta] Kimi-Dev-72B-UD-Q8_K_XL-00001-of-00002 avg=30.024s over 3 runs
▶ [vulkan_radv] Kimi-Dev-72B-UD-Q8_K_XL-00001-of-00002 (runs: 3)
→ log : loadtime_results/Kimi-Dev-72B-UD-Q8_K_XL-00001-of-00002__vulkan_radv.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_radv] Kimi-Dev-72B-UD-Q8_K_XL-00001-of-00002 avg=30.591s over 3 runs
▶ [vulkan_amdvlk] Kimi-Dev-72B-UD-Q8_K_XL-00001-of-00002 (runs: 3)
→ log : loadtime_results/Kimi-Dev-72B-UD-Q8_K_XL-00001-of-00002__vulkan_amdvlk.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✖ [vulkan_amdvlk] Kimi-Dev-72B-UD-Q8_K_XL-00001-of-00002 all runs failed
▶ [rocm6_4_2] Kimi-Dev-72B-UD-Q8_K_XL-00001-of-00002 (runs: 3)
→ log : loadtime_results/Kimi-Dev-72B-UD-Q8_K_XL-00001-of-00002__rocm6_4_2.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm6_4_2] Kimi-Dev-72B-UD-Q8_K_XL-00001-of-00002 avg=35.301s over 3 runs
▶ [rocm7_rc] Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002 (runs: 3)
→ log : loadtime_results/Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002__rocm7_rc.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_rc] Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002 avg=32.911s over 3 runs
▶ [rocm7_beta] Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002 (runs: 3)
→ log : loadtime_results/Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002__rocm7_beta.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_beta] Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002 avg=32.796s over 3 runs
▶ [vulkan_radv] Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002 (runs: 3)
→ log : loadtime_results/Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002__vulkan_radv.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_radv] Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002 avg=30.376s over 3 runs
▶ [vulkan_amdvlk] Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002 (runs: 3)
→ log : loadtime_results/Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002__vulkan_amdvlk.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_amdvlk] Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002 avg=30.604s over 3 runs
▶ [rocm6_4_2] Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002 (runs: 3)
→ log : loadtime_results/Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002__rocm6_4_2.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm6_4_2] Llama-3.3-70B-Instruct-UD-Q8_K_XL-00001-of-00002 avg=30.998s over 3 runs
▶ [rocm7_rc] llama3.3-70.6B-Q4_K_M (runs: 3)
→ log : loadtime_results/llama3.3-70.6B-Q4_K_M__rocm7_rc.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_rc] llama3.3-70.6B-Q4_K_M avg=14.602s over 3 runs
▶ [rocm7_beta] llama3.3-70.6B-Q4_K_M (runs: 3)
→ log : loadtime_results/llama3.3-70.6B-Q4_K_M__rocm7_beta.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_beta] llama3.3-70.6B-Q4_K_M avg=9.338s over 3 runs
▶ [vulkan_radv] llama3.3-70.6B-Q4_K_M (runs: 3)
→ log : loadtime_results/llama3.3-70.6B-Q4_K_M__vulkan_radv.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_radv] llama3.3-70.6B-Q4_K_M avg=8.816s over 3 runs
▶ [vulkan_amdvlk] llama3.3-70.6B-Q4_K_M (runs: 3)
→ log : loadtime_results/llama3.3-70.6B-Q4_K_M__vulkan_amdvlk.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_amdvlk] llama3.3-70.6B-Q4_K_M avg=9.176s over 3 runs
▶ [rocm6_4_2] llama3.3-70.6B-Q4_K_M (runs: 3)
→ log : loadtime_results/llama3.3-70.6B-Q4_K_M__rocm6_4_2.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm6_4_2] llama3.3-70.6B-Q4_K_M avg=9.887s over 3 runs
▶ [rocm7_rc] Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-00001-of-00002 (runs: 3)
→ log : loadtime_results/Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-00001-of-00002__rocm7_rc.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_rc] Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-00001-of-00002 avg=19.365s over 2 runs
▶ [rocm7_beta] Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-00001-of-00002 (runs: 3)
→ log : loadtime_results/Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-00001-of-00002__rocm7_beta.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✖ [rocm7_beta] Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-00001-of-00002 all runs failed
▶ [vulkan_radv] Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-00001-of-00002 (runs: 3)
→ log : loadtime_results/Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-00001-of-00002__vulkan_radv.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_radv] Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-00001-of-00002 avg=20.045s over 3 runs
▶ [vulkan_amdvlk] Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-00001-of-00002 (runs: 3)
→ log : loadtime_results/Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-00001-of-00002__vulkan_amdvlk.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_amdvlk] Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-00001-of-00002 avg=16.752s over 3 runs
▶ [rocm6_4_2] Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-00001-of-00002 (runs: 3)
→ log : loadtime_results/Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-00001-of-00002__rocm6_4_2.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm6_4_2] Llama-4-Scout-17B-16E-Instruct-UD-Q4_K_XL-00001-of-00002 avg=15.776s over 3 runs
▶ [rocm7_rc] Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00002 (runs: 3)
→ log : loadtime_results/Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00002__rocm7_rc.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_rc] Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00002 avg=28.435s over 3 runs
▶ [rocm7_beta] Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00002 (runs: 3)
→ log : loadtime_results/Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00002__rocm7_beta.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_beta] Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00002 avg=28.221s over 3 runs
▶ [vulkan_radv] Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00002 (runs: 3)
→ log : loadtime_results/Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00002__vulkan_radv.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_radv] Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00002 avg=32.810s over 3 runs
▶ [vulkan_amdvlk] Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00002 (runs: 3)
→ log : loadtime_results/Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00002__vulkan_amdvlk.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_amdvlk] Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00002 avg=35.541s over 3 runs
▶ [rocm6_4_2] Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00002 (runs: 3)
→ log : loadtime_results/Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00002__rocm6_4_2.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm6_4_2] Llama-4-Scout-17B-16E-Instruct-Q6_K-00001-of-00002 avg=31.792s over 3 runs
▶ [rocm7_rc] Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00003 (runs: 3)
→ log : loadtime_results/Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00003__rocm7_rc.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_rc] Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00003 avg=35.742s over 3 runs
▶ [rocm7_beta] Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00003 (runs: 3)
→ log : loadtime_results/Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00003__rocm7_beta.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_beta] Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00003 avg=36.400s over 3 runs
▶ [vulkan_radv] Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00003 (runs: 3)
→ log : loadtime_results/Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00003__vulkan_radv.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_radv] Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00003 avg=41.626s over 3 runs
▶ [vulkan_amdvlk] Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00003 (runs: 3)
→ log : loadtime_results/Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00003__vulkan_amdvlk.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_amdvlk] Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00003 avg=47.967s over 3 runs
▶ [rocm6_4_2] Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00003 (runs: 3)
→ log : loadtime_results/Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00003__rocm6_4_2.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm6_4_2] Llama-4-Scout-17B-16E-Instruct-Q8_0-00001-of-00003 avg=40.739s over 3 runs
▶ [rocm7_rc] Qwen3-235B-A22B-Instruct-2507-UD-Q3_K_XL-00001-of-00003 (runs: 3)
→ log : loadtime_results/Qwen3-235B-A22B-Instruct-2507-UD-Q3_K_XL-00001-of-00003__rocm7_rc.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_rc] Qwen3-235B-A22B-Instruct-2507-UD-Q3_K_XL-00001-of-00003 avg=33.458s over 3 runs
▶ [rocm7_beta] Qwen3-235B-A22B-Instruct-2507-UD-Q3_K_XL-00001-of-00003 (runs: 3)
→ log : loadtime_results/Qwen3-235B-A22B-Instruct-2507-UD-Q3_K_XL-00001-of-00003__rocm7_beta.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_beta] Qwen3-235B-A22B-Instruct-2507-UD-Q3_K_XL-00001-of-00003 avg=35.392s over 3 runs
▶ [vulkan_radv] Qwen3-235B-A22B-Instruct-2507-UD-Q3_K_XL-00001-of-00003 (runs: 3)
→ log : loadtime_results/Qwen3-235B-A22B-Instruct-2507-UD-Q3_K_XL-00001-of-00003__vulkan_radv.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_radv] Qwen3-235B-A22B-Instruct-2507-UD-Q3_K_XL-00001-of-00003 avg=40.722s over 3 runs
▶ [vulkan_amdvlk] Qwen3-235B-A22B-Instruct-2507-UD-Q3_K_XL-00001-of-00003 (runs: 3)
→ log : loadtime_results/Qwen3-235B-A22B-Instruct-2507-UD-Q3_K_XL-00001-of-00003__vulkan_amdvlk.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_amdvlk] Qwen3-235B-A22B-Instruct-2507-UD-Q3_K_XL-00001-of-00003 avg=44.883s over 3 runs
▶ [rocm6_4_2] Qwen3-235B-A22B-Instruct-2507-UD-Q3_K_XL-00001-of-00003 (runs: 3)
→ log : loadtime_results/Qwen3-235B-A22B-Instruct-2507-UD-Q3_K_XL-00001-of-00003__rocm6_4_2.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm6_4_2] Qwen3-235B-A22B-Instruct-2507-UD-Q3_K_XL-00001-of-00003 avg=39.062s over 3 runs
▶ [rocm7_rc] Qwen3-30B-A3B-BF16-00001-of-00002 (runs: 3)
→ log : loadtime_results/Qwen3-30B-A3B-BF16-00001-of-00002__rocm7_rc.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_rc] Qwen3-30B-A3B-BF16-00001-of-00002 avg=22.669s over 3 runs
▶ [rocm7_beta] Qwen3-30B-A3B-BF16-00001-of-00002 (runs: 3)
→ log : loadtime_results/Qwen3-30B-A3B-BF16-00001-of-00002__rocm7_beta.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_beta] Qwen3-30B-A3B-BF16-00001-of-00002 avg=15.930s over 3 runs
▶ [vulkan_radv] Qwen3-30B-A3B-BF16-00001-of-00002 (runs: 3)
→ log : loadtime_results/Qwen3-30B-A3B-BF16-00001-of-00002__vulkan_radv.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_radv] Qwen3-30B-A3B-BF16-00001-of-00002 avg=14.761s over 3 runs
▶ [vulkan_amdvlk] Qwen3-30B-A3B-BF16-00001-of-00002 (runs: 3)
→ log : loadtime_results/Qwen3-30B-A3B-BF16-00001-of-00002__vulkan_amdvlk.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_amdvlk] Qwen3-30B-A3B-BF16-00001-of-00002 avg=12.935s over 3 runs
▶ [rocm6_4_2] Qwen3-30B-A3B-BF16-00001-of-00002 (runs: 3)
→ log : loadtime_results/Qwen3-30B-A3B-BF16-00001-of-00002__rocm6_4_2.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm6_4_2] Qwen3-30B-A3B-BF16-00001-of-00002 avg=22.166s over 3 runs
▶ [rocm7_rc] Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002 (runs: 3)
→ log : loadtime_results/Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002__rocm7_rc.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_rc] Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002 avg=16.161s over 3 runs
▶ [rocm7_beta] Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002 (runs: 3)
→ log : loadtime_results/Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002__rocm7_beta.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm7_beta] Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002 avg=14.392s over 3 runs
▶ [vulkan_radv] Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002 (runs: 3)
→ log : loadtime_results/Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002__vulkan_radv.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_radv] Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002 avg=14.021s over 3 runs
▶ [vulkan_amdvlk] Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002 (runs: 3)
→ log : loadtime_results/Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002__vulkan_amdvlk.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [vulkan_amdvlk] Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002 avg=12.940s over 3 runs
▶ [rocm6_4_2] Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002 (runs: 3)
→ log : loadtime_results/Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002__rocm6_4_2.log
→ flags : -ngl 999 -fa --no-mmap -no-cnv -n 1
✔ [rocm6_4_2] Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002 avg=17.779s over 3 runs