julian/amd-strix-halo-toolboxes
1
0
Fork 0
Code Issues Pull Requests 2 Actions Packages Projects Releases Wiki Activity

chore: update ROCm version to 7.2.3 and remove deprecated pr21344 toolbox

Browse Source
This commit is contained in:
Donato Capitella
2026-05-11 19:39:46 +01:00
parent 0f9c2c85be
commit 2e3dc657d2
8 changed files with 18 additions and 144 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+5 -5
View File
@@ -44,7 +44,7 @@ This is currently the most stable setup. Kernels older than 6.18.4 have a bug th
## Supported Toolboxes
> [!WARNING]
> Current `rocm7-nightlies` builds have a bug that caps memory allocation to 64GB. If you need larger models, prefer stable builds like `rocm-7.2.2` (performance is similar). Track the issue here: https://github.com/ROCm/TheRock/issues/4645
> Current `rocm7-nightlies` builds have a bug that caps memory allocation to 64GB. If you need larger models, prefer stable builds like `rocm-7.2.3` (performance is similar). Track the issue here: https://github.com/ROCm/TheRock/issues/4645
You can check the containers on DockerHub: [kyuz0/amd-strix-halo-toolboxes](https://hub.docker.com/r/kyuz0/amd-strix-halo-toolboxes/tags).
@@ -53,7 +53,7 @@ You can check the containers on DockerHub: [kyuz0/amd-strix-halo-toolboxes](http
| `vulkan-amdvlk` | Vulkan (AMDVLK) | Fastest backend—AMD open-source driver. ≤2 GiB single buffer allocation limit, some large models won't load. |
| `vulkan-radv` | Vulkan (Mesa RADV) | Most stable and compatible. Recommended for most users and all models. |
| `rocm-6.4.4` | ROCm 6.4.4 (Fedora 43) | Latest stable 6.x build. Uses Fedora 43 packages with backported patch for **kernel 6.18.4+** support. |
| `rocm-7.2.2` | ROCm 7.2.2 | Latest stable 7.x build. Includes patch for **kernel 6.18.4+** support. |
| `rocm-7.2.3` | ROCm 7.2.3 | Latest stable 7.x build. Includes patch for **kernel 6.18.4+** support. |
| `rocm7-nightlies` | ROCm 7 Nightly | Tracks nightly builds. Includes patch for **kernel 6.18.4+** support. |
> These containers are **automatically** rebuilt whenever the Llama.cpp master branch is updated. Legacy images (`rocm-6.4.2`, `rocm-6.4.3`, `rocm-7.1.1`) are excluded from this list.
@@ -73,12 +73,12 @@ toolbox enter llama-vulkan-radv
**Option B: ROCm (Recommended for Performance)**
```sh
toolbox create llama-rocm-7.2.2 \
--image docker.io/kyuz0/amd-strix-halo-toolboxes:rocm-7.2.2 \
toolbox create llama-rocm-7.2.3 \
--image docker.io/kyuz0/amd-strix-halo-toolboxes:rocm-7.2.3 \
-- --device /dev/dri --device /dev/kfd \
--group-add video --group-add render --group-add sudo --security-opt seccomp=unconfined
toolbox enter llama-rocm-7.2.2
toolbox enter llama-rocm-7.2.3
```
### 2. Check GPU Access