julian/amd-strix-halo-toolboxes
1
0
Fork 0
Code Issues Pull Requests 2 Actions Packages Projects Releases Wiki Activity

Merge pull request #17 from neuhaus/patch-1

Browse Source 
Fix command syntax for llama-cli usage
This commit is contained in:
kyuz0
2025-11-10 19:24:07 +00:00
committed by GitHub
parent 6d121bc88a 4ec72fa8f4
commit 19c67b6665
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files
README.md
+1 -1
View File
@@ -145,7 +145,7 @@ Once inside, the following commands show how to run local LLMs:
* `llama-cli --list-devices` * `llama-cli --list-devices`
*Lists available GPU devices for Llama.cpp.* *Lists available GPU devices for Llama.cpp.*
* `llama-cli --no-mmap -ngl 999 -fa -m <model>` * `llama-cli --no-mmap -ngl 999 -fa 1 -m <model>`
*Runs inference on the specified model, with all layers on GPU and flash attention enabled (replace \*\* with your model path).* *Runs inference on the specified model, with all layers on GPU and flash attention enabled (replace \*\* with your model path).*
## 2.3 Downloading GGUF Models from HuggingFace ## 2.3 Downloading GGUF Models from HuggingFace