Update README with correction to model download and inference instructions (#54)
Updated instructions for downloading model files to include both parts of the example GGUF
This commit is contained in:
@@ -90,6 +90,10 @@ Example: Qwen3 Coder 30B (BF16)
|
||||
HF_HUB_ENABLE_HF_TRANSFER=1 huggingface-cli download unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF \
|
||||
BF16/Qwen3-Coder-30B-A3B-Instruct-BF16-00001-of-00002.gguf \
|
||||
--local-dir models/qwen3-coder-30B-A3B/
|
||||
|
||||
HF_HUB_ENABLE_HF_TRANSFER=1 huggingface-cli download unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF \
|
||||
BF16/Qwen3-Coder-30B-A3B-Instruct-BF16-00002-of-00002.gguf \
|
||||
--local-dir models/qwen3-coder-30B-A3B/
|
||||
```
|
||||
|
||||
### 4. Run Inference
|
||||
|
||||
Reference in New Issue
Block a user