Removed typo
This commit is contained in:
@@ -21,7 +21,7 @@ This repo provides a tool, **`gguf-vram-estimator.py`**, which reads a `.gguf` m
|
|||||||
Make sure you have the estimator script (in `tools/`):
|
Make sure you have the estimator script (in `tools/`):
|
||||||
|
|
||||||
```sh
|
```sh
|
||||||
python3 tools/gguf-vram-estimator.py <path-to-model.gguf> x`
|
python3 tools/gguf-vram-estimator.py <path-to-model.gguf>
|
||||||
```
|
```
|
||||||
|
|
||||||
* Supply one or more context lengths to get the corresponding VRAM footprint.
|
* Supply one or more context lengths to get the corresponding VRAM footprint.
|
||||||
|
|||||||
Reference in New Issue
Block a user