Update README.md
Browse files
README.md
CHANGED
|
@@ -56,7 +56,7 @@ For more details about the training protocol of this model, please refer to the
|
|
| 56 |
|
| 57 |
# Usage
|
| 58 |
|
| 59 |
-
Currently to use this model you can either rely on Hugging Face `transformers`, `vLLM` or our
|
| 60 |
|
| 61 |
## Inference
|
| 62 |
|
|
@@ -102,8 +102,8 @@ vllm serve tiiuae/Falcon-H1-1B-Instruct --tensor-parallel-size 2 --data-parallel
|
|
| 102 |
|
| 103 |
### `llama.cpp`
|
| 104 |
|
| 105 |
-
|
| 106 |
-
|
| 107 |
|
| 108 |
# Evaluation
|
| 109 |
|
|
|
|
| 56 |
|
| 57 |
# Usage
|
| 58 |
|
| 59 |
+
Currently to use this model you can either rely on Hugging Face `transformers`, `vLLM` or our `llama.cpp` library.
|
| 60 |
|
| 61 |
## Inference
|
| 62 |
|
|
|
|
| 102 |
|
| 103 |
### `llama.cpp`
|
| 104 |
|
| 105 |
+
You can find all GGUF files compatible with `llama.cpp` under [our official collection](https://huggingface.co/collections/tiiuae/falcon-h1-6819f2795bc406da60fab8df)
|
| 106 |
+
|
| 107 |
|
| 108 |
# Evaluation
|
| 109 |
|