Update README.md
Browse files
README.md
CHANGED
|
@@ -86,8 +86,8 @@ Example repository: [PrimeNumberTheoremAnd](https://github.com/AlexKontorovich/P
|
|
| 86 |
### Local Deployment
|
| 87 |
|
| 88 |
The model can also be deployed with the following libraries, we advise everyone to use the Mistral AI API if the model is subpar with local serving:
|
| 89 |
-
- [`vllm (recommended)`](https://github.com/vllm-project/vllm): See [here](#vllm-recommended)
|
| 90 |
-
- [`transformers`](https://github.com/huggingface/transformers): WIP ⏳ - follow updates on this PR:
|
| 91 |
|
| 92 |
#### vLLM (recommended)
|
| 93 |
|
|
|
|
| 86 |
### Local Deployment
|
| 87 |
|
| 88 |
The model can also be deployed with the following libraries, we advise everyone to use the Mistral AI API if the model is subpar with local serving:
|
| 89 |
+
- [`vllm (recommended)`](https://github.com/vllm-project/vllm): See [here](#vllm-recommended).
|
| 90 |
+
- [`transformers`](https://github.com/huggingface/transformers): WIP ⏳ - follow updates on [this PR](https://github.com/huggingface/transformers/pull/44760).
|
| 91 |
|
| 92 |
#### vLLM (recommended)
|
| 93 |
|