Update README.md
Browse files
README.md
CHANGED
|
@@ -13,8 +13,11 @@ pipeline_tag: text-generation
|
|
| 13 |
inference: false
|
| 14 |
|
| 15 |
---
|
|
|
|
| 16 |
# **GGUF-Imatrix quantizations for [Kunocchini-7b-128k-test](https://huggingface.co/Test157t/Kunocchini-7b-128k-test/).**
|
| 17 |
|
|
|
|
|
|
|
| 18 |
# What does "Imatrix" mean?
|
| 19 |
|
| 20 |
It stands for **Importance Matrix**, a technique used to improve the quality of quantized models.
|
|
|
|
| 13 |
inference: false
|
| 14 |
|
| 15 |
---
|
| 16 |
+
|
| 17 |
# **GGUF-Imatrix quantizations for [Kunocchini-7b-128k-test](https://huggingface.co/Test157t/Kunocchini-7b-128k-test/).**
|
| 18 |
|
| 19 |
+
# UPDATED: Please download the v2 files that are now available.
|
| 20 |
+
|
| 21 |
# What does "Imatrix" mean?
|
| 22 |
|
| 23 |
It stands for **Importance Matrix**, a technique used to improve the quality of quantized models.
|