Commit
·
efe952e
1
Parent(s):
0f45b9f
Update README.md
Browse files
README.md
CHANGED
|
@@ -40,7 +40,7 @@ datasets:
|
|
| 40 |
|
| 41 |
Just a fiction oriented 4bpw exl2 quantization of https://huggingface.co/jondurbin/bagel-dpo-34b-v0.2
|
| 42 |
|
| 43 |
-
Quantized on 300K
|
| 44 |
|
| 45 |
If anyone wants sizes other than 4bpw, for more/less context or smaller GPUs, just ask.
|
| 46 |
***
|
|
|
|
| 40 |
|
| 41 |
Just a fiction oriented 4bpw exl2 quantization of https://huggingface.co/jondurbin/bagel-dpo-34b-v0.2
|
| 42 |
|
| 43 |
+
Quantized on 300K tokens of two Vicuna format chats, a sci fi story and a fiction story at a long context. This should yield better storywriting performance than the default exl2 quantization.
|
| 44 |
|
| 45 |
If anyone wants sizes other than 4bpw, for more/less context or smaller GPUs, just ask.
|
| 46 |
***
|