Update README.md
Browse files
README.md
CHANGED
|
@@ -12,7 +12,7 @@ language:
|
|
| 12 |
|
| 13 |
# catalystsec/Seed-OSS-36B-Instruct-4bit-DWQ
|
| 14 |
|
| 15 |
-
This model was quantized to 4-bit
|
| 16 |
|
| 17 |
| Learning Rate | Total Loss | KL Loss | Activation Loss | Improvement |
|
| 18 |
|---------------|------------|---------|-----------------|-------------|
|
|
|
|
| 12 |
|
| 13 |
# catalystsec/Seed-OSS-36B-Instruct-4bit-DWQ
|
| 14 |
|
| 15 |
+
This model was quantized to 4-bit using DWQ with mlx-lm version **0.27.1**, distilled from a BF16 teacher model.
|
| 16 |
|
| 17 |
| Learning Rate | Total Loss | KL Loss | Activation Loss | Improvement |
|
| 18 |
|---------------|------------|---------|-----------------|-------------|
|