Update README.md
Browse files
README.md
CHANGED
|
@@ -16,4 +16,6 @@ https://github.com/NVlabs/Sana/issues/128
|
|
| 16 |
|
| 17 |
https://github.com/NVlabs/Sana/blob/main/tools/convert_sana_to_svdquant.py and https://github.com/NVlabs/Sana/blob/main/asset/docs/quantize/4bit_sana.md
|
| 18 |
|
| 19 |
-
but this solution is not stable, you can get error like this `RuntimeError: The expanded size of the tensor (2240) must match the existing size (1152) at non-singleton dimension 1. Target sizes: [2880, 2240, 1, 1]. Tensor sizes: [2880, 1152, 1, 1]` (only with the 592M model), so prepare a workaround for this case. This script just creates a safetensor version of original pth, then you will need to make a SVDQuant from it
|
|
|
|
|
|
|
|
|
| 16 |
|
| 17 |
https://github.com/NVlabs/Sana/blob/main/tools/convert_sana_to_svdquant.py and https://github.com/NVlabs/Sana/blob/main/asset/docs/quantize/4bit_sana.md
|
| 18 |
|
| 19 |
+
but this solution is not stable, you can get error like this `RuntimeError: The expanded size of the tensor (2240) must match the existing size (1152) at non-singleton dimension 1. Target sizes: [2880, 2240, 1, 1]. Tensor sizes: [2880, 1152, 1, 1]` (only with the 592M model), so prepare a workaround for this case. This script just creates a safetensor version of original pth, then you will need to make a SVDQuant from it
|
| 20 |
+
|
| 21 |
+
probably the most easy way https://huggingface.co/Kijai/flux-fp8/discussions/7
|