Update README.md
Browse files
README.md
CHANGED
|
@@ -31,13 +31,18 @@ pip install -U hqq
|
|
| 31 |
After installing the required library, you can run the following script:
|
| 32 |
|
| 33 |
```python
|
|
|
|
| 34 |
from diffusers import FluxPipeline
|
| 35 |
|
| 36 |
pipe = FluxPipeline.from_pretrained(
|
| 37 |
-
"
|
| 38 |
torch_dtype=torch.bfloat16
|
| 39 |
)
|
| 40 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 41 |
prompt = "Baroque style, a lavish palace interior with ornate gilded ceilings, intricate tapestries, and dramatic lighting over a grand staircase."
|
| 42 |
|
| 43 |
pipe_kwargs = {
|
|
|
|
| 31 |
After installing the required library, you can run the following script:
|
| 32 |
|
| 33 |
```python
|
| 34 |
+
import torch
|
| 35 |
from diffusers import FluxPipeline
|
| 36 |
|
| 37 |
pipe = FluxPipeline.from_pretrained(
|
| 38 |
+
"HighCWu/FLUX.1-dev-bnb-hqq-4bit",
|
| 39 |
torch_dtype=torch.bfloat16
|
| 40 |
)
|
| 41 |
|
| 42 |
+
# Use model cpu offload or all on cuda
|
| 43 |
+
pipe.enable_model_cpu_offload()
|
| 44 |
+
# pipe.to("cuda")
|
| 45 |
+
|
| 46 |
prompt = "Baroque style, a lavish palace interior with ornate gilded ceilings, intricate tapestries, and dramatic lighting over a grand staircase."
|
| 47 |
|
| 48 |
pipe_kwargs = {
|