HighCWu commited on
Commit
140c0ab
·
verified ·
1 Parent(s): 92adf37

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -1
README.md CHANGED
@@ -31,13 +31,18 @@ pip install -U hqq
31
  After installing the required library, you can run the following script:
32
 
33
  ```python
 
34
  from diffusers import FluxPipeline
35
 
36
  pipe = FluxPipeline.from_pretrained(
37
- "HighCwu/FLUX.1-dev-bnb-hqq-4bit",
38
  torch_dtype=torch.bfloat16
39
  )
40
 
 
 
 
 
41
  prompt = "Baroque style, a lavish palace interior with ornate gilded ceilings, intricate tapestries, and dramatic lighting over a grand staircase."
42
 
43
  pipe_kwargs = {
 
31
  After installing the required library, you can run the following script:
32
 
33
  ```python
34
+ import torch
35
  from diffusers import FluxPipeline
36
 
37
  pipe = FluxPipeline.from_pretrained(
38
+ "HighCWu/FLUX.1-dev-bnb-hqq-4bit",
39
  torch_dtype=torch.bfloat16
40
  )
41
 
42
+ # Use model cpu offload or all on cuda
43
+ pipe.enable_model_cpu_offload()
44
+ # pipe.to("cuda")
45
+
46
  prompt = "Baroque style, a lavish palace interior with ornate gilded ceilings, intricate tapestries, and dramatic lighting over a grand staircase."
47
 
48
  pipe_kwargs = {