Instructions to use argmaxinc/mlx-FLUX.1-schnell-4bit-quantized with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- DiffusionKit
How to use argmaxinc/mlx-FLUX.1-schnell-4bit-quantized with DiffusionKit:
# Pipeline for Flux from diffusionkit.mlx import FluxPipeline pipeline = FluxPipeline( shift=1.0, model_version=argmaxinc/mlx-FLUX.1-schnell-4bit-quantized, low_memory_mode=True, a16=True, w16=True, )
# Image Generation HEIGHT = 512 WIDTH = 512 NUM_STEPS = 4 CFG_WEIGHT = 0 image, _ = pipeline.generate_image( "a photo of a cat", cfg_weight=CFG_WEIGHT, num_steps=NUM_STEPS, latent_size=(HEIGHT // 8, WIDTH // 8), )
- MLX
How to use argmaxinc/mlx-FLUX.1-schnell-4bit-quantized with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir mlx-FLUX.1-schnell-4bit-quantized argmaxinc/mlx-FLUX.1-schnell-4bit-quantized
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Commit ·
9a7ac86
1
Parent(s): ebf52e2
update model_version and add note
Browse files
README.md
CHANGED
|
@@ -13,6 +13,7 @@ tags:
|
|
| 13 |
## Check out the [original model](https://huggingface.co/black-forest-labs/FLUX.1-schnell)!
|
| 14 |
## Check out the [DiffusionKit](https://github.com/argmaxinc/DiffusionKit) github repository!
|
| 15 |
![FLUX.1 [schnell] Grid](./flux_on_mac.png)
|
|
|
|
| 16 |
# Usage
|
| 17 |
- ## Create conda environment
|
| 18 |
```shell
|
|
@@ -26,7 +27,7 @@ diffusionkit-cli --prompt "detailed cinematic dof render of a \
|
|
| 26 |
detailed MacBook Pro on a wooden desk in a dim room with items \
|
| 27 |
around, messy dirty room. On the screen are the letters 'FLUX on \
|
| 28 |
DiffusionKit' glowing softly. High detail hard surface render" \
|
| 29 |
-
--model-version FLUX.1-schnell-4bit-quantized \
|
| 30 |
--height 768 \
|
| 31 |
--width 1360 \
|
| 32 |
--seed 1001 \
|
|
|
|
| 13 |
## Check out the [original model](https://huggingface.co/black-forest-labs/FLUX.1-schnell)!
|
| 14 |
## Check out the [DiffusionKit](https://github.com/argmaxinc/DiffusionKit) github repository!
|
| 15 |
![FLUX.1 [schnell] Grid](./flux_on_mac.png)
|
| 16 |
+
Note: This checkpoint features 4-bit quantization of the mmdit module using MLX's nn.quantize function with default settings (group_size=64).
|
| 17 |
# Usage
|
| 18 |
- ## Create conda environment
|
| 19 |
```shell
|
|
|
|
| 27 |
detailed MacBook Pro on a wooden desk in a dim room with items \
|
| 28 |
around, messy dirty room. On the screen are the letters 'FLUX on \
|
| 29 |
DiffusionKit' glowing softly. High detail hard surface render" \
|
| 30 |
+
--model-version argmaxinc/FLUX.1-schnell-4bit-quantized \
|
| 31 |
--height 768 \
|
| 32 |
--width 1360 \
|
| 33 |
--seed 1001 \
|