Part of the Outlier shipping lineup. Outlier is a free macOS app that runs this model locally, with one click. Apple Silicon only.

Outlier Lite 9B (MLX 4-bit)

The mid-tier shipping model. 9B dense, text-only, MLX 4-bit. Recommended for 12 GB+ Macs that want stronger reasoning than Nano without paying the latency cost of a 27B-class model.

Try it in Outlier

The simplest way to use this model is through the Outlier app โ€” open the tier picker, select Outlier Lite, click download, and chat. No setup, no Python, no MLX install, no token quotas.

โžก Download Outlier โ€” outlier.host

A screenshot of the tier picker is at outlier.host/screenshots/tier-picker.png.

Load this directly (power users)

If you want the raw MLX-4bit weights without the app:

pip install mlx-lm
python -m mlx_lm.generate \
  --model Outlier-Ai/Outlier-Lite-9B-MLX-4bit \
  --prompt "Write a quicksort in Python." \
  --max-tokens 512
from mlx_lm import load, generate
model, tokenizer = load("Outlier-Ai/Outlier-Lite-9B-MLX-4bit")
print(generate(model, tokenizer, prompt="Hello", max_tokens=256))

Verified benchmarks

For ฯƒ-qualified MMLU, HumanEval, and Mac inference-speed numbers โ€” with full provenance (source file, command, n, stderr, date) โ€” see outlier.host/benchmarks.

Other Outlier shipping tiers

License

Apache 2.0 (inherits from upstream base model). Conversion artifact only โ€” the underlying weights are governed by the base model's license.

Downloads last month
22
Safetensors
Model size
9B params
Tensor type
U32
ยท
BF16
ยท
F32
ยท
MLX
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for Outlier-Ai/Outlier-Lite-9B-MLX-4bit

Finetuned
Qwen/Qwen3.5-9B
Quantized
(629)
this model

Evaluation results