---
license: apple-amlr
base_model:
- apple/FastVLM-0.5B
pipeline_tag: text-generation
tags:
- gguf-connector
---
## fastvlm-gguf
- run it with `gguf-connector`; simply execute the command below in console/terminal
```
ggc f6
```
>
>GGUF file(s) available. Select which one to use:
>
>1. fastvlm-0.5b-iq4_nl.gguf
>3. fastvlm-0.5b-q4_0.gguf
>4. fastvlm-0.5b-q8_0.gguf
>
>Enter your choice (1 to 3): _
>
- opt a `gguf` file in your current directory to interact with; nothing else

![screenshot](https://raw.githubusercontent.com/calcuis/gguf-pack/master/f5.png)

### connector f5 (alternative)
```
ggc f5
```
- note: `f5` is different from `f6`; you don't need gguf files with `f5`

### **reference**
- base model from [apple](https://huggingface.co/apple/FastVLM-0.5B)
- gguf-connector ([pypi](https://pypi.org/project/gguf-connector))