File size: 835 Bytes
05dd762 8a45c48 04829e6 a625729 0ca5c77 a625729 8a45c48 a625729 8a45c48 a625729 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 |
---
license: apple-amlr
base_model:
- apple/FastVLM-0.5B
pipeline_tag: text-generation
tags:
- gguf-connector
---
## fastvlm-gguf
- run it with `gguf-connector`; simply execute the command below in console/terminal
```
ggc f6
```
>
>GGUF file(s) available. Select which one to use:
>
>1. fastvlm-0.5b-iq4_nl.gguf
>3. fastvlm-0.5b-q4_0.gguf
>4. fastvlm-0.5b-q8_0.gguf
>
>Enter your choice (1 to 3): _
>
- opt a `gguf` file in your current directory to interact with; nothing else
### connector f5 (alternative)
```
ggc f5
```
- note: `f5` is different from `f6`; you don't need gguf files with `f5`
### **reference**
- base model from [apple](https://huggingface.co/apple/FastVLM-0.5B)
- gguf-connector ([pypi](https://pypi.org/project/gguf-connector)) |