README.md

metadata

license: apple-amlr
base_model:
  - apple/FastVLM-0.5B
pipeline_tag: text-generation
tags:
  - gguf-connector

fastvlm-gguf

• run it with gguf-connector; simply execute the command below in console/terminal

ggc f6

GGUF file(s) available. Select which one to use:

1. fastvlm-0.5b-iq4_nl.gguf
2. fastvlm-0.5b-q4_0.gguf
3. fastvlm-0.5b-q8_0.gguf

Enter your choice (1 to 3): _

• opt a gguf file in your current directory to interact with; nothing else

connector f5 (alternative)

ggc f5

• note: f5 is different from f6; you don't need gguf files with f5

reference

• base model from apple
• gguf-connector (pypi)