Model description

  • Developed by: teleboas
  • License: apache-2.0
  • Finetuned from model : unsloth/mistral-7b-v0.2-bnb-4bit

This is the GGUF version of the model, made for the llama.cpp inference engine.

If you are looking for the transformers/fp16 model, it is available here: https://huggingface.co/teleboas/alpaca_mistral-7b-v0.2

Downloads last month
6
GGUF
Model size
7B params
Architecture
llama
Hardware compatibility
Log In to view the estimation

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for teleboas/alpaca_mistral-7b-v0.2-GGUF

Quantized
(26)
this model

Dataset used to train teleboas/alpaca_mistral-7b-v0.2-GGUF