WisPerMed
/

Llama-3.1-SauerkrautLM-70b-Instruct-AWQ

Text Generation

4-bit precision

Model card Files Files and versions

This model is created with love by the PhD Students from DFG funded Wispermed group.

Downloads last month: 139

Safetensors

Model size

11B params

Tensor type

I32

·

F16

·

Model tree for WisPerMed/Llama-3.1-SauerkrautLM-70b-Instruct-AWQ

Base model

VAGOsolutions/Llama-3.1-SauerkrautLM-70b-Instruct

Quantized

(4)

this model