phymbert/dbrx-16x12b-instruct-q8_0-gguf
132B • Updated • 7
dbrx-16x12b-instruct-gguf
GGUF quantum models for DBRX: https://github.com/ggerganov/llama.cpp
-
-
phymbert/dbrx-16x12b-instruct-q6_k-gguf
132B • Updated • 6 -
phymbert/dbrx-16x12b-instruct-q4_0-gguf
132B • Updated • 25 • 1 -
phymbert/dbrx-16x12b-instruct-q3_k_m-gguf
132B • Updated • 2 -
phymbert/dbrx-16x12b-instruct-iq3_s-gguf
132B • Updated • 7 -
phymbert/dbrx-16x12b-instruct-iq3_xxs-gguf
132B • Updated • 5 • 1