Models

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text • 5B • Updated Sep 22 • 136k • 9

RedHatAI/NVIDIA-Nemotron-Nano-9B-v2-quantized.w4a16

Text Generation • 2B • Updated 5 days ago • 41 • 1

BelleGroup/BELLE-7B-gptq

Text Generation • Updated Apr 20, 2023 • 10 • 26

sardukar/llama13b-4bit-v2

Text Generation • Updated Apr 8, 2023 • 3 • 5

sardukar/llama7b-4bit-v2

Text Generation • Updated Apr 6, 2023 • 1 • 3

BelleGroup/BELLE-LLaMA-7B-2M-gptq-enc

Text Generation • Updated Apr 12, 2023 • 2

BelleGroup/BELLE_BLOOM_GPTQ_4BIT

Text Generation • Updated Apr 20, 2023 • 10 • 3

Thireus/Vicuna13B-v1.1-8bit-128g

Text Generation • Updated Apr 22, 2023 • 7 • 16

mayank-mishra/starcoderbase-GPTQ-4bit-128g

Updated May 5, 2023 • 21

mayank-mishra/starcoderbase-GPTQ-8bit-128g

Updated May 5, 2023 • 3

mayank-mishra/santacoder-GPTQ-8bit-128g

Updated May 4, 2023 • 1

mayank-mishra/santacoder-GPTQ-4bit-128g

Updated May 4, 2023 • 2

mayank-mishra/starcoder-GPTQ-4bit-128g

Updated May 5, 2023 • 16

mayank-mishra/starcoder-GPTQ-8bit-128g

Updated May 5, 2023 • 11

ssaroya/gptq_model

Updated May 25, 2023

Honkware/Manticore-13b-Landmark-GPTQ

Text Generation • Updated Jun 14, 2023 • 4 • 2

malhajar/Platypus2-70B-instruct-4bit-gptq

Text Generation • Updated Jan 29, 2024 • 339

clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit

Text Generation • Updated Sep 1, 2023 • 5 • 9

clibrain/Llama-2-13b-ft-instruct-es-gptq-4bit

Text Generation • Updated Sep 4, 2023 • 4 • 3

daedalus314/Griffin-3B-GPTQ

Text Generation • 0.7B • Updated Sep 8, 2023

daedalus314/Marx-3B-V2-GPTQ

Text Generation • Updated Oct 12, 2023 • 1

TRAC-MTRY/traclm-v2-7b-instruct-GPTQ

Text Generation • 1B • Updated Dec 22, 2023

iproskurina/bloom-1b7-GPTQ-4bit-g128

Text Generation • 1B • Updated Mar 29 • 7

iproskurina/bloom-3b-GPTQ-4bit-g128

Text Generation • 2B • Updated Mar 29 • 8

iproskurina/bloom-560m-GPTQ-4bit-g128

Text Generation • 0.6B • Updated Mar 29 • 36

iproskurina/bloom-1b1-GPTQ-4bit-g128

Text Generation • 0.9B • Updated Mar 29 • 11

iproskurina/bloom-7b1-GPTQ-4bit-g128

Text Generation • 3B • Updated Mar 29 • 9 • 2

iproskurina/opt-350m-GPTQ-4bit-g128

Text Generation • 95.6M • Updated Mar 29 • 23

iproskurina/opt-1.3b-GPTQ-4bit-g128

Text Generation • 0.4B • Updated Mar 29 • 10

iproskurina/opt-2.7b-GPTQ-4bit-g128

Text Generation • 0.6B • Updated Mar 29 • 10