Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

TheBloke
/
Llama-2-70B-Chat-GPTQ

Text Generation
Transformers
Safetensors
PyTorch
English
llama
facebook
meta
llama-2
text-generation-inference
4-bit precision
gptq
Model card Files Files and versions
xet
Community
52
Llama-2-70B-Chat-GPTQ
35.3 GB
  • 3 contributors
History: 6 commits
TheBloke's picture
TheBloke
Initial GPTQ model commit
76b4d5b over 2 years ago
  • .gitattributes
    1.52 kB
    initial commit over 2 years ago
  • config.json
    629 Bytes
    Initial GPTQ model commit over 2 years ago
  • generation_config.json
    137 Bytes
    Initial GPTQ model commit over 2 years ago
  • gptq_model-4bit--1g.safetensors
    35.3 GB
    xet
    Initial GPTQ model commit over 2 years ago
  • quantize_config.json
    183 Bytes
    Initial GPTQ model commit over 2 years ago
  • tokenizer_config.json
    745 Bytes
    Initial GPTQ model commit over 2 years ago