Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

MaziyarPanahi
/
Qwen2.5-14B-Instruct-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Files and versions
xet
Community
2
Qwen2.5-14B-Instruct-GGUF
54.4 GB
  • 1 contributor
History: 10 commits
MaziyarPanahi's picture
MaziyarPanahi
761d84ba2805fb01959fc61401bc125f9fcc1c50dfb81e95f102baffbcc21208
122ddc4 verified about 1 year ago
  • .gitattributes
    2.14 kB
    761d84ba2805fb01959fc61401bc125f9fcc1c50dfb81e95f102baffbcc21208 about 1 year ago
  • Qwen2.5-14B-Instruct.IQ1_M.gguf
    3.87 GB
    xet
    58921dce9808db69c818cd7ef2253c92511b450bfb753a7429c463ced1ab6ad1 about 1 year ago
  • Qwen2.5-14B-Instruct.IQ1_S.gguf
    3.61 GB
    xet
    0fc28181d54f0c7a46c386019e0d243ca13e6c1a8cfa1176e31fb88c0bc0c66e about 1 year ago
  • Qwen2.5-14B-Instruct.IQ2_XS.gguf
    4.7 GB
    xet
    440e7af9efadc0cae9aaea3a2b2d2437d81f0da04f89c9daea4fa9c4ff0768f7 about 1 year ago
  • Qwen2.5-14B-Instruct.IQ3_XS.gguf
    6.38 GB
    xet
    7c190992f9dfd49b8c22e7fbe87faadf151c9c81a6a55d6d04c3cd6c9c1e272d about 1 year ago
  • Qwen2.5-14B-Instruct.IQ4_XS.gguf
    8.12 GB
    xet
    08d5eb66889a053a86a0e0fc5d4502660cfbbc0536a0e9c46e8fb409dbe26f34 about 1 year ago
  • Qwen2.5-14B-Instruct.Q2_K.gguf
    5.77 GB
    xet
    bd8d0650ee7da4375206c40ed1d9c545eb0628a84e5e67d5a3cc2c47ed338aa5 about 1 year ago
  • Qwen2.5-14B-Instruct.Q3_K_L.gguf
    7.92 GB
    xet
    5445187ee8d87cb1a5bcabba4803f0d5d07612275651abcab1f204cb1c0155e3 about 1 year ago
  • Qwen2.5-14B-Instruct.Q3_K_M.gguf
    7.34 GB
    xet
    df55af329e2942fc594678c12825bf9b10f89fc71dfe7976df0d65bd7a777c12 about 1 year ago
  • Qwen2.5-14B-Instruct.Q3_K_S.gguf
    6.66 GB
    xet
    761d84ba2805fb01959fc61401bc125f9fcc1c50dfb81e95f102baffbcc21208 about 1 year ago