Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

cyankiwi
/
Kimi-Linear-48B-A3B-Instruct-AWQ-4bit

Safetensors
kimi_linear
custom_code
compressed-tensors
Model card Files Files and versions
xet
Community
3
New discussion
Resources
  • PR & discussions documentation
  • Code of Conduct
  • Hub documentation

vLLM v0.11.1 seems to work, but v0.11.2 fails

๐Ÿ‘ โค๏ธ 2
6
#3 opened 1 day ago by
stelterlab

Error installing from PR branch

๐Ÿ‘ 1
14
#1 opened 27 days ago by
DrRos
Company
TOS Privacy About Jobs
Website
Models Datasets Spaces Pricing Docs