Zack Siri

zacksiri's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in cpatonn/Qwen3-Coder-30B-A3B-Instruct-GPTQ-4bit 4 months ago

Possibility of an AWQ version?

🤝 1

3

#1 opened 4 months ago by

fredericodeveloper

New activity in Qwen/Qwen3-30B-A3B-Instruct-2507 4 months ago

AWQ version

❤️ 6

6

#3 opened 4 months ago by

devops724

New activity in RedHatAI/Mistral-Small-3.2-24B-Instruct-2506-FP8 5 months ago

Not working with vLLM 0.9.1

5

#1 opened 5 months ago by

zacksiri

New activity in RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16 6 months ago

Mistral small 3.2 is out

👍 3

#4 opened 6 months ago by

zacksiri

Running in vLLM with tool calling support

2

#1 opened 8 months ago by

LLukas22

New activity in RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8 7 months ago

Having trouble running this model with vLLM not sure why

4

#1 opened 8 months ago by

zacksiri

New activity in stelterlab/Mistral-Small-24B-Instruct-2501-AWQ 8 months ago

Really good work

🔥 2

11

#1 opened 10 months ago by

divmgl

Really good work

🔥 2

11

#1 opened 10 months ago by

divmgl

New activity in RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w8a8 8 months ago

Having trouble running this model with vLLM not sure why

4

#1 opened 8 months ago by

zacksiri