TheBloke
/

Mixtral-8x7B-Instruct-v0.1-GGUF

Model card Files Files and versions

Resources

View closed (4)

Request: Updated Mixtral GGUF (Q6_K or Q5_K_M) with full MoE tensor support for LM Studio (post-Jan 2025)

#33 opened about 1 month ago by

Report

#32 opened 7 months ago by

USE

#31 opened 8 months ago by

fail

#30 opened 9 months ago by

How do you estimate the number of GPUs required to run this model?

#29 opened over 1 year ago by

Ollama Modelfile

#28 opened over 1 year ago by

Help: CUDA out of memory. Hardware Requirments.

#27 opened almost 2 years ago by

CUDA error: the provided PTX was compiled with an unsupported toolchain.

#26 opened almost 2 years ago by

THANK YOU!!

#25 opened almost 2 years ago by

No K_S models?

#24 opened almost 2 years ago by

Hardware Requirements for Q4_K_M

#23 opened almost 2 years ago by

ShivanshMathur007

Can we finetune this gguf model for our custom need

#22 opened almost 2 years ago by

Download Error when deploying to SageMaker

#21 opened almost 2 years ago by

csanchez-aureum

Getting runtime error when loading with llama-cpp in a HF space with Nvidia A10G Large

#20 opened almost 2 years ago by

Q6_K version is broken

#19 opened almost 2 years ago by

Snake.py with pygame works!!

#16 opened almost 2 years ago by

Works with with the current oobabooga version.

#15 opened almost 2 years ago by

Issue with GPU Utilization in Colab Notebook

#14 opened almost 2 years ago by

Update README.md

#13 opened almost 2 years ago by

8x7B (Q3) vs 7B

#12 opened almost 2 years ago by

Update README.md

#10 opened almost 2 years ago by

Why is the response slower than the 70B model?

#9 opened almost 2 years ago by

Even this excellent high-end model doesn't follow my instructions

#8 opened almost 2 years ago by

Behaviour with AMD GPU offload?

#7 opened almost 2 years ago by

chatbot giving weird responses

#6 opened almost 2 years ago by

KCPP frankenstein experimental release for Mixtral

#5 opened almost 2 years ago by

Issue with Mixtral-8x7B-Instruct-v0.1-GGUF Model: 'blk.0.ffn_gate.weight' Tensor Not Found

#4 opened almost 2 years ago by

error

#3 opened almost 2 years ago by

WOW - best opensource llm I ever seen !

#1 opened almost 2 years ago by