Broken with latest llama.cpp

by GeorgyGUF - opened Jun 11

Jun 11

llama_model_load: error loading model: missing tensor 'blk.0.ffn_down_exps.weight'
llama_model_load_from_file_impl: failed to load model
common_init_from_params: failed to load model 'Mixtral-8x7B-Instruct-v0.1.Q3_K_M.gguf'
main: error: unable to load model

GeorgyGUF

Jun 11

https://huggingface.co/tensorblock/Mixtral-8x7B-Instruct-v0.1-GGUF this has the blk.0.ffn_down_exps

GeorgyGUF

Jun 11

https://huggingface.co/ddh0/Mixtral-8x7B-Instruct-v0.1-bf16-GGUF/tree/main this has also

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment