How to generate mmproj file?
#1
by
Evi1ran
- opened
Sorry, I tried using llama.cpp for inference but was missing the mmproj file. Even after generating the mmproj with examples/llava/qwen2_vl_surgery.py, I'm still unable to perform inference successfully.
You don't need the mmproj file for inference, you only need it for vision support - so you should first concentrate on getting that to work. mmproj generation is currently highly in flux in llama.cpp, so you best consult the llama.cpp documentation for the version you are using.