Fix data parsing in forward() method
#18
by
bialykostek
- opened
Problem described here: https://huggingface.co/openbmb/MiniCPM-V-4_5/discussions/12
Consequence: unable to quantize model
Fix: data parser copied from MiniCPM-V-4
https://github.com/OpenSQZ/MiniCPM-V-CookBook/blob/main/quantization/awq/minicpm-v4_5_awq_quantize.md
You can refer to the documentation we provided. If you still have questions, I will reply as soon as possible after the holiday.
OK, I understand the whole process. I will merge the code.
tc-mb
changed pull request status to
merged