Chinese characters added in the response
#34
by
DrAliGomaa
- opened
the Model is Great and awesome!, using it in arabic, but the issue that preventing me from depending on it in chatbot that it randomly generates chinese characters, is there a metigation ? i tried in the system and user prompt to tell to not send characters in chinese, also reduce the temperature to 0.1 and top_P to 0.1 and made the top_K 0 but still!!
I had this kind of Issues when using with VLLM and very high batch numbers.
If you do batching try if it happpens without.
If anyone knows why this is the case, I would be happy to learn about it.
Otherwise I never used it in arabic, perhaps it is not as stable in this language.
Had similar Issues in the past with older Models in German for example.