Recommended Parameters?
Hello, I'm pretty new to this so I apologize if this isnt the best spot to ask this. I'm using this with Koboldcpp & Sillytavern, and I was wondering, whats the best parameters to use for role playing? I know there's trial and error involved to get it tuned to a person's likes, but I was wondering if theres a good starting place or such with this model? I'm still learning on how to use temp, tops, rep penalty, etc. Any help is greatly appreciated, especially for any new users finding this in the future, thank you!
I'm not part of Anthracite but have a look at this sphiratrioth666/SillyTavern-Presets-Sphiratrioth
With 12B models in general, I often try temp=1, minP=0.02 as a starting point to get creative outputs.
I'd recommend either Temp=1, 0.1 Min-p or Temp1, 2.0 Nsigma, 0.01 Min-p, Toss in 1.03 rep-pen to taste.
Thank you all so much!