This fine tuning would score 56 and be placed 1st in the leaderboard but I didn't add it, I only include full trainings in the leaderboard or (further tunings by the same company):
https://huggingface.co/CWClabs/CWC-Mistral-Nemo-12B-V2-q4_k_m
Our leaderboard can be used for human alignment in an RL setting. Ask the same question to top models and worst models and the answer from top models can get +1 score, bad models can get -1. Ask many times with higher temperature to generate more answers. What do you think?
Hi Doctor Chad, nice to see you too
Thanks for sharing,
I will test that. Yi 1.5 has the second place on my leaderboard!
Enjoy!
If you were to change them to YES/NO or two-choice questions like
Is this bioactive compound beneficial to body or not?
Is this mycotoxin really a toxin and should be removed from foods?
Which mycotoxin is worse, A or B?
We could add them to the AHA leaderboard!
Interesting, I could test that as well.
Do you know their method of uncensoring? Are they fine tuning or doing vector operations?
I may upload a Qwen3 fine tune for AHA soon (would u like to merge others with it?).
maybe! i find LLMs to have not much integrity (not much correlation between domains) compared to a human.. a human can do interdisciplinary work better imo.
yes it censors more than others. about 1% of the time it didn't answer the question. there may be a correlation between censoring and scoring low in AHA.
i will send you some questions if you politely ask
