Hugging Face's logo

giraffe176
/
WestMaid_HermesMonarchv0.1

Text Generation
Transformers
Safetensors
mistral
mergekit
Merge
Eval Results
text-generation-inference
Model card Files
xet
Community
1
giraffe176 commited on
Commit
236b71a
·
verified ·
1 Parent(s): 400f634

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +22 -10
README.md CHANGED
@@ -198,16 +198,16 @@ dtype: bfloat16
198
  ### Table of Benchmarks
199
 
200
  ## Open LLM Leaderboard
201
- | | MT-Bench | EQ-Bench v2.1 | Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
202
- |---------------------------------------------------------|---------------------------------------------|---------------------------------------------------------------------------------|---------|-------|-----------|-------|------------|------------|-------|
203
- | giraffe176/WestMaid_HermesMonarchv0.1 | 8.021875 | 77.19 (3 Shot, ooba) | 72.62 | 70.22 | 87.42 | 64.31 | 61.99 | 82.16 | 69.6 |
204
- | AlphaMonarch-7B | 7.928125 | 76.08 | 75.99 | 73.04 | 89.18 | 64.4 | 77.91 | 84.69 | 66.72 |
205
- | senseable/WestLake-7B-v2 | | 78.7 | 74.68 | 73.04 | 88.65 | 64.71 | 67.06 | 86.98 | 67.63 |
206
- | teknium/OpenHermes-2.5-Mistral-7B | | 66.89 | 61.52 | 64.93 | 84.18 | 63.64 | 52.24 | 78.06 | 26.08 |
207
- | NeverSleep/Noromaid-7B-0.4-DPO | | | 59.08 | 62.29 | 84.32 | 63.2 | 42.28 | 76.95 | 25.47 |
208
- | claude-v1 | 7.900000 | 76.83 | | | | | | | |
209
- | gpt-3.5-turbo | 7.943750 | 71.74 | | | | | | | |
210
- | | [(Paper)](https://arxiv.org/abs/2306.05685) | [(Paper)](https://arxiv.org/abs/2312.06281) [Leaderboard](https://eqbench.com/) | | | | | | | |
211
 
212
  ## Yet Another LLM Leaderboard benchmarks
213
 
@@ -215,3 +215,15 @@ dtype: bfloat16
215
  |------------------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
216
  |[WestMaid_HermesMonarchv0.1](https://huggingface.co/giraffe176/WestMaid_HermesMonarchv0.1)| 45.34| 76.33| 61.99| 46.02| 57.42|
217
 
 
 
 
 
 
 
 
 
 
 
 
 
 
198
  ### Table of Benchmarks
199
 
200
  ## Open LLM Leaderboard
201
+
202
+ | | Average | ARC | HellaSwag | MMLU | TruthfulQA | Winogrande | GSM8K |
203
+ |---------------------------------------------------------|---------|-------|-----------|-------|------------|------------|-------|
204
+ | giraffe176/WestMaid_HermesMonarchv0.1 | 72.62 | 70.22 | 87.42 | 64.31 | 61.99 | 82.16 | 69.6 |
205
+ | AlphaMonarch-7B | 75.99 | 73.04 | 89.18 | 64.4 | 77.91 | 84.69 | 66.72 |
206
+ | senseable/WestLake-7B-v2 | 74.68 | 73.04 | 88.65 | 64.71 | 67.06 | 86.98 | 67.63 |
207
+ | teknium/OpenHermes-2.5-Mistral-7B | 61.52 | 64.93 | 84.18 | 63.64 | 52.24 | 78.06 | 26.08 |
208
+ | NeverSleep/Noromaid-7B-0.4-DPO | 59.08 | 62.29 | 84.32 | 63.2 | 42.28 | 76.95 | 25.47 |
209
+
210
+
211
 
212
  ## Yet Another LLM Leaderboard benchmarks
213
 
 
215
  |------------------------------------------------------------------------------------------|------:|------:|---------:|-------:|------:|
216
  |[WestMaid_HermesMonarchv0.1](https://huggingface.co/giraffe176/WestMaid_HermesMonarchv0.1)| 45.34| 76.33| 61.99| 46.02| 57.42|
217
 
218
+ ## Misc. Benchmarks
219
+
220
+ | | MT-Bench | EQ-Bench v2.1 |
221
+ |---------------------------------------------------------|---------------------------------------------|---------------------------------------------------------------------------------|
222
+ | giraffe176/WestMaid_HermesMonarchv0.1 | 8.021875 | 77.19 (3 Shot, ooba) |
223
+ | AlphaMonarch-7B | 7.928125 | 76.08 |
224
+ | senseable/WestLake-7B-v2 | | 78.7 |
225
+ | teknium/OpenHermes-2.5-Mistral-7B | | 66.89 |
226
+ | claude-v1 | 7.900000 | 76.83 |
227
+ | gpt-3.5-turbo | 7.943750 | 71.74 |
228
+ | | [(Paper)](https://arxiv.org/abs/2306.05685) | [(Paper)](https://arxiv.org/abs/2312.06281) [Leaderboard](https://eqbench.com/) |
229
+