Update README.md
Browse files
README.md
CHANGED
@@ -37,7 +37,8 @@ As all palmer models, the model is biased to respond to answers without using an
|
|
37 |
| Model | MMLU | ARC-C | HellaSwag | PIQA | Winogrande | Average |
|
38 |
|--------------------------------|-------|-------|-----------|--------|------------|---------|
|
39 |
| tinyllama | 0.2577| 0.3029| 0.5935 | 0.7329 | 0.5959 | 0.4966 |
|
40 |
-
|
|
|
|
41 |
| palmer-004 | 0.2661 |0.3490 | 0.6173 | **0.7481** | **0.6417** | 0.5244|
|
42 |
|
43 |
|
|
|
37 |
| Model | MMLU | ARC-C | HellaSwag | PIQA | Winogrande | Average |
|
38 |
|--------------------------------|-------|-------|-----------|--------|------------|---------|
|
39 |
| tinyllama | 0.2577| 0.3029| 0.5935 | 0.7329 | 0.5959 | 0.4966 |
|
40 |
+
| danube3-500m-chat (current sota)| 0.2554 | **0.3626** | 0.6072 | 0.7432 | 0.6140 | 0.5164
|
41 |
+
| palmer-004-turbo |**0.2736**|0.3558|**0.6179**|0.7367|0.6117|0.5191|
|
42 |
| palmer-004 | 0.2661 |0.3490 | 0.6173 | **0.7481** | **0.6417** | 0.5244|
|
43 |
|
44 |
|