metadata
license: llama2
pipeline_tag: text-generation
tags:
- code
model-index:
- name: coma-7B-v0.1
results:
- task:
type: text-generation
dataset:
type: lm-evaluation-harness
name: bbh
metrics:
- name: acc_norm
type: acc_norm
value: 0.3355
verified: false
- task:
type: text-generation
dataset:
type: lm-evaluation-harness
name: gpqa
metrics:
- name: acc_norm
type: acc_norm
value: 0.2587
verified: false
- task:
type: text-generation
dataset:
type: lm-evaluation-harness
name: math
metrics:
- name: exact_match
type: exact_match
value: 0.0104
verified: false
- task:
type: text-generation
dataset:
type: lm-evaluation-harness
name: mmlu
metrics:
- name: acc_norm
type: acc_norm
value: 0.1433
verified: false
- task:
type: text-generation
dataset:
type: lm-evaluation-harness
name: musr
metrics:
- name: acc_norm
type: acc_norm
value: 0.3844
verified: false
- task:
type: text-generation
dataset:
type: lm-evaluation-harness
name: hellaswag
metrics:
- name: acc
type: acc
value: 0.5182234614618602
verified: false
- name: acc_norm
type: acc_norm
value: 0.6834295956980682
verified: false
base_model:
- DevQuasar/coma-7B-v0.1
I'm doing this to 'Make knowledge free for everyone', using my personal time and resources.
If you want to support my efforts please visit my ko-fi page: https://ko-fi.com/devquasar
Also feel free to visit my website https://devquasar.com/