Validation Metrics

Loss: 2.133
Rouge1: 45.861
Rouge2: 14.179
RougeL: 23.565
RougeLsum: 40.908
Gen Len: 195.334

Downloads last month: 105

Safetensors

Model size

460M params

Tensor type

F32

Inference Providers NEW

Summarization

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Dataset used to train Blaise-g/led_pubmed_sumpubmed_1

Evaluation results

ROUGE-1 on Blaise-g/SumPubmed
test set self-reported

41.252
ROUGE-2 on Blaise-g/SumPubmed
test set self-reported

11.129
ROUGE-L on Blaise-g/SumPubmed
test set self-reported

20.253
ROUGE-LSUM on Blaise-g/SumPubmed
test set self-reported

37.150
loss on Blaise-g/SumPubmed
test set self-reported

6.371
gen_len on Blaise-g/SumPubmed
test set self-reported

193.374

View on Papers With Code