MarsupialAI
/

EVA-Qwen2.5-14B-v0.2_EXL2_8.0BPW_H8

Text Generation

text-generation-inference

Inference Endpoints

8-bit precision

Model card Files Files and versions Community

MarsupialAI commited on 20 days ago

Commit

f0df5f0

·

verified ·

1 Parent(s): dfb9ef0

Create README.md

8.0 BPW EXL2 quant of https://huggingface.co/EVA-UNIT-01/EVA-Qwen2.5-14B-v0.2
8bit heads. Default measurement dataset.

Files changed (1) hide show

README.md +5 -0

README.md ADDED Viewed

	@@ -0,0 +1,5 @@

+---
+library_name: transformers
+license: apache-2.0
+base_model: Qwen/Qwen2.5-14B
+---