neuralmagic
/

zephyr-7b-beta-marlin

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

zephyr-7b-beta-marlin

Commit History

Update README.md

99a5e49
verified

robertgshaw2 commited on Mar 6, 2024

Update quantization/apply_gptq_save_marlin.py

a037bbe
verified

robertgshaw2 commited on Mar 6, 2024

Update README.md

ecbf873
verified

robertgshaw2 commited on Mar 6, 2024

Create requirements.txt

396feff
verified

robertgshaw2 commited on Mar 6, 2024

Create quantization/apply_gptq_save_marlin.py

a76e9cf
verified

robertgshaw2 commited on Mar 6, 2024

Create README.md

46af74a
verified

robertgshaw2 commited on Mar 6, 2024

added models

764bad9

robertgshaw2 commited on Feb 7, 2024

initial commit

f028fae
verified

robertgshaw2 commited on Feb 7, 2024