ReadyArt
/

magnum-twilight-12b_EXL2_4.0bpw_H8

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

magnum-twilight-12b_EXL2_4.0bpw_H8 / mergekit_config.yml

FrenzyBiscuit's picture

Upload folder using huggingface_hub

268f54e verified 10 days ago

history blame contribute delete

212 Bytes

	models:
	- model: grimjim/magnum-consolidatum-v1-12b
	- model: Epiculous/Violet_Twilight-v0.2
	merge_method: slerp
	base_model: grimjim/magnum-consolidatum-v1-12b
	parameters:
	t:
	- value: 0.1
	dtype: bfloat16