Liu's picture

4

Liu

Melody32768

AI & ML interests

None yet

Recent Activity

new activity 18 days ago

Anibaaal/Flux-Fusion-DS-merge-gguf-nf4-fp4-fp8-fp16:NF4 model inference

new activity 25 days ago

ulkaa/Mistral-7B-Instruct-v0.2-fp4:How can I inference about this model

new activity 3 months ago

hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4:num_key_value_heads=16 instead of 8 in the original model

View all activity

Organizations

None yet

Melody32768's activity

New activity in Anibaaal/Flux-Fusion-DS-merge-gguf-nf4-fp4-fp8-fp16 18 days ago

NF4 model inference

#8 opened 18 days ago by

New activity in ulkaa/Mistral-7B-Instruct-v0.2-fp4 25 days ago

How can I inference about this model

#1 opened 25 days ago by

New activity in hugging-quants/Meta-Llama-3.1-405B-Instruct-AWQ-INT4 3 months ago

num_key_value_heads=16 instead of 8 in the original model

#21 opened 3 months ago by

New activity in Kijai/flux-fp8 5 months ago

fp8 inference

#26 opened 5 months ago by