mobiuslabsgmbh/Meta-Llama-3-8B-Instruct_4bitgs64_hqq_hf
Text Generation
•
Updated
•
16
•
2
Shaij PRO
appoose
AI & ML interests
None yet
Recent Activity
liked
a model
5 days ago
mobiuslabsgmbh/Meta-Llama-3-8B-Instruct_4bitgs64_hqq_hf
liked
a model
12 days ago
mobiuslabsgmbh/DeepSeek-R1-ReDistill-Llama3-8B-v1.1
upvoted
a
collection
13 days ago
DeepSeek-R1-ReDistill
Organizations
appoose's activity
liked
a
model
5 days ago
liked
a
model
12 days ago
upvoted
a
collection
13 days ago
liked
2
models
15 days ago
upvoted
an
article
2 months ago
Article
EuroLLM-9B
By
and 5 others
•
•
108
liked
a
model
3 months ago
liked
2
models
4 months ago
liked
a
model
5 months ago
upvoted
an
article
5 months ago
Article
Unlocking Longer Generation with Key-Value Cache Quantization
•
41
liked
a
model
6 months ago
updated
a
model
6 months ago
posted
an
update
6 months ago
Post
2078
Releasing HQQ Llama-3.1-70b 4-bit quantized version! Check it out at
mobiuslabsgmbh/Llama-3.1-70b-instruct_4bitgs64_hqq.
Achieves 99% of the base model performance across various benchmarks! Details in the model card.
Achieves 99% of the base model performance across various benchmarks! Details in the model card.
liked
2
models
6 months ago
posted
an
update
7 months ago
Post
1792
Excited to announce the release of our high-quality Llama-3.1 8B 4-bit HQQ/calibrated quantized model! Achieving an impressive 99.3% relative performance to FP16, it also delivers the fastest inference speed for transformers.
mobiuslabsgmbh/Llama-3.1-8b-instruct_4bitgs64_hqq_calib
mobiuslabsgmbh/Llama-3.1-8b-instruct_4bitgs64_hqq_calib
- 1 reply
liked
2
models
7 months ago
updated
a
model
9 months ago