Marc Sun's picture

Marc Sun

marcsun13

·

AI & ML interests

LLM, Quantization, Training, Inference

Recent Activity

published a model 2 days ago

marcsun13/paligemma_vqav2

liked a model 29 days ago

deepseek-ai/DeepSeek-V3

reacted to sayakpaul's post with 🔥 about 1 month ago

Commits speak louder than words 🤪 * 4 new video models * Multiple image models, including SANA & Flux Control * New quantizers -> GGUF & TorchAO * New training scripts Enjoy this holiday-special Diffusers release 🤗 Notes: https://github.com/huggingface/diffusers/releases/tag/v0.32.0

View all activity

Organizations

Articles 0

Article

39

Introducing SynthID Text

Article

216

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

View all Articles

models 15

marcsun13/paligemma_vqav2

Updated 2 days ago

marcsun13/Meta-Llama-3-8B-torchao-int8_weight_only

Updated Oct 18, 2024 • 8

marcsun13/sft_openassistant-guanaco

Text Generation • Updated Jul 5, 2024 • 12

marcsun13/gemma-2-27b-it-bnb-colab

Text Generation • Updated Jul 4, 2024 • 10

marcsun13/gemma-2-9b-it-GPTQ

Text Generation • Updated Jul 3, 2024 • 194 • 3

marcsun13/test_push_checkpoint

Fill-Mask • Updated Jun 28, 2024 • 72

marcsun13/Mixtral-8x7B-v0.1-GPTQ

Text Generation • Updated Dec 11, 2023 • 21

marcsun13/Mixtral-tiny-GPTQ

Text Generation • Updated Dec 11, 2023 • 35

marcsun13/Llama-2-13B-AWQ

Text Generation • Updated Nov 6, 2023 • 10

marcsun13/opt-125m-awq

Text Generation • Updated Oct 30, 2023 • 83

datasets

None public yet