SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Model
Paper
•
2502.02737
•
Published
•
61
HuggingFaceFW
Enterprise
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
HuggingFaceFW's activity
craffel
authored
a
paper
about 1 hour ago
hynky
authored
a
paper
about 1 hour ago
eliebak
authored
a
paper
about 1 hour ago
loubnabnl
authored
a
paper
about 1 hour ago
clefourrier
authored
a
paper
about 1 hour ago
guipenedo
authored
a
paper
about 1 hour ago
eliebak
authored
a
paper
about 1 hour ago
anton-l
authored
a
paper
about 1 hour ago
thomwolf
authored
a
paper
about 1 hour ago
lvwerra
authored
a
paper
about 4 hours ago
guipenedo
updated
2
datasets
6 days ago
davanstrien
posted
an
update
8 days ago
Post
1683
Why choose between strong LLM reasoning and efficient models?
Use DeepSeek to generate high-quality training data, then distil that knowledge into ModernBERT answerdotai/ModernBERT-base for fast, efficient classification.
Blog post: https://danielvanstrien.xyz/posts/2025/deepseek/distil-deepseek-modernbert.html
Use DeepSeek to generate high-quality training data, then distil that knowledge into ModernBERT answerdotai/ModernBERT-base for fast, efficient classification.
Blog post: https://danielvanstrien.xyz/posts/2025/deepseek/distil-deepseek-modernbert.html
davanstrien
posted
an
update
9 days ago
Post
1823
Updated the ColPali Query Generator Space
davanstrien/ColPali-Query-Generator to use
Qwen/Qwen2.5-VL-7B-Instruct.
Given an input image, it generates several queries along with explanations to justify them. This approach can generate synthetic data for fine-tuning ColPali models.
Given an input image, it generates several queries along with explanations to justify them. This approach can generate synthetic data for fine-tuning ColPali models.
davanstrien
posted
an
update
10 days ago
Post
1981
🌍 Big step for multilingual AI data!
The Hugging Face community has rated educational content in languages spoken by 1.6 billion people! New additions:
• Japanese
• Italian
• Old High German
Learn more and contribute: https://huggingface.co/blog/davanstrien/fineweb2-community
These ratings can help enhance training data for major world languages.
The Hugging Face community has rated educational content in languages spoken by 1.6 billion people! New additions:
• Japanese
• Italian
• Old High German
Learn more and contribute: https://huggingface.co/blog/davanstrien/fineweb2-community
These ratings can help enhance training data for major world languages.
- 1 reply
hynky
authored
a
paper
21 days ago
lvwerra
authored
a
paper
21 days ago
guipenedo
authored
a
paper
21 days ago
thomwolf
authored
a
paper
21 days ago
Post
3003
💫...And we're live!💫 Seasonal newsletter from ethicsy folks at Hugging Face, exploring the ethics of "AI Agents"
https://huggingface.co/blog/ethics-soc-7
Our analyses found:
- There's a spectrum of "agent"-ness
- *Safety* is a key issue, leading to many other value-based concerns
Read for details & what to do next!
With @evijit , @giadap , and @sasha
https://huggingface.co/blog/ethics-soc-7
Our analyses found:
- There's a spectrum of "agent"-ness
- *Safety* is a key issue, leading to many other value-based concerns
Read for details & what to do next!
With @evijit , @giadap , and @sasha