Quentin Gallouédec's picture

Quentin Gallouédec

qgallouedec

·

https://gallouedec.com

AI & ML interests

None yet

Recent Activity

published a model about 3 hours ago

qgallouedec/Qwen2.5-1.5B-Open-R1-GRPO

reacted to lewtun's post with 🔥 1 day ago

We are reproducing the full DeepSeek R1 data and training pipeline so everybody can use their recipe. Instead of doing it in secret we can do it together in the open! 🧪 Step 1: replicate the R1-Distill models by distilling a high-quality reasoning corpus from DeepSeek-R1. 🧠 Step 2: replicate the pure RL pipeline that DeepSeek used to create R1-Zero. This will involve curating new, large-scale datasets for math, reasoning, and code. 🔥 Step 3: show we can go from base model -> SFT -> RL via multi-stage training. Follow along: https://github.com/huggingface/open-r1

upvoted an article 4 days ago

Open-R1: Update #1

View all activity

Organizations

qgallouedec's activity

liked a dataset 14 days ago

trl-internal-testing/zen

Viewer • Updated Nov 26, 2024 • 266 • 23.5k • 1

liked a model 19 days ago

weqweasdas/RM-Gemma-2B

Text Classification • Updated Mar 22, 2024 • 7.57k • 22

liked a Space 22 days ago

Reward Bench Leaderboard

Explore and analyze RewardBench leaderboard data

liked a dataset 29 days ago

trl-lib/lm-human-preferences-descriptiveness

Viewer • Updated 29 days ago • 6.26k • 50 • 1

liked a dataset about 2 months ago

argilla/distilabel-intel-orca-kto

Viewer • Updated Mar 19, 2024 • 23.1k • 67 • 7

liked a Space 2 months ago

Package Download History

Github Star History, but for PyPI package downloads.

liked a dataset 2 months ago

b-mc2/sql-create-context

Viewer • Updated Jan 25, 2024 • 78.6k • 2.23k • 433

liked a model 2 months ago

Qwen/Qwen2.5-Coder-7B-Instruct

Text Generation • Updated 26 days ago • 138k • 403

liked a dataset 4 months ago

Birchlabs/openai-prm800k-stepwise-critic

Viewer • Updated Jun 3, 2023 • 1.09M • 212 • 44

liked 2 models 4 months ago

allenai/Molmo-7B-D-0924

Image-Text-to-Text • Updated Oct 10, 2024 • 570k • 503

trl-lib/Qwen2-0.5B-DPO

Text Generation • Updated Sep 27, 2024 • 11 • 4

liked a model 5 months ago

llm-blender/PairRM

Text Generation • Updated Jan 22, 2024 • 11.2k • 196

liked a dataset 5 months ago

openbmb/UltraFeedback

Viewer • Updated Dec 29, 2023 • 64k • 2.2k • 347

liked 2 models 5 months ago

Qwen/Qwen2-0.5B-Instruct

Text Generation • Updated Aug 21, 2024 • 179k • 174

mistral-community/pixtral-12b-240910

Image-Text-to-Text • Updated Oct 1, 2024 • 383

liked a dataset 5 months ago

openai/summarize_from_feedback

Viewer • Updated Jan 3, 2023 • 194k • 1.27k • 196

liked a dataset 6 months ago

lewtun/ultrafeedback_prompts

Viewer • Updated Aug 23, 2024 • 59.3k • 28 • 1

liked a Space 6 months ago

Models Explorer

liked a model 6 months ago

EleutherAI/pythia-14m

Text Generation • Updated Jul 26, 2023 • 236k • 20

liked a Space 7 months ago

Followgraph