UnstableLlama's picture

UnstableLlama

UnstableLlama
·

AI & ML interests

Local AI

Recent Activity

Organizations

None yet

UnstableLlama's activity

reacted to chansung's post with 👍 21 days ago
view post
Post
2025
Simple Summarization on DeepSeek-R1 from DeepSeek AI

The RL stage is very important.
↳ However, it is difficult to create a truly helpful AI for people solely through RL.
↳ So, we applied a learning pipeline consisting of four stages: providing a good starting point, reasoning RL, SFT, and safety RL, and achieved performance comparable to o1.
↳ Simply fine-tuning other open models with the data generated by R1-Zero (distillation) resulted in performance comparable to o1-mini.

Of course, this is just a brief overview and may not be of much help. All models are accessible on Hugging Face, and the paper can be read through the GitHub repository.


Model: https://huggingface.co/deepseek-ai
Paper: https://github.com/deepseek-ai/DeepSeek-R1
  • 1 reply
·
reacted to ezgikorkmaz's post with 🚀 3 months ago
New activity in UnstableLlama/Xwin-LM-13B-V0.1-4bpw-exl2 over 1 year ago

Thanks!

2
#1 opened over 1 year ago by
SekkSea