Kevin Pham's picture

4 17

Kevin Pham

deoxykev

·

deoxykev

AI & ML interests

None yet

Recent Activity

replied to Ihor's post 6 days ago

🚀 Reproducing DeepSeek R1 for Text-to-Graph Extraction I’ve been working on replicating DeepSeek R1, focusing on zero-shot text-to-graph extraction—a challenging task where LMs extract entities and relations from text based on predefined types. 🧠 Key Insight: Language models struggle when constrained by entity/relation types. Supervised training alone isn’t enough, but reinforcement learning (RL), specifically Guided Reward Policy Optimization (GRPO), shows promise. 💡 Why GRPO? It trains the model to generate structured graphs, optimizing multiple reward functions (format, JSON validity, and extraction accuracy). It allows the model to learn from both positive and hard negative examples dynamically. RL can be fine-tuned to emphasize relation extraction improvements. 📊 Early Results: Even with limited training, F1 scores consistently improved, and we saw clear benefits from RL-based optimization. More training = better performance! 🔬 Next Steps: We’re scaling up experiments with larger models and high-quality data. Stay tuned for updates! Meanwhile, check out one of our experimental models here: https://huggingface.co/Ihor/Text2Graph-R1-Qwen2.5-0.5b 📔 Learn more details from the blog post: https://medium.com/p/d8b648d9f419 Feel free to share your thoughts and ask questions!

liked a model 7 days ago

mistralai/Mistral-Small-24B-Instruct-2501

replied to fdaudens's post 7 days ago

🎯 Kokoro TTS just hit v1.0! 🚀 Small but mighty: 82M parameters, runs locally, speaks multiple languages. The best part? It's Apache 2.0 licensed! This could unlock so many possibilities ✨ Check it out: https://huggingface.co/hexgrad/Kokoro-82M

View all activity

Organizations

deoxykev's activity

New activity in bespokelabs/Bespoke-Stratos-17k 14 days ago

Clarification on parent model

#3 opened 14 days ago by

New activity in RLHFlow/Llama3.1-8B-PRM-Deepseek-Data 21 days ago

Protip: Use system prompt

#1 opened 21 days ago by

New activity in numind/NuExtract 7 months ago

Training questions

#7 opened 7 months ago by

New activity in microsoft/Phi-3-vision-128k-instruct 9 months ago

phi3 vision visual encoder

#2 opened 9 months ago by