Jędrzej Grabala's picture

20 98

Jędrzej Grabala

jgitsolutions

·

https://jgitsol.github.io

AI & ML interests

Local Drive Human Overseered System of Agents, LLMs, Langchains & other useful stuff on mid-to-low-end of commercial hardware.

Recent Activity

liked a Space 1 day ago

depth-anything/Video-Depth-Anything

reacted to chansung's post with 👍 1 day ago

Simple Paper Review #5 I briefly reviewed the paper "SFT Memorizes, RL Generalizes," which compares SFT and RL in post-training of LLM/VLM from HKU, UC Berkeley, Google DeepMind, and New York University The conclusion suggests SFT excels in memorization, while RL is better for generalization. However, since LLM/VLM should benefit humans beyond just generalization, a mix of SFT and RL is advisable. Typically, some SFT is followed by RL to understand prompt formats and enhance generalization through trial and error. The study focused on one model, Llama-3.2-Vision-11B, using environments like General Points for arithmetic reasoning and V-IRL for spatial reasoning. Training data was used for both SFT and RL, with evaluations on in-distribution and out-of-distribution data to assess memorization and generalization. I want to apply RL extensively, but it requires building a similar simulation environment. For domain-specific models, significant investment in creating a "playground" for the model is crucial, as the effort will directly influence the outcomes. https://arxiv.org/abs/2501.17161

liked a Space 3 days ago

prithivMLmods/Multimodal-OCR

View all activity

Organizations

Collections 5

spaces 1

Owl Tracking

Powerful foundation model for zero-shot object tracking

models

None public yet

datasets

None public yet