Jason Corkill's picture

Jason Corkill

jasoncorkill

AI & ML interests

Human data annotation

Recent Activity

updated a collection 2 days ago
Sora Rich annotation
upvoted a collection 2 days ago
Sora Rich annotation
updated a dataset 2 days ago
Rapidata/text-2-video-Rich-Human-Feedback
View all activity

Organizations

Blog-explorers's profile picture Hugging Face Discord Community's profile picture mlo-data-collab's profile picture Rapidata's profile picture

jasoncorkill's activity

posted an update 6 days ago
view post
Post
2629
We benchmarked @xai-org 's Aurora model, as far as we know the first public evaluation of the model at scale.

We collected 401k human annotations in over the past ~2 days for this, we have uploaded all of the annotation data here on huggingface with a fully permissive license
Rapidata/xAI_Aurora_t2i_human_preferences
reacted to ariG23498's post with ๐Ÿš€ 20 days ago
posted an update 27 days ago
view post
Post
1136
We uploaded huge human annotated preference dataset for image generation. Instead of just having people choose which model they preferer, we annotated an alignment score on a word by word basis for the prompt. rate the images on coherence, overall alignment and style preference. Those images that score badly were also given to annotators to highlight problem areas. Check it out! Rapidata/text-2-image-Rich-Human-Feedback

We also wrote a blog post for those who want a bit more detail:
https://huggingface.co/blog/RapidataAI/beyond-image-preferences
posted an update 29 days ago