Nathan Habib's picture

Nathan Habib

SaylorTwift

·

AI & ML interests

None yet

Recent Activity

upvoted an article 1 day ago

Open-source DeepResearch – Freeing our search agents

published a dataset 3 days ago

SaylorTwift/details_openai__gpt-4o_private

published a dataset 3 days ago

SaylorTwift/details_hosted_vllm____fsx__anton__deepseek-r1-checkpoint_private

View all activity

Organizations

SaylorTwift's activity

New activity in open-llm-leaderboard/open_llm_leaderboard about 2 months ago

Llama-3.1 70B Math Hard doesn't match its dataset

#1041 opened about 2 months ago by

New activity in hf-doc-build/doc-build 5 months ago

Create lighteval/_versions.yml

#28 opened 5 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 9 months ago

bump-transformers-to-4.41.1

#753 opened 9 months ago by

apply-ruff

#748 opened 9 months ago by

New activity in open-llm-leaderboard/GenerationVisualizer 9 months ago

bbh_math_fixes

#1 opened 9 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 9 months ago

Understanding raw result data files

#729 opened 9 months ago by

No good way to identify number of activated parameters causes MIxtral evaluation failures

#680 opened 10 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 10 months ago

GSM8K failure with Llama 3 finetunes

#703 opened 10 months ago by

New activity in open-llm-leaderboard-old/results 10 months ago

Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B

#57 opened 10 months ago by

New activity in open-llm-leaderboard-old/requests 10 months ago

Renaming Model hsramall/hsramall-8b-placeholder to meta-llama/Meta-Llama-3-8B

#102 opened 10 months ago by

New activity in databricks/dbrx-base 10 months ago

Update README.md

#16 opened 10 months ago by

New activity in open-llm-leaderboard/open_llm_leaderboard 11 months ago

Model evaluation failed after 2 days

#622 opened 11 months ago by

bigstral and bigyi both failed

#628 opened 11 months ago by

New activity in open-llm-leaderboard-old/results 11 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

#46 opened 12 months ago by

Renaming Model gg-hf/gemma-7b to google/gemma-7b

#45 opened 12 months ago by

New activity in google/gemma-7b 12 months ago

Fix typo

#15 opened 12 months ago by

New activity in open-llm-leaderboard-old/details_google__gemma-2b 12 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

#1 opened 12 months ago by

New activity in open-llm-leaderboard-old/details_google__gemma-7b 12 months ago

Renaming Model gg-hf/gemma-7b to google/gemma-7b

#1 opened 12 months ago by

New activity in open-llm-leaderboard-old/requests 12 months ago

Renaming Model gg-hf/gemma-2b to google/gemma-2b

#59 opened 12 months ago by

Renaming Model gg-hf/gemma-7b to google/gemma-7b

#58 opened 12 months ago by