106 1 29

Lucas Atkins PRO

Crystalcareai

lucasatkins7

AI & ML interests

MoE Models & Dataset Curation

Recent Activity

updated a model 3 days ago

arcee-ai/Virtuoso-Lite

reacted to sometimesanotion's post with 👍 4 days ago

**Update** Either I had some wrong numbers plugged in to estimate benchmark numbers from comparator, or the benchmark changed. Virtuoso Small v2 at 41.07 average is still very impressive, especially for writing draft copy for business purposes, while Lamarck remains a chatty generalist-reasoning model. I've felt confident that 14B Qwen finetunes and merges could break the 42.0 average, and Arcee **came close** with https://huggingface.co/arcee-ai/Virtuoso-Small-2. Congratulations to @arcee-ai! Just two months ago, it was easy to think that 14B had plateaued, that you could have high IFEVAL or high MUSR/MATH/GPQA at 14B, but not both. That barrier is completely shattered. I see a pathway to even better, and Virtuoso Small 2 is a big part of why. Very impressive work. This community would expect no less from Arcee. Just look at this graph! Keep in mind, my merges here build on the first Virtuoso Small, and *-DS merges build on DeepSeek R1. There are some impressive merges in the pipe!

reacted to sometimesanotion's post with 🚀 4 days ago

View all activity

Organizations

Crystalcareai's activity

updated a model 3 days ago

arcee-ai/Virtuoso-Lite

Text Generation • Updated 3 days ago • 684 • 28

reacted to sometimesanotion's post with 👍🚀 4 days ago

Post

3089

**Update** Either I had some wrong numbers plugged in to estimate benchmark numbers from comparator, or the benchmark changed. Virtuoso Small v2 at 41.07 average is still very impressive, especially for writing draft copy for business purposes, while Lamarck remains a chatty generalist-reasoning model.

I've felt confident that 14B Qwen finetunes and merges could break the 42.0 average, and Arcee **came close** with https://huggingface.co/arcee-ai/Virtuoso-Small-2. Congratulations to @arcee-ai !

Just two months ago, it was easy to think that 14B had plateaued, that you could have high IFEVAL or high MUSR/MATH/GPQA at 14B, but not both. That barrier is completely shattered. I see a pathway to even better, and Virtuoso Small 2 is a big part of why. Very impressive work. This community would expect no less from Arcee.

Just look at this graph! Keep in mind, my merges here build on the first Virtuoso Small, and *-DS merges build on DeepSeek R1. There are some impressive merges in the pipe!

5 replies

replied to sometimesanotion's post 4 days ago

Thank you for sharing this! We haven’t publicized v2 yet as we’re building out our model engine to support all these different models - but there’s more come here. Along with some updates to mergekit!

published a model 8 days ago