Any performance improvements??

#2
by KrishnaKaasyap - opened

Haa anyone seen any performance improvements either in vibes or in documented evals while using a 16 bit version instead of official 8 bit version released by DeepSeek?

Unsloth AI org

Haa anyone seen any performance improvements either in vibes or in documented evals while using a 16 bit version instead of official 8 bit version released by DeepSeek?

The 8bit version is 2x faster by default. Always use the 2xfaster

Sign up or log in to comment