Proposal to add a Number of Parameters Column

#7
by bulb-infmind - opened

A lot of startups and other organisations make decision on choosing their Language Model of choice by looking at the parameter/performance tradeoff between different models. Considering the added cost of quantising/pruning larger models or the increased FLOPs causing an increase in carbon emissions, leads me to believe adding Number of Parameters should aid the reader in better appreciating the practicality of using that particular model for their own use-case.

So, is it possible to add such a column in the leaderboard?

Sign up or log in to comment