Spaces:
Running
on
CPU Upgrade
Leaderboard refresh heuristic
Hello,
I have noticed recently the leaderboard is taking much longer to refresh and I am wondering what's the heuristic behind leaderboard refresh/update. Is it based on the amount of evaluated models? Is it just a cron job? Is it something manual? Would be great to know more about this.
Thanks a lot for this fantastic space!
Regards.
Hi @tensopolis ,
We have three automatic components: the backend, which handles evaluations, the parser, which processes evaluations and stores them in the Contents dataset, and the Leaderboard itself. Occasionally, network issues can affect the backend and parser, but we work to restart them as quickly as possible, so the Leaderboard can pull all the recent updates from Contents
Thank you for using the space! 🤗
I closed this issue, but feel free to ping me here in case you have any other questions about this topic
Thanks a lot!