To Submit Your Model

#1
by appvoid - opened

Welcome

Welcome to the meta-arena leaderboard! We are happy to see you here. Do you think your small model handles fewshot learning tasks with ease? If so, reply to this post with your model!

How it works

  • Only the 20 best fewshot meta-learners are shown in the leaderboard to avoid bloating the benchmark.
  • Each model is required to be at most 4b parameters (or active parameters i case of MoE)
  • Once submitted it might take a few hours or days (depending on the amount of replies for that day)
  • If everything goes as expected (and you model behaves better than any of the current 20s) your model will replace another in the leaderboard
  • The last model simply gets removed from the leaderboard.

Let the games begin!

If you would like your model to be tested against this benchmark, simply leave a reply here. You can also contact me at nohakcoffee@gmail.com

appvoid pinned discussion

Something worth noting: You need to point to the exact url for the GGUF in your request. This way, everyone can test the exact model and quantization used for those specific weights.

Sign up or log in to comment