bluebench / src

Commit History

update to ibm-research org
45bc88b
verified

jbnayahu commited on

.
a6a0e86
unverified

jbnayahu commited on

.
3ee3ca7
unverified

jbnayahu commited on

Updated execution guide
0650525
unverified

jbnayahu commited on

.
bc7425f
unverified

jbnayahu commited on

Ignore non-json files
5dc0fc8
unverified

jbnayahu commited on

.
382809d
unverified

jbnayahu commited on

Cleanup
460efe2
unverified

jbnayahu commited on

Remove model links.
6066b5d
unverified

jbnayahu commited on

Switch to read local results only.
3a4f28e
unverified

jbnayahu commited on

.
57da4d5
unverified

jbnayahu commited on

.
98eb96a
unverified

jbnayahu commited on

.
b2373ad
unverified

jbnayahu commited on

updated adout content
6ff409b
unverified

jbnayahu commited on

.
50cdce4
unverified

jbnayahu commited on

Updated list of bluebench tasks (with contributions by omer.bnayahu@gmail.com)
ab870dd
unverified

jbnayahu commited on

.
d83a397
unverified

jbnayahu commited on

Apply CSS to the model name column (#14)
fc32710

clefourrier HF Staff t0-0 commited on

os.isfile --> os.path.isfile (#12)
abf5a88

clefourrier HF Staff meg HF Staff commited on

Minimal edit for directory structure assumption. (#11)
1e9865f

clefourrier HF Staff meg HF Staff commited on

Update src/display/utils.py
f867bb5

clefourrier HF Staff commited on

Update src/envs.py
30da67d

clefourrier HF Staff commited on

added leaderboard component to simplify main script
4103566

Clémentine commited on

doc
5fe3b95

Clémentine commited on

simplified the template
bbd72ab

Clémentine commited on

CPU, TOKEN, env variables (#4)
4d3bd61

clefourrier HF Staff meg HF Staff commited on

Update src/submission/check_validity.py
0767925

clefourrier HF Staff commited on

made token a requirement
0df3db8

Clémentine commited on

test
16837ad

Clémentine commited on

fix
6be74f5

Clémentine commited on

removed quantization to simplify
32b707a

Clémentine commited on

now with a functionning backend
01ea22b

Clémentine commited on

update read
4f3c2a8

Clémentine commited on

fixs
91e8a06

Clémentine commited on

updated leaderboard
29546b4

Clémentine commited on

Simplified leaderboard v0
2a860f6

Clémentine commited on

simplified some parts of the code + updated requirements
3d8dbe8

Clémentine commited on

Added check on tokenizer to prevent submissions which won't run
06b0c2d

Clémentine commited on

Update benchmark count and fix typo (`inetuning->finetuning`) (#395)
71f3e62

clefourrier HF Staff alvarobartt HF Staff commited on

fix order of request file vs request file list, to avoid resubmitting issues
54eae7e

Clémentine commited on

cache
a983535

Clémentine commited on

update for caching
29efd58

Clémentine commited on

add model architecture as column
1ba1924

Clémentine commited on

Simplify About
a6eaff8

Clémentine commited on

Refactor 2 - added plotting back
ceb2102

Clémentine commited on

fix value error in param size
76a47ce

Clémentine commited on

Fix requirements for mistral models - to change once transformers gets updated.
c875275

Clémentine commited on

fix col width
16a06c4

Clémentine commited on

refacto style + rate limit
3b3db42

Clémentine commited on

Fix TruthfulQA NaN scores to 0
992b592

Clémentine commited on