longcodeu-leaderboard / results /Semantic Relation Extraction 1.csv
XuyuanGuo
Update results
52d52ce
raw
history blame contribute delete
661 Bytes
Model,Type,Model Size,Context Size,0~8K,8~16K,16~32K,32~64K,64~128K
CodeLlama,Code Model, 33.7B, 16K,49.60,36.54,_,_,_
Mistral-v0.3,General Model, 7.3B, 32K,46.07,37.43,20.37,_,_
Phi-3.5,General Model, 3.8B, 128K,41.57,29.84,21.76,13.75, 3.99
DeepSeek-Coder-V2,Code Model, 15.7B, 128K,52.35,39.69,24.78,20.32, 6.22
Qwen2.5-Coder,Code Model, 7.6B, 128K,52.77,41.55,20.98,13.99,11.90
DeepSeek-V2.5,General Model,236B, 128K,72.54,61.98,38.42,38.17,_
Gemini-1.5-Flash,General Model,_,1000K,69.94,58.87,30.76,35.36,25.64
Claude-3-5-Sonnet,General Model,_, 200K,66.39,58.82,23.05,11.65, 5.04
GPT-4o,General Model,_, 128K,72.47,60.29,36.18,36.98,34.41