File size: 661 Bytes
52d52ce
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
Model,Type,Model Size,Context Size,0~8K,8~16K,16~32K,32~64K,64~128K
CodeLlama,Code Model, 33.7B,  16K,72.66,64.47,_,_,_
Mistral-v0.3,General Model,  7.3B,  32K,37.43,48.33,52.87,_,_
Phi-3.5,General Model,  3.8B, 128K,45.44,47.67,43.07,22.46,17.27
DeepSeek-Coder-V2,Code Model, 15.7B, 128K,56.51,57.08,56.18,43.93,37.54
Qwen2.5-Coder,Code Model,  7.6B, 128K,44.96,36.01,32.59,15.54,33.70
DeepSeek-V2.5,General Model,236B, 128K,79.03,76.25,77.13,75.04,_
Gemini-1.5-Flash,General Model,_,1000K,68.63,71.96,74.89,66.94,76.92
Claude-3-5-Sonnet,General Model,_, 200K,68.14,27.59,47.91,25.50, 9.95
GPT-4o,General Model,_, 128K,65.37,73.97,75.58,67.34,74.58