num_layers,num_heads,ffn_dim,memory_enabled,score
6,8,1024,True,0.7715