Spico/LLaMA-MoE-v1-2_8-UniformSFT
Text Generation • 7B • Updated • 3
Tong Zhu
Spico
AI & ML interests
Information Extraction, Mixture-of-Experts, LLM
Recent Activity
commentedon a paper 1 day ago
Intern-S1-Pro: Scientific Multimodal Foundation Model at Trillion Scale upvoted an article about 1 month ago
Your MoE Model Does Not Have to Select Fixed Number of Experts published an article about 1 month ago
Your MoE Model Does Not Have to Select Fixed Number of ExpertsOrganizations
Spico/LLaMA-MoE-v1-2_8-DynamicSFT
Text Generation • 7B • Updated • 3
Spico/sheared-llama-2.7b-deita-6k-sft
Text Generation • 3B • Updated • 2 • 1
Spico/internlm2-7b-hf-llama
Text Generation • Updated • 3
Spico/mirror-chinese-mrcqa-alpha
Updated
Spico/Humback-Myx
Text Generation • Updated • 6 • 3
Spico/Humback-M0
Text Generation • Updated • 4 • 3