luchangli03

luchangli03's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in AQ-MedAI/Kimi-K25-eagle3 4 days ago

Can you reduce the kv head num of this model? "num_key_value_heads": 64, which requies a lots of kv cache

2

#1 opened 4 days ago by

luchangli03

liked a model 4 days ago

AQ-MedAI/Kimi-K25-eagle3

1B • Updated 5 days ago • 360 • 6

New activity in jerryzh168/Kimi-K2-Thinking-FP8 24 days ago

Can you provide the code that convert the int4 weight to fp8? thanks

#2 opened 24 days ago by

luchangli03

New activity in chutesai/DeepSeek-V3.1-Terminus-NextN 3 months ago

what's the difference between this nextn and self contained MTP model in DeepSeek-V3.1-Terminus?

#1 opened 3 months ago by

luchangli03

liked a Space about 1 year ago

Running

3.72k

The Ultra-Scale Playbook

🌌

3.72k

The ultimate guide to training LLM on large GPU Clusters