-
Aligning Teacher with Student Preferences for Tailored Training Data Generation
Paper • 2406.19227 • Published • 25 -
Pre-training Distillation for Large Language Models: A Design Space Exploration
Paper • 2410.16215 • Published • 17 -
Baichuan Alignment Technical Report
Paper • 2410.14940 • Published • 51 -
MiniPLM: Knowledge Distillation for Pre-Training Language Models
Paper • 2410.17215 • Published • 16
By
ByRookie
AI & ML interests
None yet
Recent Activity
upvoted a collection 5 days ago
Nemotron-Cascade 2 liked a dataset 9 days ago
stepfun-ai/Step-3.5-Flash-SFT liked a model 13 days ago
miromind-ai/MiroThinker-1.7Organizations
None yet
llm math
llm length control
dataset
kd
-
Aligning Teacher with Student Preferences for Tailored Training Data Generation
Paper • 2406.19227 • Published • 25 -
Pre-training Distillation for Large Language Models: A Design Space Exploration
Paper • 2410.16215 • Published • 17 -
Baichuan Alignment Technical Report
Paper • 2410.14940 • Published • 51 -
MiniPLM: Knowledge Distillation for Pre-Training Language Models
Paper • 2410.17215 • Published • 16
pretrain data selectection
llm math
llm engineer
llm length control
reward model
dataset