BabyLMs for Learner Simulation - a ALTACambridge Collection

ALTACambridge 's Collections

ALTA Corpora and Datasets

BabyLMs for Learner Simulation

Controllable Complexity Chatbots

Papers

BabyLMs for Learner Simulation

updated 14 days ago

We develop Small Language Models (BabyLMs) as Cognitive Proxies of Language Learners.

BabyBabelLM GPTBERT

Collection

BabyBabelLM (Multilingual BabyLM) with GPT-BERT Architecture • 11 items • Updated 6 days ago
Multilingual BabyLM CHILDES

Collection

Salhan et al (2024) Multilingual BabyLMs trained on CHILDES corpora. • 8 items • Updated Apr 12
Less is More: Pre-Training Cross-Lingual Small-Scale Language Models with Cognitively-Plausible Curriculum Learning Strategies

Paper • 2410.22886 • Published Oct 30, 2024 • 1
Looking to Learn: Token-wise Dynamic Gating for Low-Resource Vision-Language Modelling

Paper • 2510.08470 • Published 16 days ago • 1