Article 1 Emergent Semantics Beyond Token Embeddings: A GPT-like Transformer Learns with Frozen 16βD Binary Token-ID Embeddings (n_embed=16)
Emergent Semantics Beyond Token Embeddings Paper: 2507.04886 (TMLR, Oct 2025). 'Emergent Semantics Beyond Token Embeddings: Transformer LMs with Frozen Visual Unicode Representations' Bochkov/emergent-semantics-model-uni-glyph-335m Text Generation β’ Updated 30 days ago β’ 16 Bochkov/emergent-semantics-model-unfrozen-335m Text Generation β’ Updated 30 days ago β’ 2 Bochkov/emergent-semantics-model-16-bit-269m Text Generation β’ Updated 30 days ago β’ 19 β’ 1 Bochkov/emergent-semantics-model-64-bit-272m Text Generation β’ Updated 30 days ago β’ 5
Growing Transformers:Layer-wise Expansion Comparative Study Paper: 2507.07129 'Growing Transformers: Modular Composition and Layer-wise Expansion on a Frozen Substrate' (4.2.2, 5.2. βResults) Bochkov/growing-transformers-model-16-bit-1-9-181m Text Generation β’ Updated 28 days ago β’ 13 Bochkov/growing-transformers-model-unicode-1-9-247m Text Generation β’ Updated Jan 4 β’ 6 Bochkov/growing-transformers-model-unfrozen-1-9-247m Text Generation β’ Updated 28 days ago β’ 9 Bochkov/growing-transformers-model-frozen-16-bit-baseline-monolyth-181m Text Generation β’ Updated 28 days ago β’ 3
Bochkov/growing-transformers-model-frozen-16-bit-baseline-monolyth-181m Text Generation β’ Updated 28 days ago β’ 3
Emergent Semantics Beyond Token Embeddings Paper: 2507.04886 (TMLR, Oct 2025). 'Emergent Semantics Beyond Token Embeddings: Transformer LMs with Frozen Visual Unicode Representations' Bochkov/emergent-semantics-model-uni-glyph-335m Text Generation β’ Updated 30 days ago β’ 16 Bochkov/emergent-semantics-model-unfrozen-335m Text Generation β’ Updated 30 days ago β’ 2 Bochkov/emergent-semantics-model-16-bit-269m Text Generation β’ Updated 30 days ago β’ 19 β’ 1 Bochkov/emergent-semantics-model-64-bit-272m Text Generation β’ Updated 30 days ago β’ 5
Growing Transformers:Layer-wise Expansion Comparative Study Paper: 2507.07129 'Growing Transformers: Modular Composition and Layer-wise Expansion on a Frozen Substrate' (4.2.2, 5.2. βResults) Bochkov/growing-transformers-model-16-bit-1-9-181m Text Generation β’ Updated 28 days ago β’ 13 Bochkov/growing-transformers-model-unicode-1-9-247m Text Generation β’ Updated Jan 4 β’ 6 Bochkov/growing-transformers-model-unfrozen-1-9-247m Text Generation β’ Updated 28 days ago β’ 9 Bochkov/growing-transformers-model-frozen-16-bit-baseline-monolyth-181m Text Generation β’ Updated 28 days ago β’ 3
Bochkov/growing-transformers-model-frozen-16-bit-baseline-monolyth-181m Text Generation β’ Updated 28 days ago β’ 3
Bochkov/growing-transformers-model-frozen-16-bit-baseline-monolyth-181m Text Generation β’ Updated 28 days ago β’ 3
Bochkov/growing-transformers-model-unfrozen-baseline-monolyth-247m Text Generation β’ Updated 28 days ago β’ 5
Bochkov/growing-transformers-model-frozen-unicode-baseline-monolyth-247m Text Generation β’ Updated 28 days ago β’ 6