AISE-TUDelft/Custom-Activations-BERT-Adaptive-GELU
Fill-Mask
•
Updated
BRP Tiny-Transformers
Models for the 2024-Q4 BSc. Research Project: "Architectural Decisions for Language Modelling with Small Transformers".
-
-
AISE-TUDelft/Custom-Activations-BERT-GELU
Fill-Mask • Updated • 1 -
AISE-TUDelft/Custom-Activations-BERT-PReLU
Fill-Mask • Updated • 2 -
AISE-TUDelft/Custom-Activations-BERT-ReLU
Fill-Mask • Updated • 2 -
AISE-TUDelft/Custom-Activations-BERT-SiLU
Fill-Mask • Updated • 3 -
AISE-TUDelft/Custom-Activations-BERT-Swish
Fill-Mask • Updated • 4 -
AISE-TUDelft/Custom-Activations-GPT-Adaptive-GELU
Text Generation • Updated • 4 -
AISE-TUDelft/Custom-Activations-GPT-GELU
Text Generation • Updated • 2 -
AISE-TUDelft/Custom-Activations-GPT-KAN
Text Generation • Updated • 1 -
AISE-TUDelft/Custom-Activations-GPT-PReLU
Text Generation • Updated • 2 -
AISE-TUDelft/Custom-Activations-GPT-ReLU
Text Generation • Updated • 5 -
AISE-TUDelft/Custom-Activations-GPT-SiLU
Text Generation • Updated • 8 -
AISE-TUDelft/Custom-Activations-GPT-Swish
Text Generation • Updated • 6