TinyGPT (Minimal) — Colab A100 Run

Tokens: TinyStories 10%
Context: 512
Dim: 512
Layers: 6
Heads: 8
Files: model.safetensors, pytorch_model.bin, tokenizer.json, config.json

A cute little experiment for testing. Lets teach our little robot some fun pentachoron behavior.

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including AbstractPhil/tiny-gpt-tests