Tiny models - a trl-internal-testing Collection

trl-internal-testing 's Collections

Tiny reward models

Tiny models

updated May 8

trl-internal-testing/tiny-BloomForCausalLM

Text Generation • Updated Nov 25, 2024 • 42k
trl-internal-testing/tiny-CohereForCausalLM

Text Generation • Updated Nov 25, 2024 • 41.3k
trl-internal-testing/tiny-DbrxForCausalLM

Text Generation • Updated Nov 25, 2024 • 41.7k
trl-internal-testing/tiny-FalconMambaForCausalLM

Text Generation • Updated Nov 25, 2024 • 41.5k
trl-internal-testing/tiny-GemmaForCausalLM

Text Generation • Updated Nov 25, 2024 • 41.8k
trl-internal-testing/tiny-Gemma2ForCausalLM

Text Generation • Updated Nov 25, 2024 • 43.1k • 1
trl-internal-testing/tiny-GPT2LMHeadModel

Text Generation • Updated Nov 25, 2024 • 46.4k
trl-internal-testing/tiny-GPTNeoXForCausalLM

Text Generation • Updated Nov 25, 2024 • 41.6k
trl-internal-testing/tiny-LlamaForCausalLM-3

Text Generation • Updated Nov 25, 2024 • 41.8k
trl-internal-testing/tiny-LlamaForCausalLM-3.1

Text Generation • Updated Nov 25, 2024 • 41.7k
trl-internal-testing/tiny-LlamaForCausalLM-3.2

Text Generation • Updated Nov 25, 2024 • 395k • 1
trl-internal-testing/tiny-MistralForCausalLM-0.1

Text Generation • Updated Nov 25, 2024 • 41.6k
trl-internal-testing/tiny-MistralForCausalLM-0.2

Text Generation • Updated Nov 25, 2024 • 93.9k
trl-internal-testing/tiny-OPTForCausalLM

Text Generation • Updated Nov 25, 2024 • 41.8k
trl-internal-testing/tiny-Phi3ForCausalLM

Text Generation • Updated Nov 25, 2024 • 41.8k
trl-internal-testing/tiny-Qwen2ForCausalLM-2.5

Text Generation • Updated Nov 25, 2024 • 1.38M • 1
trl-internal-testing/tiny-Qwen2ForCausalLM-2.5-Coder

Text Generation • Updated Nov 25, 2024 • 10
trl-internal-testing/tiny-Qwen3ForCausalLM

Text Generation • Updated May 5 • 8

Note ^ Decoder-only
trl-internal-testing/tiny-BartModel

Feature Extraction • Updated Nov 25, 2024 • 43.7k
trl-internal-testing/tiny-T5ForConditionalGeneration

Text2Text Generation • Updated Nov 25, 2024 • 340k

Note ^ Encoder-decoder
trl-internal-testing/tiny-Idefics2ForConditionalGeneration

Image-Text-to-Text • Updated Nov 25, 2024 • 6.37k
trl-internal-testing/tiny-LlavaForConditionalGeneration

Image-Text-to-Text • Updated Nov 25, 2024 • 13.4k
trl-internal-testing/tiny-LlavaNextForConditionalGeneration

Image-Text-to-Text • Updated Nov 25, 2024 • 7.67k
trl-internal-testing/tiny-PaliGemmaForConditionalGeneration

Image-Text-to-Text • Updated Nov 25, 2024 • 12

Note ^ Vision language models