Edit Models filters

Apps

Docker Model Runner

Inference Providers

HF Inference API

Misc

Inference Endpoints

text-generation-inference

4-bit precision

8-bit precision

text-embeddings-inference

Carbon Emissions

Mixture of Experts

Models

780

Full-text search

Active filters: exl3

MetaphoricalCode/Q2.5-32B-Slush-exl3-4.5bpw-hb8

Text Generation • 10B • Updated Jun 4 • 4

MetaphoricalCode/Q2.5-32B-Slush-exl3-5bpw-hb6

Text Generation • 11B • Updated Jun 4 • 3

MetaphoricalCode/Q2.5-32B-Slush-exl3-6bpw-hb6

Text Generation • 13B • Updated Jun 4 • 3

MetaphoricalCode/Q2.5-32B-Slush-exl3-8bpw-hb8

Text Generation • 17B • Updated Jun 4 • 3

ArtusDev/qingy2024_GRMR-V3-G4B-EXL3

Updated Jun 17 • 1

ArtusDev/qingy2024_GRMR-V3-Q4B-EXL3

ArtusDev/qingy2024_GRMR-V3-L3B-EXL3

Updated Jun 17 • 8

MetaphoricalCode/gemma3-27b-abliterated-dpo-exl3-2bpw-hb6

Image-Text-to-Text • 6B • Updated Jun 6 • 3

MetaphoricalCode/gemma3-27b-abliterated-dpo-exl3-2.5bpw-hb6

Image-Text-to-Text • 6B • Updated Jun 6 • 4

MetaphoricalCode/Mistral-Nemo-Gutenberg-Encore-12B-exl3-4bpw-hb6

Text Generation • Updated Jun 6 • 4

MetaphoricalCode/Mistral-Nemo-Gutenberg-Encore-12B-exl3-5bpw-hb6

Text Generation • 4B • Updated Jun 6 • 5

MetaphoricalCode/Mistral-Nemo-Gutenberg-Encore-12B-exl3-6bpw-hb6

Text Generation • 5B • Updated Jun 6 • 2

MetaphoricalCode/Mistral-Nemo-Gutenberg-Encore-12B-exl3-8bpw-hb8

Text Generation • 6B • Updated Jun 6 • 5

MetaphoricalCode/Qwen3-Gutenberg-Encore-14B-exl3-4bpw-hb6

Text Generation • 4B • Updated Jun 6 • 3

MetaphoricalCode/Qwen3-Gutenberg-Encore-14B-exl3-5bpw-hb6

Text Generation • 5B • Updated Jun 6 • 3

MetaphoricalCode/Qwen3-Gutenberg-Encore-14B-exl3-6bpw-hb6

Text Generation • 6B • Updated Jun 6 • 3

MetaphoricalCode/Qwen3-Gutenberg-Encore-14B-exl3-8bpw-hb8

Text Generation • 8B • Updated Jun 6 • 3

ArtusDev/nvidia_Nemotron-Research-Reasoning-Qwen-1.5B-EXL3

Text Generation • Updated Jun 17

ArtusDev/TeeZee_DarkForest-20B-v2.0-EXL3

Updated Jun 17 • 1

DeusImperator/L3.3-GeneticLemonade-Unleashed-v3-70B_exl3_3.0bpw_H6

Text Generation • 14B • Updated Jun 9 • 12

ArtusDev/sophosympatheia_StrawberryLemonade-L3-70B-v1.0-EXL3

Updated Jun 17 • 3 • 1

async0x42/DeepSeek-R1-0528-Qwen3-8B-exl3_4.0bpw

Text Generation • Updated Jun 9 • 11

async0x42/DeepSeek-R1-0528-Qwen3-8B-exl3_4.5bpw

Text Generation • Updated Jun 9 • 5

MetaphoricalCode/Vitus-Qwen3-14B-exl3-4bpw-hb6

4B • Updated Jun 9 • 3

MetaphoricalCode/Vitus-Qwen3-14B-exl3-5bpw-hb6

5B • Updated Jun 9 • 3

MetaphoricalCode/Vitus-Qwen3-14B-exl3-6bpw-hb6

6B • Updated Jun 10 • 3

MetaphoricalCode/Vitus-Qwen3-14B-exl3-8bpw-hb8

8B • Updated Jun 10 • 3

MetaphoricalCode/Gemma-3-Glitter-27B-exl3-3bpw-hb6

Image-Text-to-Text • 7B • Updated Jun 10 • 4

MikeRoz/DS-R1-Distill-70B-ArliAI-RpR-v4-Large-exl3

Text Generation • Updated Jun 10 • 7

ArtusDev/Delta-Vector_Austral-70B-Preview-EXL3