Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

text-generation-inference

Inference Endpoints

Mixture of Experts

8-bit precision

Carbon Emissions

text-embeddings-inference

Models

7,127

Full-text search

Active filters: awq

PrunaAI/01-ai-Yi-6B-Chat-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 12

PrunaAI/flammenai-Mahou-1.2-llama3-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 13

broyal/gemma-7b-AWQ

Text Generation • Updated Jul 19, 2024 • 14

PrunaAI/ajibawa-2023-Code-Llama-3-8B-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 19

PrunaAI/nayohan-llama3-instrucTrans-enko-8b-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 11

PrunaAI/instructlab-merlinite-7b-lab-AWQ-4bit-smashed

Text Generation • Updated Jul 19, 2024 • 13

google/gemma-7b-AWQ

Text Generation • Updated Jul 23, 2024 • 31

PrunaAI/dicta-il-dictalm2.0-instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 20, 2024 • 10

lk11/Llama-3-8B-AWQ-4bit

Text Generation • Updated Jul 24, 2024 • 14

PrunaAI/LumiOpen-Viking-7B-AWQ-4bit-smashed

Text Generation • Updated Jul 20, 2024 • 14

PrunaAI/VAGOsolutions-SauerkrautLM-7b-LaserChat-AWQ-4bit-smashed

Text Generation • Updated Jul 21, 2024 • 13

PrunaAI/h2oai-h2o-danube-1.8b-base-AWQ-4bit-smashed

Text Generation • Updated Jul 21, 2024 • 12

PrunaAI/hfl-llama-3-chinese-8b-instruct-v3-AWQ-4bit-smashed

Text Generation • Updated Jul 21, 2024 • 19

PrunaAI/yam-peleg-Hebrew-Mistral-7B-AWQ-4bit-smashed

Text Generation • Updated Jul 21, 2024 • 13

PrunaAI/ibm-granite-granite-3b-code-base-AWQ-4bit-smashed

Text Generation • Updated Jul 21, 2024 • 11

PrunaAI/rinna-llama-3-youko-8b-AWQ-4bit-smashed

Text Generation • Updated Jul 21, 2024 • 12

PrunaAI/ibm-granite-granite-8b-code-instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 21, 2024 • 11

Weni/ZeroShot-Agents-Mistral-4.0.71-SFT-300-AWQ

Text Generation • Updated Jul 21, 2024 • 11

PrunaAI/openchat-openchat-3.5-0106-AWQ-4bit-smashed

Text Generation • Updated Jul 21, 2024 • 13

PrunaAI/FreedomIntelligence-Apollo-7B-AWQ-4bit-smashed

Text Generation • Updated Jul 21, 2024 • 9

PrunaAI/BramVanroy-GEITje-7B-ultra-AWQ-4bit-smashed

Text Generation • Updated Jul 21, 2024 • 14

PrunaAI/tensoropera-Fox-1-1.6B-AWQ-4bit-smashed

Text Generation • Updated Jul 21, 2024 • 14

PrunaAI/aixsatoshi-Llama-3-youko-8b-instruct-chatvector-AWQ-4bit-smashed

Text Generation • Updated Jul 22, 2024 • 11

PrunaAI/hiieu-Meta-Llama-3-8B-Instruct-function-calling-json-mode-AWQ-4bit-smashed

Text Generation • Updated Jul 22, 2024 • 14

PrunaAI/Qwen-Qwen1.5-0.5B-Chat-AWQ-4bit-smashed

Text Generation • Updated Jul 22, 2024 • 15

PrunaAI/cognitivecomputations-dolphin-2.9.2-qwen2-7b-AWQ-4bit-smashed

Text Generation • Updated Jul 22, 2024 • 15

PrunaAI/mzbac-llama-3-8B-Instruct-function-calling-v0.2-AWQ-4bit-smashed

Text Generation • Updated Jul 22, 2024 • 13

PrunaAI/scb10x-llama-3-typhoon-v1.5-8b-instruct-AWQ-4bit-smashed

Text Generation • Updated Jul 22, 2024 • 15

ildodeltaRule/Yi-6B-200K-AWQ-VLLM

Text Generation • Updated Jul 23, 2024 • 16

PrunaAI/HuggingFaceTB-SmolLM-1.7B-AWQ-4bit-smashed

Text Generation • Updated Jul 22, 2024 • 11