Efficient Intelligence and Systems

community

AI & ML interests

Low-bit Quantization of Large Language Models (LLMs)

Recent Activity

AaronHuangWei authored a paper 15 days ago

Scaling RL to Long Videos

HaotongQin authored a paper 2 months ago

QVGen: Pushing the Limit of Quantized Video Generative Models

HaoranChu updated a model 3 months ago

Efficient-ML/GPTQ-for-Qwen3

View all activity

Efficient-ML 's models 52

Efficient-ML/Qwen3-4B-base-gptq-w8-perchannel

Efficient-ML/Qwen3-4B-base-gptq-w8-128

Efficient-ML/Qwen3-4B-base-gptq-w4-perchannel

Efficient-ML/Qwen3-4B-base-gptq-w4-128

Efficient-ML/Qwen3-1.7B-base-gptq-w8-perchannel

Efficient-ML/Qwen3-1.7B-base-gptq-w8-128

Efficient-ML/Qwen3-1.7B-base-gptq-w4-perchannel

Efficient-ML/Qwen3-1.7B-base-gptq-w4-128

Efficient-ML/Qwen3-0.6B-base-gptq-w8-128

Efficient-ML/Qwen3-0.6B-base-gptq-w8-perchannel

Efficient-ML/Qwen3-0.6B-base-gptq-w4-128

Efficient-ML/Qwen3-0.6B-base-gptq-w4-perchannel

Efficient-ML/LLaMA-3-70B-GPTQ-4bit-b128

Updated Jun 4, 2024 • 2

Efficient-ML/LLaMA-3-8B-AWQ-4bit-b128

Text Generation • Updated Apr 28, 2024 • 5

Efficient-ML/LLaMA-3-8B-DB-LLM-2bit-fake

Text Generation • Updated Apr 26, 2024 • 6 • 2

Efficient-ML/LLaMA-3-8B-QuIP-2bit

Text Generation • Updated Apr 26, 2024 • 6 • 3

Efficient-ML/LLaMA-3-8B-IR-QLoRA

Updated Apr 25, 2024 • 2

Efficient-ML/LLaMA-3-8B-SmoothQuant-4bit-4bit

Text Generation • 8B • Updated Apr 22, 2024 • 3

Efficient-ML/LLaMA-3-8B-SmoothQuant-8bit-8bit

Text Generation • 8B • Updated Apr 22, 2024 • 6

Efficient-ML/LLaMA-3-8B-PB-LLM-1.7bit-fake

Text Generation • 8B • Updated Apr 22, 2024 • 8 • 1

Efficient-ML/LLaMA-3-8B-BiLLM-1.1bit-fake

Updated Apr 21, 2024

Efficient-ML/LLaMA-3-8B-GPTQ-4bit-b128

Updated Apr 21, 2024 • 3