ISTA-DASLab/Llama-3.2-1B-Instruct-FPQuant-QAT-NVFP4
Text Generation
•
0.8B
•
Updated
•
17
FP-Quant QAT
High-quality QAT FP4 models to use with the fp_quant vLLM/Transformers integration on Blackwell NVIDIA GPUs. See https://arxiv.org/abs/2509.23202
-
-
ISTA-DASLab/Llama-3.2-1B-Instruct-FPQuant-QAT-MXFP4
Text Generation • 0.8B • Updated • 14 -
ISTA-DASLab/Llama-3.2-3B-Instruct-FPQuant-QAT-NVFP4
Text Generation • 2B • Updated • 21 -
ISTA-DASLab/Llama-3.2-3B-Instruct-FPQuant-QAT-MXFP4
Text Generation • 2B • Updated • 15 -
ISTA-DASLab/Llama-3.1-8B-Instruct-FPQuant-QAT-NVFP4
Text Generation • 5B • Updated • 31 -
ISTA-DASLab/Llama-3.1-8B-Instruct-FPQuant-QAT-MXFP4
Text Generation • 5B • Updated • 23 -
ISTA-DASLab/Qwen3-0.6B-FPQuant-QAT-NVFP4
Text Generation • 0.4B • Updated • 21 -
ISTA-DASLab/Qwen3-1.7B-FPQuant-QAT-NVFP4
Text Generation • 1B • Updated • 12 -
ISTA-DASLab/Qwen3-4B-FPQuant-QAT-NVFP4
Text Generation • 2B • Updated • 16 -
ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4
Text Generation • 5B • Updated • 21 -
ISTA-DASLab/Qwen3-8B-FPQuant-QAT-MXFP4
Text Generation • 5B • Updated • 43