MR-GPTQ - a ISTA-DASLab Collection

ISTA-DASLab 's Collections

MR-GPTQ

GGUF

QuEST

HIGGS

AQLM+PV

AQLM

MR-GPTQ

updated 15 days ago

MXFP4 and NVFP4 quantized models

ISTA-DASLab/Llama-3.1-8B-Instruct-MR-GPTQ-nvfp

Image-Text-to-Text • 5B • Updated 15 days ago • 59
ISTA-DASLab/Llama-3.1-8B-Instruct-MR-GPTQ-mxfp

Image-Text-to-Text • 5B • Updated 15 days ago • 14