IST Austria Distributed Algorithms and Systems Lab

university

https://ist.ac.at/en/research/alistarh-group/

https://github.com/IST-DASLab

AI & ML interests

None defined yet.

Recent Activity

d-alistarh new activity 14 days ago

ISTA-DASLab/Mistral-Small-3.1-24B-Instruct-2503-GPTQ-4b-128g:Will you Quantize Mistral Small 3.2 this way?

BlackSamorez updated a model 26 days ago

ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4-1000steps

BlackSamorez published a model 26 days ago

ISTA-DASLab/Qwen3-8B-FPQuant-QAT-NVFP4-1000steps

View all activity

ISTA-DASLab 's models 112

ISTA-DASLab/QuEST-800M-sparse-INT4

ISTA-DASLab/DeepSeek-R1-Distill-Qwen-14B-HIGGS-4bit

Text Generation • 5B • Updated Feb 14 • 5

ISTA-DASLab/DeepSeek-R1-HIGGS-4bit

Updated Feb 14 • 4

ISTA-DASLab/DeepSeek-R1-Distill-Qwen-32B-HIGGS-4bit

Text Generation • 9B • Updated Feb 14 • 6

ISTA-DASLab/DeepSeek-R1-Distill-Llama-70B-HIGGS-4bit

Text Generation • 19B • Updated Feb 12 • 5

ISTA-DASLab/QuEST-800M-BF16

ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-GPTQ-4bit

19B • Updated Dec 12, 2024 • 6 • 7

ISTA-DASLab/Llama-3.1-8B-HIGGS-GPTQ-4bit

Text Generation • 3B • Updated Dec 10, 2024 • 4

ISTA-DASLab/Llama-3.1-8B-HIGGS-GPTQ-3bit

Text Generation • 2B • Updated Dec 10, 2024 • 5

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-GPTQ-3bit

Text Generation • 2B • Updated Dec 10, 2024 • 4

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-GPTQ-4bit

Text Generation • 3B • Updated Dec 10, 2024 • 5

ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-4bit

Text Generation • 19B • Updated Dec 9, 2024 • 5 • 3

ISTA-DASLab/Llama-3.3-70B-Instruct-HIGGS-3bit

Text Generation • 15B • Updated Dec 6, 2024 • 4

ISTA-DASLab/Llama-3.1-70B-Instruct-HIGGS-4bit

Text Generation • 19B • Updated Dec 6, 2024 • 5

ISTA-DASLab/Llama-3.1-70B-Instruct-HIGGS-3bit

Text Generation • 15B • Updated Dec 6, 2024 • 4

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-3bit

Text Generation • 2B • Updated Dec 6, 2024 • 4

ISTA-DASLab/Llama-3.1-8B-Instruct-HIGGS-4bit

Text Generation • 3B • Updated Dec 6, 2024 • 5

ISTA-DASLab/Llama-3.1-8B-HIGGS-3bit

Text Generation • 2B • Updated Dec 6, 2024 • 4

ISTA-DASLab/Llama-3.1-8B-HIGGS-4bit

Text Generation • 3B • Updated Dec 6, 2024 • 4

ISTA-DASLab/gemma-2-9b-HIGGS-3bit

Text Generation • 3B • Updated Dec 6, 2024 • 6

ISTA-DASLab/gemma-2-9b-HIGGS-4bit

Text Generation • 3B • Updated Dec 6, 2024 • 6

ISTA-DASLab/gemma-2-9b-it-HIGGS-3bit

Text Generation • 3B • Updated Dec 6, 2024 • 6

ISTA-DASLab/gemma-2-9b-it-HIGGS-4bit

Text Generation • 3B • Updated Dec 6, 2024 • 6 • 1

ISTA-DASLab/Llama-3.2-3B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • 1B • Updated Nov 8, 2024 • 34

ISTA-DASLab/Llama-3.2-1B-Instruct-AQLM-PV-2Bit-2x8

Text Generation • 0.5B • Updated Nov 8, 2024 • 245 • 1

ISTA-DASLab/Llama-3.2-1B-AQLM-PV-2Bit-2x8

Text Generation • 0.5B • Updated Nov 8, 2024 • 21

ISTA-DASLab/Llama-3.2-3B-AQLM-PV-2Bit-2x8

Text Generation • 1B • Updated Nov 8, 2024 • 7

ISTA-DASLab/Meta-Llama-3-8B-Instruct-AQLM-2Bit-1x16

Text Generation • 2B • Updated Nov 8, 2024 • 1.17k • 12

ISTA-DASLab/Meta-Llama-3.1-70B-Instruct-AQLM-PV-2Bit-1x16

Text Generation • 11B • Updated Sep 17, 2024 • 15 • 46

ISTA-DASLab/Meta-Llama-3.1-70B-AQLM-PV-2Bit-1x16

Text Generation • 11B • Updated Sep 14, 2024 • 8 • 17