DeepSeek-R1-ThaiInsurance-COT-Demo1 - GGUF

About

This repository contains GGUF weights for Pavariss/DeepSeek-R1-ThaiInsurance-COT-Demo1.

For a convenient overview and download list, visit our model page.

Usage

If you are unsure how to use GGUF files, refer to the llama.cpp documentation for more details.

Llama.cpp CLI

./llama-cli -m DeepSeek-R1-ThaiInsurance-COT-Demo1-q4_k_m.gguf -p "Hello!"

Provided Quants

(sorted by size, not necessarily quality)

Link	Type	Size/GB	Notes
GGUF	q2_k	2.96	very low quality, for testing
GGUF	q3_k_m	3.74
GGUF	q4_0	4.34
GGUF	q4_k_m	4.58	recommended, good balance
GGUF	q5_k_m	5.34
GGUF	q8_0	7.95	near-full precision

Thanks

Special thanks to the llama.cpp team for their amazing work.