saksornr
/

SeaLLM-7B-v2.5-4bit

Text Generation

transformers accelerate bitsandbytes

text-generation-inference

4-bit precision

Model card Files Files and versions Community

Uploaded model

Developed by: saksornr
License: apache-2.0
Finetuned from model : SeaLLMs/SeaLLM-7B-v2.5

Pre-quantized for faster loading. (~17 GB to 5 GB)

Downloads last month: 5

Safetensors

Model size

4.78B params

Tensor type

F32

·

BF16

·

U8

·

Inference Providers NEW

Text Generation

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for saksornr/SeaLLM-7B-v2.5-4bit

Base model

SeaLLMs/SeaLLM-7B-v2.5

Quantized

(15)

this model

Finetunes

1 model