Hugging Face's logo

mratsim
/
Seed-OSS-36B-Instruct-FP8-KV8

Text Generation
Safetensors
seed_oss
vllm
llmcompressor
text-generation-inference
conversational
compressed-tensors
Model card Files
xet
Community
Seed-OSS-36B-Instruct-FP8-KV8 / README.md

Commit History

Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
2b7d5a6

Mamy Ratsimbazafy commited on