Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
mratsim
/
Seed-OSS-36B-Instruct-FP8-KV8
like
0
Text Generation
Safetensors
HuggingFaceH4/ultrachat_200k
seed_oss
vllm
llmcompressor
text-generation-inference
conversational
compressed-tensors
License:
mit
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
Seed-OSS-36B-Instruct-FP8-KV8
37.8 GB
2 contributors
History:
2 commits
Mamy Ratsimbazafy
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
2b7d5a6
23 days ago
.gitattributes
Safe
1.57 kB
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
README.md
996 Bytes
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
chat_template.jinja
Safe
7.71 kB
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
config.json
2.27 kB
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
generation_config.json
192 Bytes
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
model-00001-of-00008.safetensors
4.94 GB
xet
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
model-00002-of-00008.safetensors
4.86 GB
xet
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
model-00003-of-00008.safetensors
4.86 GB
xet
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
model-00004-of-00008.safetensors
4.86 GB
xet
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
model-00005-of-00008.safetensors
4.86 GB
xet
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
model-00006-of-00008.safetensors
4.86 GB
xet
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
model-00007-of-00008.safetensors
4.86 GB
xet
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
model-00008-of-00008.safetensors
3.63 GB
xet
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
model.safetensors.index.json
112 kB
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
recipe.yaml
1.11 kB
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
special_tokens_map.json
Safe
432 Bytes
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
tokenizer.json
Safe
11.9 MB
xet
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
tokenizer_config.json
Safe
23.8 kB
Seed-OSS: FP8 weights + FP8 activation + non-working FP8 KV-cache for debugging
23 days ago
