PrunaAI
/

PowerInfer-SmallThinker-3B-Preview-bnb-8bit-smashed

8-bit precision

Model card Files Files and versions

PowerInfer-SmallThinker-3B-Preview-bnb-8bit-smashed

Ctrl+K

Ctrl+K

1 contributor

History: 4 commits

sharpenb's picture

785f37f6660877dca19109cb08dca4847ff00c85b43080369daa95094e6fe000

3292dfe verified 7 months ago

.gitattributes

1.52 kB

initial commit 8 months ago
README.md

5.32 kB

785f37f6660877dca19109cb08dca4847ff00c85b43080369daa95094e6fe000 7 months ago
config.json

1.24 kB

785f37f6660877dca19109cb08dca4847ff00c85b43080369daa95094e6fe000 7 months ago
generation_config.json

242 Bytes

785f37f6660877dca19109cb08dca4847ff00c85b43080369daa95094e6fe000 7 months ago
model.safetensors

3.4 GB
xet

7c9a9d2b4cb1e4c431ecc30299a724a301048b97d8b211970db13ac36f13f5a0 7 months ago
smash_config.json

658 Bytes

785f37f6660877dca19109cb08dca4847ff00c85b43080369daa95094e6fe000 7 months ago