nvfp4_dfloat11
Collection
The bf16 layers are compressed using the Dfloat11 lossless compression mixed with nvfp4 layers. • 2 items • Updated
New tests with larger model
Not worth the dfoat11 compression with this layer mix. only saves 2.91Mbs
- Downloads last month
- -
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support