nm-testing
/

DeepSeek-Coder-V2-Lite-Instruct-W8A8-No-smoothquant

8-bit precision

compressed-tensors

Model card Files Files and versions

DeepSeek-Coder-V2-Lite-Instruct-W8A8-No-smoothquant / recipe.yaml

RelaxingSnorlax's picture

RelaxingSnorlax

Upload folder using huggingface_hub

1b9e5c0 verified 4 months ago

history blame contribute delete

147 Bytes

	default_stage:
	default_modifiers:
	QuantizationModifier:
	targets: [Linear]
	ignore: [lm_head, 're:.*mlp.gate$']
	scheme: W8A8