Are you sure this is 4-bit quantization? Is there a typo?

#1
by mimeng1990 - opened

Are you sure this is 4-bit quantization? Is there a typo?

Yes

Don't mind the tags. I also noticed it.

Sign up or log in to comment