Thanks and Request for NVFP4 - Please :)
#14
by
MidnightPhreaker
- opened
First of all, thank you so much for GLM it is absolutely the best model I have tested. I would like to ask if you could provide a NVFP4 version of GLM-4.5-Air ? I have tried over the weekend but failed due to not having enough VRAM locally to load the ~220GB bf16 model, and all attempts to offload to CPU or disk , failed :(
Again, thank you for GLM, and all your amazing work!
