TorchAO quantized Qwen3 models from PyTorch team, runnable in A100, H100 through vLLM and in mobile devices through ExecuTorch

pytorch
non-profit
AI & ML interests
An open source machine learning framework that accelerates the path from research prototyping to production deployment.
Recent Activity
View all activity
Organization Card
Hugging Face 🤗 + PyTorch 🔥
spaces
43
models
6

pytorch/Phi-4-mini-instruct-8da4w
Text Generation
•
Updated
•
1.17k
•
1

pytorch/Qwen3-4B-8da4w
Text Generation
•
Updated
•
140

pytorch/Qwen3-32B-float8dq
Text Generation
•
Updated
•
102

pytorch/Phi-4-mini-instruct-int4wo-hqq
Text Generation
•
Updated
•
767

pytorch/Phi-4-mini-instruct-float8dq
Text Generation
•
Updated
•
809
•
1

pytorch/Qwen3-8B-int4wo-hqq
Text Generation
•
Updated
•
24
datasets
0
None public yet