Speculative Decoding Modules Collection A collection of speculative decoding modules created using TensorRT Model Optimizer. • 11 items • Updated 4 days ago • 5
Inference Optimized Checkpoints (with Model Optimizer) Collection A collection of generative models quantized and optimized for inference with TensorRT Model Optimizer. • 43 items • Updated 4 days ago • 50