A newer version of the Gradio SDK is available: 5.33.1
5.33.1
Demonstration of speculative decoding and tree-based speculative decoding techniques
More info: