How to use 3 MTPs?

by Yi30 - opened Apr 30

Yi30

Apr 30

May I know how to use 3 MTPs?
I tried it with num_speculative_tokens=3, but failed.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment