Hugging Face's logo

Spaces:
aelitta
/
BioMistral_gradio
Runtime error

App Files Community
BioMistral_gradio / llama-cpp-python /vendor /llama.cpp /examples /lookahead /README.md
aelitta's picture
aelitta
Upload folder using huggingface_hub
4bdb245 verified
preview code
|
raw
history blame contribute delete
195 Bytes

A newer version of the Gradio SDK is available: 6.1.0

Upgrade

llama.cpp/examples/lookahead

Demonstration of lookahead decoding technique:

https://lmsys.org/blog/2023-11-21-lookahead-decoding/

More info: https://github.com/ggerganov/llama.cpp/pull/4207