Does it support llama.cpp server?

#10

by BlindTech - opened 5 days ago

5 days ago

Hi 👋

I've noticed it's support for llama-cpp-python. But I suspect there is no way to run it with llama.cpp server and there is no plans in making it work that way?

Thank you in advance!

BlindTech changed discussion status to closed 4 days ago

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment