Tried on android - looks like the tokenizers are broke
#4
by
manancode
- opened
Hi tried the gguf model. Please look
Hello! This is not a generative model, but instead a model that outputs a fixed-size embedding vector for every input text. These vectors can then be compared with cosine similarity to determine their similarity, useful especially for semantic search/information retrieval.
You can't use them as a decoder in a chatbot.
- Tom Aarsen