dolphin-mistral-TRACHI-7b

Quantized versions of the fine-tuned dolphin-2.2.1-mistral-7b on TRACHI datasets.

Model Details

This model aims to facilitate conversations with individual TRACHI characters. Prototyping Discord Bots running on Ollama.

Characters are prompted by including their name in the system role within the prompt:

<|im_start|>system
{character}<|im_end|>
<|im_start|>user
{prompt}<|im_end|>
<|im_start|>assistant

Like the base model ( dolphin-2.2.1-mistral-7b ), this fine-tune is unbiased and uncensored.

GGUF

Model size

7B params

Architecture

llama

Hardware compatibility

4-bit

5-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support