shivik-m1-2b / tokenizer_config.json
ziadrone's picture
Upload tokenizer_config.json with huggingface_hub
7d867bf verified
{
"model_type": "shivik-m1",
"bos_token": "<think>",
"eos_token": "<answer>",
"unk_token": "<context>",
"pad_token": "<context>"
}