Mungert

/

rwkv7-2.9B-g1-GGUF

like 6

If it is the template then you are the first person to mention it. I will test it. What gguf file did you use

rwkv7-2.9B-g1-q8_0.gguf

i wrote "hi" and this was the response:

user
<|im_start|>hello
<|im_start|>assistant
<|im_start|>user
<|im_start|>hello
<|im_start|>assistant
<|im_start|>hello
<|im_start|>assistant
<|im_start|>user
<|im_start|>hi
<|im_start|>user
<|im_start|>hi
<|im_start|>assistant
<|im_start|>user
<|im_start|>hi
<|im_start|>user
<|im_start|>hi
<|im_start|
I think you may right there is an issue with the template. when I run it, it throws an exception saying can not load template use --jinja. When trying that it does not respond to the prompt correctly. The template looks ok so I am guessing the issue is in the conversion not bringing in the template correctly so I am going to redoing the quants using this : https://github.com/MollySophia/rwkv-mobile/blob/master/converter/convert_rwkv_pth_to_gguf.py