zai-org
/

chatglm3-6b

Model card Files Files and versions Community

chatglm3-6b / tokenization_chatglm.py

Commit History

Update tokenization_chatglm.py

e9e0406
verified

zR commited on Dec 5, 2024

update tokenizer for compatibility with new transformers (#64)

3afaed6
verified

zR

katuni4ka commited on Nov 22, 2024

fix for apply_chat_template

37f2196
verified

Yuxuan Zhang commited on Jan 16, 2024

fix can't set attribute 'eos_token' when loading the saved tokenizer (#27)

6d10497

Yuxuan Zhang

hiyouga commited on Dec 29, 2023

fix piece id out of range (#20)

456aa87

Yuxuan Zhang commited on Dec 7, 2023

Add encode_special_tokens option

e46a148

duzx16 commited on Nov 9, 2023

Implement new interface

1676f07

duzx16 commited on Oct 26, 2023

Add system prompt

591fa87

duzx16 commited on Oct 26, 2023

Implement new chat method

85ba2d2

duzx16 commited on Oct 25, 2023