tokenizer_v0 / tokenizer.json
thomasw21
Add tokenizer
9f96c30
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
54733cceb3fa9eb9e61b238bd09f4c755b99703841351029e4a4e1b9f21d968a
Pointer size:
133 Bytes
·
Size of remote file:
10.6 MB
·
Xet backed hash:
166557adf7dc11995dcb3fb98673dbb7be26881f21be3681ca2f35c78b480cee

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.