ayayay-tokenizer / tokenizer.json
transhumanist-already-exists's picture
add tokenizer files
0d47963 verified
This file is stored with Xet . It is too big to display, but you can still download it.

Large File Pointer Details

( Raw pointer file )
SHA256:
af466bdd5663abcff6cc5c02d5a38539f3c420f767f009f5716e9f032075a11d
Pointer size:
133 Bytes
·
Size of remote file:
14.5 MB
·
Xet hash:
ebd61ba00d6660b244eccef5007c8bbf08b9db492b614ff1259640aa4ed4614b

Xet efficiently stores Large Files inside Git, intelligently splitting files into unique chunks and accelerating uploads and downloads. More info.