Search
@chonkiejs/token
HuggingFace tokenizer support for Chonkie - extends @chonkiejs/core with real tokenization
0.0.2
0.0.3
main:
https:/unpkg.com/@chonkiejs/token@0.0.3/dist/index.js
Copy URL
Browse on unpkg
