rwkv-tokenizer-node

RWKV / gpt-NeoX / Pythia, 0-dep tokenizer library, for nodejs

v1.0.5 URL: https://unpkg.com/rwkv-tokenizer-node@1.0.5/src/tokenizer.js

Open Browse Files

RWKV Tokenizer neox gpt-neox pythia