bpe-tokenizer-encoding

A simple JavaScript implementation of Byte Pair Encoding (BPE)

Browse on unpkg