@mindlearn/tokenizer

Enhances comprehension for MindScript-powered models by tokenizing text.