printable-characters

A little helper for handling strings containing zero width control characters, ANSI styling, whitespaces, newlines, 💩, etc.
OpenBrowse Files
string widthstring lengthreal string widthreal string lengthoptical string widthprinted widthunicodecodepointscode pointsstrlenzero widthzero width symbolszero width charactersvisible charactersvisible symbolsvisibleinvisibleinvisible symbolsinvisible charactersprintableprintable lengthprintable symbolsprintable charactersnon-printable charactersnonprintable characterscharacterssymbolsstring lengthreal string lengthstring trimmingtrimmingescapesescape codescodesansi escapestokenizingansiwhitespaces

happynodetokenizer

A simple, Twitter-aware tokenizer.
OpenBrowse Files
tokenisetokenizetokenisingtokenizingtokenisertokenizertokentwitterNLPlanguagetextstringsstanforddlatkwwbp

@hgargg-0710/parsers.js

A JavaScript library for simplification the process of organization/creation of parsers/validators/code-generators of arbitrary complexity.
OpenBrowse Files
parsingtokenizingvalidationgenerationmaps

printable-characters-plus-directional

A little helper for handling strings containing zero width control characters, ANSI styling, whitespaces, newlines, etc.
OpenBrowse Files
string widthstring lengthreal string widthreal string lengthoptical string widthprinted widthunicodecodepointscode pointsstrlenzero widthzero width symbolszero width charactersvisible charactersvisible symbolsvisibleinvisibleinvisible symbolsinvisible charactersprintableprintable lengthprintable symbolsprintable charactersnon-printable charactersnonprintable characterscharacterssymbolsstring lengthreal string lengthstring trimmingtrimmingescapesescape codescodesansi escapestokenizingansiwhitespaces

sentence-tools

Tools for manipulating sentences
OpenBrowse Files
sentenceparsingtokenizationtokenizing