Logical expression parser and evaluates result, suitable for permissions management
A tokenzier for Sass' SCSS syntax
String Tokenizer for Node.js using ICU's BreakIterators
A parser generator with Bison's API
Multilingual tokenizer that automatically tags each token with its type
personal tokenize util
An object-oriented programming language
Tokenize paragraphs into sentences, and smaller tokens.
A fast tokenizer/lexer core that is well tested.
Converts text into tokens, as defined by provided syntax; Supports recursive sub-syntaxes, regular expressions, and more..
Wix Restaurants credit-cards tokenizer
lexical analyzer generator used by jison
Simple algorithm to tokenize Chinese texts into words using CC-CEDICT.
Turns a string into tokens.
Is given character suitable to be in an HTML attribute's name?
Configurable SQL formatter