104 packages found

M
Q
P

Description

Tiny JavaScript tokenizer.

Keywords

Publisher

published 6.0.06 months ago
M
Q
P

Description

transform stream to tokenize html

Keywords

Publisher

published 2.0.17 months ago
M
Q
P

Description

A simple, Twitter-aware tokenizer.

Keywords

Publisher

published 2.1.33 months ago
M
Q
P

Description

Tokenize Excel formulas

Keywords

Publisher

published 2.3.16 months ago
M
Q
P

Description

String Tokenizer for Node.js using ICU's BreakIterators

Keywords

Publisher

published 1.0.102 months ago
M
Q
P

Description

A replacment library for JavaScript's standard JSON functions and more

Keywords

Publisher

published 0.1.03 months ago
M
Q
P

Description

personal tokenize util

Keywords

Publisher

published 2.0.06 months ago
M
Q
P

Description

NLP Functions for amplifying negations, managing elisions, creating ngrams, stems, phonetic codes to tokens and more.

Keywords

Publisher

published 2.0.64 months ago
M
Q
P

Description

Multilingual tokenizer that automatically tags each token with its type

Keywords

Publisher

published 5.2.33 months ago
M
Q
P

Description

lexing json

Keywords

Publisher

published 1.1.14 years ago
M
Q
P

Description

A NodeJS library to tokenize strings

Keywords

Publisher

published 0.1.12 months ago
M
Q
P

Description

A fast tokenizer/lexer core that is well tested.

Keywords

Publisher

published 0.2.1a year ago
M
Q
P

Description

Tokenize JavaScript

Keywords

Publisher

published 0.2.1a year ago
M
Q
P

Description

Fork: HTML parsing/serialization toolset for Node.js. WHATWG HTML Living Standard (aka HTML5)-compliant. Fork from the HTMLParseErrorWG branch.

Keywords

Publisher

published 4.0.4a month ago
M
Q
P

Description

Transform stream that tokenizes CSS

Keywords

Publisher

published 1.0.16 years ago
M
Q
P
M
Q
P

Description

tokenize c/c++ source code

Keywords

Publisher

published 1.0.04 years ago
M
Q
P

Description

Lexical analyzer built in Javascript

Keywords

Publisher

published 1.0.42 years ago
M
Q
P

Description

Simple synchronous string tokenizer using Regex

Keywords

Publisher

published 2.0.03 years ago
M
Q
P

Description

A streaming JSON tokenizer

Keywords

Publisher

published 1.1.03 years ago