108 packages found

M
Q
P

Description

Tiny JavaScript tokenizer.

Keywords

Publisher

published 6.0.0a year ago
M
Q
P

Description

transform stream to tokenize html

Keywords

Publisher

published 2.0.1a year ago
M
Q
P

Description

A simple, Twitter-aware tokenizer.

Keywords

Publisher

published 2.1.38 months ago
M
Q
P

Description

String Tokenizer for Node.js using ICU's BreakIterators

Keywords

Publisher

published 1.0.152 months ago
M
Q
P

Description

Tokenize Excel formulas

Keywords

Publisher

published 2.3.22 months ago
M
Q
P

Description

A NodeJS library to tokenize strings

Keywords

Publisher

published 0.1.43 months ago
M
Q
P

Description

A replacement library for JavaScript's standard JSON functions and more

Keywords

Publisher

published 0.1.33 months ago
M
Q
P

Description

lexing json

Keywords

Publisher

published 1.1.15 years ago
M
Q
P

Description

Tokenize Excel formulas

Keywords

Publisher

published 2.3.110 months ago
M
Q
P

Description

Multilingual tokenizer that automatically tags each token with its type

Keywords

Publisher

published 5.2.38 months ago
M
Q
P

Description

WHATWG HTML5 specification-compliant, fast and ready for production HTML parsing/serialization toolset for Node.js

Keywords

Publisher

published 2.2.64 years ago
M
Q
P

Description

personal tokenize util

Keywords

Publisher

published 2.0.0a year ago
M
Q
P

Description

NLP Functions for amplifying negations, managing elisions, creating ngrams, stems, phonetic codes to tokens and more.

Keywords

Publisher

published 2.0.68 months ago
M
Q
P

Description

Transform stream that tokenizes CSS

Keywords

Publisher

published 1.0.16 years ago
M
Q
P

Description

Fork: HTML parsing/serialization toolset for Node.js. WHATWG HTML Living Standard (aka HTML5)-compliant. Fork from the HTMLParseErrorWG branch.

Keywords

Publisher

published 4.0.46 months ago
M
Q
P

Description

tokenize c/c++ source code

Keywords

Publisher

published 1.0.04 years ago
M
Q
P

Description

Lexical analyzer built in Javascript

Keywords

Publisher

published 1.0.43 years ago
M
Q
P
M
Q
P

Description

A gemtext (`text/gemini`) parser with support for streaming, ASTs, and CSTs

Keywords

Publisher

published 1.0.12 months ago
M
Q
P

Description

Simple synchronous string tokenizer using Regex

Keywords

Publisher

published 2.0.03 years ago