258 packages found

M
Q
P

Description

A tokenizer for Google-like search queries

Keywords

Publisher

published 2.1.13 years ago
M
Q
P

Description

lexical analyzer generator used by jison

Keywords

Publisher

published 0.3.46 years ago
M
Q
P

Description

Tokenizer for mixed inputs aiming at broken code, especially HTML & CSS

Keywords

Publisher

published 2.5.316 days ago
M
Q
P

Description

Tokenize (Scan) JSDoc buffer

Keywords

Publisher

published 1.4.24 months ago
M
Q
P

Description

Parse PHP code and returns its AST (with comments indent support)

Keywords

Publisher

published 1.1.02 years ago
M
Q
P

Description

personal tokenize util

Keywords

Publisher

published 1.0.1a year ago
M
Q
P

Description

An expression tokenizer, parser and evaluator.

Keywords

Publisher

published 1.7.42 months ago
M
Q
P

Description

A regex-based string scanner/tokenizer

Keywords

Publisher

published 1.1.1a year ago
M
Q
P
M
Q
P

Description

React-based typeahead and typeahead-tokenizer

Keywords

Publisher

published 2.0.0-alpha.82 years ago
M
Q
P

Description

Simple synchronous string tokenizer using Regex

Keywords

Publisher

published 2.0.02 years ago
M
Q
P

Description

Tokenizes utterances that contain a mix of English and Chinese words.

Keywords

Publisher

published 1.1.0a year ago
M
Q
P

Description

Chinese word segmentation 簡繁中文分词模块 以網路小說為樣本

Keywords

Publisher

published 2.5.311 days ago
M
Q
P

Description

Japanese Script for Eliza Interpreter

Keywords

Publisher

published 1.2.0-alpha.319 days ago
M
Q
P
M
Q
P

Description

Tokenize javascript expressions.

Keywords

Publisher

published 0.4.25 months ago
M
Q
P

Description

A streaming JSON tokenizer

Keywords

Publisher

published 1.1.02 years ago
M
Q
P

Description

Range-request tokenizer adapter

Keywords

Publisher

published 0.2.224 days ago
M
Q
P
M
Q
P

Description

A simple, Twitter-aware tokenizer.

Keywords

Publisher

published 1.0.02 months ago