Skip to content
JS
Package

tokenizr

String Tokenization Library for JavaScript

v2.2.1, 10 Apr 2026MITESM + CommonJSTypes: BundledParsers and serialisersStrings and text
$ npm install tokenizr

Key numbers

As of 25 Sept 2026
Weekly downloads
31.3k
-15% over 12 months
Gzip bundle size
-
No Bundlephobia data
Dependencies
0
Direct, from package.json
Last release
5 months ago
v2.2.1
GitHub stars
110
7 forks
Open issues / PRs
5 / 2
Contributors
-
Commits, last 52 weeks
48

Downloads

Last week 2026-09-15 to 2026-09-21
020k40k60kSept 2025Mar 2026Sept 2026High 46.5k (28 Oct 2025)Low 13.6k (23 Dec 2025)
Weekly npm downloads, one point per week, weeks starting 23 Sept 2025 to 15 Sept 2026. The y axis starts at zero.

31,324 downloads last week, 142,342 in the last month. The 12-month change of -15% compares the average of the last 4 weeks with the first 4 weeks of the series.

Releases, last 12 months
-
Latest version
2.2.1, 10 Apr 20265 months ago
First published
-
Last push to GitHub
19 Jun 202697 days before the snapshot
Repository archived
No
Open issues
5
Open pull requests
2
Commits, last 52 weeks
48
Dependents on npm
37

Major versions

-

Recent releases

-

Module format
ESM + CommonJSFrom package.json type, main and exports fields
TypeScript types
Bundled
Node.js engine range
Not declared
Runtimes
-
Unpacked size (npm)
121 kB
Dependencies (0)
None
npm install tokenizr
  • jsDelivrhttps://cdn.jsdelivr.net/npm/tokenizr@2.2.1/
  • unpkghttps://unpkg.com/tokenizr@2.2.1/
  • esm.shhttps://esm.sh/tokenizr@2.2.1
Sources: npm registry, npm downloads API, GitHub API. Data fetched 25 Sept 2026.

Indexability: Indexed.