Skip to content
JS
Package

node-llama-cpp

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

v3.21.1, 12 Sept 2026MITESM onlyTypes: BundledSchema validation
$ npm install node-llama-cpp

Key numbers

As of 25 Sept 2026
Weekly downloads
245.4k
+3592% over 12 months
Gzip bundle size
-
No Bundlephobia data
Dependencies
28
Direct, from package.json
Last release
12 days ago
v3.21.1
GitHub stars
2.2k
218 forks
Open issues / PRs
28 / 4
Contributors
-
Commits, last 52 weeks
40

Downloads

Last week 2026-09-15 to 2026-09-21
01m2m3mSept 2025Mar 2026Sept 2026High 2m (16 Jun 2026)Low 7.2k (23 Dec 2025)
Weekly npm downloads, one point per week, weeks starting 23 Sept 2025 to 15 Sept 2026. The y axis starts at zero.

245,392 downloads last week, 1,630,605 in the last month. The 12-month change of +3592% compares the average of the last 4 weeks with the first 4 weeks of the series.

Releases, last 12 months
-
Latest version
3.21.1, 12 Sept 202612 days ago
First published
-
Last push to GitHub
24 Sept 2026same day as the snapshot
Repository archived
No
Open issues
28
Open pull requests
4
Commits, last 52 weeks
40
Dependents on npm
204

Major versions

-

Recent releases

-

Module format
ESM onlyFrom package.json type, main and exports fields
TypeScript types
Bundled
Node.js engine range
>=20.0.0
Runtimes
-
Unpacked size (npm)
37.3 MB
Dependencies (28)
orabyteschalkipullwhichyargsignorenanoidsemverchmodrpenv-varcmake-jsfs-extrapretty-msfilenamifysimple-gitslice-ansistrip-ansiasync-retrycross-spawnlog-symbolsstdout-updatenode-addon-apilifecycle-utilsproper-lockfile@huggingface/jinjais-unicode-supportedvalidate-npm-package-name
Peer dependencies (1)
typescript
npm install node-llama-cpp
  • jsDelivrhttps://cdn.jsdelivr.net/npm/node-llama-cpp@3.21.1/
  • unpkghttps://unpkg.com/node-llama-cpp@3.21.1/
  • esm.shhttps://esm.sh/node-llama-cpp@3.21.1
Sources: npm registry, npm downloads API, GitHub API. Data fetched 25 Sept 2026.

Indexability: Indexed.