node-llama-cpp

v3.18.1npm· JavaScript

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

The verdict

Worth a look. Actively maintained and growing, actively maintained. Catch: pulls in 28 runtime dependencies.

Catch: pulls in 28 runtime dependencies.

Live from the npm registry · derived rules, not AI

How it scores

MaintenanceHealthy

PopularityRising

SecurityClean

LicensePermissive

DepsHeavy

Maintenance

Last published 3 months ago.

Popularity

173K downloads / week

Security

No known advisories for this version (OSV).

License

MIT

Dependencies

28 direct dependencies

Recent releases