kvat

v0.1.4npm· JavaScript

Automatic KV-Cache Optimization for HuggingFace Transformers - Find the optimal cache strategy, attention backend, and configuration for your model and hardware.

The verdict

Maintained. Maintained, actively maintained.

Live from the npm registry · derived rules, not AI

How it scores

MaintenanceHealthy

PopularityUnknown

SecurityClean

LicensePermissive

DepsZero deps

Maintenance

Last published 5 months ago.

Popularity

Download count unavailable.

Security

No known advisories for this version (OSV).

License

Apache-2.0

Dependencies

No runtime dependencies

Recent releases

0.1.45 months ago
0.1.35 months ago
0.1.05 months ago