tq-kv
v0.6.0crates.io· RustTurboQuant KV Cache Compression for LLMs — First working on GGUF Q4_K_M (3-Fix framework). KV Compaction (50x token reduction). Per-head adaptive bitwidth. 4-bit value compression. Calibration pipeline. SRHT QJL (115x faster). AVX2 SIMD fused attention. C FFI. 114 tests.
The verdict
Maintained. Niche but maintained, actively maintained.
Live from the crates.io registry · derived rules, not AI
How it scores
MaintenanceHealthy
PopularityNiche
SecurityClean
LicensePermissive
DepsZero deps
Maintenance
Last published 2 months ago.
Popularity
14 downloads / week
Security
No known advisories for this version (OSV).
License
Apache-2.0 OR MIT
Dependencies
No runtime dependencies
Recent releases
- 0.6.02 months ago
- 0.5.02 months ago
- 0.4.02 months ago
- 0.3.02 months ago
- 0.2.02 months ago
- 0.1.02 months ago