atomr-infer-runtime-vllm

v0.8.0crates.io· Rust

vLLM runner for atomr-infer. Hosts local LLMs via PyO3-bound AsyncLLMEngine + token-streaming. Includes Gemma 4 auto-provisioning helpers under the `gemma-default` feature.

The verdict

Maintained. Niche but maintained, actively maintained.

Live from the crates.io registry · derived rules, not AI

How it scores

MaintenanceHealthy

PopularityNiche

SecurityClean

LicensePermissive

DepsZero deps

Maintenance

Last published this month.

Popularity

5 downloads / week

Security

No known advisories for this version (OSV).

License

Apache-2.0

Dependencies

No runtime dependencies

Recent releases

0.8.0this month
0.6.5this month
0.6.4this month