Results for infer_model

A Rust-native agent framework with tool calling, streaming, and multi-provider support for OpenAI, Anthropic, Gemini, and Grok

Ultralytics YOLO inference library and CLI for Rust

Unified inference runtime for high-performance LLM execution

High-performance LLM inference engine with advanced quantization and salience-based optimization

High-performance inference engine for BitNet models

High-performance key-value cache for LLM inference

Advanced quantization engine for efficient LLM inference

Salience analysis engine for intelligent token prioritization in LLM inference

Shared utilities and types for Zeta Reticula components

Command-line interface for BitNet model operations

Embedded storage at the speed of light.

LLM inference module for Memvid Q&A with local and cloud model support