Install all the tools required for building and testing C++/C projects.
This package provides a foundation for implementing providers that expose an OpenAI-compatible API.
Chat UI and Local API for the Llama models
## Installation
Prebuilt binary for node-llama-cpp for macOS x64
Prebuilt binary for node-llama-cpp for Windows x64 with Vulkan support
Prebuilt binary for node-llama-cpp for Windows x64 with CUDA support
Prebuilt binary for node-llama-cpp for Linux arm64
> [!WARNING] > This package has been deprecated since version 4.1.0. > Please migrate to [llama-cloud-services](https://www.npmjs.com/package/llama-cloud-services). > See the documentation: https://docs.cloud.llamaindex.ai
Prebuilt binary for node-llama-cpp for Windows x64
A minimal llama.cpp provider for the Vercel AI SDK implementing LanguageModelV4 and EmbeddingModelV4
Prebuilt binary for node-llama-cpp for Linux armv7l
Prebuilt binary for node-llama-cpp for macOS arm64 with Metal support
A light-weight module that brings Fetch API to node.js
The official TypeScript library for the Llama API Client API
Prebuilt binary for node-llama-cpp for Linux x64 with CUDA support
Prebuilt binary for node-llama-cpp for Linux x64 with Vulkan support
The **[DeepInfra provider](https://ai-sdk.dev/providers/ai-sdk-providers/deepinfra)** for the [AI SDK](https://ai-sdk.dev/docs) contains language model support for the DeepInfra API, giving you access to models like Llama 3, Mixtral, and other state-of-th
Cortex-cpp is a streamlined, stateless C++ server engineered to be fully compatible with OpenAI's API, particularly its stateless functionalities
Helpers for installing and using Whisper.cpp
Prebuilt binary for node-llama-cpp for Windows arm64
Load and use an LLM model directly in Electron. Experimental.
Generated llama-deploy API client from OpenAPI specification
An implementation of window.fetch in Node.js using Minipass streams