Alternatives and similar repositories for ai-gateway

Users that are interested in ai-gateway are comparing it to the libraries listed below

• jimexist / surya-rs
  Rust implementation of Surya
  ☆58Updated 3 months ago
• graniet / kheish
  Kheish: A multi-role LLM agent for tasks like code auditing, file searching, and more seamlessly leveraging RAG and extensible modules.
  ☆140Updated 5 months ago
• jina-ai / node-serp
  LLM-as-SERP
  ☆67Updated 3 months ago
• PlugOvr-ai / PlugOvr
  AI Assistant
  ☆20Updated 2 months ago
• baehyunsol / ragit
  git-like rag pipeline
  ☆230Updated this week
• Oxen-AI / GRPO-With-Cargo-Feedback
  This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback
  ☆95Updated 3 months ago
• MinishLab / model2vec-rs
  Official Rust Implementation of Model2Vec
  ☆118Updated 3 weeks ago
• AhmedAl93 / multimodal-semantic-RAG
  A RAG system designed to process documents with multimodal content. It can generate factual, context-aware answers to user queries, based…
  ☆21Updated 6 months ago
• spyglass-search / memex
  Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.
  ☆62Updated last year
• ShelbyJenkins / llm_client
  The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes
  ☆203Updated 4 months ago
• avahowell / offeryn
  Build tools for LLMs in Rust using Model Context Protocol
  ☆38Updated 4 months ago
• samuel-vitorino / lm.rs-webui
  Light WebUI for lm.rs
  ☆23Updated 8 months ago
• nath1295 / MLX-Textgen
  A python package for serving LLM on OpenAI-compatible API endpoints with prompt caching using MLX.
  ☆85Updated last week
• twitchax / augre
  An LLM-powered (CodeLlama or OpenAI) local diff code review tool.
  ☆38Updated 11 months ago
• mcp-ectors / mcp-ectors
  The MCP enterprise actors-based server or mcp-ectors for short
  ☆31Updated 3 weeks ago
• lucasjinreal / Crane
  A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.
  ☆126Updated last week
• traceloop / hub
  High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included
  ☆104Updated this week
• pixelspark / poly
  A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust
  ☆80Updated last year
• leockl / tool-ahead-of-time
  This is a Python package to add tool calling capabilities to newly released LLMs on LangChain's ChatOpenAI, AzureAIChatCompletionsModel a…
  ☆119Updated 3 weeks ago
• JackMatthewRimmer / rust-rag-toolchain
  Library for doing RAG
  ☆74Updated last month
• brandondocusen / CntxtPY
  A discovery and compression tool for your Python codebase. Creates a knowledge graph for a LLM context window, efficiently outlining your…
  ☆95Updated 6 months ago
• phildougherty / mcp-compose
  Run and manage MCP servers as Docker containers with a unified HTTP endpoint. Inspired by Docker compose.
  ☆35Updated 2 weeks ago
• EndlessReform / fish-speech.rs
  A Fish Speech implementation in Rust, with Candle.rs
  ☆91Updated 2 weeks ago
• Goekdeniz-Guelmez / mlx-lm-lora
  Train Large Language Models on MLX.
  ☆94Updated this week
• graniet / rllm
  Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.
  ☆131Updated last month
• shoibloya / nuggt-research
  ☆22Updated 4 months ago
• DeDeveloper23 / codebase-mcp
  Model Context Protocol implementation for retrieving codebases using RepoMix
  ☆36Updated 3 months ago
• agentic-labs / lsproxy
  Multi-language code navigation API in a container
  ☆80Updated last month
• IncredibleDevHQ / agent-panel
  AI gateway and observability server written in Rust. Designed to help optimize multi-agent workflows.
  ☆61Updated 11 months ago
• remichu-ai / gallama
  ☆130Updated last month