Noveum / ai-gatewayLinks
Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly and quickly.
☆78Updated 4 months ago
Alternatives and similar repositories for ai-gateway
Users that are interested in ai-gateway are comparing it to the libraries listed below
Sorting:
- Rust implementation of Surya☆61Updated 7 months ago
- git-like rag pipeline☆246Updated 2 weeks ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆238Updated 2 months ago
- High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included☆139Updated last week
- Kheish: A multi-role LLM agent for tasks like code auditing, file searching, and more seamlessly leveraging RAG and extensible modules.☆140Updated 9 months ago
- High-performance framework for building interactive multi-agent workflow systems in Rust☆167Updated last month
- Performance centered DSPy rewrite to(not port) Rust☆160Updated this week
- Fast rust MCP proxy between stdio and SSE☆24Updated 4 months ago
- This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback☆107Updated 7 months ago
- The MCP enterprise actors-based server or mcp-ectors for short☆31Updated 4 months ago
- A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.☆168Updated last month
- Fast serverless LLM inference, in Rust.☆94Updated 7 months ago
- AI Assistant☆20Updated 6 months ago
- Official Rust Implementation of Model2Vec☆139Updated 3 weeks ago
- TensorRT-LLM server with Structured Outputs (JSON) built with Rust☆59Updated 6 months ago
- Self-hosted alternative to OpenAI's Responses API compatible with Agents SDK and works with all model providers (Claude/R1/Qwen/Ollama et…☆94Updated 6 months ago
- Use multiple LLM backends in a single crate, simple builder-based configuration, and built-in prompt chaining & templating.☆137Updated 5 months ago
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆45Updated last year
- LLM-as-SERP☆71Updated 7 months ago
- A Fish Speech implementation in Rust, with Candle.rs☆98Updated 4 months ago
- Securely run AI-generated code in stateful sandboxes that run forever.☆221Updated 6 months ago
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆79Updated last year
- Burn through tech debt with AI agents!☆309Updated this week
- Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.☆109Updated 11 months ago
- Public API documentation from dependencies for AI coding assistants☆37Updated 8 months ago
- A multi-agent framework written in Rust that enables you to build, deploy, and coordinate multiple intelligent agents☆153Updated 2 weeks ago
- Run AI generated code in isolated sandboxes☆112Updated 8 months ago
- A simple, fast terminal based AI coding assistant☆222Updated this week
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆62Updated 2 years ago
- A RAG API server written in Rust following OpenAI specs☆57Updated 6 months ago