Noveum / ai-gatewayLinks
Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly and quickly.
☆88Updated 7 months ago
Alternatives and similar repositories for ai-gateway
Users that are interested in ai-gateway are comparing it to the libraries listed below
Sorting:
- Kheish: A multi-role LLM agent for tasks like code auditing, file searching, and more seamlessly leveraging RAG and extensible modules.☆143Updated last year
- High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included☆154Updated last week
- High-performance framework for building interactive multi-agent workflow systems in Rust☆227Updated last month
- Rust implementation of Surya☆64Updated 10 months ago
- Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.☆115Updated last year
- A full featured, enterprise grade rust MCP SDK☆63Updated this week
- The MCP enterprise actors-based server or mcp-ectors for short☆31Updated 7 months ago
- Official Rust Implementation of Model2Vec☆146Updated 3 months ago
- Self-hosted alternative to OpenAI's Responses API compatible with Agents SDK and works with all model providers (Claude/R1/Qwen/Ollama et…☆172Updated 9 months ago
- powerful and fast tool calling agents☆80Updated 10 months ago
- git-like rag pipeline☆256Updated last month
- ⚡️Lightning fast in-memory VectorDB written in rust🦀☆29Updated 10 months ago
- Performance centered DSPy rewrite to(not port) Rust☆211Updated last week
- This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback☆114Updated 10 months ago
- AI Assistant☆20Updated 9 months ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆242Updated 5 months ago
- LLM-as-SERP☆68Updated 10 months ago
- A high-performance BPE tokenizer built with Rust with Python bindings, focused on speed, safety, and resource optimization.☆54Updated last month
- Split code into semantic chunks☆58Updated last year
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆65Updated 2 years ago
- Please check our new project with similar targets: https://github.com/pixlie/Pixlie☆48Updated 6 months ago
- Blockoli is a high-performance tool for code indexing, embedding generation and semantic search tool for use with LLMs.☆160Updated last year
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆46Updated last year
- Run AI generated code in isolated sandboxes☆138Updated 11 months ago
- Fast rust MCP proxy between stdio and SSE☆28Updated 7 months ago
- LLMap solves context extraction for large codebases☆115Updated 11 months ago
- Securely run AI-generated code in stateful sandboxes that run forever.☆225Updated 9 months ago
- Fast serverless LLM inference, in Rust.☆108Updated 2 months ago
- MarinaBox is a toolkit for creating and managing secure, isolated environments for AI agents☆142Updated last month
- ☆162Updated 3 months ago