Noveum / ai-gatewayLinks
Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly and quickly.
☆64Updated this week
Alternatives and similar repositories for ai-gateway
Users that are interested in ai-gateway are comparing it to the libraries listed below
Sorting:
- This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback☆92Updated 2 months ago
- LLM-as-SERP☆66Updated 3 months ago
- Rust implementation of Surya☆58Updated 3 months ago
- AI Assistant☆20Updated last month
- git-like rag pipeline☆212Updated this week
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆37Updated last year
- Light WebUI for lm.rs☆23Updated 7 months ago
- Kheish: A multi-role LLM agent for tasks like code auditing, file searching, and more seamlessly leveraging RAG and extensible modules.☆140Updated 5 months ago
- Split code into semantic chunks☆26Updated 8 months ago
- graph + ai in your products; reduce costs and get correct answers from your data☆43Updated this week
- TensorRT-LLM server with Structured Outputs (JSON) built with Rust☆54Updated last month
- Build tools for LLMs in Rust using Model Context Protocol☆38Updated 3 months ago
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆201Updated 3 months ago
- The MCP enterprise actors-based server or mcp-ectors for short☆31Updated this week
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆62Updated last year
- Run multiple resource-heavy Large Models (LM) on the same machine with limited amount of VRAM/other resources by exposing them on differe…☆65Updated this week
- ChronoMind: Redefining Vector Intelligence Through Time.☆70Updated last month
- Run AI generated code in isolated sandboxes☆74Updated 3 months ago
- A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.☆118Updated 2 months ago
- Library for doing RAG☆72Updated 2 weeks ago
- ☆58Updated 5 months ago
- Easy MCP (Model Context Protocol) servers and AI agents, defined as YAML.☆16Updated 2 weeks ago
- Fast serverless LLM inference, in Rust.☆74Updated 3 months ago
- Leveraging DSPy for AI-driven task understanding and solution generation, the Self-Discover Framework automates problem-solving through r…☆60Updated 10 months ago
- Public API documentation from dependencies for AI coding assistants☆35Updated 3 months ago
- The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework in Rust☆34Updated last week
- Minimalistic Rust Implementation Of Model Context Protocol from Anthropic☆56Updated 2 months ago
- ⚡ Bhumi – The fastest AI inference client for Python, built with Rust for unmatched speed, efficiency, and scalability 🚀☆55Updated 2 weeks ago
- Try out HallOumi, a state-of-the-art claim verification model in a simple UI!☆34Updated 2 months ago
- ☆129Updated last month