Noveum / ai-gatewayLinks
Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly and quickly.
☆73Updated 2 months ago
Alternatives and similar repositories for ai-gateway
Users that are interested in ai-gateway are comparing it to the libraries listed below
Sorting:
- Kheish: A multi-role LLM agent for tasks like code auditing, file searching, and more seamlessly leveraging RAG and extensible modules.☆141Updated 7 months ago
- This repository has code for fine-tuning LLMs with GRPO specifically for Rust Programming using cargo as feedback☆100Updated 4 months ago
- git-like rag pipeline☆237Updated this week
- The Easiest Rust Interface for Local LLMs and an Interface for Deterministic Signals from Probabilistic LLM Vibes☆219Updated 2 weeks ago
- Rust implementation of Surya☆58Updated 5 months ago
- Super-simple, fully Rust powered "memory" (doc store + semantic search) for LLM projects, semantic search, etc.☆62Updated last year
- High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included☆116Updated 2 weeks ago
- Fast serverless LLM inference, in Rust.☆88Updated 5 months ago
- A Pure Rust based LLM (Any LLM based MLLM such as Spark-TTS) Inference Engine, powering by Candle framework.☆144Updated last week
- LLMap solves context extraction for large codebases☆107Updated 5 months ago
- Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.☆102Updated 9 months ago
- AI Assistant☆20Updated 3 months ago
- A DSPy rewrite to(not port) Rust☆48Updated this week
- A simple, CUDA or CPU powered, library for creating vector embeddings using Candle and models from Hugging Face☆37Updated last year
- Split code into semantic chunks☆47Updated 10 months ago
- Light WebUI for lm.rs☆24Updated 9 months ago
- ☆138Updated last year
- LLM-as-SERP☆68Updated 5 months ago
- Multi-language code navigation API in a container☆84Updated last month
- High-performance framework for building interactive multi-agent workflow systems in Rust☆111Updated last week
- Official Rust Implementation of Model2Vec☆123Updated last month
- A memory framework for Large Language Models and Agents.☆183Updated 7 months ago
- High-performance MinHash implementation in Rust with Python bindings for efficient similarity estimation and deduplication of large datas…☆192Updated 2 weeks ago
- Burn through tech debt with AI agents!☆269Updated last week
- ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…☆125Updated last month
- Routing on Random Forest (RoRF)☆187Updated 10 months ago
- George is an API leveraging AI to make it easy to control a computer with natural language.☆48Updated 7 months ago
- OpenAI compatible API for serving LLAMA-2 model☆218Updated last year
- A single-binary, GPU-accelerated LLM server (HTTP and WebSocket API) written in Rust☆80Updated last year
- Blockoli is a high-performance tool for code indexing, embedding generation and semantic search tool for use with LLMs.☆137Updated last year