robbyt / llm_proxyLinks
AI aware proxy
☆19Updated 11 months ago
Alternatives and similar repositories for llm_proxy
Users that are interested in llm_proxy are comparing it to the libraries listed below
Sorting:
- Knowledge for GPTScript☆29Updated 9 months ago
- ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…☆136Updated last month
- A plan engine for dynamic planning and reliable execution of AI agent workflows.☆224Updated 2 months ago
- ☆12Updated last year
- Open Source LLM proxy that transparently captures and logs all interactions with LLM API☆59Updated 2 months ago
- Open Weight, tool-calling LLMs☆155Updated 9 months ago
- Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.☆105Updated 9 months ago
- Tutorial for building LLM router☆223Updated last year
- Quickly and securely turn any Linux box into a build and deployment assistant☆24Updated 10 months ago
- Structured outputs from DSPy and Jinja2☆26Updated last month
- High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included☆123Updated last week
- Routing on Random Forest (RoRF)☆191Updated 10 months ago
- LLMap solves context extraction for large codebases☆108Updated 5 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆109Updated 6 months ago
- An open-source, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such …☆52Updated 2 weeks ago
- A Site Reliability Engineer AI agent that can monitor application and infrastructure logs, diagnose issues, and report on diagnostics.☆65Updated 2 weeks ago
- Lyzr SDKs help you to build all your favorite GenAI SaaS products as enterprise applications in minutes.☆183Updated 8 months ago
- A framework for building large-scale, deterministic, interactive workflows with a fault-tolerant, conversational UX☆23Updated this week
- Python module for running GPTScript☆14Updated 3 months ago
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆33Updated 4 months ago
- Open-source AI copilot that lets you chat with your observability data and code 🧙♂️☆354Updated 3 months ago
- Run AI generated code in isolated sandboxes☆96Updated 6 months ago
- Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)☆78Updated 6 months ago
- [deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications☆160Updated last year
- The Prime Intellect CLI provides a powerful command-line interface for managing GPU resources across various providers☆38Updated last week
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆32Updated last year
- Security and compliance proxy for LLM APIs☆48Updated 2 years ago
- 🤖 Headless IDE for AI agents☆200Updated 4 months ago
- The home of official Obot tools☆29Updated last week
- Testing and evaluation framework for voice agents☆143Updated 2 months ago