robbyt / llm_proxyLinks
AI aware proxy
☆19Updated last year
Alternatives and similar repositories for llm_proxy
Users that are interested in llm_proxy are comparing it to the libraries listed below
Sorting:
- Knowledge for GPTScript☆29Updated last year
- Building self-refined guardrails via DSPy☆13Updated last year
- ☆12Updated last year
- The home of official Obot tools☆32Updated this week
- Open Source LLM proxy that transparently captures and logs all interactions with LLM API☆61Updated 6 months ago
- Open Weight, tool-calling LLMs☆155Updated last year
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆34Updated 8 months ago
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆128Updated 10 months ago
- An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud p…☆83Updated this week
- Python module for running GPTScript☆13Updated this week
- ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…☆273Updated 5 months ago
- A plan engine for dynamic planning and reliable execution of AI agent workflows.☆233Updated 6 months ago
- ☆19Updated last year
- A framework for building large-scale, deterministic, interactive workflows with a fault-tolerant, conversational UX☆43Updated 3 weeks ago
- LLMap solves context extraction for large codebases☆114Updated 9 months ago
- A toy AI agent that can write programs, powered by Dagger☆37Updated 8 months ago
- A Python framework for building AI agent systems with robust task management in the form of a graph execution engine, inference capabilit…☆31Updated 6 months ago
- Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.☆113Updated last year
- ScaledMCP is a horizontally scalabled MCP and A2A Server. You know, for AI.☆42Updated 4 months ago
- Cloud-native, durable state for AI agents: WAL+snapshots, watch streams, idempotency, leases, TLS/mTLS, capability tokens, Python/TS SDKs…☆54Updated last month
- Agentkube - Run Kubernetes Like Never Before☆22Updated last week
- Gateway and load balancer to your LLM inference endpoints☆25Updated last year
- Routing on Random Forest (RoRF)☆233Updated last year
- ☆137Updated 8 months ago
- Official servlets for mcp.run published by @dylibso☆64Updated last month
- 🤖 Headless IDE for AI agents☆200Updated 2 months ago
- Chat strategies for LLMs☆125Updated this week
- Run AI generated code in isolated sandboxes☆128Updated 10 months ago
- DSPy Go implementation☆134Updated this week
- Organise your AI's memories with graph database entries☆52Updated 2 weeks ago