robbyt / llm_proxyLinks
AI aware proxy
☆19Updated last year
Alternatives and similar repositories for llm_proxy
Users that are interested in llm_proxy are comparing it to the libraries listed below
Sorting:
- Building self-refined guardrails via DSPy☆13Updated last year
- Knowledge for GPTScript☆29Updated last year
- Open Weight, tool-calling LLMs☆155Updated last year
- The home of official Obot tools☆32Updated 2 weeks ago
- An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud p…☆88Updated last week
- Open Source LLM proxy that transparently captures and logs all interactions with LLM API☆62Updated 6 months ago
- ScaledMCP is a horizontally scalabled MCP and A2A Server. You know, for AI.☆42Updated 5 months ago
- ☆19Updated last year
- Quickly and securely turn any Linux box into a build and deployment assistant☆24Updated last year
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆129Updated 10 months ago
- A plan engine for dynamic planning and reliable execution of AI agent workflows.☆239Updated 7 months ago
- Litmus is a comprehensive LLM testing and evaluation tool designed for GenAI Application Development. It provides a robust platform with …☆41Updated 5 months ago
- 🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps☆153Updated last year
- A Python framework for building AI agent systems with robust task management in the form of a graph execution engine, inference capabilit…☆32Updated 6 months ago
- [deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications☆161Updated last year
- Gateway and load balancer to your LLM inference endpoints☆25Updated last year
- Build reliable, secure, and production-ready AI apps easily.☆97Updated last month
- ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…☆304Updated 6 months ago
- Python module for running GPTScript☆13Updated 3 weeks ago
- DSPy Go implementation☆142Updated last week
- Blueprint by Mozilla.ai for answering questions about structured documents☆37Updated 9 months ago
- A toy AI agent that can write programs, powered by Dagger☆37Updated 9 months ago
- ☆12Updated last year
- GPU prices aggregator for cloud providers☆45Updated last week
- Vector Embedding Server in under 100 lines of code☆22Updated last year
- The DPAB-α Benchmark☆32Updated 11 months ago
- Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.☆115Updated last year
- Welcome to FluidAPI, it's a framework that allows you to interact with APIs using natural language. No more JSON, headers, or complex for…☆32Updated 2 months ago
- cgpt - cli for LLM operations☆37Updated 2 months ago
- Tutorial for building LLM router☆241Updated last year