robbyt / llm_proxyLinks
AI aware proxy
☆19Updated last year
Alternatives and similar repositories for llm_proxy
Users that are interested in llm_proxy are comparing it to the libraries listed below
Sorting:
- Knowledge for GPTScript☆29Updated last year
- Building self-refined guardrails via DSPy☆14Updated last year
- A Python framework for building AI agent systems with robust task management in the form of a graph execution engine, inference capabilit…☆32Updated 7 months ago
- A plan engine for dynamic planning and reliable execution of AI agent workflows.☆243Updated 8 months ago
- Open Weight, tool-calling LLMs☆156Updated last year
- Open Source LLM proxy that transparently captures and logs all interactions with LLM API☆62Updated 7 months ago
- [deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications☆160Updated last year
- Welcome to FluidAPI, it's a framework that allows you to interact with APIs using natural language. No more JSON, headers, or complex for…☆32Updated 3 months ago
- A toy AI agent that can write programs, powered by Dagger☆37Updated 10 months ago
- Structured outputs from DSPy and Jinja2☆27Updated 7 months ago
- An open-source, cloud-native, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud p…☆98Updated this week
- A powerful AI observability framework that provides comprehensive insights into agent interactions across platforms, enabling developers …☆107Updated 8 months ago
- Quickly and securely turn any Linux box into a build and deployment assistant☆25Updated last year
- Build reliable, secure, and production-ready AI apps easily.☆100Updated 2 months ago
- Gateway and load balancer to your LLM inference endpoints☆25Updated last year
- 😎 Awesome list of resources about using and building AI software development systems☆117Updated last year
- Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.☆115Updated this week
- ☆25Updated last year
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆34Updated 9 months ago
- A simple DAG for executing LLM calls and using tools.☆42Updated 2 years ago
- Organise your AI's memories with graph database entries☆72Updated 2 months ago
- High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included☆159Updated last week
- ScaledMCP is a horizontally scalabled MCP and A2A Server. You know, for AI.☆44Updated 5 months ago
- Litmus is a comprehensive LLM testing and evaluation tool designed for GenAI Application Development. It provides a robust platform with …☆42Updated 6 months ago
- DSPy Go implementation☆152Updated this week
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆133Updated 11 months ago
- ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…☆325Updated 7 months ago
- Guards and protection agnostic to your model or provider☆40Updated last year
- The version 0.2 is a prompt based agent workflow that integrates with other Lyzr agents☆32Updated 2 years ago
- A powerful, AI Gateway designed from scratch for AI☆53Updated this week