robbyt / llm_proxyLinks
AI aware proxy
☆19Updated 11 months ago
Alternatives and similar repositories for llm_proxy
Users that are interested in llm_proxy are comparing it to the libraries listed below
Sorting:
- Knowledge for GPTScript☆29Updated 10 months ago
- Open Weight, tool-calling LLMs☆155Updated 10 months ago
- Open Source LLM proxy that transparently captures and logs all interactions with LLM API☆59Updated 2 months ago
- ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…☆166Updated 2 months ago
- The home of official Obot tools☆29Updated last week
- Security and compliance proxy for LLM APIs☆48Updated 2 years ago
- The version 0.2 is a prompt based agent workflow that integrates with other Lyzr agents☆32Updated last year
- Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…☆114Updated 6 months ago
- Build reliable, secure, and production-ready AI apps easily.☆82Updated 2 weeks ago
- Like catnip, a highly addictive agentic coding tool☆88Updated this week
- The DPAB-α Benchmark☆29Updated 7 months ago
- A high performance batching router optimises max throughput for text inference workload☆16Updated 2 years ago
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆33Updated last year
- Quickly and securely turn any Linux box into a build and deployment assistant☆24Updated 11 months ago
- 😎 Awesome list of resources about using and building AI software development systems☆112Updated last year
- A plan engine for dynamic planning and reliable execution of AI agent workflows.☆223Updated 3 months ago
- Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.☆105Updated 10 months ago
- Structured outputs from DSPy and Jinja2☆26Updated 2 months ago
- Routing on Random Forest (RoRF)☆203Updated 11 months ago
- Python module for running GPTScript☆14Updated 3 months ago
- Blueprint by Mozilla.ai for answering questions about structured documents☆36Updated 5 months ago
- 🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps☆151Updated last year
- Gateway and load balancer to your LLM inference endpoints☆25Updated 10 months ago
- ☆12Updated last year
- ☆20Updated 5 months ago
- ☆25Updated 11 months ago
- Guards and protection agnostic to your model or provider☆39Updated 9 months ago
- Private ChatGPT/Perplexity. Securely unlocks knowledge from confidential business information.☆72Updated 11 months ago
- Code Indexer Loop is a Python library for indexing and retrieving source code files through an integrated vector database that's continuo…☆175Updated last year
- A toy AI agent that can write programs, powered by Dagger☆35Updated 5 months ago