robbyt / llm_proxy
AI aware proxy
☆18Updated 7 months ago
Alternatives and similar repositories for llm_proxy:
Users that are interested in llm_proxy are comparing it to the libraries listed below
- convert natural language into technical diagrams☆14Updated 4 months ago
- Run Structured LLM Inference with Easy Parallelism☆16Updated 3 months ago
- Vector Embedding Server in under 100 lines of code☆22Updated last year
- Private ChatGPT/Perplexity. Securely unlocks knowledge from confidential business information.☆64Updated 6 months ago
- A simple github actions script to build a llamafile and uploads to huggingface☆14Updated last year
- ☆12Updated this week
- Multi-agent workflows and complex Agent interactions, both via YAML manifest and programmatic usage. Pydantic-AI and LiteLLM backends. Hu…☆17Updated this week
- A daemon that makes a desktop OS accessible to AI agents☆26Updated 2 weeks ago
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆33Updated 3 weeks ago
- Knowledge for GPTScript☆29Updated 6 months ago
- Structured outputs from DSPy and Jinja2☆23Updated 4 months ago
- ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…☆61Updated last week
- Open Source LLM proxy that transparently captures and logs all interactions with LLM API☆53Updated 3 months ago
- LLM code editor for backend services☆14Updated 6 months ago
- Document parser for RAG☆25Updated 5 months ago
- GO GO PARSE YOUR CODE GO GO☆11Updated 3 months ago
- ScaledMCP is a horizontally scalabled MCP and A2A Server. You know, for AI.☆17Updated this week
- Gateway and load balancer to your LLM inference endpoints☆22Updated 6 months ago
- A better way of testing, inspecting, and analyzing AI Agent traces.☆35Updated this week
- Run AI generated code in isolated sandboxes☆63Updated 3 months ago
- The home of official Obot tools☆29Updated this week
- The Prime Intellect CLI provides a powerful command-line interface for managing GPU resources across various providers☆18Updated last month
- one click setup, add MCP server to claude cursor windsurf. Model Context Protocol mcp marketplace store☆31Updated this week
- TLS & API keys for your LLM APIs☆16Updated 4 months ago
- The reliability layer between your code and LLM providers.☆18Updated 3 months ago
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆32Updated 11 months ago
- An AI-Powered documentation generator for legacy codebases☆26Updated last week
- An open-source, high-performance gateway unifying multiple LLM providers, from local solutions like Ollama to major cloud providers such …☆22Updated this week
- Guide: from fragile multi-agent app to prod ready with orra - code and resources.☆12Updated last month
- A GUI-based AI development tool with integrated Metaphor support☆40Updated this week