robbyt / llm_proxyLinks
AI aware proxy
☆19Updated 9 months ago
Alternatives and similar repositories for llm_proxy
Users that are interested in llm_proxy are comparing it to the libraries listed below
Sorting:
- convert natural language into technical diagrams☆14Updated 6 months ago
- ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…☆104Updated last week
- 📡 Deploy AI models and apps to Kubernetes without developing a hernia☆32Updated last year
- Agents and RAG workflows with little to no code☆22Updated 6 months ago
- QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…☆33Updated 3 months ago
- MCP Server to Let Your Coding Agent Write, Run, and Maintain Integration Tests for You. Written in Go. Durably Backed by Temporal. 🚀☆42Updated this week
- Computer use-like MCP for webapps and electron apps, to enable AI agents to test their changes☆27Updated last week
- Run Structured LLM Inference with Easy Parallelism☆16Updated 5 months ago
- ScaledMCP is a horizontally scalabled MCP and A2A Server. You know, for AI.☆33Updated last week
- Run AI generated code in isolated sandboxes☆88Updated 5 months ago
- The reliability layer between your code and LLM providers.☆19Updated 6 months ago
- Guards and protection agnostic to your model or provider☆36Updated 7 months ago
- MCP that provides a persistent shell for multi-agent applications☆17Updated this week
- Open Source LLM proxy that transparently captures and logs all interactions with LLM API☆59Updated 3 weeks ago
- Chew is a Go library for processing various content types into markdown/plaintext.☆42Updated 4 months ago
- ☆10Updated last year
- Vector Embedding Server in under 100 lines of code☆22Updated last year
- DockaShell is an MCP server that gives AI agents isolated Docker containers to work in. MCP tools for shell access, file operations, and …☆22Updated last month
- Serverless runtime environment tailored for code produced by LLMs. Automatic API generation from your code, support for multiple programm…☆25Updated 2 years ago
- A Model Context Protocol (MCP) server that provides file system context to Large Language Models (LLMs). This server enables LLMs to read…☆20Updated last month
- Guide: from fragile multi-agent app to prod ready with orra - code and resources.☆14Updated 3 months ago
- Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…☆27Updated 8 months ago
- GO GO PARSE YOUR CODE GO GO☆12Updated last month
- Private ChatGPT/Perplexity. Securely unlocks knowledge from confidential business information.☆67Updated 9 months ago
- AI Agent which deep crawls a company website and generates a comprehensive PDF report.☆22Updated 4 months ago
- Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.☆100Updated 8 months ago
- Gateway and load balancer to your LLM inference endpoints☆23Updated 8 months ago
- Structured outputs from DSPy and Jinja2☆23Updated 2 weeks ago
- A lightweight code assistant with tool-using capabilities built on HuggingFace's smolagents.☆34Updated last month
- The home of official Obot tools☆29Updated this week