Alternatives and similar repositories for llm_proxy

Users that are interested in llm_proxy are comparing it to the libraries listed below

• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated last year
• BoxiYu / DSPy-Guardrails
  Building self-refined guardrails via DSPy
  ☆13Updated last year
• PromptSail / prompt_sail
  Open Source LLM proxy that transparently captures and logs all interactions with LLM API
  ☆62Updated 6 months ago
• orra-dev / orra
  A plan engine for dynamic planning and reliable execution of AI agent workflows.
  ☆239Updated 7 months ago
• obot-platform / tools
  The home of official Obot tools
  ☆32Updated 2 weeks ago
• rubra-ai / rubra
  Open Weight, tool-calling LLMs
  ☆155Updated last year
• langfuse / oss-llmops-stack
  Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…
  ☆129Updated 10 months ago
• gptscript-ai / function-calling-test-suite
  ☆12Updated last year
• missingstudio / gateway
  [deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications
  ☆161Updated last year
• Portkey-AI / portkey-python-sdk
  Build reliable, secure, and production-ready AI apps easily.
  ☆97Updated last month
• seanchatmangpt / dslmodel
  Structured outputs from DSPy and Jinja2
  ☆26Updated 6 months ago
• premAI-io / Ayup
  Quickly and securely turn any Linux box into a build and deployment assistant
  ☆24Updated last year
• 0xSero / mem-layer
  Organise your AI's memories with graph database entries
  ☆60Updated last month
• humanlayer / agentcontrolplane
  ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…
  ☆304Updated 6 months ago
• dbos-inc / durable-swarm
  Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.
  ☆115Updated last year
• hivenetwork-ai / hive-agent-py
  This library provides you with an easy way to create and run Hive Agents.
  ☆19Updated last year
• gptscript-ai / py-gptscript
  Python module for running GPTScript
  ☆14Updated 3 weeks ago
• dagger / agents
  ☆137Updated 8 months ago
• quantalogic / qllm
  QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…
  ☆34Updated 9 months ago
• agentkube / agentkube
  Agentkube - Run Kubernetes Like Never Before
  ☆23Updated last month
• substratusai / sandboxai
  Run AI generated code in isolated sandboxes
  ☆134Updated 11 months ago
• EinStack / glide
  🐦 A open blazing-fast simple model gateway for rapid development of production GenAI apps
  ☆153Updated last year
• XiaoConstantine / dspy-go
  DSPy Go implementation
  ☆142Updated last week
• firstbatchxyz / function-calling-eval
  The DPAB-α Benchmark
  ☆32Updated 11 months ago
• NeuralTrust / TrustGate
  A powerful, AI Gateway designed from scratch for AI
  ☆48Updated 3 weeks ago
• LyzrCore / lyzr-experimental-automata
  The version 0.2 is a prompt based agent workflow that integrates with other Lyzr agents
  ☆32Updated last year
• Traego / scaled-mcp
  ScaledMCP is a horizontally scalabled MCP and A2A Server. You know, for AI.
  ☆42Updated 5 months ago
• SerjSmor / open-intent-classifier
  A project that enables identification and classification of an intent of a message with dynamic labels
  ☆50Updated last year
• ialacol / text-inference-batcher
  A high performance batching router optimises max throughput for text inference workload
  ☆16Updated 2 years ago
• mozilla-ai / structured-qa
  Blueprint by Mozilla.ai for answering questions about structured documents
  ☆37Updated 9 months ago