Alternatives and similar repositories for llm_proxy

Users that are interested in llm_proxy are comparing it to the libraries listed below

• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated 11 months ago
• humanlayer / agentcontrolplane
  ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…
  ☆209Updated 3 months ago
• PromptSail / prompt_sail
  Open Source LLM proxy that transparently captures and logs all interactions with LLM API
  ☆60Updated 3 months ago
• gptscript-ai / function-calling-test-suite
  ☆12Updated last year
• gptscript-ai / py-gptscript
  Python module for running GPTScript
  ☆14Updated 4 months ago
• BismuthCloud / asimov
  A Python framework for building AI agent systems with robust task management in the form of a graph execution engine, inference capabilit…
  ☆31Updated 3 months ago
• langfuse / oss-llmops-stack
  Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…
  ☆117Updated 7 months ago
• gptscript-ai / browser
  ☆19Updated last year
• seanchatmangpt / dslmodel
  Structured outputs from DSPy and Jinja2
  ☆26Updated 3 months ago
• dbos-inc / durable-swarm
  Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.
  ☆107Updated 10 months ago
• orra-dev / orra
  A plan engine for dynamic planning and reliable execution of AI agent workflows.
  ☆226Updated 4 months ago
• j4ys0n / llm-proxy
  TLS & API keys for your LLM APIs
  ☆18Updated 9 months ago
• rubra-ai / rubra
  Open Weight, tool-calling LLMs
  ☆156Updated 11 months ago
• fuzzylabs / sre-agent
  A Site Reliability Engineer AI agent that can monitor application and infrastructure logs, diagnose issues, and report on diagnostics.
  ☆91Updated this week
• prem-research / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆33Updated last year
• phil65 / llmling-agent
  Multi-agent workflows and complex Agent interactions, both via YAML manifest and programmatic usage. MCP & ACP (Agent Client Protocol) s…
  ☆28Updated this week
• tom-doerr / awesome-dspy
  ☆22Updated last year
• missingstudio / gateway
  [deprecated] AI Gateway - core infrastructure stack for building production-ready AI Applications
  ☆161Updated last year
• whylabs / openllmtelemetry
  Open LLM Telemetry package
  ☆29Updated 10 months ago
• shykes / toy-programmer
  A toy AI agent that can write programs, powered by Dagger
  ☆35Updated 6 months ago
• Portkey-AI / portkey-python-sdk
  Build reliable, secure, and production-ready AI apps easily.
  ☆85Updated last week
• dylibso / mcp.run-servlets
  Official servlets for mcp.run published by @dylibso
  ☆63Updated 2 months ago
• obot-platform / tools
  The home of official Obot tools
  ☆30Updated last week
• XiaoConstantine / dspy-go
  DSPy Go implementation
  ☆101Updated 3 weeks ago
• ruvnet / Agent-Name-Service
  Agent Name Service (ANS) Protocol, introduced by the OWASP GenAI Security Project, is a foundational framework designed to facilitate sec…
  ☆37Updated 4 months ago
• gptscript-ai / desktop
  ☆25Updated last year
• interlocklabs / trellis
  A simple DAG for executing LLM calls and using tools.
  ☆41Updated 2 years ago
• jamsocket / forevervm
  Securely run AI-generated code in stateful sandboxes that run forever.
  ☆217Updated 5 months ago
• mithril-security / blind_llama_client
  Zero-trust AI APIs for easy and private consumption of open-source LLMs
  ☆40Updated last year
• Debapriya-source / nyaya-gpt
  AI agent with RAG+ReAct on Indian Constitution & BNS
  ☆74Updated 3 months ago