Alternatives and similar repositories for llm_proxy

Users that are interested in llm_proxy are comparing it to the libraries listed below

• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated 9 months ago
• humanlayer / agentcontrolplane
  ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…
  ☆125Updated last month
• rubra-ai / rubra
  Open Weight, tool-calling LLMs
  ☆154Updated 9 months ago
• PromptSail / prompt_sail
  Open Source LLM proxy that transparently captures and logs all interactions with LLM API
  ☆59Updated last month
• obot-platform / tools
  The home of official Obot tools
  ☆29Updated this week
• phil65 / llmling-agent
  Multi-agent workflows and complex Agent interactions, both via YAML manifest and programmatic usage. Pydantic-AI and LiteLLM backends. Hu…
  ☆21Updated last week
• premAI-io / Ayup
  Quickly and securely turn any Linux box into a build and deployment assistant
  ☆24Updated 9 months ago
• langfuse / oss-llmops-stack
  Modular, open source LLMOps stack that separates concerns: LiteLLM unifies LLM APIs, manages routing and cost controls, and ensures high-…
  ☆107Updated 5 months ago
• gptscript-ai / py-gptscript
  Python module for running GPTScript
  ☆14Updated 2 months ago
• quantalogic / qllm
  QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…
  ☆33Updated 3 months ago
• substratusai / sandboxai
  Run AI generated code in isolated sandboxes
  ☆89Updated 5 months ago
• seanchatmangpt / dslmodel
  Structured outputs from DSPy and Jinja2
  ☆25Updated last month
• gptscript-ai / function-calling-test-suite
  ☆12Updated last year
• JeezAI / DSPy_matchmaking
  A seamless matchmaking application that is programmed with Cohere Command R+, Stanford NLP DSPy framework, Weaviate Vector store and Crew…
  ☆59Updated last year
• hide-org / hide
  🤖 Headless IDE for AI agents
  ☆196Updated 3 months ago
• prem-research / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆32Updated last year
• gptscript-ai / browser
  ☆19Updated 10 months ago
• dbos-inc / durable-swarm
  Augment Swarm with durable execution to help you build reliable and scalable multi-agent systems.
  ☆101Updated 8 months ago
• PrimeIntellect-ai / prime-cli
  The Prime Intellect CLI provides a powerful command-line interface for managing GPU resources across various providers
  ☆30Updated 2 months ago
• traceloop / hub
  High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included
  ☆116Updated 2 weeks ago
• google / litmus
  Litmus is a comprehensive LLM testing and evaluation tool designed for GenAI Application Development. It provides a robust platform with …
  ☆36Updated 2 weeks ago
• agentsea / agentd
  A daemon that makes a desktop OS accessible to AI agents
  ☆33Updated 2 months ago
• mithril-security / blind_llama_client
  Zero-trust AI APIs for easy and private consumption of open-source LLMs
  ☆40Updated last year
• plastic-labs / honcho
  The Identity layer for the agentic world
  ☆201Updated this week
• Traego / scaled-mcp
  ScaledMCP is a horizontally scalabled MCP and A2A Server. You know, for AI.
  ☆39Updated last week
• gptscript-ai / desktop
  ☆25Updated 10 months ago
• Debapriya-source / nyaya-gpt
  AI agent with RAG+ReAct on Indian Constitution & BNS
  ☆71Updated last month
• samalba / hf-model-ops
  🤗 MLOps with Hugging Face Spaces and Dagger
  ☆46Updated 2 years ago
• radiantlogicinc / fastworkflow
  A framework for building large-scale, deterministic, interactive workflows with a fault-tolerant, conversational UX
  ☆18Updated this week
• Noveum / ai-gateway
  Built for demanding AI workflows, this gateway offers low-latency, provider-agnostic access, ensuring your AI applications run smoothly a…
  ☆73Updated 2 months ago