Alternatives and similar repositories for llm_proxy:

Users that are interested in llm_proxy are comparing it to the libraries listed below

• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated 5 months ago
• gptscript-ai / py-gptscript
  Python module for running GPTScript
  ☆14Updated 3 weeks ago
• obot-platform / tools
  The home of official Obot tools
  ☆26Updated this week
• computer-reinvention / ChainFactory
  Run Structured LLM Inference with Easy Parallelism
  ☆16Updated 2 months ago
• premAI-io / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆32Updated 10 months ago
• struct-chat / embedding
  Vector Embedding Server in under 100 lines of code
  ☆22Updated last year
• caspianmoon / jsonpaws
  A library for generating structured JSON using GPT-4o.
  ☆13Updated 8 months ago
• gptscript-ai / gptparse
  Document parser for RAG
  ☆23Updated 5 months ago
• teilomillet / hapax
  The reliability layer between your code and LLM providers.
  ☆17Updated 3 months ago
• rabilrbl / llamafile-builder
  A simple github actions script to build a llamafile and uploads to huggingface
  ☆14Updated last year
• substratusai / sandboxai
  Run AI generated code in isolated sandboxes
  ☆50Updated 2 months ago
• mmatongo / chew
  Chew is a Go library for processing various content types into markdown/plaintext.
  ☆42Updated last month
• seanchatmangpt / dslmodel
  Structured outputs from DSPy and Jinja2
  ☆23Updated 3 months ago
• PromptSail / prompt_sail
  Open Source LLM proxy that transparently captures and logs all interactions with LLM API
  ☆52Updated 2 months ago
• quantalogic / qllm
  QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…
  ☆33Updated this week
• alexminnaar / Diagify
  convert natural language into technical diagrams
  ☆12Updated 3 months ago
• gptscript-ai / browser
  ☆19Updated 6 months ago
• Lytix-Labs / optimodel
  Guards and protection agnostic to your model or provider
  ☆36Updated 4 months ago
• go-go-golems / oak
  GO GO PARSE YOUR CODE GO GO
  ☆11Updated 2 months ago
• nospecs / ovadare
  AI conflict resolution framework designed to work alongside existing AI orchestration tools
  ☆24Updated 4 months ago
• run-llama / mixtral_ollama
  ☆46Updated last year
• thetaris / testup-ai-driver
  ☆10Updated 10 months ago
• gptscript-ai / function-calling-test-suite
  ☆12Updated 9 months ago
• humanlayer / agentcontrolplane
  ACP is the Agent Control Plane - a distributed agent scheduler optimized for simplicity, clarity, and control. It is designed for outer-l…
  ☆24Updated this week
• modelgw / modelgw
  Gateway and load balancer to your LLM inference endpoints
  ☆21Updated 5 months ago
• docqai / docq
  Private ChatGPT/Perplexity. Securely unlocks knowledge from confidential business information.
  ☆62Updated 6 months ago
• zby / LLMEasyTools
  Tools for LLM agents.
  ☆62Updated 3 months ago
• premAI-io / Ayup
  Quickly and securely turn any Linux box into a build and deployment assistant
  ☆24Updated 6 months ago
• cognitivecomputations / runpod-vllm
  ☆15Updated last year
• pavanjava / llama_workflow_and_agents
  This repository is a combination of llama workflows and agents together which is a powerful concept.
  ☆17Updated 8 months ago