Alternatives and similar repositories for llm_proxy:

Users that are interested in llm_proxy are comparing it to the libraries listed below

• computer-reinvention / ChainFactory
  Run Structured LLM Inference with Easy Parallelism
  ☆15Updated 3 weeks ago
• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated 3 months ago
• quantalogic / qllm
  QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…
  ☆31Updated this week
• struct-chat / embedding
  Vector Embedding Server in under 100 lines of code
  ☆22Updated 11 months ago
• alexminnaar / Diagify
  convert natural language into technical diagrams
  ☆12Updated 2 months ago
• r2d4 / dacc
  docker-as-code compiler
  ☆13Updated 4 months ago
• PromptSail / prompt_sail
  Open Source LLM proxy that transparently captures and logs all interactions with LLM API
  ☆51Updated 3 weeks ago
• premAI-io / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆32Updated 8 months ago
• firstbatchxyz / function-calling-eval
  The DPAB-α Benchmark
  ☆16Updated last month
• gptscript-ai / py-gptscript
  Python module for running GPTScript
  ☆14Updated 2 weeks ago
• InftyAI / Awesome-LLMOps
  🎉 An awesome & curated list of best LLMOps tools.
  ☆40Updated last week
• gptscript-ai / gptparse
  Document parser for RAG
  ☆20Updated 3 months ago
• zachblume / autospec
  Autospec is an open-source AI agent that takes a web app URL and autonomously QAs it, and saves its passing specs as E2E test code
  ☆52Updated 2 weeks ago
• distribute-dev / dagen
  Agents and RAG workflows with little to no code
  ☆22Updated 2 months ago
• seanchatmangpt / dslmodel
  Structured outputs from DSPy and Jinja2
  ☆22Updated last month
• Anilturaga / aiide
  Pragmatic framework to build LLM Copilots
  ☆17Updated last month
• FalkorDB / falkordb-browser
  FalkorDB-Browser is a visualization UI for FalkorDB.
  ☆26Updated this week
• kyegomez / Exa
  Unleash the full potential of exascale LLMs on consumer-class GPUs, proven by extensive benchmarks, with no long-term adjustments and min…
  ☆25Updated 3 months ago
• thetaris / testup-ai-driver
  ☆10Updated 8 months ago
• Portkey-AI / portkey-python-sdk
  Build reliable, secure, and production-ready AI apps easily.
  ☆61Updated this week
• PrimeIntellect-ai / prime-cli
  The Prime Intellect CLI provides a powerful command-line interface for managing GPU resources across various providers
  ☆15Updated last week
• rabilrbl / llamafile-builder
  A simple github actions script to build a llamafile and uploads to huggingface
  ☆13Updated last year
• caspianmoon / jsonpaws
  A library for generating structured JSON using GPT-4o.
  ☆13Updated 6 months ago
• obot-platform / tools
  The home of official Obot tools
  ☆20Updated this week
• go-skynet / go-ggml-transformers.cpp
  Binding to transformers in ggml
  ☆60Updated last month
• Lytix-Labs / optimodel
  Guards and protection agnostic to your model or provider
  ☆36Updated 2 months ago
• The-Swarm-Corporation / swarms-cloud
  Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.
  ☆36Updated last week
• codebased-sh / codebased
  Embedded AI search engine for code
  ☆20Updated 5 months ago
• docqai / docq
  Private ChatGPT/Perplexity. Securely unlocks knowledge from confidential business information.
  ☆61Updated 4 months ago
• mmatongo / chew
  Chew is a Go library for processing various content types into markdown/plaintext.
  ☆40Updated this week