Alternatives and similar repositories for llm_proxy:

Users that are interested in llm_proxy are comparing it to the libraries listed below

• gptscript-ai / knowledge
  Knowledge for GPTScript
  ☆29Updated 4 months ago
• computer-reinvention / ChainFactory
  Run Structured LLM Inference with Easy Parallelism
  ☆15Updated last month
• struct-chat / embedding
  Vector Embedding Server in under 100 lines of code
  ☆22Updated last year
• quantalogic / qllm
  QLLM: A powerful CLI for seamless interaction with multiple Large Language Models. Simplify AI workflows, streamline development, and unl…
  ☆33Updated 3 weeks ago
• obot-platform / tools
  The home of official Obot tools
  ☆22Updated this week
• caspianmoon / jsonpaws
  A library for generating structured JSON using GPT-4o.
  ☆13Updated 7 months ago
• gptscript-ai / gptparse
  Document parser for RAG
  ☆22Updated 4 months ago
• mmatongo / chew
  Chew is a Go library for processing various content types into markdown/plaintext.
  ☆41Updated last month
• r2d4 / dacc
  docker-as-code compiler
  ☆13Updated 5 months ago
• PromptSail / prompt_sail
  Open Source LLM proxy that transparently captures and logs all interactions with LLM API
  ☆52Updated 2 months ago
• alexminnaar / Diagify
  convert natural language into technical diagrams
  ☆12Updated 3 months ago
• rabilrbl / llamafile-builder
  A simple github actions script to build a llamafile and uploads to huggingface
  ☆14Updated last year
• noco-ai / spellbook-ui
  ☆16Updated last year
• go-go-golems / oak
  GO GO PARSE YOUR CODE GO GO
  ☆11Updated last month
• furudo-erika / ai-testing-agent
  AI Testing Agent: Open Source AI Agent for Software Testing
  ☆14Updated 3 months ago
• premAI-io / prem-operator
  📡 Deploy AI models and apps to Kubernetes without developing a hernia
  ☆32Updated 9 months ago
• gptscript-ai / py-gptscript
  Python module for running GPTScript
  ☆14Updated this week
• quentinlintz / synthetic-data-generator
  🦄 Use GPT to generate and label data
  ☆25Updated 10 months ago
• firstbatchxyz / function-calling-eval
  The DPAB-α Benchmark
  ☆19Updated 2 months ago
• russellballestrini / opencompletion
  Chatroom app where messages are sent to GPT, Claude, Mistral, Together, Grok, Groq, Google, vLLM, Ollama & streamed to the frontend.
  ☆39Updated last week
• gptscript-ai / browser
  ☆19Updated 5 months ago
• distribute-dev / dagen
  Agents and RAG workflows with little to no code
  ☆22Updated 3 months ago
• irthomasthomas / llm-cerebras
  llm plugin for Cerebras fast inference API
  ☆23Updated last week
• Lytix-Labs / optimodel
  Guards and protection agnostic to your model or provider
  ☆36Updated 4 months ago
• seanchatmangpt / dslmodel
  Structured outputs from DSPy and Jinja2
  ☆23Updated 2 months ago
• shellc / iauto
  iauto is a low-code engine for building and deploying AI agents
  ☆85Updated 4 months ago
• teilomillet / hapax
  The reliability layer between your code and LLM providers.
  ☆17Updated 2 months ago
• manooshree / PEFT-qLORA-Gemma2B
  Supervised fine-tuning of Google's open-source Gemma-2B model to optimize writing Python code
  ☆21Updated last year