Alternatives and similar repositories for vllm_proxy_server

Users that are interested in vllm_proxy_server are comparing it to the libraries listed below

• sudarshan-koirala / langchain-groq-chainlit
  Simple Chainlit UI for running llms from Groq and LangChain
  ☆17Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆50Updated last year
• eurdoch / toolla
  High level tool use for LLMs
  ☆34Updated 9 months ago
• severian42 / Proteus-The-Genesis-LLM
  Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine
  ☆22Updated 4 months ago
• The-Swarm-Corporation / OmniParse
  Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …
  ☆19Updated 3 weeks ago
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆47Updated 7 months ago
• jmikedupont2 / openlightllm
  fork of litellm that is open source
  ☆19Updated 4 months ago
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆38Updated last year
• Tonic-AI / EasyAGI
  🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.
  ☆23Updated last year
• Forest-Person / smolResearcher
  Use smol agents to do research and then update csv coumns with its findings.
  ☆40Updated 3 months ago
• severian42 / Mycomind-Daemon-Ollama-Mixture-of-Memory-RAG-Agents
  Mycomind Daemon: A mycelium-inspired, advanced Mixture-of-Memory-RAG-Agents (MoMRA) cognitive assistant that combines multiple AI models …
  ☆32Updated 10 months ago
• xNul / codestral-mamba-for-vscode
  Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.
  ☆31Updated 9 months ago
• AGiXT / streamlit
  Streamlit Web UI for AGiXT
  ☆26Updated 2 months ago
• theroyallab / llm-prompt-templates
  Prompt Jinja2 templates for LLMs
  ☆29Updated 4 months ago
• truemagic-coder / nemo-agent
  Your Python AI Coder!
  ☆34Updated last week
• sammcj / vlm-ui
  Web Interface for Vision Language Models Including InternVLM2
  ☆21Updated 9 months ago
• cognitivecomputations / kraken
  ☆66Updated 11 months ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 8 months ago
• adrienbrault / hf-gguf-to-ollama
  Dagger functions to import Hugging Face GGUF models into a local ollama instance and optionally push them to ollama.com.
  ☆115Updated 11 months ago
• rodrigobaron / anthill
  ☆24Updated 3 months ago
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆75Updated 2 months ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆61Updated 8 months ago
• bhimrazy / chat-with-phi-3-vision
  Chat with Phi 3.5/3 Vision LLMs. Phi-3.5-vision is a lightweight, state-of-the-art open multimodal model built upon datasets which includ…
  ☆33Updated 4 months ago
• remichu-ai / gallamaUI
  ☆23Updated 6 months ago
• laelhalawani / gguf_modeldb
  A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…
  ☆12Updated last year
• AiFlowSolutions / MADS
  A framework that uses multi-agents to enable users to perform a systematic data science pipeline with just two inputs.
  ☆41Updated 9 months ago
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated last year
• l4b4r4b4b4 / AIDocks
  LLM-Training-API: Including Embeddings & ReRankers, mergekit, LaserRMT
  ☆27Updated last year
• stringandstickytape / MaxsAiStudio
  A Windows tool to query various LLM AIs. Supports branched conversations, history and summaries among others.
  ☆30Updated this week
• remichu-ai / gallama
  ☆130Updated 2 weeks ago