Alternatives and similar repositories for vllm_proxy_server:

Users that are interested in vllm_proxy_server are comparing it to the libraries listed below

• eurdoch / toolla
  High level tool use for LLMs
  ☆34Updated 7 months ago
• astramind-ai / Pulsar
  The hearth of The Pulsar App, fast, secure and shared inference with modern UI
  ☆56Updated 3 months ago
• theroyallab / llm-prompt-templates
  Prompt Jinja2 templates for LLMs
  ☆31Updated 3 months ago
• Aesthisia / LLMinator
  Gradio based tool to run opensource LLM models directly from Huggingface
  ☆91Updated 9 months ago
• catena-labs / moa-llm
  A Python library to orchestrate LLMs in a neural network-inspired structure
  ☆46Updated 5 months ago
• Forest-Person / smolResearcher
  Use smol agents to do research and then update csv coumns with its findings.
  ☆37Updated 2 months ago
• sony / talkhier
  Official Repo for The Paper "Talk Structurally, Act Hierarchically: A Collaborative Framework for LLM Multi-Agent Systems"
  ☆47Updated last month
• severian42 / Proteus-The-Genesis-LLM
  Proteus is an experimental platform that combines the power of Large Language Models with the Genesis physics engine
  ☆21Updated 3 months ago
• multiplexerai / mplx_rag
  Complex RAG backend
  ☆28Updated last year
• AGiXT / hub
  Hub for Open Source AGiXT Extensions, Chains, Prompts, and Agents.
  ☆17Updated last year
• cognitivecomputations / kraken
  ☆66Updated 10 months ago
• Tonic-AI / EasyAGI
  🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.
  ☆23Updated last year
• LostRuins / datasetexplorer
  Easily view and modify JSON datasets for large language models
  ☆71Updated 3 weeks ago
• abgulati / hf-waitress
  Serving LLMs in the HF-Transformers format via a PyFlask API
  ☆71Updated 6 months ago
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆67Updated 4 months ago
• xNul / codestral-mamba-for-vscode
  Use Codestral Mamba with Visual Studio Code and the Continue extension. A local LLM alternative to GitHub Copilot.
  ☆31Updated 8 months ago
• brittlewis12 / autogguf
  Easily convert HuggingFace models to GGUF-format for llama.cpp
  ☆21Updated 8 months ago
• AGiXT / streamlit
  Streamlit Web UI for AGiXT
  ☆26Updated last month
• truemagic-coder / nemo-agent
  Your Python AI Coder!
  ☆33Updated last month
• laelhalawani / gguf_modeldb
  A quick and optimized solution to manage llama based gguf quantized models, download gguf files, retreive messege formatting, add more mo…
  ☆12Updated last year
• monk1337 / auto-ollama
  run ollama & gguf easily with a single command
  ☆50Updated 10 months ago
• Aincvy / vscode-fauxpilot
  ☆24Updated 9 months ago
• andrewginns / CoT-at-Home
  Who needs o1 anyways. Add CoT to any OpenAI compatible endpoint.
  ☆41Updated 6 months ago
• diicellman / dynamite-dogs
  BH hackathon
  ☆14Updated 11 months ago
• leafspark / AutoGGUF
  automatically quant GGUF models
  ☆164Updated last week
• unslothai / unsloth-studio
  Unsloth Studio
  ☆73Updated 2 weeks ago
• Ejb503 / ai-voice-generation
  Experience the power of AI with this free AI voice generator demo. Utilizing Deepgram and Groq, we transform text into voice seamlessly. …
  ☆37Updated 9 months ago
• rodrigobaron / anthill
  ☆24Updated 2 months ago
• slashml / awesome-finetuning
  ☆27Updated 7 months ago
• jabberjabberjabber / Chunkify
  Create text chunks which end at natural stopping points without using a tokenizer
  ☆26Updated 2 weeks ago