Alternatives and similar repositories for vllm:

Users that are interested in vllm are comparing it to the libraries listed below

• stanford-oval / chainlite
  LangChain + LiteLLM that works
  ☆39Updated this week
• The-Swarm-Corporation / swarms-cloud
  Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.
  ☆37Updated last week
• The-Swarm-Corporation / swarm-ecosystem
  The Swarm Ecosystem
  ☆20Updated 8 months ago
• yoheinakajima / captainaction
  Collections of Actions for Custom GPTs (some created by Captain Action)
  ☆10Updated last year
• kyegomez / dev-swarm
  A swarm of LLM agents that will help you test, document, and productionize your code!
  ☆15Updated last week
• stanford-oval / gpt_paper_assistant
  GPT4 based personalized ArXiv paper assistant bot
  ☆10Updated last year
• The-Swarm-Corporation / swarm-models
  A simple to use package to call various model providers such as openai, anthropic, and others with utmost reliability, security, and perf…
  ☆12Updated last week
• agentsea / taskara
  Task management for AI agents
  ☆15Updated 2 weeks ago
• kyegomez / SwarmOS
  An all-new OS that orchestrates autonomous agents as workers to execute tasks.
  ☆17Updated 5 months ago
• unclecode / tool4ai
  Tool4AI: A model agnostic, LLM friendly router for tool/function call
  ☆17Updated 7 months ago
• The-Swarm-Corporation / AgentParse
  AgentParse is a high-performance parsing library designed to map various structured data formats (such as Pydantic models, JSON, YAML, an…
  ☆13Updated this week
• kyegomez / WhiteRock
  The world's first fully automated VC fund.
  ☆20Updated this week
• phil65 / llmling-agent
  Multi-agent workflows and complex Agent interactions, both via YAML manifest and programmatic usage. Pydantic-AI and LiteLLM backends. Hu…
  ☆15Updated this week
• kimtth / mcp-aoai-web-browsing
  A minimal Model Context Protocol 🖥️ server/client🧑‍💻with Azure OpenAI and 🌐 web browser control via Playwright.
  ☆15Updated last week
• unclecode / mem4ai
  🧠 Mem4AI: A LLM Friendly memory management library.
  ☆24Updated 5 months ago
• Josephrp / LablabAutogen
  A generalist agent that can go online and accomplish complex tasks using semantic-kernel and autogen.
  ☆25Updated last year
• OpenDevin / OD-SWE-bench
  Enhanced fork of SWE-bench, tailored for OpenDevin's ecosystem.
  ☆23Updated 10 months ago
• shivvamm / Search-With-Aisia
  AI Search engine
  ☆12Updated last month
• kyegomez / forest-of-thoughts
  A forest of autonomous agents.
  ☆19Updated 2 months ago
• mckaywrigley / generative-ui-experiments
  ☆20Updated last year
• fofr / prompter.fofr.ai
  An app for generating prompts
  ☆26Updated 2 months ago
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆37Updated 11 months ago
• Qredence / GraphFleet
  An open-source integration of GraphRAG for Agentic System with NoCode
  ☆12Updated this week
• Doriandarko / OraclesGPT
  ☆11Updated last year
• vast-ai / vast-pyworker
  ☆10Updated 2 months ago
• unclecode / callama
  Democratizing Function Calling Capabilities for Open-Source Language Models
  ☆39Updated 11 months ago
• The-Swarm-Corporation / agentverse
  Various agents from all of the top agent frameworks to integrate into swarms! Langchain, Griptape, CrewAI, and more!
  ☆11Updated this week
• BerriAI / litellm-CodeLlama-server
  ☆13Updated last year
• Tonic-AI / EasyAGI
  🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.
  ☆23Updated last year
• joshbickett / run-mistral-7b
  This repo lets you run mistral-7b in Google Colab.
  ☆16Updated last year