Alternatives and similar repositories for vllm:

Users that are interested in vllm are comparing it to the libraries listed below

• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated last year
• kyegomez / NeoSapiens
  The next evolution of Agents
  ☆48Updated last week
• The-Swarm-Corporation / OmniParse
  Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …
  ☆17Updated last week
• glaive-ai / reflection_70b_training
  ☆17Updated last week
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆48Updated 2 weeks ago
• superagi / Veagle
  Enhancement in Multimodal Representation Learning.
  ☆40Updated 11 months ago
• The-Swarm-Corporation / swarms-cloud
  Deploy your autonomous agents to production grade environments with 99% Uptime Guarantee, Infinite Scalability, and self-healing.
  ☆36Updated last week
• qnguyen3 / hermes-llava
  ☆54Updated last year
• AGiXT / streamlit
  Streamlit Web UI for AGiXT
  ☆26Updated 4 months ago
• johanndiep / language-models-trajectory-generators
  This repository contains a fork from "language-models-trajectory-generators", the goal is to test the same functionality with Mistrals LL…
  ☆21Updated 4 months ago
• cognitivecomputations / generate
  ☆28Updated 11 months ago
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆71Updated last month
• camenduru / MiniGPT-v2-colab
  ☆29Updated last year
• yip-kl / llm_dspy_tutorial
  Tutorial for DSPy
  ☆23Updated 9 months ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆89Updated 3 weeks ago
• kyegomez / forest-of-thoughts
  A forest of autonomous agents.
  ☆19Updated 3 weeks ago
• kyegomez / MLXTransformer
  Simple Implementation of a Transformer in the new framework MLX by Apple
  ☆20Updated 3 months ago
• diicellman / dynamite-dogs
  BH hackathon
  ☆14Updated 10 months ago
• facebookresearch / ExploreToM
  Code for ExploreTom
  ☆75Updated 2 months ago
• gradio-app / sambanova-gradio
  ☆18Updated 3 months ago
• Alignment-Lab-AI / KnowledgeBase
  never forget anything again! combine AI and intelligent tooling for a local knowledge base to track catalogue, annotate, and plan for you…
  ☆37Updated 9 months ago
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆58Updated 6 months ago
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated 8 months ago
• OS-Copilot / FRIDAY-Gizmos
  ☆28Updated 10 months ago
• Scale3-Labs / dspy-examples
  A collection of example AI programs built using DSPy and maitained by the Langtrace AI team.
  ☆21Updated 3 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆48Updated 7 months ago
• truemagic-coder / nemo-agent
  Your Python AI Coder!
  ☆32Updated this week
• Tonic-AI / EasyAGI
  🌟EasyAGI : A generalist agent that can go online and accomplish complex tasks.
  ☆23Updated last year
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆80Updated 8 months ago