Alternatives and similar repositories for vllm:

Users that are interested in vllm are comparing it to the libraries listed below

• qnguyen3 / hermes-llava
  ☆54Updated last year
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought"
  ☆88Updated last month
• SebastianBodza / EnsembleForecasting
  Using multiple LLMs for ensemble Forecasting
  ☆16Updated last year
• phunterlau / paper_without_code
  LLM reads a paper and produce a working prototype
  ☆46Updated 2 weeks ago
• agentsea / agentdesk
  A desktop for AI agents
  ☆36Updated this week
• zhudotexe / redel
  ReDel is a toolkit for researchers and developers to build, iterate on, and analyze recursive multi-agent systems. (EMNLP 2024 Demo)
  ☆68Updated 3 weeks ago
• kyegomez / Kosmos-X
  The Next Generation Multi-Modality Superintelligence
  ☆70Updated 4 months ago
• ruvnet / q-star
  Q-Star Agent Code: A reinforcement learning-based framework for intelligent agents using Microsoft AutoGen. It leverages Q-Star, a Q-lear…
  ☆76Updated 11 months ago
• johanndiep / language-models-trajectory-generators
  This repository contains a fork from "language-models-trajectory-generators", the goal is to test the same functionality with Mistrals LL…
  ☆20Updated 3 months ago
• lamm-mit / AtomAgents
  ☆49Updated 3 months ago
• Birch-san / wizardcoder-play
  Command-line script for inferencing from models such as WizardCoder
  ☆26Updated last year
• kyegomez / NeoSapiens
  The next evolution of Agents
  ☆47Updated last week
• glaive-ai / reflection_70b_training
  ☆17Updated 3 months ago
• diicellman / dynamite-dogs
  BH hackathon
  ☆14Updated 9 months ago
• EdwardDali / EntropixLab
  entropix style sampling + GUI
  ☆25Updated 2 months ago
• JakeFurtaw / Chat-RAG
  Uses a Gradio interface to stream coding related responses from local and cloud based large language models. Pulls context from GitHub Re…
  ☆19Updated 4 months ago
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆39Updated last week
• AK391 / dailypapersHN
  ☆83Updated 3 months ago
• facebookresearch / TraceTheMind
  Code for TrackTheMind
  ☆68Updated last month
• The-Swarm-Corporation / OmniParse
  Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …
  ☆16Updated this week
• kyegomez / Finetuning-Suite
  Finetune any model on HF in less than 30 seconds
  ☆57Updated 2 months ago
• deshwalmahesh / PHUDGE
  Official repo for the paper PHUDGE: Phi-3 as Scalable Judge. Evaluate your LLMs with or without custom rubric, reference answer, absolute…
  ☆48Updated 6 months ago
• shivamsanju / ragswift
  🚀 Scale your RAG pipeline using Ragswift: A scalable centralized embeddings management platform
  ☆37Updated 11 months ago
• camenduru / MiniGPT-v2-colab
  ☆29Updated last year
• teknium1 / ShareGPT-Builder
  ☆108Updated last month
• kyegomez / AutoRT
  Implementation of AutoRT: "AutoRT: Embodied Foundation Models for Large Scale Orchestration of Robotic Agents"
  ☆34Updated 2 months ago
• arcee-ai / DAM
  ☆46Updated 2 months ago
• adithya-s-k / YoloGemma
  Testing and evaluating the capabilities of Vision-Language models (PaliGemma) in performing computer vision tasks such as object detectio…
  ☆79Updated 7 months ago
• marib00 / llamaindex-embedding-lora
  ☆29Updated 10 months ago
• camel-ai / camel_chat
  Minimalistic repository to reproduce and serve CAMEL models.
  ☆19Updated last year