Alternatives and similar repositories for vllm:

Users that are interested in vllm are comparing it to the libraries listed below

• cray-lm / cray-lm
  Cray-LM unified training and inference stack.
  ☆22Updated 2 months ago
• raphaelmansuy / iteration_of_tought
  Example implementation of Iteration of Tought - Gives a star if you like the project
  ☆40Updated 3 months ago
• samchaineau / llm_slerp_generation
  Repo hosting codes and materials related to speeding LLMs' inference using token merging.
  ☆36Updated 11 months ago
• andysingal / LLMops
  purpose of this repo is to Implement LLMOPs as shared in Deeplearning AI course
  ☆16Updated this week
• AI-ANK / c3-python-nostream
  Python Server for C3 AI app. A project that brings the power of Large Language Models (LLM) and Retrieval-Augmented Generation (RAG) with…
  ☆23Updated last year
• cognitivecomputations / chat-logger
  ☆51Updated 5 months ago
• glaive-ai / reflection_70b_training
  ☆17Updated 2 months ago
• aniketmaurya / fastserve-ai
  Machine Learning Serving focused on GenAI with simplicity as the top priority.
  ☆58Updated 2 weeks ago
• SohamGovande / podplex
  🦾💻🌐 distributed training & serverless inference at scale on RunPod
  ☆17Updated 10 months ago
• tom-doerr / awesome-dspy
  ☆16Updated 11 months ago
• yoheinakajima / babyagi_og
  The original BabyAGI, updated with LiteLLM and no vector database reliance (csv instead)
  ☆21Updated 6 months ago
• the-crypt-keeper / tcurtsni
  Tcurtsni: Reverse Instruction Chat, ever wonder what your LLM wants to ask you?
  ☆21Updated 9 months ago
• BBischof / yapping
  Verbosity control for AI agents
  ☆62Updated 11 months ago
• ruvnet / open-space
  An open source code of the GitHub Copilot Workspace
  ☆11Updated 10 months ago
• JosephJeesungSuh / subpop
  Official repository for Language Model Fine-Tuning on Scaled Survey Data for Predicting Distributions of Public Opinions
  ☆17Updated this week
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆66Updated 5 months ago
• devadigapratham / CoDSPy
  An intelligent code optimization system leveraging AI analysis, automated refactoring, and test generation. Built with DSPy and Gradio, i…
  ☆18Updated 2 months ago
• run-llama / azure-cosmos-db-demo
  ☆20Updated last year
• The-Swarm-Corporation / OmniParse
  Transform unstructured documents into actionable, structured data with enterprise-grade precision and reliability, ready for large-scale …
  ☆19Updated last week
• arcee-ai / DAM
  ☆48Updated 5 months ago
• kyegomez / Ocean
  Ultra Fast Multi-Modality Vector Database
  ☆18Updated last year
• FanaHOVA / openai-o1-code-interpreter
  Code interpreter support for o1
  ☆32Updated 7 months ago
• kyegomez / forest-of-thoughts
  A forest of autonomous agents.
  ☆19Updated 2 months ago
• lordspline / DevOn
  ☆41Updated 11 months ago
• bipul1010 / agents_tutorial
  ☆19Updated 8 months ago
• HarleyCoops / StoneyNakoda
  A locally trained model of Stoney Nakoda has been developed and released. You can access the working model here or train your own instanc…
  ☆10Updated 2 weeks ago
• The-Swarm-Corporation / AgentGym
  A framework making it effortless to convert any llm model into a reasoning agent like o1 or DeepSeek's r1
  ☆20Updated 2 weeks ago
• ruvnet / agentXNG
  ☆11Updated 9 months ago
• langchain-ai / prompt-eval-recommendation
  Streamlit app for recommending eval functions using prompt diffs
  ☆27Updated last year
• matthelmer / DSPy-examples
  Example code using the DSPy framework.
  ☆18Updated 10 months ago