Alternatives and similar repositories for vllm-release

Users that are interested in vllm-release are comparing it to the libraries listed below

• kyegomez / Andromeda
  An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast
  ☆149Updated last year
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆169Updated last year
• QuixiAI / kraken
  ☆68Updated last year
• promptslab / LLMtuner
  FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)
  ☆246Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆111Updated last year
• Leeroo-AI / leeroo_orchestrator
  The implementation of "Leeroo Orchestrator: Elevating LLMs Performance Through Model Integration"
  ☆56Updated last year
• Preemo-Inc / text-generation-inference
  ☆198Updated last year
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆211Updated last year
• QuixiAI / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆240Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆104Updated 2 years ago
• Xalp / ECHO
  Official homepage for "Self-Harmonized Chain of Thought" (NAACL 2025)
  ☆91Updated 11 months ago
• QuixiAI / OpenChatML
  ☆165Updated 5 months ago
• emrgnt-cmplxty / zero-shot-replication
  ☆74Updated 2 years ago
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆133Updated 3 weeks ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• teknium1 / ShareGPT-Builder
  ☆119Updated last year
• serp-ai / Parameter-Efficient-MoE
  Parameter-Efficient Sparsity Crafting From Dense to Mixture-of-Experts for Instruction Tuning on General Tasks
  ☆31Updated last year
• Cerebras / DocChat
  GPT-4 Level Conversational QA Trained In a Few Hours
  ☆66Updated last year
• runpod-workers / worker-sglang
  SGLang is fast serving framework for large language models and vision language models.
  ☆31Updated last month
• kyegomez / Kosmos-X
  The Next Generation Multi-Modality Superintelligence
  ☆70Updated last year
• NousResearch / Obsidian
  Maybe the new state of the art vision model? we'll see 🤷‍♂️
  ☆170Updated last year
• dropbox / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆55Updated 4 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated 2 years ago
• huggingface / api-inference-community
  ☆172Updated 10 months ago
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆94Updated last year
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆161Updated 2 years ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆115Updated 9 months ago
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆56Updated last year
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆222Updated last year
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆180Updated last year