Alternatives and similar repositories for vllm-release

Users that are interested in vllm-release are comparing it to the libraries listed below

• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆170Updated last year
• kyegomez / Andromeda
  An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast
  ☆152Updated last year
• promptslab / LLMtuner
  FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)
  ☆242Updated last year
• mobiusml / aana_sdk
  Aana SDK is a powerful framework for building AI enabled multimodal applications.
  ☆52Updated 3 weeks ago
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated last year
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• QuixiAI / kraken
  ☆67Updated last year
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆118Updated last year
• QuixiAI / OpenChatML
  ☆161Updated last month
• NousResearch / Obsidian
  Maybe the new state of the art vision model? we'll see 🤷‍♂️
  ☆166Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆101Updated last year
• LLM360 / crystalcoder-train
  Pre-training code for CrystalCoder 7B LLM
  ☆55Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆94Updated last year
• teknium1 / ShareGPT-Builder
  ☆116Updated 9 months ago
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆161Updated last year
• teknium1 / transformers-gptq-quant
  ☆46Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆110Updated 9 months ago
• furiousteabag / vram-calculator
  Transformer GPU VRAM estimator
  ☆66Updated last year
• togethercomputer / Llama-2-7B-32K-Instruct
  ☆85Updated 2 years ago
• Leeroo-AI / leeroo_orchestrator
  The implementation of "Leeroo Orchestrator: Elevating LLMs Performance Through Model Integration"
  ☆56Updated last year
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆120Updated 7 months ago
• rafacelente / bllama
  1.58-bit LLaMa model
  ☆82Updated last year
• deepinfra / deepctl
  Command line tool for Deep Infra cloud ML inference service
  ☆33Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆91Updated last year
• AlexBodner / How_Much_VRAM
  ☆102Updated last year
• tiiuae / onebitllms
  Lightweight toolkit package to train and fine-tune 1.58bit Language models
  ☆88Updated 4 months ago
• weaviate / structured-rag
  Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models
  ☆111Updated 5 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆38Updated last year
• LLukas22 / llm-rs-python
  Unofficial python bindings for the rust llm library. 🐍❤️🦀
  ☆75Updated 2 years ago
• kyegomez / Kosmos-X
  The Next Generation Multi-Modality Superintelligence
  ☆70Updated last year