Alternatives and similar repositories for vllm-release

Users that are interested in vllm-release are comparing it to the libraries listed below

• kyegomez / Andromeda
  An all-new Language Model That Processes Ultra-Long Sequences of 100,000+ Ultra-Fast
  ☆151Updated 10 months ago
• QuixiAI / kraken
  ☆66Updated last year
• argilla-io / notus
  Notus is a collection of fine-tuned LLMs using SFT, DPO, SFT+DPO, and/or any other RLHF techniques, while always keeping a data-first app…
  ☆168Updated last year
• automix-llm / automix
  Mixing Language Models with Self-Verification and Meta-Verification
  ☆106Updated 7 months ago
• QuixiAI / laserRMT
  This is our own implementation of 'Layer Selective Rank Reduction'
  ☆239Updated last year
• emrgnt-cmplxty / zero-shot-replication
  ☆74Updated last year
• teknium1 / LLM-Benchmark-Logs
  Just a bunch of benchmark logs for different LLMs
  ☆119Updated 11 months ago
• NousResearch / Obsidian
  Maybe the new state of the art vision model? we'll see 🤷‍♂️
  ☆165Updated last year
• TheBlokeAI / AIScripts
  Some simple scripts that I use day-to-day when working with LLMs and Huggingface Hub
  ☆162Updated last year
• Gryphe / BlockMerge_Gradient
  Merge Transformers language models by use of gradient parameters.
  ☆206Updated 11 months ago
• sdan / selfextend
  an implementation of Self-Extend, to expand the context window via grouped attention
  ☆119Updated last year
• cognitivecomputations / OpenChatML
  ☆157Updated last year
• teknium1 / ShareGPT-Builder
  ☆115Updated 6 months ago
• 4dh / GRDN
  GRDN.AI app for garden optimization
  ☆70Updated last year
• thooton / muse
  Let's create synthetic textbooks together :)
  ☆75Updated last year
• thomasgauthier / LoRD
  Low-Rank adapter extraction for fine-tuned transformers models
  ☆173Updated last year
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆100Updated last year
• VatsaDev / NanoPhi-alpha
  GPT-2 small trained on phi-like data
  ☆66Updated last year
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆91Updated last year
• Preemo-Inc / text-generation-inference
  ☆199Updated last year
• emrgnt-cmplxty / SmolTrainer
  ☆20Updated last year
• huggingface / optimum-tpu
  Google TPU optimizations for transformers models
  ☆116Updated 5 months ago
• premAI-io / benchmarks
  🕹️ Performance Comparison of MLOps Engines, Frameworks, and Languages on Mainstream AI Models.
  ☆137Updated 11 months ago
• glaive-ai / function-calling-server
  ☆37Updated last year
• migtissera / Sensei
  Generate Synthetic Data Using OpenAI, MistralAI or AnthropicAI
  ☆222Updated last year
• ComposioHQ / Composio-Function-Calling-Benchmark
  Function Calling Benchmark & Testing
  ☆87Updated last year
• cognitivecomputations / spectrum
  ☆128Updated 3 months ago
• cognitivecomputations / grokadamw
  ☆134Updated 10 months ago
• anyscale / llm-router
  Tutorial for building LLM router
  ☆216Updated 11 months ago