Alternatives and similar repositories for LLM-distributed-finetune:

Users that are interested in LLM-distributed-finetune are comparing it to the libraries listed below

• anyscale / llm-continuous-batching-benchmarks
  ☆116Updated last year
• hamelsmu / llama-inference
  experiments with inference on llama
  ☆104Updated 9 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆122Updated last month
• snowflakedb / ArcticTraining
  ArcticTraining is a framework designed to simplify and accelerate the post-training process for large language models (LLMs)
  ☆51Updated this week
• run-ai / llmperf
  ☆54Updated 6 months ago
• withmartian / routerbench
  The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System
  ☆107Updated 9 months ago
• JiahaoYao / awesome-ray
  Ray - A curated list of resources: https://github.com/ray-project/ray
  ☆52Updated last month
• abacusai / gh200-llm
  Docker image NVIDIA GH200 machines - optimized for vllm serving and hf trainer finetuning
  ☆37Updated last month
• gpu-mode / ring-attention
  ring-attention experiments
  ☆128Updated 5 months ago
• fw-ai / benchmark
  Benchmark suite for LLMs from Fireworks.ai
  ☆69Updated last month
• Infini-AI-Lab / MagicDec
  [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding
  ☆110Updated 3 months ago
• LMCache / lmcache-vllm
  The driver for LMCache core to run in vLLM
  ☆35Updated last month
• foundation-model-stack / fms-fsdp
  🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…
  ☆232Updated 2 weeks ago
• sabetAI / BLoRA
  batched loras
  ☆340Updated last year
• llm-efficiency-challenge / neurips_llm_efficiency_challenge
  NeurIPS Large Language Model Efficiency Challenge: 1 LLM + 1GPU + 1Day
  ☆255Updated last year
• RAIVNLab / AdANNS
  Code repository for the paper - "AdANNS: A Framework for Adaptive Semantic Search"
  ☆63Updated last year
• huggingface / llm-swarm
  Manage scalable open LLM inference endpoints in Slurm clusters
  ☆253Updated 8 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆114Updated last month
• neuralmagic / guidellm
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs
  ☆224Updated this week
• bentoml / llm-bench
  ☆49Updated 4 months ago
• neuralmagic / nm-vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆262Updated 5 months ago
• ScalingIntelligence / KernelBench
  KernelBench: Can LLMs Write GPU Kernels? - Benchmark with Torch -> CUDA problems
  ☆237Updated this week
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆249Updated this week
• project-etalon / etalon
  LLM Serving Performance Evaluation Harness
  ☆70Updated last month
• NetEase-FuXi / EETQ
  Easy and Efficient Quantization for Transformers
  ☆193Updated last month
• huggingface / picotron_tutorial
  ☆158Updated last month
• AnswerDotAI / cold-compress
  Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…
  ☆122Updated 7 months ago
• asprenger / ray_vllm_inference
  A simple service that integrates vLLM with Ray Serve for fast and scalable LLM serving.
  ☆65Updated 11 months ago
• deepspeedai / DeepSpeed-Kernels
  ☆62Updated 3 weeks ago
• LLM360 / amber-data-prep
  Data preparation code for Amber 7B LLM
  ☆86Updated 10 months ago