Alternatives and similar repositories for Megatron-LM

Users that are interested in Megatron-LM are comparing it to the libraries listed below

• Azure / msccl
  Microsoft Collective Communication Library
  ☆67Updated 9 months ago
• mk1-project / quickreduce
  QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.
  ☆32Updated 5 months ago
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆110Updated 3 months ago
• triton-lang / kernels
  ☆88Updated 9 months ago
• ROCm / TransformerEngine
  ☆42Updated this week
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆73Updated last week
• hao-ai-lab / MuxServe
  ☆69Updated last year
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆118Updated this week
• meta-pytorch / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆292Updated last week
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆261Updated last month
• yifuwang / symm-mem-recipes
  ☆111Updated 8 months ago
• cchan / tccl
  extensible collectives library in triton
  ☆88Updated 5 months ago
• EfficientMoE / MoE-Infinity
  PyTorch library for cost-effective, fast and easy serving of MoE models.
  ☆228Updated last month
• ROCm / flash-attention
  Fast and memory-efficient exact attention
  ☆184Updated this week
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆62Updated 2 months ago
• ROCm / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆94Updated this week
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆209Updated last week
• Azure / msccl-executor-nccl
  ☆47Updated 8 months ago
• argonne-lcf / LLM-Inference-Bench
  LLM-Inference-Bench
  ☆50Updated last month
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆40Updated 2 years ago
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆81Updated this week
• RulinShao / LightSeq
  Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training
  ☆215Updated last year
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆79Updated 9 months ago
• deepspeedai / DeepSpeed-Kernels
  ☆74Updated 5 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆356Updated last week
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆160Updated last week
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆218Updated last year
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆81Updated 11 months ago
• ROCm / triton
  Development repository for the Triton language and compiler
  ☆127Updated this week
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆56Updated this week