Alternatives and similar repositories for Megatron-LM:

Users that are interested in Megatron-LM are comparing it to the libraries listed below

• abhibambhaniya / GenZ-LLM-Analyzer
  LLM Inference analyzer for different hardware platforms
  ☆47Updated this week
• ROCm / TransformerEngine
  ☆15Updated this week
• ROCm / rccl-tests
  RCCL Performance Benchmark Tests
  ☆55Updated 2 weeks ago
• Azure / msccl-executor-nccl
  ☆36Updated last month
• Azure / msccl
  Microsoft Collective Communication Library
  ☆61Updated 2 months ago
• ColfaxResearch / cfx-article-src
  ☆67Updated last month
• ROCm / vllm
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆57Updated this week
• parasailteam / coconet
  ☆73Updated 2 years ago
• hao-ai-lab / MuxServe
  ☆48Updated 7 months ago
• alibaba / easydist
  Automated Parallelization System and Infrastructure for Multiple Ecosystems
  ☆77Updated 2 months ago
• ColfaxResearch / cutlass-kernels
  ☆180Updated 6 months ago
• yifuwang / symm-mem-recipes
  ☆36Updated last month
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆94Updated 6 months ago
• ROCm / pytorch-micro-benchmarking
  ☆18Updated 2 months ago
• flexflow / flexflow-serve
  FlexFlow Serve: Low-Latency, High-Performance LLM Serving
  ☆17Updated this week
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆232Updated 3 months ago
• sunlex0717 / DissectingTensorCores
  ☆84Updated 9 months ago
• fanshiqing / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆86Updated 3 weeks ago
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆61Updated 2 months ago
• ROCm / amd_matrix_instruction_calculator
  A tool for generating information about the matrix multiplication instructions in AMD Radeon™ and AMD Instinct™ accelerators
  ☆73Updated last year
• AlibabaPAI / FLASHNN
  ☆79Updated 4 months ago
• triton-lang / kernels
  ☆64Updated 2 months ago
• north-numerical-computing / tensor-cores-numerical-behavior
  Test suite for probing the numerical behavior of NVIDIA tensor cores
  ☆37Updated 6 months ago
• mlcommons / training_results_v2.0
  This repository contains the results and code for the MLPerf™ Training v2.0 benchmark.
  ☆27Updated 11 months ago
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆87Updated 3 weeks ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆99Updated 4 months ago
• ROCm / TransferBench
  TransferBench is a utility capable of benchmarking simultaneous copies between user-specified devices (CPUs/GPUs)
  ☆38Updated this week
• LoongServe / LoongServe
  ☆82Updated 2 months ago
• triton-lang / triton-cpu
  An experimental CPU backend for Triton
  ☆81Updated last week
• DachengLi1 / AMP
  (NeurIPS 2022) Automatically finding good model-parallel strategies, especially for complex models and clusters.
  ☆37Updated 2 years ago