ROCm / Megatron-LMLinks
Ongoing research training transformer models at scale
☆23Updated 2 weeks ago
Alternatives and similar repositories for Megatron-LM
Users that are interested in Megatron-LM are comparing it to the libraries listed below
Sorting:
- ☆19Updated last week
- ☆38Updated this week
- RCCL Performance Benchmark Tests☆68Updated last month
- ☆90Updated 6 months ago
- Microsoft Collective Communication Library☆64Updated 7 months ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆84Updated this week
- oneCCL Bindings for Pytorch*☆97Updated 2 months ago
- Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…☆61Updated last week
- ☆37Updated 6 months ago
- A CUTLASS implementation using SYCL☆27Updated this week
- ☆20Updated 3 months ago
- An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).☆252Updated 8 months ago
- ☆81Updated 7 months ago
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆28Updated 3 months ago
- Fast and memory-efficient exact attention☆174Updated this week
- A lightweight design for computation-communication overlap.☆143Updated last week
- ☆62Updated last year
- DeepSeek-V3/R1 inference performance simulator☆149Updated 3 months ago
- extensible collectives library in triton☆86Updated 2 months ago
- ☆48Updated this week
- Development repository for the Triton language and compiler☆125Updated this week
- Applied AI experiments and examples for PyTorch☆277Updated 3 weeks ago
- PyTorch bindings for CUTLASS grouped GEMM.☆100Updated 3 weeks ago
- Multi-GPU communication profiler and visualizer☆30Updated last year
- rocSHMEM intra-kernel networking runtime for AMD dGPUs on the ROCm platform.☆90Updated this week
- ☆212Updated 11 months ago
- A Quirky Assortment of CuTe Kernels☆117Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆76Updated this week
- ☆97Updated 9 months ago
- A hierarchical collective communications library with portable optimizations☆35Updated 6 months ago