☆1,600Mar 25, 2026Updated 7 months ago
Alternatives and similar repositories for megablocks
Users that are interested in megablocks are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- A family of open-sourced Mixture-of-Experts (MoE) Large Language Models☆1,704Mar 8, 2024Updated 2 years ago
- Tutel MoE: Optimized Mixture-of-Experts Library, Support GLM/Kimi/Gpt/DeepSeek/Qwen using FP8/NVFP4/MXFP4☆1,028Updated this week
- ☆112Aug 26, 2024Updated 2 years ago
- ☆864Dec 8, 2023Updated 2 years ago
- A PyTorch native platform for training generative AI models☆5,893Updated this week
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Minimalistic large language model 3D-parallelism training☆2,859Oct 8, 2026Updated last month
- Ring attention implementation with flash attention☆1,068Sep 10, 2025Updated last year
- Ongoing research training transformer models at scale☆18,377Updated this week
- Tile primitives for speedy kernels☆3,795Sep 12, 2026Updated last month
- A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on H…☆3,602Updated this week
- Efficient Triton Kernels for LLM Training☆6,695Updated this week
- LLM training code for Databricks foundation models☆4,460Mar 25, 2026Updated 7 months ago
- Triton-based implementation of Sparse Mixture of Experts.☆281Oct 3, 2025Updated last year
- PyTorch bindings for CUTLASS grouped GEMM.☆157May 29, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Fast and memory-efficient exact attention☆25,275Updated this week
- Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.☆6,271Aug 22, 2025Updated last year
- FlashInfer: Kernel Library for LLM Serving☆6,897Updated this week
- Serving multiple LoRA finetuned LLM as one☆1,177May 8, 2024Updated 2 years ago
- Hackable and optimized Transformers building blocks, supporting a composable construction.☆10,578Oct 29, 2026Updated last week
- Microsoft Automatic Mixed Precision Library☆635Dec 1, 2025Updated 11 months ago
- PyTorch native quantization for training and inference☆3,026Updated this week
- Transformer related optimization, including BERT, GPT☆6,460Mar 27, 2024Updated 2 years ago
- Large Context Attention☆776Oct 13, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- Accelerating MoE with IO and Tile-aware Optimizations☆791Aug 29, 2026Updated 2 months ago
- Tools for merging pretrained large language models.☆7,447Oct 31, 2026Updated last week
- PyTorch extensions for high performance and large scale training.☆3,404Apr 26, 2025Updated last year
- Development repository for the Triton language and compiler☆20,553Updated this week
- Accessible large language models via k-bit quantization for PyTorch.☆8,536Nov 2, 2026Updated last week
- Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.☆3,419Updated this week
- Ongoing research training transformer language models at scale, including: BERT & GPT-2☆2,267Aug 14, 2025Updated last year
- PyTorch native post-training library☆5,818Updated this week
- Zero Bubble Pipeline Parallelism☆467May 7, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Automatically Discovering Fast Parallelization Strategies for Distributed Deep Neural Network Training☆1,903Updated this week
- A Quirky Assortment of CuTe Kernels☆1,193Oct 30, 2026Updated last week
- Supercharge Your Model Training☆5,504Apr 29, 2026Updated 6 months ago
- A fast communication-overlapping library for tensor/expert parallelism on GPUs.☆1,377Aug 28, 2025Updated last year
- FP16xINT4 LLM inference kernel that can achieve near-ideal ~4x speedups up to medium batchsizes of 16-32 tokens.☆1,174Sep 4, 2024Updated 2 years ago
- A fast MoE impl for PyTorch☆1,859Feb 10, 2025Updated last year
- 🚀 Efficient implementations for emerging model architectures☆6,040Updated this week
Are these results useful?