Alternatives and similar repositories for sonic-moe

Users that are interested in sonic-moe are comparing it to the libraries listed below

• Dao-AILab / quack
  A Quirky Assortment of CuTe Kernels
  ☆741Updated this week
• meta-pytorch / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆308Updated this week
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆139Updated 7 months ago
• meta-pytorch / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆312Updated 4 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆270Updated this week
• meta-pytorch / KernelAgent
  Autonomous GPU Kernel Generation via Deep Agents
  ☆202Updated this week
• HazyResearch / Megakernels
  kernels, of the mega variety
  ☆640Updated 3 months ago
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆259Updated 3 months ago
• osayamenja / FlashMoE
  Distributed MoE in a Single Kernel [NeurIPS '25]
  ☆174Updated this week
• dropbox / gemlite
  Fast low-bit matmul kernels in Triton
  ☆418Updated 3 weeks ago
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆196Updated last month
• triton-lang / kernels
  ☆100Updated last year
• fanshiqing / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆180Updated 3 weeks ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆282Updated 4 months ago
• yifuwang / symm-mem-recipes
  ☆153Updated last year
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆256Updated last month
• yanring / Megatron-MoE-ModelZoo
  Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.
  ☆147Updated 3 weeks ago
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆362Updated 5 months ago
• IST-DASLab / qutlass
  QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning
  ☆155Updated last month
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆445Updated 8 months ago
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆267Updated 2 months ago
• NVIDIA / TileGym
  Helpful kernel tutorials and examples for tile-based GPU programming
  ☆554Updated this week
• flagos-ai / FlagAttention
  A collection of memory efficient attention operators implemented in the Triton language.
  ☆287Updated last year
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆174Updated 9 months ago
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆276Updated 5 months ago
• perplexityai / pplx-kernels
  Perplexity GPU Kernels
  ☆548Updated 2 months ago
• sgl-project / sglang-jax
  JAX backend for SGL
  ☆211Updated this week
• fzyzcjy / torch_utils
  Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…
  ☆76Updated 3 months ago
• ByteDance-Seed / FlexPrefill
  Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  ☆160Updated 2 months ago
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆454Updated 7 months ago