Alternatives and similar repositories for sonic-moe

Users that are interested in sonic-moe are comparing it to the libraries listed below

• Dao-AILab / quack
  A Quirky Assortment of CuTe Kernels
  ☆772Updated this week
• meta-pytorch / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆319Updated this week
• meta-pytorch / KernelAgent
  Autonomous GPU Kernel Generation via Deep Agents
  ☆223Updated this week
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆141Updated 8 months ago
• meta-pytorch / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆314Updated 5 months ago
• dropbox / gemlite
  Fast low-bit matmul kernels in Triton
  ☆424Updated this week
• HazyResearch / Megakernels
  kernels, of the mega variety
  ☆657Updated 4 months ago
• osayamenja / FlashMoE
  Distributed MoE in a Single Kernel [NeurIPS '25]
  ☆188Updated this week
• Deep-Learning-Profiling-Tools / triton-viz
  ☆277Updated this week
• ByteDance-Seed / ByteCheckpoint
  ByteCheckpoint: An Unified Checkpointing Library for LFMs
  ☆264Updated last month
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆213Updated 2 weeks ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆291Updated 4 months ago
• mit-han-lab / Quest
  [ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference
  ☆368Updated 6 months ago
• stepfun-ai / StepMesh
  ☆342Updated this week
• IST-DASLab / qutlass
  QuTLASS: CUTLASS-Powered Quantized BLAS for Deep Learning
  ☆163Updated 2 months ago
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆449Updated 8 months ago
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆263Updated 3 months ago
• perplexityai / pplx-kernels
  Perplexity GPU Kernels
  ☆554Updated 2 months ago
• ByteDance-Seed / FlexPrefill
  Code for paper: [ICLR2025 Oral] FlexPrefill: A Context-Aware Sparse Attention Mechanism for Efficient Long-Sequence Inference
  ☆161Updated 3 months ago
• yifuwang / symm-mem-recipes
  ☆158Updated last year
• yanring / Megatron-MoE-ModelZoo
  Best practices for training DeepSeek, Mixtral, Qwen and other MoE models using Megatron Core.
  ☆158Updated last week
• Victarry / PP-Schedule-Visualization
  Pipeline Parallelism Emulation and Visualization
  ☆76Updated 3 weeks ago
• fzyzcjy / torch_utils
  Utility scripts for PyTorch (e.g. Make Perfetto show some disappearing kernels, Memory profiler that understands more low-level allocatio…
  ☆82Updated 4 months ago
• efeslab / Atom
  [MLSys'24] Atom: Low-bit Quantization for Efficient and Accurate LLM Serving
  ☆335Updated last year
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆276Updated 6 months ago
• sgl-project / sglang-jax
  JAX backend for SGL
  ☆232Updated this week
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆457Updated 8 months ago
• RulinShao / LightSeq
  Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training
  ☆222Updated last year
• flashinfer-ai / flashinfer-bench
  Building the Virtuous Cycle for AI-driven LLM Systems
  ☆140Updated this week
• NVIDIA / TileGym
  Helpful kernel tutorials and examples for tile-based GPU programming
  ☆617Updated this week