Alternatives and similar repositories for FlashModels

Users that are interested in FlashModels are comparing it to the libraries listed below

• AlibabaPAI / torchacc
  PyTorch distributed training acceleration framework
  ☆52Updated last month
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆95Updated 2 years ago
• kwai / Megatron-Kwai
  [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…
  ☆63Updated last year
• ConnollyLeon / awesome-Auto-Parallelism
  A baseline repository of Auto-Parallelism in Training Neural Networks
  ☆146Updated 3 years ago
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆378Updated last year
• ColfaxResearch / cutlass-kernels
  ☆237Updated last year
• OpenPPL / ppl.llm.kernel.cuda
  ☆150Updated 8 months ago
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆427Updated 4 months ago
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆418Updated 3 months ago
• DD-DuDa / Cute-Learning
  Examples of CUDA implementations by Cutlass CuTe
  ☆233Updated 2 months ago
• ColfaxResearch / cfx-article-src
  ☆140Updated 4 months ago
• yifuwang / symm-mem-recipes
  ☆119Updated 8 months ago
• perplexityai / pplx-kernels
  Perplexity GPU Kernels
  ☆469Updated last week
• microsoft / triton-shared
  Shared Middle-Layer for Triton Compilation
  ☆287Updated 3 weeks ago
• fanshiqing / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆151Updated 3 weeks ago
• antgroup / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆480Updated 6 months ago
• stepfun-ai / StepMesh
  ☆295Updated this week
• Yinghan-Li / YHs_Sample
  Yinghan's Code Sample
  ☆350Updated 3 years ago
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆171Updated last week
• microsoft / nnscaler
  nnScaler: Compiling DNN models for Parallel Training
  ☆118Updated 3 weeks ago
• reed-lau / cute-gemm
  ☆134Updated 9 months ago
• OpenPPL / ppl.nn.llm
  ☆141Updated last year
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆417Updated this week
• DeepLink-org / DIOPI
  ☆75Updated 10 months ago
• CalebDu / Awesome-Cute
  ☆106Updated 4 months ago
• 66RING / tiny-flash-attention
  flash attention tutorial written in python, triton, cuda, cutlass
  ☆420Updated 4 months ago
• Cambricon / triton-linalg
  Development repository for the Triton-Linalg conversion
  ☆200Updated 7 months ago
• Bruce-Lee-LY / cuda_hgemm
  Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…
  ☆478Updated last year
• bytedance / ByteMLPerf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆265Updated last month
• microsoft / msccl
  Microsoft Collective Communication Library
  ☆360Updated 2 years ago