Alternatives and similar repositories for FlashModels

Users that are interested in FlashModels are comparing it to the libraries listed below

• AlibabaPAI / torchacc
  PyTorch distributed training acceleration framework
  ☆52Updated 3 weeks ago
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆95Updated 2 years ago
• ColfaxResearch / cfx-article-src
  ☆136Updated 3 months ago
• yifuwang / symm-mem-recipes
  ☆111Updated 8 months ago
• kwai / Megatron-Kwai
  [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…
  ☆61Updated last year
• microsoft / vattention
  Dynamic Memory Management for Serving LLMs without PagedAttention
  ☆407Updated 3 months ago
• ColfaxResearch / cutlass-kernels
  ☆229Updated last year
• perplexityai / pplx-kernels
  Perplexity GPU Kernels
  ☆449Updated 3 weeks ago
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆376Updated 11 months ago
• ConnollyLeon / awesome-Auto-Parallelism
  A baseline repository of Auto-Parallelism in Training Neural Networks
  ☆145Updated 3 years ago
• OpenPPL / ppl.llm.kernel.cuda
  ☆150Updated 7 months ago
• DD-DuDa / Cute-Learning
  Examples of CUDA implementations by Cutlass CuTe
  ☆225Updated 2 months ago
• sail-sg / zero-bubble-pipeline-parallelism
  Zero Bubble Pipeline Parallelism
  ☆423Updated 3 months ago
• reed-lau / cute-gemm
  ☆131Updated 8 months ago
• Yinghan-Li / YHs_Sample
  Yinghan's Code Sample
  ☆344Updated 3 years ago
• stepfun-ai / StepMesh
  ☆288Updated last week
• microsoft / mscclpp
  MSCCL++: A GPU-driven communication stack for scalable AI applications
  ☆404Updated last week
• bytedance / ByteMLPerf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆261Updated 2 weeks ago
• fanshiqing / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆138Updated last week
• infinigence / FlashOverlap
  A lightweight design for computation-communication overlap.
  ☆160Updated last week
• microsoft / triton-shared
  Shared Middle-Layer for Triton Compilation
  ☆275Updated this week
• AlibabaPAI / FLASHNN
  ☆98Updated 11 months ago
• LLMServe / SwiftTransformer
  High performance Transformer implementation in C++.
  ☆129Updated 7 months ago
• fzyzcjy / torch_memory_saver
  Allow torch tensor memory to be released and resumed later
  ☆118Updated this week
• Cambricon / triton-linalg
  Development repository for the Triton-Linalg conversion
  ☆194Updated 6 months ago
• bytedance / byteir
  A model compilation solution for various hardware
  ☆446Updated 2 weeks ago
• OpenPPL / ppl.nn.llm
  ☆141Updated last year
• 66RING / tiny-flash-attention
  flash attention tutorial written in python, triton, cuda, cutlass
  ☆415Updated 3 months ago
• Dao-AILab / quack
  A Quirky Assortment of CuTe Kernels
  ☆435Updated this week
• facebookexperimental / triton
  Github mirror of trition-lang/triton repo.
  ☆54Updated this week