Alternatives and similar repositories for DIOPI

Users that are interested in DIOPI are comparing it to the libraries listed below

• DeepLink-org / deeplink.framework
  ☆72Updated last year
• OpenPPL / ppl.llm.kernel.cuda
  ☆152Updated 10 months ago
• OpenPPL / ppl.llm.serving
  ☆130Updated 11 months ago
• antgroup / glake
  GLake: optimizing GPU memory management and IO transmission.
  ☆490Updated 8 months ago
• OpenPPL / ppl.nn.llm
  ☆140Updated last year
• bytedance / ByteMLPerf
  AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and ver…
  ☆276Updated 3 months ago
• flagos-ai / FlagGems
  FlagGems is an operator library for large language models implemented in the Triton Language.
  ☆773Updated last week
• OpenPPL / ppl.pmx
  ☆60Updated last year
• DeepLink-org / DLOP-Bench
  A benchmark suited especially for deep learning operators
  ☆42Updated 2 years ago
• AlibabaPAI / torchacc
  PyTorch distributed training acceleration framework
  ☆53Updated 3 months ago
• bytedance / ByteTransformer
  optimized BERT transformer inference on NVIDIA GPU. https://arxiv.org/abs/2210.03052
  ☆477Updated last year
• Cambricon / triton-linalg
  Development repository for the Triton-Linalg conversion
  ☆206Updated 9 months ago
• alibaba / TePDist
  TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.
  ☆98Updated 2 years ago
• Tencent / KsanaLLM
  ☆514Updated 2 weeks ago
• bytedance / byteir
  A model compilation solution for various hardware
  ☆456Updated 3 months ago
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆394Updated last month
• alibaba / rtp-llm
  RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
  ☆934Updated this week
• infinigence / Semi-PD
  A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.
  ☆118Updated 6 months ago
• BBuf / how-to-learn-deep-learning-framework
  how to learn PyTorch and OneFlow
  ☆460Updated last year
• Cjkkkk / CUDA_gemm
  A simple high performance CUDA GEMM implementation.
  ☆418Updated last year
• ConnollyLeon / awesome-Auto-Parallelism
  A baseline repository of Auto-Parallelism in Training Neural Networks
  ☆147Updated 3 years ago
• xlite-dev / ffpa-attn
  🤖FFPA: Extend FlashAttention-2 with Split-D, ~O(1) SRAM complexity for large headdim, 1.8x~3x↑🎉 vs SDPA EA.
  ☆233Updated 2 weeks ago
• Yinghan-Li / YHs_Sample
  Yinghan's Code Sample
  ☆358Updated 3 years ago
• flagos-ai / FlagAttention
  A collection of memory efficient attention operators implemented in the Triton language.
  ☆285Updated last year
• microsoft / triton-shared
  Shared Middle-Layer for Triton Compilation
  ☆316Updated last month
• flagos-ai / FlagCX
  ☆131Updated this week
• DD-DuDa / Cute-Learning
  Examples of CUDA implementations by Cutlass CuTe
  ☆254Updated 5 months ago
• madsys-dev / deepseekv2-profile
  ☆152Updated 9 months ago
• Bruce-Lee-LY / cuda_hgemm
  Several optimization methods of half-precision general matrix multiplication (HGEMM) using tensor core with WMMA API and MMA PTX instruct…
  ☆503Updated last year
• kwai / Megatron-Kwai
  LLM training technologies developed by kwai
  ☆66Updated last week