sunkx109 / My-Torch-Extension

Related projects ⓘ

Alternatives and complementary repositories for My-Torch-Extension

• 66RING / tiny-flash-attention
  flash attention tutorial written in python, triton, cuda, cutlass
  ☆194Updated 4 months ago
• ifromeast / cuda_learning
  learning how CUDA works
  ☆162Updated 2 months ago
• DD-DuDa / Cute-Learning
  Examples of CUDA implementations by Cutlass CuTe
  ☆82Updated last week
• openmlsys / openmlsys-cuda
  Tutorials for writing high-performance GPU operators in AI frameworks.
  ☆122Updated last year
• FlagOpen / FlagAttention
  A collection of memory efficient attention operators implemented in the Triton language.
  ☆215Updated 5 months ago
• AyakaGEMM / Hands-on-GEMM
  ☆97Updated 7 months ago
• AlibabaPAI / FLASHNN
  ☆79Updated 2 months ago
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆287Updated last month
• RussWong / CUDATutorial
  A CUDA tutorial to make people learn CUDA program from 0
  ☆195Updated 4 months ago
• zjhellofss / KuiperLLama
  校招、秋招、春招、实习好项目，带你从零动手实现支持LLama2/3和Qwen2.5的大模型推理框架。
  ☆220Updated this week
• Bruce-Lee-LY / flash_attention_inference
  Performance of the C++ interface of flash attention and flash attention v2 in large language model (LLM) inference scenarios.
  ☆26Updated 2 months ago
• kwai / Megatron-Kwai
  [USENIX ATC '24] Accelerating the Training of Large Language Models using Efficient Activation Rematerialization and Optimal Hybrid Paral…
  ☆46Updated 3 months ago
• FlagOpen / FlagGems
  FlagGems is an operator library for large language models implemented in Triton Language.
  ☆328Updated this week
• JackonYang / hands-on-tvm
  hands on model tuning with TVM and profile it on a Mac M1, x86 CPU, and GTX-1080 GPU.
  ☆39Updated last year
• HandH1998 / QQQ
  QQQ is an innovative and hardware-optimized W4A8 quantization solution for LLMs.
  ☆75Updated 3 weeks ago
• weishengying / cutlass_flash_atten_fp8
  使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention
  ☆51Updated 2 months ago
• reed-lau / cute-gemm
  ☆78Updated 8 months ago
• OpenPPL / ppl.pmx
  ☆56Updated this week
• madsys-dev / deepseekv2-profile
  ☆63Updated 3 months ago
• mit-han-lab / deepcompressor
  ☆121Updated this week
• DD-DuDa / BitDistiller
  [ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.
  ☆79Updated 5 months ago
• Bruce-Lee-LY / decoding_attention
  Decoding Attention is specially optimized for multi head attention (MHA) using CUDA core for the decoding stage of LLM inference.
  ☆24Updated this week
• OpenPPL / ppl.llm.kernel.cuda
  ☆136Updated this week
• l1nkr / DL-Compiler-Navigation
  Machine Learning Compiler Road Map
  ☆41Updated last year
• weishengying / tiny-flash-attention
  使用 cutlass 实现 flash-attention 精简版，具有教学意义
  ☆31Updated 2 months ago
• BBuf / how-to-learn-deep-learning-framework
  how to learn PyTorch and OneFlow
  ☆347Updated 7 months ago
• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆29Updated this week
• OpenPPL / ppl.nn.llm
  ☆140Updated 6 months ago
• MARD1NO / CUDA-PPT
  ☆79Updated last year
• chenhongyu2048 / LLM-inference-optimization-paper
  Summary of some awesome work for optimizing LLM inference
  ☆34Updated this week