thuml / depyf

Related projects ⓘ

Alternatives and complementary repositories for depyf

• mirage-project / mirage
  Mirage: Automatically Generating Fast GPU Kernels without Programming in Triton/CUDA
  ☆636Updated this week
• pytorch / PiPPy
  Pipeline Parallelism for PyTorch
  ☆726Updated 2 months ago
• FlagOpen / FlagGems
  FlagGems is an operator library for large language models implemented in Triton Language.
  ☆342Updated this week
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆483Updated 3 weeks ago
• KnowingNothing / MatmulTutorial
  A Easy-to-understand TensorOp Matmul Tutorial
  ☆290Updated 2 months ago
• FlagOpen / FlagAttention
  A collection of memory efficient attention operators implemented in the Triton language.
  ☆219Updated 5 months ago
• facebookresearch / HolisticTraceAnalysis
  A library to analyze PyTorch traces.
  ☆307Updated this week
• pytorch-labs / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆211Updated 3 months ago
• Deep-Learning-Profiling-Tools / triton-viz
  ☆152Updated this week
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆166Updated 2 weeks ago
• Azure / MS-AMP
  Microsoft Automatic Mixed Precision Library
  ☆525Updated last month
• microsoft / BitBLAS
  BitBLAS is a library to support mixed-precision matrix multiplications, especially for quantized LLM deployment.
  ☆420Updated this week
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆134Updated 2 months ago
• 66RING / tiny-flash-attention
  flash attention tutorial written in python, triton, cuda, cutlass
  ☆202Updated 5 months ago
• bytedance / flux
  A fast communication-overlapping library for tensor parallelism on GPUs.
  ☆224Updated 3 weeks ago
• tspeterkim / flash-attention-minimal
  Flash Attention in ~100 lines of CUDA (forward pass only)
  ☆626Updated 7 months ago
• wangzyon / NVIDIA_SGEMM_PRACTICE
  Step-by-step optimization of CUDA SGEMM
  ☆240Updated 2 years ago
• hidet-org / hidet
  An open-source efficient deep learning framework/compiler, written in python.
  ☆652Updated last week
• Cjkkkk / CUDA_gemm
  A simple high performance CUDA GEMM implementation.
  ☆335Updated 10 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆68Updated 3 weeks ago
• albanD / subclass_zoo
  ☆148Updated 5 months ago
• pytorch / kineto
  A CPU+GPU Profiling library that provides access to timeline traces and hardware performance counters.
  ☆734Updated this week
• zhuzilin / ring-flash-attention
  Ring attention implementation with flash attention
  ☆585Updated last week
• ColfaxResearch / cutlass-kernels
  ☆167Updated 4 months ago
• sustcsonglin / flash-linear-attention
  Efficient implementations of state-of-the-art linear attention models in Pytorch and Triton
  ☆1,339Updated this week
• siboehm / SGEMM_CUDA
  Fast CUDA matrix multiplication from scratch
  ☆479Updated 10 months ago
• Guangxuan-Xiao / torch-int
  This repository contains integer operators on GPUs for PyTorch.
  ☆183Updated last year
• flashinfer-ai / flashinfer
  FlashInfer: Kernel Library for LLM Serving
  ☆1,452Updated this week
• pytorch-labs / attention-gym
  Helpful tools and examples for working with flex-attention
  ☆469Updated 3 weeks ago
• srush / Triton-Puzzles
  Puzzles for learning Triton
  ☆1,135Updated this week