thuml / learn_torch.compile

Related projects ⓘ

Alternatives and complementary repositories for learn_torch.compile

• feifeibear / ChituAttention
  Quantized Attention on GPU
  ☆30Updated 2 weeks ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆13Updated 3 years ago
• LeiWang1999 / Stream-k.tvm
  ☆18Updated last month
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆36Updated 6 months ago
• NVlabs / COAT
  ☆34Updated this week
• flashinfer-ai / debug-print
  Debug print operator for cudagraph debugging
  ☆10Updated 3 months ago
• tlc-pack / libflash_attn
  Standalone Flash Attention v2 kernel without libtorch dependency
  ☆98Updated 2 months ago
• CalebDu / Awesome-Cute
  ☆16Updated this week
• tlc-pack / cutlass_fpA_intB_gemm
  A standalone GEMM kernel for fp16 activation and quantized weight, extracted from FasterTransformer
  ☆85Updated 8 months ago
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆79Updated 5 months ago
• pigirons / conv3x3_m1
  This is a demo how to write a high performance convolution run on apple silicon
  ☆52Updated 2 years ago
• xdit-project / DiTCacheAnalysis
  An auxiliary project analysis of the characteristics of KV in DiT Attention.
  ☆15Updated this week
• caiwanxianhust / FasterLLaMA
  使用 CUDA C++ 实现的 llama 模型推理框架
  ☆24Updated 2 weeks ago
• TileLang / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆15Updated this week
• AlibabaPAI / FLASHNN
  ☆79Updated 2 months ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆57Updated 5 months ago
• chips-compilers-mlsys-21 / chips-compilers-mlsys-21.github.io
  ☆11Updated 3 years ago
• leimao / CUTLASS-Examples
  CUTLASS and CuTe Examples
  ☆14Updated this week
• uwsampl / SparseTIR
  SparseTIR: Sparse Tensor Compiler for Deep Learning
  ☆131Updated last year
• sjtu-epcc / Tacker
  Tacker: Tensor-CUDA Core Kernel Fusion for Improving the GPU Utilization while Ensuring QoS
  ☆17Updated 2 years ago
• TiledTensor / TiledCUDA
  TiledCUDA is a highly efficient kernel template library designed to elevate CUDA C’s level of abstraction for processing tiles.
  ☆156Updated this week
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆53Updated 3 weeks ago
• weishengying / cutlass_flash_atten_fp8
  使用 cutlass 仓库在 ada 架构上实现 fp8 的 flash attention
  ☆52Updated 3 months ago
• microsoft / DeepSpeed-Kernels
  ☆55Updated 6 months ago
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆11Updated 3 months ago
• LeiWang1999 / tvm_gpu_gemm
  play gemm with tvm
  ☆84Updated last year
• INT-FlashAttention2024 / INT-FlashAttention
  ☆47Updated 2 months ago