ptillet / triton-llvm-releases

Related projects ⓘ

Alternatives and complementary repositories for triton-llvm-releases

• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆36Updated 6 months ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆60Updated 8 months ago
• iree-org / iree-nvgpu
  ☆48Updated 8 months ago
• Aleph-Alpha / NeurIPS-WANT-submission-efficient-parallelization-layouts
  ☆22Updated 11 months ago
• NVIDIA / HMM_sample_code
  CUDA 12.2 HMM demos
  ☆17Updated 3 months ago
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last month
• microsoft / DeepSpeed-Kernels
  ☆55Updated 5 months ago
• enp1s0 / ozIMMU
  FP64 equivalent GEMM via Int8 Tensor Cores using the Ozaki scheme
  ☆46Updated 2 months ago
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆11Updated 3 months ago
• Harry-Chen / InfMoE
  Inference framework for MoE layers based on TensorRT with Python binding
  ☆41Updated 3 years ago
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆20Updated last week
• chips-compilers-mlsys-21 / chips-compilers-mlsys-21.github.io
  ☆11Updated 3 years ago
• Doraemonzzz / Awesome-Triton-Resources
  Awesome Triton Resources
  ☆18Updated last month
• manishucsd / py-codegen
  ☆14Updated last month
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆63Updated 2 years ago
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆53Updated 3 weeks ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆90Updated 4 months ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆50Updated last year
• INT-FlashAttention2024 / INT-FlashAttention
  ☆47Updated 2 months ago
• megvii-research / IntLLaMA
  IntLLaMA: A fast and light quantization solution for LLaMA
  ☆18Updated last year
• FrancescoSaverioZuppichini / pytorch-2.0-benchmark
  Benchmarking PyTorch 2.0 different models
  ☆21Updated last year
• exists-forall / striped_attention
  ☆36Updated last year
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆57Updated 5 months ago
• cchan / tccl
  extensible collectives library in triton
  ☆72Updated last month
• facebookexperimental / protoquant
  Prototype routines for GPU quantization written using PyTorch.
  ☆19Updated last week
• zhuzilin / pytorch-malloc
  An external memory allocator example for PyTorch.
  ☆13Updated 3 years ago
• vllm-project / flash-attention
  Fast and memory-efficient exact attention
  ☆30Updated 3 weeks ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆72Updated 9 months ago
• glassroom / heinsen_attention
  Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)
  ☆24Updated 5 months ago