IBM / triton-dejavu

Related projects ⓘ

Alternatives and complementary repositories for triton-dejavu

• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆19Updated this week
• triton-lang / kernels
  ☆45Updated 2 weeks ago
• cchan / tccl
  extensible collectives library in triton
  ☆72Updated last month
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA / Triton
  ☆145Updated this week
• IST-DASLab / Sparse-Marlin
  Boosting 4-bit inference kernels with 2:4 Sparsity
  ☆51Updated 2 months ago
• INT-FlashAttention2024 / INT-FlashAttention
  ☆47Updated 2 months ago
• sgl-project / tensorrt-demo
  TensorRT LLM Benchmark Configuration
  ☆11Updated 3 months ago
• microsoft / DeepSpeed-Kernels
  ☆55Updated 5 months ago
• stanford-futuredata / stk
  ☆88Updated 2 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆68Updated 3 weeks ago
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆166Updated 3 weeks ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆60Updated 8 months ago
• mlc-ai / xgrammar
  Efficient, Flexible and Portable Structured Generation
  ☆53Updated this week
• neuralmagic / compressed-tensors
  A safetensors extension to efficiently store sparse quantized tensors on disk
  ☆50Updated this week
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆38Updated 10 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆134Updated 2 months ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆57Updated 5 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆25Updated last year
• LeiWang1999 / AutoGPTQ.tvm
  GPTQ inference TVM kernel
  ☆36Updated 6 months ago
• yifuwang / symm-mem-recipes
  ☆12Updated last month
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆53Updated 3 weeks ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆72Updated 9 months ago
• vedantroy / gpu_kernels
  ☆22Updated 10 months ago
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆27Updated last month
• fw-ai / llama-cuda-graph-example
  Example of applying CUDA graphs to LLaMA-v2
  ☆10Updated last year
• gpu-mode / ring-attention
  ring-attention experiments
  ☆97Updated last month
• facebookexperimental / protoquant
  Prototype routines for GPU quantization written using PyTorch.
  ☆19Updated last week
• pytorch-labs / triton-cpu
  An experimental CPU backend for Triton (https//github.com/openai/triton)
  ☆35Updated 6 months ago
• NVIDIA / kvpress
  LLM KV cache compression made easy
  ☆64Updated last week
• NVlabs / COAT
  ☆32Updated this week