Alternatives and similar repositories for RLCompOpt

Users that are interested in RLCompOpt are comparing it to the libraries listed below

• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆160Updated 2 years ago
• meta-pytorch / float8_experimental
  This repository contains the experimental PyTorch native float8 training UX
  ☆227Updated last year
• lucidrains / triton-transformer
  Implementation of a Transformer, but completely in Triton
  ☆279Updated 3 years ago
• stanford-futuredata / stk
  ☆115Updated last year
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆115Updated last year
• meta-pytorch / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆324Updated this week
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆178Updated last week
• tridao / flash-attention-wheels
  ☆61Updated 2 years ago
• gpu-mode / ring-attention
  ring-attention experiments
  ☆165Updated last year
• gpu-mode / profiling-cuda-in-torch
  ☆178Updated 2 years ago
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆95Updated last year
• meta-pytorch / superblock
  A block oriented training approach for inference time optimization.
  ☆34Updated last year
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆30Updated last week
• haochengxi / Train_Transformers_with_INT4
  ☆157Updated 2 years ago
• flagos-ai / FlagAttention
  A collection of memory efficient attention operators implemented in the Triton language.
  ☆287Updated last year
• meta-pytorch / tritonparse
  TritonParse: A Compiler Tracer, Visualizer, and Reproducer for Triton Kernels
  ☆194Updated this week
• mit-han-lab / tinychat-tutorial
  ☆77Updated last year
• teelinsan / parallel-decoding
  Repository of the paper "Accelerating Transformer Inference for Translation via Parallel Decoding"
  ☆123Updated last year
• mlc-ai / notebooks
  ☆222Updated last year
• cchan / tccl
  extensible collectives library in triton
  ☆95Updated 10 months ago
• kyegomez / FlashAttention20
  Get down and dirty with FlashAttention2.0 in pytorch, plug in and play no complex CUDA kernels
  ☆113Updated 2 years ago
• hpcaitech / TensorNVMe
  A Python library transfers PyTorch tensors between CPU and NVMe
  ☆125Updated last year
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆73Updated last year
• hidet-org / hidet
  An open-source efficient deep learning framework/compiler, written in python.
  ☆740Updated 5 months ago
• fpgaminer / GPTQ-triton
  GPTQ inference Triton kernel
  ☆321Updated 2 years ago
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆276Updated 6 months ago
• IST-DASLab / Quartet
  ☆118Updated last month
• tgale96 / grouped_gemm
  PyTorch bindings for CUTLASS grouped GEMM.
  ☆142Updated 8 months ago
• feifeibear / Odysseus-Transformer
  Odysseus: Playground of LLM Sequence Parallelism
  ☆79Updated last year
• shawntan / scattermoe
  Triton-based implementation of Sparse Mixture of Experts.
  ☆263Updated 4 months ago