Alternatives and similar repositories for cutex:

Users that are interested in cutex are comparing it to the libraries listed below

• NVIDIA / free-threaded-python
  No-GIL Python environment featuring NVIDIA Deep Learning libraries.
  ☆53Updated 3 weeks ago
• aredden / torch-bnb-fp4
  Faster Pytorch bitsandbytes 4bit fp4 nn.Linear ops
  ☆28Updated last year
• GindaChen / FlexFlashAttention3
  FlexAttention w/ FlashAttention3 Support
  ☆26Updated 5 months ago
• DeMoriarty / custom_matmul_kernels
  Customized matrix multiplication kernels
  ☆54Updated 3 years ago
• cli99 / flops-profiler
  pytorch-profiler
  ☆51Updated last year
• jundaf2 / INT8-Flash-Attention-FMHA-Quantization
  ☆157Updated last year
• pytorch-labs / superblock
  A block oriented training approach for inference time optimization.
  ☆32Updated 7 months ago
• ptillet / triton-llvm-releases
  ☆21Updated last year
• bentherien / mu_learned_optimization
  [Oral; Neurips OPT2024 ] μLO: Compute-Efficient Meta-Generalization of Learned Optimizers
  ☆12Updated 2 weeks ago
• rlin27 / DeBut
  Codes of the paper Deformable Butterfly: A Highly Structured and Sparse Linear Transform.
  ☆12Updated 3 years ago
• graphcore-research / out-of-the-box-fp8-training
  Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.
  ☆45Updated 8 months ago
• zhenhuaw-me / onnxcli
  ONNX Command-Line Toolbox
  ☆35Updated 5 months ago
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆124Updated 4 months ago
• habanero-lab / APPy
  APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…
  ☆23Updated last month
• facebookresearch / fairring
  Fairring (FAIR + Herring) is a plug-in for PyTorch that provides a process group for distributed training that outperforms NCCL at large …
  ☆65Updated 3 years ago
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆107Updated this week
• chenjoya / dropit
  DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training (ICLR 2023)
  ☆30Updated last year
• WaveSpeedAI / QuantumAttention
  [WIP] Better (FP8) attention for Hopper
  ☆26Updated last month
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆62Updated last year
• IntelLabs / DyNAS-T
  Dynamic Neural Architecture Search Toolkit
  ☆29Updated 3 months ago
• mit-han-lab / patch_conv
  Patch convolution to avoid large GPU memory usage of Conv2D
  ☆84Updated 2 months ago
• wangsiping97 / FastGEMV
  High-speed GEMV kernels, at most 2.7x speedup compared to pytorch baseline.
  ☆102Updated 8 months ago
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆44Updated last year
• tridao / flash-attention-wheels
  ☆46Updated last year
• cchan / tccl
  extensible collectives library in triton
  ☆84Updated 6 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆25Updated last year
• lernapparat / torchhacks
  Hacks for PyTorch
  ☆19Updated last year
• lianakoleva / no-libtorch-compile
  ☆21Updated 3 weeks ago
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆78Updated last year
• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆22Updated 9 months ago