tjyuyao / cutexLinks
PyCUDA based PyTorch Extension Made Easy
☆26Updated last year
Alternatives and similar repositories for cutex
Users that are interested in cutex are comparing it to the libraries listed below
Sorting:
- Customized matrix multiplication kernels☆57Updated 3 years ago
- FlexAttention w/ FlashAttention3 Support☆27Updated last year
- A block oriented training approach for inference time optimization.☆33Updated last year
- ☆158Updated 2 years ago
- APPy (Annotated Parallelism for Python) enables users to annotate loops and tensor expressions in Python with compiler directives akin to…☆25Updated last week
- Hacks for PyTorch☆19Updated 2 years ago
- Faster Pytorch bitsandbytes 4bit fp4 nn.Linear ops☆29Updated last year
- No-GIL Python environment featuring NVIDIA Deep Learning libraries.☆67Updated 6 months ago
- Patch convolution to avoid large GPU memory usage of Conv2D☆93Updated 9 months ago
- pytorch-profiler☆51Updated 2 years ago
- Codes of the paper Deformable Butterfly: A Highly Structured and Sparse Linear Transform.☆13Updated 4 years ago
- DropIT: Dropping Intermediate Tensors for Memory-Efficient DNN Training (ICLR 2023)☆31Updated 2 years ago
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆45Updated 2 years ago
- AdamW optimizer for bfloat16 models in pytorch 🔥.☆37Updated last year
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆45Updated last year
- Reference implementation of "Softmax Attention with Constant Cost per Token" (Heinsen, 2024)☆24Updated last year
- ☆22Updated last year
- A library for unit scaling in PyTorch☆132Updated 3 months ago
- Torch Distributed Experimental☆117Updated last year
- ☆22Updated 2 years ago
- ☆32Updated last year
- Quantize transformers to any learned arbitrary 4-bit numeric format☆48Updated 3 months ago
- [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling☆39Updated last year
- PyTorch centric eager mode debugger☆48Updated 10 months ago
- Repository for CPU Kernel Generation for LLM Inference☆26Updated 2 years ago
- Examples for the WebDataset PyTorch Dataset Library☆51Updated 4 years ago
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆181Updated 2 months ago
- MaskedTensors for PyTorch☆38Updated 3 years ago
- ☆19Updated 3 years ago
- ONNX Command-Line Toolbox☆35Updated last year