lucidrains / triton-transformer
Implementation of a Transformer, but completely in Triton
☆257Updated 2 years ago
Alternatives and similar repositories for triton-transformer:
Users that are interested in triton-transformer are comparing it to the libraries listed below
- Implementation of Flash Attention in Jax☆204Updated 11 months ago
- This repository contains the experimental PyTorch native float8 training UX☆221Updated 6 months ago
- ☆157Updated last year
- ☆284Updated last week
- Torch Distributed Experimental☆115Updated 6 months ago
- Applied AI experiments and examples for PyTorch☆225Updated this week
- jax-triton contains integrations between JAX and OpenAI Triton☆379Updated 3 weeks ago
- A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…☆154Updated 2 months ago
- ☆246Updated 6 months ago
- ☆182Updated 2 weeks ago
- ☆179Updated last week
- 🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.☆187Updated last week
- ☆138Updated last year
- torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters i…☆178Updated 2 months ago
- PyTorch RFCs (experimental)☆131Updated 5 months ago
- Block-sparse primitives for PyTorch☆153Updated 3 years ago
- Slicing a PyTorch Tensor Into Parallel Shards☆298Updated 3 years ago
- Implementation of fused cosine similarity attention in the same style as Flash Attention☆210Updated 2 years ago
- Pipeline Parallelism for PyTorch☆749Updated 5 months ago
- Triton-based implementation of Sparse Mixture of Experts.☆196Updated 2 months ago
- Fast low-bit matmul kernels in Triton☆236Updated this week
- A library for unit scaling in PyTorch☆122Updated 2 months ago
- Cataloging released Triton kernels.☆168Updated last month
- ☆159Updated 8 months ago
- A library to analyze PyTorch traces.☆332Updated last week
- A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.☆514Updated this week
- ☆338Updated 10 months ago
- ☆100Updated 5 months ago
- Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimenta…☆478Updated 2 weeks ago
- Collection of kernels written in Triton language☆105Updated this week