UmerHA / triton_util
Make triton easier
☆39Updated 3 months ago
Related projects: ⓘ
- A place to store reusable transformer components of my own creation or found on the interwebs☆43Updated 3 weeks ago
- Simple and fast low-bit matmul kernels in CUDA☆48Updated this week
- Experiment of using Tangent to autodiff triton☆66Updated 7 months ago
- RWKV model implementation☆38Updated last year
- ☆68Updated 2 months ago
- Simple and efficient pytorch-native transformer training and inference (batched)☆53Updated 5 months ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆29Updated 3 weeks ago
- Triton Implementation of HyperAttention Algorithm☆46Updated 9 months ago
- ☆66Updated 3 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs. Now, with kittens!☆45Updated last month
- ☆50Updated last month
- ☆61Updated 2 weeks ago
- Utilities for Training Very Large Models☆56Updated last week
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆36Updated 8 months ago
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆66Updated 3 months ago
- Cold Compress is a hackable, lightweight, and open-source toolkit for creating and benchmarking cache compression methods built on top of…☆73Updated last month
- ☆45Updated 7 months ago
- Here we will test various linear attention designs.☆55Updated 4 months ago
- ☆36Updated last year
- Collection of autoregressive model implementation☆62Updated 2 weeks ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆26Updated last year
- The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"☆57Updated 5 months ago
- ☆29Updated 2 weeks ago
- PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu☆25Updated 3 weeks ago
- Using FlexAttention to compute attention with different masking patterns☆28Updated last week
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆34Updated 2 months ago
- ☆22Updated 3 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆94Updated 2 weeks ago
- Code repository for the paper - "AdANNS: A Framework for Adaptive Semantic Search"☆57Updated 11 months ago
- [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts☆29Updated 6 months ago