lianakoleva / no-libtorch-compile
☆17Updated 2 weeks ago
Related projects ⓘ
Alternatives and complementary repositories for no-libtorch-compile
- FlexAttention w/ FlashAttention3 Support☆27Updated last month
- A place to store reusable transformer components of my own creation or found on the interwebs☆43Updated this week
- Experiment of using Tangent to autodiff triton☆71Updated 9 months ago
- Make triton easier☆41Updated 5 months ago
- extensible collectives library in triton☆63Updated last month
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆35Updated 3 months ago
- PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu☆38Updated 2 months ago
- Utilities for PyTorch distributed☆23Updated last year
- See https://github.com/cuda-mode/triton-index/ instead!☆11Updated 6 months ago
- CUDA and Triton implementations of Flash Attention with SoftmaxN.☆66Updated 5 months ago
- ☆18Updated last month
- ☆76Updated 5 months ago
- Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.☆29Updated last week
- An implementation of the Llama architecture, to instruct and delight☆21Updated 2 months ago
- Explore training for quantized models☆10Updated this week
- Personal solutions to the Triton Puzzles☆15Updated 3 months ago
- Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers☆58Updated 3 months ago
- ☆20Updated last year
- RWKV model implementation☆38Updated last year
- Training hybrid models for dummies.☆15Updated 2 weeks ago
- ☆72Updated 4 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆104Updated last month
- A safetensors extension to efficiently store sparse quantized tensors on disk☆46Updated this week
- ☆13Updated 4 months ago
- Scalable and Performant Data Loading☆44Updated this week
- Implementation of a Light Recurrent Unit in Pytorch☆46Updated last month
- RWKV-7: Surpassing GPT☆42Updated this week
- ☆49Updated 7 months ago
- Triton Implementation of HyperAttention Algorithm☆46Updated 11 months ago
- ☆39Updated 9 months ago