hyhieu / easy_pybindLinks
☆32Updated last year
Alternatives and similar repositories for easy_pybind
Users that are interested in easy_pybind are comparing it to the libraries listed below
Sorting:
- ☆89Updated last year
- Experimental GPU language with meta-programming☆23Updated last year
- ☆242Updated 3 months ago
- Fast and memory efficient PyTorch implementation of the Perceiver with FlashAttention.☆26Updated 10 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆129Updated 9 months ago
- ☆88Updated last year
- ☆27Updated last year
- FlashRNN - Fast RNN Kernels with I/O Awareness☆97Updated 3 months ago
- Experiment of using Tangent to autodiff triton☆81Updated last year
- ☆168Updated last year
- Learning about CUDA by writing PTX code.☆135Updated last year
- Focused on fast experimentation and simplicity☆75Updated 8 months ago
- Flash Attention Triton kernel with support for second-order derivatives☆75Updated last week
- Mixed precision training from scratch with Tensors and CUDA☆26Updated last year
- ☆22Updated 4 months ago
- train with kittens!☆62Updated 10 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Updated last year
- ☆53Updated last year
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year
- WIP☆94Updated last year
- CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning☆186Updated last month
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆84Updated this week
- The evaluation framework for training-free sparse attention in LLMs☆93Updated 2 months ago
- Implementation of the proposed Spline-Based Transformer from Disney Research☆103Updated 10 months ago
- ring-attention experiments☆152Updated 11 months ago
- FlexAttention w/ FlashAttention3 Support☆27Updated 11 months ago
- ☆40Updated 5 months ago
- 📄Small Batch Size Training for Language Models☆60Updated 3 weeks ago
- JAX bindings for Flash Attention v2☆91Updated last week
- ☆33Updated 8 months ago