hyhieu / easy_pybindLinks
☆32Updated last year
Alternatives and similar repositories for easy_pybind
Users that are interested in easy_pybind are comparing it to the libraries listed below
Sorting:
- ☆256Updated 5 months ago
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆130Updated 11 months ago
- ☆90Updated last year
- Experimental GPU language with meta-programming☆24Updated last year
- ☆177Updated last year
- Fast and memory efficient PyTorch implementation of the Perceiver with FlashAttention.☆31Updated last year
- ☆91Updated last year
- Learning about CUDA by writing PTX code.☆147Updated last year
- Experiment of using Tangent to autodiff triton☆80Updated last year
- ☆28Updated last month
- train with kittens!☆63Updated last year
- Landing repository for the paper "Softpick: No Attention Sink, No Massive Activations with Rectified Softmax"☆85Updated 2 months ago
- CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning☆243Updated 3 weeks ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year
- ☆23Updated 6 months ago
- ☆53Updated last year
- Flash Attention Triton kernel with support for second-order derivatives☆115Updated last month
- Supporting code for the blog post on modular manifolds.☆103Updated 2 months ago
- 📄Small Batch Size Training for Language Models☆63Updated last month
- H-Net Dynamic Hierarchical Architecture☆80Updated 2 months ago
- WIP☆93Updated last year
- Implementation of the proposed Spline-Based Transformer from Disney Research☆105Updated last year
- FlashRNN - Fast RNN Kernels with I/O Awareness☆166Updated last month
- Focused on fast experimentation and simplicity☆75Updated 11 months ago
- ☆63Updated last week
- The evaluation framework for training-free sparse attention in LLMs☆104Updated last month
- Explorations into the recently proposed Taylor Series Linear Attention☆100Updated last year
- Quick implementation of nGPT, learning entirely on the hypersphere, from NvidiaAI☆293Updated 5 months ago
- JAX bindings for Flash Attention v2☆99Updated 3 weeks ago
- σ-GPT: A New Approach to Autoregressive Models☆70Updated last year