hyhieu / easy_pybindLinks
☆32Updated last year
Alternatives and similar repositories for easy_pybind
Users that are interested in easy_pybind are comparing it to the libraries listed below
Sorting:
- ☆251Updated 4 months ago
- ☆89Updated last year
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆130Updated 10 months ago
- ☆91Updated last year
- Experimental GPU language with meta-programming☆23Updated last year
- ☆173Updated last year
- Experiment of using Tangent to autodiff triton☆81Updated last year
- FlashRNN - Fast RNN Kernels with I/O Awareness☆98Updated 3 months ago
- Fast and memory efficient PyTorch implementation of the Perceiver with FlashAttention.☆29Updated 11 months ago
- Learning about CUDA by writing PTX code.☆138Updated last year
- σ-GPT: A New Approach to Autoregressive Models☆68Updated last year
- train with kittens!☆62Updated 11 months ago
- ☆53Updated last year
- ☆28Updated last week
- Normalized Transformer (nGPT)☆190Updated 10 months ago
- Quantized LLM training in pure CUDA/C++.☆180Updated this week
- ☆34Updated 2 weeks ago
- 📄Small Batch Size Training for Language Models☆62Updated last week
- An efficient implementation of the NSA (Native Sparse Attention) kernel☆118Updated 3 months ago
- The evaluation framework for training-free sparse attention in LLMs☆100Updated 3 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆132Updated last year
- Flash Attention Triton kernel with support for second-order derivatives☆98Updated this week
- ☆22Updated 5 months ago
- Implementation of the proposed Spline-Based Transformer from Disney Research☆104Updated 11 months ago
- FlexAttention w/ FlashAttention3 Support☆27Updated last year
- Explorations into the recently proposed Taylor Series Linear Attention☆100Updated last year
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆46Updated last year
- ring-attention experiments☆152Updated 11 months ago
- Focused on fast experimentation and simplicity☆75Updated 9 months ago
- This repository contains the experimental PyTorch native float8 training UX☆224Updated last year