hyhieu / easy_pybind
☆32Updated 8 months ago
Alternatives and similar repositories for easy_pybind:
Users that are interested in easy_pybind are comparing it to the libraries listed below
- ☆75Updated 7 months ago
- ☆53Updated last year
- ☆25Updated last year
- ☆86Updated 11 months ago
- Fast and memory efficient PyTorch implementation of the Perceiver with FlashAttention.☆25Updated 3 months ago
- Experiment of using Tangent to autodiff triton☆75Updated last year
- supporting pytorch FSDP for optimizers☆76Updated 2 months ago
- ☆32Updated last month
- ☆142Updated last year
- Focused on fast experimentation and simplicity☆65Updated last month
- WIP☆93Updated 6 months ago
- Implementation of the proposed Spline-Based Transformer from Disney Research☆86Updated 3 months ago
- Collection of autoregressive model implementation☆81Updated this week
- FlashRNN - Fast RNN Kernels with I/O Awareness☆75Updated 2 months ago
- Demo of the unit_scaling library, showing how a model can be easily adapted to train in FP8.☆43Updated 7 months ago
- ☆47Updated 2 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training☆122Updated 10 months ago
- Experimental scripts for researching data adaptive learning rate scheduling.☆23Updated last year
- CUDA implementation of autoregressive linear attention, with all the latest research findings☆44Updated last year
- A basic pure pytorch implementation of flash attention☆16Updated 3 months ago
- ☆49Updated 11 months ago
- Explorations into the recently proposed Taylor Series Linear Attention☆92Updated 6 months ago
- The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.☆57Updated 3 weeks ago
- Normalized Transformer (nGPT)☆152Updated 3 months ago
- Mixed precision training from scratch with Tensors and CUDA☆21Updated 9 months ago
- FlexAttention w/ FlashAttention3 Support☆26Updated 4 months ago
- ☆66Updated 7 months ago
- Make triton easier☆44Updated 8 months ago
- Triton Implementation of HyperAttention Algorithm☆46Updated last year
- Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters☆116Updated 2 months ago