vikhyat / e_nattenLinks
Blazingly fast neighborhood attention
☆14Updated 2 years ago
Alternatives and similar repositories for e_natten
Users that are interested in e_natten are comparing it to the libraries listed below
Sorting:
- Explorations into adversarial losses on top of autoregressive loss for language modeling☆41Updated last month
- Utilities for PyTorch distributed☆25Updated 11 months ago
- Implementation of a Light Recurrent Unit in Pytorch☆49Updated last year
- A dashboard for exploring timm learning rate schedulers☆19Updated last year
- Official Repository for Efficient Linear-Time Attention Transformers.☆18Updated last year
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"☆103Updated last year
- Utilities for Training Very Large Models☆58Updated last year
- ☆82Updated last year
- Latent Diffusion Language Models☆70Updated 2 years ago
- Tiled Flash Linear Attention library for fast and efficient mLSTM Kernels.☆84Updated 2 months ago
- ☆24Updated last year
- My explorations into editing the knowledge and memories of an attention network☆35Updated 3 years ago
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆38Updated 8 months ago
- ☆34Updated last year
- Explorations into the recently proposed Taylor Series Linear Attention☆100Updated last year
- ☆50Updated last year
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆28Updated last year
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆23Updated last year
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- A byte-level decoder architecture that matches the performance of tokenized Transformers.☆67Updated last year
- Collection of autoregressive model implementation☆85Updated 3 weeks ago
- JAX Scalify: end-to-end scaled arithmetics☆18Updated last year
- Fast, Modern, and Low Precision PyTorch Optimizers☆124Updated last month
- Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)☆55Updated 10 months ago
- Implementation of GateLoop Transformer in Pytorch and Jax☆92Updated last year
- A scalable implementation of diffusion and flow-matching with XGBoost models, applied to calorimeter data.☆19Updated last year
- HomebrewNLP in JAX flavour for maintable TPU-Training☆51Updated 2 years ago
- QAmeleon introduces synthetic multilingual QA data using PaLM, a 540B large language model. This dataset was generated by prompt tuning P…☆35Updated 2 years ago
- GoldFinch and other hybrid transformer components☆45Updated last year
- ☆19Updated 2 months ago