vikhyat / e_natten
Blazingly fast neighborhood attention
☆12Updated last year
Alternatives and similar repositories for e_natten:
Users that are interested in e_natten are comparing it to the libraries listed below
- CHARacter-awaRE Diffusion: Multilingual Character-Aware Encoders for Font-Aware Diffusers That Can Actually Spell☆14Updated last year
- Utilities for PyTorch distributed☆23Updated last year
- My explorations into editing the knowledge and memories of an attention network☆34Updated 2 years ago
- Another attempt at a long-context / efficient transformer by me☆37Updated 2 years ago
- Describe the format of image/text datasets☆11Updated 2 years ago
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆21Updated 6 months ago
- Implementation of a holodeck, written in Pytorch☆17Updated last year
- Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.☆22Updated 2 years ago
- Implementation of a Light Recurrent Unit in Pytorch☆48Updated 4 months ago
- Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)☆44Updated this week
- Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…☆25Updated 10 months ago
- A dashboard for exploring timm learning rate schedulers☆19Updated 2 months ago
- Utilities for Training Very Large Models☆57Updated 4 months ago
- DiCE: The Infinitely Differentiable Monte-Carlo Estimator☆31Updated last year
- implementation of https://arxiv.org/pdf/2312.09299☆20Updated 7 months ago
- ☆21Updated 2 months ago
- HomebrewNLP in JAX flavour for maintable TPU-Training☆48Updated last year
- Implementation of Metaformer, but in an autoregressive manner☆23Updated 2 years ago
- ☆31Updated 8 months ago
- Implementation of a Transformer using ReLA (Rectified Linear Attention) from https://arxiv.org/abs/2104.07012☆49Updated 2 years ago
- 🚀🤗 A collection of templates for Hugging Face Spaces☆35Updated last year
- Load any clip model with a standardized interface☆21Updated 9 months ago
- Shows how to do parameter ensembling using differential evolution.☆10Updated 3 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 8 months ago
- A scalable implementation of diffusion and flow-matching with XGBoost models, applied to calorimeter data.☆17Updated 3 months ago
- ☆19Updated 4 months ago
- Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing☆48Updated 3 years ago
- Minimal Implementation of Visual Autoregressive Modelling (VAR)☆26Updated last month
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year