annosubmission / GRC-Cache
☆16Updated last year
Alternatives and similar repositories for GRC-Cache:
Users that are interested in GRC-Cache are comparing it to the libraries listed below
- Curse-of-memory phenomenon of RNNs in sequence modelling☆19Updated this week
- ☆24Updated 4 months ago
- ☆45Updated 9 months ago
- Open source community's implementation of the model from "LANGUAGE MODEL BEATS DIFFUSION — TOKENIZER IS KEY TO VISUAL GENERATION"☆15Updated 2 months ago
- A repository for DenseSSMs☆86Updated 9 months ago
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models☆28Updated 7 months ago
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆33Updated 3 months ago
- HGRN2: Gated Linear RNNs with State Expansion☆52Updated 5 months ago
- [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…☆62Updated 9 months ago
- ☆15Updated 2 weeks ago
- The repository for our paper: Neighboring Perturbations of Knowledge Editing on Large Language Models☆16Updated 8 months ago
- Triton implement of bi-directional (non-causal) linear attention☆38Updated 2 weeks ago
- Official code for the paper "Attention as a Hypernetwork"☆23Updated 7 months ago
- State Space Models☆64Updated 8 months ago
- Official Implementation Of The Paper: `DeciMamba: Exploring the Length Extrapolation Potential of Mamba'☆22Updated 6 months ago
- ☆28Updated 6 months ago
- Mixture of Attention Heads☆41Updated 2 years ago
- Official Pytorch Implementation of Self-emerging Token Labeling☆32Updated 10 months ago
- [NeurIPS 2022] Your Transformer May Not be as Powerful as You Expect (official implementation)☆34Updated last year
- ☆31Updated 8 months ago
- Official Code Repository for the paper "Key-value memory in the brain"☆20Updated last week
- The official implementation of the paper "Asymmetric Polynomial Loss for Multi-Label Classification"(ICASSP 2023)☆19Updated last year
- Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"☆51Updated this week
- Code for paper: "LASeR: Learning to Adaptively Select Reward Models with Multi-Arm Bandits"☆13Updated 3 months ago
- Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxiang Li, Lu Yi…☆16Updated last month
- [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…☆48Updated last year
- ☆14Updated last year
- ☆37Updated 2 months ago
- A simple implementation of [Mamba: Linear-Time Sequence Modeling with Selective State Spaces](https://arxiv.org/abs/2312.00752)☆21Updated last year
- Here we will test various linear attention designs.☆58Updated 9 months ago