Official code for the NeurIPS25 paper "RAT: Bridging RNN Efficiencyand Attention Accuracy in Language Modeling" (https://arxiv.org/abs/2507.04416))
☆26Aug 31, 2026Updated last month
Alternatives and similar repositories for RAT
Users that are interested in RAT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- The official code of "Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers"☆20Jul 24, 2024Updated 2 years ago
- ☆17Aug 18, 2026Updated last month
- [ICLR 2025] SDTT: a simple and effective distillation method for discrete diffusion models☆55Feb 26, 2026Updated 7 months ago
- mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models☆11Jan 19, 2024Updated 2 years ago
- FlexiTokens☆23Dec 27, 2025Updated 9 months ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …☆12Mar 18, 2023Updated 3 years ago
- A tensorflow based implementation of DeepVoice3 https://arxiv.org/abs/1710.07654☆13Jun 5, 2018Updated 8 years ago
- Official repository for "SSA: Sparse Sparse Attention by Aligning Full and Sparse Attention Outputs in Feature Space"☆32May 7, 2026Updated 5 months ago
- Codebase to fully reproduce the results of "No Representation, No Trust: Connecting Representation, Collapse, and Trust Issues in PPO" (M…☆34Nov 20, 2024Updated last year
- ☆13Feb 7, 2023Updated 3 years ago
- ☆16May 14, 2024Updated 2 years ago
- ☆21Dec 5, 2022Updated 3 years ago
- Official code release for "SuperBPE: Space Travel for Language Models"☆101May 28, 2026Updated 4 months ago
- [ICML 2026] Scaling Beyond Masked Diffusion Language Models☆37Sep 7, 2026Updated last month
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- VibeRL is a Reinforcement Learning framework built essentially through vibe coding with Kimi K2.☆18Sep 28, 2026Updated last week
- Deep Data Research. Seek More, See Beyond.☆20Feb 6, 2026Updated 8 months ago
- ☆14Mar 10, 2020Updated 6 years ago
- Sparse Autoencoders for Stable Diffusion XL models.☆89Oct 30, 2025Updated 11 months ago
- Implementation and experiments for "Partially Supervised NER via Expected Entity Ratio" in TACL 2022☆14Nov 7, 2022Updated 3 years ago
- Neural Lexicon Reader: Reduce Pronunciation Errors in End-to-end TTS by Leveraging External Textual Knowledge☆21Jul 25, 2022Updated 4 years ago
- Linear Attention for Efficient Bidirectional Sequence Modeling☆18May 13, 2025Updated last year
- Official Implementation of "Variational Flow Maps: Make Some Noise for One-Step Conditional Generation"☆31Aug 7, 2026Updated 2 months ago
- ☆28Feb 26, 2026Updated 7 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆16Mar 22, 2023Updated 3 years ago
- Subset-Norm and Subset-Momentum. This repo is built on top of https://github.com/jiaweizzhao/GaLore.☆19Jul 9, 2025Updated last year
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆44Dec 29, 2025Updated 9 months ago
- HGRN2: Gated Linear RNNs with State Expansion☆59Aug 20, 2024Updated 2 years ago
- continous batching and parallel acceleration for RWKV6☆23Jun 28, 2024Updated 2 years ago
- Implementation of the paper "Fine-Tuning Transformers: Vocabulary Transfer" https://arxiv.org/pdf/2112.14569.pdf☆20Dec 28, 2021Updated 4 years ago
- ☆30Mar 22, 2024Updated 2 years ago
- ☆29Jul 9, 2024Updated 2 years ago
- Code and data for the paper "Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?"☆26Jun 3, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Code and data to explore neural scaling laws of xLSTM and Transformer models.☆24Apr 8, 2026Updated 6 months ago
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning☆30Jan 25, 2023Updated 3 years ago
- Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible…☆115Oct 2, 2026Updated last week
- German Language Understanding Evaluation Benchmark @NAACL24☆23Dec 11, 2025Updated 9 months ago
- Code for SaGe subword tokenizer (EACL 2023)☆28Nov 30, 2024Updated last year
- Code for the paper Task Agnostic Morphology Evolution.☆21May 25, 2021Updated 5 years ago
- Easily deploy my zsh and tmux configuration on new machines. Includes local and remote aliases to improve workflow.☆16Apr 23, 2026Updated 5 months ago