Official code for the NeurIPS25 paper "RAT: Bridging RNN Efficiencyand Attention Accuracy in Language Modeling" (https://arxiv.org/abs/2507.04416))
☆26Aug 31, 2026Updated 2 weeks ago
Alternatives and similar repositories for RAT
Users that are interested in RAT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official codebase for "Quantile Reward Policy Optimization: Alignment with Pointwise Regression and Exact Partition Functions" (Matrenok …☆30Dec 8, 2025Updated 9 months ago
- ☆17Aug 18, 2026Updated last month
- [ICLR 2025] SDTT: a simple and effective distillation method for discrete diffusion models☆54Feb 26, 2026Updated 6 months ago
- mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models☆11Jan 19, 2024Updated 2 years ago
- FlexiTokens☆23Dec 27, 2025Updated 8 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …☆12Mar 18, 2023Updated 3 years ago
- A tensorflow based implementation of DeepVoice3 https://arxiv.org/abs/1710.07654☆13Jun 5, 2018Updated 8 years ago
- Official repository for "SSA: Sparse Sparse Attention by Aligning Full and Sparse Attention Outputs in Feature Space"☆32May 7, 2026Updated 4 months ago
- Codebase to fully reproduce the results of "No Representation, No Trust: Connecting Representation, Collapse, and Trust Issues in PPO" (M…☆34Nov 20, 2024Updated last year
- ☆13Feb 7, 2023Updated 3 years ago
- ☆16May 14, 2024Updated 2 years ago
- Implementation of Cascaded Head-colliding Attention (ACL'2021)☆11Sep 16, 2021Updated 5 years ago
- ☆16Jul 29, 2025Updated last year
- CVPR '26 Highlight☆24May 6, 2026Updated 4 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- [ICML 2026] Scaling Beyond Masked Diffusion Language Models☆37Sep 7, 2026Updated last week
- VibeRL is a Reinforcement Learning framework built essentially through vibe coding with Kimi K2.☆18Updated this week
- ☆14Mar 10, 2020Updated 6 years ago
- Implementation and experiments for "Partially Supervised NER via Expected Entity Ratio" in TACL 2022☆14Nov 7, 2022Updated 3 years ago
- Linear Attention for Efficient Bidirectional Sequence Modeling☆18May 13, 2025Updated last year
- ☆28Feb 26, 2026Updated 6 months ago
- Subset-Norm and Subset-Momentum. This repo is built on top of https://github.com/jiaweizzhao/GaLore.☆19Jul 9, 2025Updated last year
- HGRN2: Gated Linear RNNs with State Expansion☆59Aug 20, 2024Updated 2 years ago
- Efficiently discovering algorithms via LLMs with evolutionary search and reinforcement learning.☆144Nov 18, 2025Updated 10 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆52Nov 19, 2025Updated 10 months ago
- [ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling☆80Apr 24, 2024Updated 2 years ago
- continous batching and parallel acceleration for RWKV6☆23Jun 28, 2024Updated 2 years ago
- Pytorch implementation of Graph-to-Graph Transformer for Transition-based Dependency Parsing accepted to EMNLP 2020☆22Nov 28, 2022Updated 3 years ago
- ☆30Mar 22, 2024Updated 2 years ago
- ☆29Jul 9, 2024Updated 2 years ago
- Code and data for the paper "Turning English-centric LLMs Into Polyglots: How Much Multilinguality Is Needed?"☆26Jun 3, 2025Updated last year
- ☆18Oct 27, 2024Updated last year
- Code and data to explore neural scaling laws of xLSTM and Transformer models.☆24Apr 8, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Efficient Language Model Training through Cross-Lingual and Progressive Transfer Learning☆30Jan 25, 2023Updated 3 years ago
- Experimental playground for benchmarking language model (LM) architectures, layers, and tricks on smaller datasets. Designed for flexible…☆115Jul 17, 2026Updated 2 months ago
- German Language Understanding Evaluation Benchmark @NAACL24☆23Dec 11, 2025Updated 9 months ago
- Code for SaGe subword tokenizer (EACL 2023)☆28Nov 30, 2024Updated last year
- Code for the paper Task Agnostic Morphology Evolution.☆21May 25, 2021Updated 5 years ago
- Easily deploy my zsh and tmux configuration on new machines. Includes local and remote aliases to improve workflow.☆16Apr 23, 2026Updated 4 months ago
- (ICML 2026) IDLM: Inverse-distilled Diffusion Language Models☆17Jun 8, 2026Updated 3 months ago