Official code for the NeurIPS25 paper "RAT: Bridging RNN Efficiencyand Attention Accuracy in Language Modeling" (https://arxiv.org/abs/2507.04416))
☆26Aug 31, 2026Updated last month
Alternatives and similar repositories for RAT
Users that are interested in RAT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official codebase for "Quantile Reward Policy Optimization: Alignment with Pointwise Regression and Exact Partition Functions" (Matrenok …☆30Dec 8, 2025Updated 10 months ago
- The official code of "Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers"☆20Jul 24, 2024Updated 2 years ago
- mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models☆11Jan 19, 2024Updated 2 years ago
- Lab sessions for MenaML 2026☆16Jan 28, 2026Updated 9 months ago
- Label shift estimation for transfer difficulty with Familiarity.☆11Feb 4, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …☆12Mar 18, 2023Updated 3 years ago
- 把 On-Policy Distillation 接到 DSpark。☆19Jun 28, 2026Updated 4 months ago
- Multilingual Pretraining for Pixel Language Models (EMNLP 2025, Official Implementation)☆13Feb 2, 2026Updated 8 months ago
- code for paper: Soft Reasoning: Navigating Solution Spaces in Large Language Models through Controlled Embedding Exploration☆14Jun 28, 2025Updated last year
- Code for Retrofitting Large Language Models with Dynamic Tokenization.☆14Jul 22, 2025Updated last year
- Official repository for "SSA: Sparse Sparse Attention by Aligning Full and Sparse Attention Outputs in Feature Space"☆32May 7, 2026Updated 5 months ago
- ☆34Oct 22, 2024Updated 2 years ago
- ☆13Feb 7, 2023Updated 3 years ago
- Implementation of Cascaded Head-colliding Attention (ACL'2021)☆11Sep 16, 2021Updated 5 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆17Jul 29, 2025Updated last year
- ☆21Dec 5, 2022Updated 3 years ago
- ☆14Jun 24, 2024Updated 2 years ago
- CVPR '26 Highlight☆24May 6, 2026Updated 5 months ago
- Official code release for "SuperBPE: Space Travel for Language Models"☆101May 28, 2026Updated 5 months ago
- VibeRL is a Reinforcement Learning framework built essentially through vibe coding with Kimi K2.☆18Updated this week
- Implementation and experiments for "Partially Supervised NER via Expected Entity Ratio" in TACL 2022☆14Nov 7, 2022Updated 3 years ago
- [ICML 2026] Scaling Beyond Masked Diffusion Language Models☆38Sep 7, 2026Updated last month
- Efficient Multi-Task Safety Classification for Toxicity, Jailbreaks, Hate Speech, and Harmful Content☆25May 29, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Linear Attention for Efficient Bidirectional Sequence Modeling☆18May 13, 2025Updated last year
- Deep Data Research. Seek More, See Beyond.☆21Feb 6, 2026Updated 8 months ago
- Subset-Norm and Subset-Momentum. This repo is built on top of https://github.com/jiaweizzhao/GaLore.☆20Jul 9, 2025Updated last year
- Pytorch implementation of Graph-to-Graph Transformer for Transition-based Dependency Parsing accepted to EMNLP 2020☆22Nov 28, 2022Updated 3 years ago
- Official Implementation of "Variational Flow Maps: Make Some Noise for One-Step Conditional Generation"☆31Aug 7, 2026Updated 2 months ago
- [ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling☆80Apr 24, 2024Updated 2 years ago
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆52Nov 19, 2025Updated 11 months ago
- ☆16Mar 22, 2023Updated 3 years ago
- HGRN2: Gated Linear RNNs with State Expansion☆59Aug 20, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Code and data to explore neural scaling laws of xLSTM and Transformer models.☆24Apr 8, 2026Updated 6 months ago
- German Language Understanding Evaluation Benchmark @NAACL24☆23Dec 11, 2025Updated 10 months ago
- ☆24Sep 25, 2024Updated 2 years ago
- continous batching and parallel acceleration for RWKV6☆23Jun 28, 2024Updated 2 years ago
- ☆30Mar 22, 2024Updated 2 years ago
- ☆29Jul 9, 2024Updated 2 years ago
- A high performance development and dispatch library for high-performance machine learning kernels.☆38Aug 15, 2026Updated 2 months ago