Official code for the NeurIPS25 paper "RAT: Bridging RNN Efficiencyand Attention Accuracy in Language Modeling" (https://arxiv.org/abs/2507.04416))
☆26Aug 31, 2026Updated 2 months ago
Alternatives and similar repositories for RAT
Users that are interested in RAT are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆18Aug 18, 2026Updated 3 months ago
- ☆11Jul 2, 2025Updated last year
- mPLM-Sim: Better Cross-Lingual Similarity and Transfer in Multilingual Pretrained Language Models☆11Jan 19, 2024Updated 2 years ago
- FlexiTokens☆23Dec 27, 2025Updated 10 months ago
- MLOps (Machine Learning Operations) süreçlerini adım adım öğrenmek için tasarlanmış kapsamlı Türkçe eğitim materyali☆15Oct 19, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Label shift estimation for transfer difficulty with Familiarity.☆11Feb 4, 2025Updated last year
- [ICLR 2024] Representation Deficiency in Masked Language Modeling☆11Mar 15, 2024Updated 2 years ago
- A method for evaluating the high-level coherence of machine-generated texts. Identifies high-level coherence issues in transformer-based …☆12Mar 18, 2023Updated 3 years ago
- A tensorflow based implementation of DeepVoice3 https://arxiv.org/abs/1710.07654☆13Jun 5, 2018Updated 8 years ago
- Multilingual Pretraining for Pixel Language Models (EMNLP 2025, Official Implementation)☆13Nov 9, 2026Updated last week
- Official repository for "SSA: Sparse Sparse Attention by Aligning Full and Sparse Attention Outputs in Feature Space"☆33May 7, 2026Updated 6 months ago
- ☆34Oct 22, 2024Updated 2 years ago
- (NeurIPS 2025) Official Code for L²M: Mutual Information Scaling Law for Long-Context Language Modeling☆14Nov 9, 2025Updated last year
- ☆13Feb 7, 2023Updated 3 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆13Oct 14, 2025Updated last year
- code for paper: Soft Reasoning: Navigating Solution Spaces in Large Language Models through Controlled Embedding Exploration☆14Jun 28, 2025Updated last year
- 把 On-Policy Distillation 接到 DSpark。☆19Jun 28, 2026Updated 4 months ago
- [Tech Report] On the Design of Hyper-Connections: Simplification, Stability, and Scalability. The fastest Hyper-Connections method with c…☆21Nov 8, 2026Updated last week
- ☆21Dec 5, 2022Updated 3 years ago
- ☆14Jun 24, 2024Updated 2 years ago
- ☆16May 14, 2024Updated 2 years ago
- CVPR '26 Highlight☆24May 6, 2026Updated 6 months ago
- Neural Lexicon Reader: Reduce Pronunciation Errors in End-to-end TTS by Leveraging External Textual Knowledge☆21Jul 25, 2022Updated 4 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Official code release for "SuperBPE: Space Travel for Language Models"☆102May 28, 2026Updated 5 months ago
- VibeRL is a Reinforcement Learning framework built essentially through vibe coding with Kimi K2.☆18Updated this week
- ☆17Jul 29, 2025Updated last year
- Code for Retrofitting Large Language Models with Dynamic Tokenization.☆14Jul 22, 2025Updated last year
- Implementation and experiments for "Partially Supervised NER via Expected Entity Ratio" in TACL 2022☆14Nov 7, 2022Updated 4 years ago
- Linear Attention for Efficient Bidirectional Sequence Modeling☆18May 13, 2025Updated last year
- FuseLIP: Multimodal Embeddings via Early Fusion of Discrete Tokens☆19Sep 8, 2025Updated last year
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆44Dec 29, 2025Updated 10 months ago
- Pytorch implementation of Graph-to-Graph Transformer for Transition-based Dependency Parsing accepted to EMNLP 2020☆22Nov 28, 2022Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆21Apr 26, 2026Updated 6 months ago
- ☆11Dec 5, 2025Updated 11 months ago
- [ICLR 2023] Official implementation of Transnormer in our ICLR 2023 paper - Toeplitz Neural Network for Sequence Modeling☆80Apr 24, 2024Updated 2 years ago
- DeepSeek-V3.2-Exp DSA Warmup Lightning Indexer training operator based on tilelang☆52Nov 19, 2025Updated last year
- ☆16Mar 22, 2023Updated 3 years ago
- Efficient Multi-Task Safety Classification for Toxicity, Jailbreaks, Hate Speech, and Harmful Content☆25May 29, 2026Updated 5 months ago
- German Language Understanding Evaluation Benchmark @NAACL24☆23Dec 11, 2025Updated 11 months ago
Are these results useful?