zaydzuhri / token-order-predictionLinks
Landing repository for the paper "Predicting the Order of Upcoming Tokens Improves Language Modeling"
☆41Updated 3 months ago
Alternatives and similar repositories for token-order-prediction
Users that are interested in token-order-prediction are comparing it to the libraries listed below
Sorting:
- Official Repo for Error-Free Linear Attention is a Free Lunch: Exact Solution from Continuous-Time Dynamics☆68Updated last week
- RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…☆59Updated 9 months ago
- Official implementation of ECCV24 paper: POA☆24Updated last year
- Implementation of the dynamic chunking mechanism in H-net by Hwang et al. of Carnegie Mellon☆65Updated 4 months ago
- The official repo of continuous speculative decoding☆31Updated 9 months ago
- Geometric-Mean Policy Optimization☆94Updated last month
- Official PyTorch implementation of TokenSet.☆127Updated 9 months ago
- Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…☆118Updated 2 months ago
- ☆152Updated 3 months ago
- Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".☆141Updated last month
- Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025☆31Updated 8 months ago
- Code for the paper "Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers" [ICCV 2025]☆98Updated 5 months ago
- CODA: Coordinating the Cerebrum and Cerebellum for a Dual-Brain Computer Use Agent with Decoupled Reinforcement Learning☆32Updated 4 months ago
- Official PyTorch Implementation for Paper "No More Adam: Learning Rate Scaling at Initialization is All You Need"☆54Updated 11 months ago
- The official github repo for "Diffusion Language Models are Super Data Learners".☆215Updated 2 months ago
- ☆63Updated 5 months ago
- Implementation of the proposed MaskBit from Bytedance AI☆83Updated last year
- This is the offical repository of InfiniteVL☆65Updated 3 weeks ago
- [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…☆79Updated last year
- A big_vision inspired repo that implements a generic Auto-Encoder class capable in representation learning and generative modeling.☆34Updated last year
- ☆21Updated 3 months ago
- LLaDA2.0 is the diffusion language model series developed by InclusionAI team, Ant Group.☆207Updated 2 weeks ago
- NeuMeta transforms neural networks by allowing a single model to adapt on the fly to different sizes, generating the right weights when n…☆43Updated last year
- ☆40Updated 7 months ago
- Resa: Transparent Reasoning Models via SAEs☆46Updated 3 months ago
- Official Implementation of LaViDa: :A Large Diffusion Language Model for Multimodal Understanding☆186Updated 3 weeks ago
- [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…☆27Updated 5 months ago
- [Preprint] GMem: A Modular Approach for Ultra-Efficient Generative Models☆41Updated 9 months ago
- ☆19Updated 11 months ago
- Official JAX implementation of End-to-End Test-Time Training for Long Context☆102Updated last week