zaydzuhri / token-order-predictionLinks
Landing repository for the paper "Predicting the Order of Upcoming Tokens Improves Language Modeling"
☆28Updated this week
Alternatives and similar repositories for token-order-prediction
Users that are interested in token-order-prediction are comparing it to the libraries listed below
Sorting:
- RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best…☆51Updated 5 months ago
- Official implementation of ECCV24 paper: POA☆24Updated last year
- Code for "C3PO: Critical-Layer, Core-Expert, Collaborative Pathway Optimization for Test-Time Expert Re-Mixing"☆18Updated 5 months ago
- Geometric-Mean Policy Optimization☆70Updated last month
- [ICLR 2025] Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegr…☆77Updated 8 months ago
- Resa: Transparent Reasoning Models via SAEs☆41Updated 3 weeks ago
- Official PyTorch Implementation for Vision-Language Models Create Cross-Modal Task Representations, ICML 2025☆30Updated 4 months ago
- Official implementation of the paper: "ZClip: Adaptive Spike Mitigation for LLM Pre-Training".☆132Updated this week
- OpenVLThinker: An Early Exploration to Vision-Language Reasoning via Iterative Self-Improvement☆107Updated last month
- Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More☆33Updated 3 months ago
- ☆26Updated 2 months ago
- Official Implementation of LaViDa: :A Large Diffusion Language Model for Multimodal Understanding☆140Updated last month
- Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…☆88Updated last week
- CODA: Coordinating the Cerebrum and Cerebellum for a Dual-Brain Computer Use Agent with Decoupled Reinforcement Learning☆29Updated last week
- [ACL2025 Findings] Benchmarking Multihop Multimodal Internet Agents☆46Updated 6 months ago
- This is a simple torch implementation of the high performance Multi-Query Attention☆16Updated 2 years ago
- ☆85Updated last year
- ☆95Updated 2 months ago
- Esoteric Language Models☆96Updated last month
- [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…☆26Updated last month
- Work in progress.☆72Updated 2 months ago
- ☆32Updated 3 months ago
- OLA-VLM: Elevating Visual Perception in Multimodal LLMs with Auxiliary Embedding Distillation, arXiv 2024☆61Updated 6 months ago
- The official implementation of Regularized Policy Gradient (RPG) (https://arxiv.org/abs/2505.17508)☆36Updated this week
- 😊 TPTT: Transforming Pretrained Transformers into Titans☆26Updated this week
- ☆29Updated last week
- official code for "BoostStep: Boosting mathematical capability of Large Language Models via improved single-step reasoning"☆36Updated 7 months ago
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆33Updated 2 weeks ago
- Code for the paper "Vamba: Understanding Hour-Long Videos with Hybrid Mamba-Transformers" [ICCV 2025]☆84Updated last month
- NeuMeta transforms neural networks by allowing a single model to adapt on the fly to different sizes, generating the right weights when n…☆43Updated 10 months ago