Curated collection of research on the limitations of next-token prediction and methods that go beyond it.
☆37Oct 30, 2026Updated this week
Alternatives and similar repositories for beyond-next-token-prediction
Users that are interested in beyond-next-token-prediction are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official codebase for "Next-Latent Prediction Transformers Learn Compact World Models"☆212Jun 12, 2026Updated 4 months ago
- This repository is a collection of widely used self-supervised auxiliary losses used for learning representations in reinforcement learni…☆14Feb 27, 2023Updated 3 years ago
- ☆10May 24, 2021Updated 5 years ago
- [ICLR 2026 Oral] Partition Generative Modeling (PGM): Masked Modeling Without Masks☆16Feb 26, 2026Updated 8 months ago
- Learning a hierarchical model of data with neural networks.☆15Aug 31, 2023Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- [ICML 2025] The official code of the paper "Emergent Symbolic Mechanisms Support Abstract Reasoning in Large Language Models"☆12Jul 13, 2026Updated 3 months ago
- ☆10Mar 26, 2025Updated last year
- ☆14Apr 11, 2022Updated 4 years ago
- Minimal fastai code needed for working with pytorch☆15Aug 25, 2021Updated 5 years ago
- A Berkeley library for probability theory.☆15Jan 14, 2025Updated last year
- Selected list of papers on World Models that I found interesting and/or useful.☆43Feb 8, 2025Updated last year
- generative models on toys☆12Sep 10, 2024Updated 2 years ago
- nanokit - a minimal development environment powered by pixi☆10Aug 17, 2026Updated 2 months ago
- Qwen3 MoE Router Statistics | 큐웬3 MoE☆11May 16, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Amortized inference in sparse factor graphs☆10Aug 30, 2026Updated 2 months ago
- Experiments on the impact of depth in transformers and SSMs.☆48Oct 23, 2025Updated last year
- Modular Physics-ML Components in JAX☆17Oct 25, 2026Updated last week
- Codebase for the paper "A Percolation Model of Emergence: Analyzing Transformers Trained on a Formal Language"☆11Oct 11, 2024Updated 2 years ago
- The official code of "Building on Efficient Foundations: Effectively Training LLMs with Structured Feedforward Layers"☆20Jul 24, 2024Updated 2 years ago
- QGFN: Controllable Greediness with Action Values - Code☆11May 17, 2024Updated 2 years ago
- ☆16Sep 8, 2025Updated last year
- Code for our ACL '23 paper titled "Grokking of Hierarchical Structure in Vanilla Transformers"☆27Oct 8, 2023Updated 3 years ago
- codes and plots for "Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs"☆11Dec 30, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Adaptation of DQN, DDQN and COMA for multi-agent Gym environments☆10Oct 3, 2023Updated 3 years ago
- ☆10Aug 26, 2022Updated 4 years ago
- Everything you need to know about Associative Memories and Hopfield Networks for the Modern AI Era☆16Jan 19, 2026Updated 9 months ago
- Code for "Exponential Family Estimation via Adversarial Dynamics Embedding" (NeurIPS 2019)☆14Nov 26, 2019Updated 6 years ago
- Jupyter notebooks from our weekly (or so) hackathons☆11Dec 3, 2024Updated last year
- Aria Gen 1/2 toolkit: MANO hand fitting, stereo depth, and real-time streaming.☆17Jul 20, 2026Updated 3 months ago
- Materials for paper "Bootstrapping World Models from Dynamics Models in Multimodal Foundation Models"☆11Jun 9, 2025Updated last year
- ☆68May 26, 2026Updated 5 months ago
- [ICML 2026] NITP: Next Implicit Token Prediction for LLM Pre-training☆35May 26, 2026Updated 5 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆15Jun 16, 2026Updated 4 months ago
- FOCUS: An object-centric world implementation that allows for extracting per-object latent representations☆12Aug 26, 2025Updated last year
- Fast Low-rank Attention Routing Engine☆17Sep 25, 2026Updated last month
- Compress and Attend Transformers (CATs) 😸☆24Aug 9, 2026Updated 2 months ago
- Variational Auto Encoders for learning binding signatures of transcription factors☆15Mar 14, 2024Updated 2 years ago
- ☆16Apr 26, 2023Updated 3 years ago
- Official implementation of NeurIPS'24 paper "Causal Language Modeling Can Elicit Search and Reasoning Capabilities on Logic Puzzles"☆17Mar 26, 2025Updated last year