Curated collection of research on the limitations of next-token prediction and methods that go beyond it.
☆27Jul 10, 2026Updated last month
Alternatives and similar repositories for beyond-next-token-prediction
Users that are interested in beyond-next-token-prediction are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- [COLM 2026] An efficient 3D sampling method for long-CoT LLM.☆16May 25, 2025Updated last year
- ☆33Jan 6, 2025Updated last year
- This repository is a collection of widely used self-supervised auxiliary losses used for learning representations in reinforcement learni…☆14Feb 27, 2023Updated 3 years ago
- ☆13Apr 11, 2022Updated 4 years ago
- Minimal fastai code needed for working with pytorch☆15Aug 25, 2021Updated 4 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Investigating the role of pre-training dataset size and diversity on the performance of single-cell foundation models☆20May 12, 2026Updated 2 months ago
- Selected list of papers on World Models that I found interesting and/or useful.☆40Feb 8, 2025Updated last year
- An approach for Circuit Synthesis using Dataset Threshold queries.☆14May 28, 2023Updated 3 years ago
- ☆58May 26, 2026Updated 2 months ago
- ☆16Sep 8, 2025Updated 11 months ago
- ☆14Dec 25, 2024Updated last year
- Code for Augment & Reduce, a scalable stochastic algorithm for large categorical distributions☆10May 16, 2018Updated 8 years ago
- ☆17May 9, 2025Updated last year
- codes and plots for "Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs"☆11Dec 30, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Jupyter notebooks from our weekly (or so) hackathons☆11Dec 3, 2024Updated last year
- ☆24Dec 17, 2025Updated 7 months ago
- Official implementation of NeurIPS'24 paper "Causal Language Modeling Can Elicit Search and Reasoning Capabilities on Logic Puzzles"☆16Mar 26, 2025Updated last year
- ☆16Apr 26, 2023Updated 3 years ago
- Official code for the NeurIPS25 paper "RAT: Bridging RNN Efficiencyand Attention Accuracy in Language Modeling" (https://arxiv.org/abs/25…☆26Dec 10, 2025Updated 8 months ago
- Code for Semi-crowdsourced Clustering with Deep Generative Models☆12Dec 9, 2022Updated 3 years ago
- ☆17Feb 4, 2026Updated 6 months ago
- Simple Scalable Discrete Diffusion for text in PyTorch☆37Sep 27, 2024Updated last year
- [ACL 2026 Oral] From Word to World: Can Large Language Models be Implicit Text-based World Models?☆68Apr 13, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [ICML 2026] Public repository for fine-tuning Masked Diffusion Models toward provable self-correction.☆26Jul 5, 2026Updated last month
- Posterior with interesting shapes from actually used models☆13Feb 10, 2025Updated last year
- ☆12Oct 21, 2017Updated 8 years ago
- ☆11Jul 25, 2021Updated 5 years ago
- ☆13Mar 10, 2026Updated 5 months ago
- PyTorch utilities for ML, specifically speech☆13Jan 30, 2024Updated 2 years ago
- Official code for the paper "Compositional Generalization from First Principles" (NeurIPS 2023)☆15Jul 25, 2023Updated 3 years ago
- Code for 'Answer Matching Outperforms Multiple Choice for Language Model Evaluation' paper☆19Jul 4, 2025Updated last year
- Code for Tangent Model Composition for Ensembling and Continual Fine-tuning (ICCV 2023) and Tangent Transformers for Composition, Privacy…☆14May 14, 2024Updated 2 years ago
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- ☆12Jul 30, 2025Updated last year
- An automatic Gaussian process classifier.☆13May 28, 2016Updated 10 years ago
- Glow and RealNVP with tensorflow 2.0 and tensorflow probability☆31Nov 21, 2022Updated 3 years ago
- SR²AM: Efficient Agentic Reasoning Through Self-Regulated Simulative Planning☆21May 22, 2026Updated 2 months ago
- Automatic identification of regions in the latent space of a model that correspond to unique concepts, namely to concepts with a semantic…☆14Nov 22, 2023Updated 2 years ago
- Stochastic Gradient Langevin Dynamics for Bayesian learning☆36Nov 29, 2021Updated 4 years ago
- Python package for P2 (Path Planning), a masked diffusion model sampling method for sequence generation (protein, text, etc.).☆24Aug 19, 2025Updated 11 months ago