lucidrains / coconut-pytorchLinks
Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
☆180Updated 3 months ago
Alternatives and similar repositories for coconut-pytorch
Users that are interested in coconut-pytorch are comparing it to the libraries listed below
Sorting:
- ☆104Updated last year
- ☆191Updated 5 months ago
- This is the official repository for Inheritune.☆113Updated 7 months ago
- [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models☆229Updated 5 months ago
- Some preliminary explorations of Mamba's context scaling.☆217Updated last year
- ☆85Updated last year
- A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models☆65Updated 7 months ago
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆161Updated 5 months ago
- Code for "Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate" [COLM 2025]☆172Updated 2 months ago
- A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).☆287Updated last week
- ☆100Updated last year
- Physics of Language Models, Part 4☆247Updated 2 months ago
- Replicating O1 inference-time scaling laws☆90Updated 10 months ago
- [EMNLP 2025 Industry] Repo for "Z1: Efficient Test-time Scaling with Code"☆64Updated 5 months ago
- ☆123Updated 7 months ago
- [NeurIPS 2024] Low rank memory efficient optimizer without SVD☆31Updated 3 months ago
- Language models scale reliably with over-training and on downstream tasks☆100Updated last year
- [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models☆129Updated last month
- ☆86Updated 8 months ago
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆128Updated last year
- AnchorAttention: Improved attention for LLMs long-context training☆212Updated 8 months ago
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆100Updated 2 months ago
- [ICLR2025] Codebase for "ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing", built on Megatron-LM.☆92Updated 9 months ago
- ☆136Updated 10 months ago
- General Reasoner: Advancing LLM Reasoning Across All Domains [NeurIPS25]☆172Updated 3 months ago
- ☆72Updated last year
- Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]☆141Updated last year
- ☆25Updated 8 months ago
- [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers☆73Updated 3 months ago
- Code for paper "Patch-Level Training for Large Language Models"☆88Updated 10 months ago