Alternatives and similar repositories for coconut-pytorch

Users that are interested in coconut-pytorch are comparing it to the libraries listed below

• ScalingIntelligence / large_language_monkeys
  ☆99Updated 10 months ago
• facebookresearch / PhysicsLM4
  Physics of Language Models, Part 4
  ☆67Updated this week
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆226Updated 2 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆187Updated 3 months ago
• jzhang38 / LongMamba
  Some preliminary explorations of Mamba's context scaling.
  ☆216Updated last year
• RobertCsordas / moeut
  ☆82Updated 11 months ago
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆160Updated 3 months ago
• SynthLabsAI / big-math
  A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
  ☆59Updated 5 months ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆97Updated last year
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆127Updated 11 months ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆112Updated 5 months ago
• haonan3 / AnchorContext
  AnchorAttention: Improved attention for LLMs long-context training
  ☆212Updated 6 months ago
• SalesforceAIResearch / GemFilter
  ☆82Updated 6 months ago
• multimodal-art-projection / LatentCoT-Horizon
  📖 This is a repository for organizing papers, codes, and other resources related to Latent Reasoning.
  ☆161Updated last week
• thu-ml / ReMoE
  [ICLR2025] Codebase for "ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing", built on Megatron-LM.
  ☆84Updated 7 months ago
• SalesforceAIResearch / LaTRO
  ☆117Updated 5 months ago
• Parallel-Reasoning / APR
  [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models
  ☆116Updated 3 months ago
• HKUNLP / DiffuLLaMA
  [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models
  ☆251Updated 2 months ago
• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆92Updated last week
• facebookresearch / RAM
  A framework to study AI models in Reasoning, Alignment, and use of Memory (RAM).
  ☆263Updated last week
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆149Updated last month
• kyleliang919 / Online-Subspace-Descent
  [NeurIPS 2024] Low rank memory efficient optimizer without SVD
  ☆30Updated last month
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains
  ☆156Updated last month
• sustcsonglin / linear-attention-and-beyond-slides
  ☆78Updated 5 months ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆172Updated last year
• dmis-lab / Monet
  [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers
  ☆70Updated last month
• da03 / implicit_chain_of_thought
  ☆135Updated 8 months ago
• shenao-zhang / SELM
  The official implementation of Self-Exploring Language Models (SELM)
  ☆64Updated last year
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆221Updated 2 weeks ago
• astramind-ai / Mixture-of-depths
  Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"
  ☆167Updated last year