Alternatives and similar repositories for coconut-pytorch:

Users that are interested in coconut-pytorch are comparing it to the libraries listed below

• ScalingIntelligence / large_language_monkeys
  ☆91Updated 7 months ago
• da03 / Internalize_CoT_Step_by_Step
  ☆170Updated 2 weeks ago
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆111Updated 2 months ago
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆123Updated 8 months ago
• HKUNLP / DiffuLLaMA
  [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models
  ☆158Updated last month
• jxiw / MambaInLlama
  [NeurIPS 2024] Official Repository of The Mamba in the Llama: Distilling and Accelerating Hybrid Models
  ☆215Updated this week
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆105Updated this week
• itsnamgyu / block-transformer
  Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)
  ☆153Updated 3 weeks ago
• jzhang38 / LongMamba
  Some preliminary explorations of Mamba's context scaling.
  ☆213Updated last year
• casper-hansen / OpenCoconut
  OpenCoconut implements a latent reasoning paradigm where we generate thoughts before decoding.
  ☆172Updated 3 months ago
• sustcsonglin / linear-attention-and-beyond-slides
  ☆69Updated 2 months ago
• princeton-nlp / HELMET
  The HELMET Benchmark
  ☆142Updated 2 weeks ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆110Updated 4 months ago
• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆177Updated last month
• whyNLP / LCKV
  Layer-Condensed KV cache w/ 10 times larger batch size, fewer params and less computation. Dramatic speed up with better task performance…
  ☆148Updated 3 weeks ago
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆84Updated 7 months ago
• SalesforceAIResearch / LaTRO
  ☆114Updated 2 months ago
• SalesforceAIResearch / GemFilter
  ☆77Updated 3 months ago
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆91Updated 2 weeks ago
• architsharma97 / dpo-rlaif
  ☆97Updated 10 months ago
• vicksEmmanuel / latent-gemma
  ☆25Updated 3 months ago
• HazyResearch / based
  Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"
  ☆232Updated 2 months ago
• RobertCsordas / moeut
  ☆78Updated 8 months ago
• SynthLabsAI / big-math
  A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
  ☆51Updated 2 months ago
• HanGuo97 / lq-lora
  ☆125Updated last year
• dllm-reasoning / d1
  Official Implementation for the paper "d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning"
  ☆100Updated 2 weeks ago
• ypwang61 / One-Shot-RLVR
  official repository for “Reinforcement Learning for Reasoning in Large Language Models with One Training Example”
  ☆52Updated this week
• fangyuan-ksgk / Tiny-GRPO
  minimal GRPO implementation from scratch
  ☆87Updated last month
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆96Updated last year
• EvolvingLMMs-Lab / multimodal-sae
  Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.
  ☆128Updated 3 months ago