Alternatives and similar repositories for LongLLaDA

Users that are interested in LongLLaDA are comparing it to the libraries listed below

• s-sahoo / Eso-LMs
  Esoteric Language Models
  ☆89Updated last week
• igul222 / plaid
  ☆104Updated 2 years ago
• liusulin / DDPD
  Official Code for Paper "Think While You Generate: Discrete Diffusion with Planned Denoising" [ICLR 2025]
  ☆70Updated 3 months ago
• ozekri / SEPO
  Code for the paper: "Fine-Tuning Discrete Diffusion Models with Policy Gradient Methods"
  ☆27Updated 2 months ago
• google-deepmind / md4
  Official Jax Implementation of MD4 Masked Diffusion Models
  ☆118Updated 5 months ago
• fal-ai-community / nano-mdm
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆55Updated 4 months ago
• fangyuan-ksgk / selective-attention-transformer
  Unofficial Implementation of Selective Attention Transformer
  ☆17Updated 9 months ago
• shawntan / stickbreaking-attention
  Stick-breaking attention
  ☆59Updated last month
• HKUNLP / DiffuLLaMA
  [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models
  ☆259Updated 2 months ago
• ML-GSAI / SMDM
  Official PyTorch implementation for ICLR2025 paper "Scaling up Masked Diffusion Models on Text"
  ☆267Updated 7 months ago
• RobertCsordas / moeut
  ☆83Updated 11 months ago
• ablghtianyi / ICL_Modular_Arithmetic
  ☆19Updated 4 months ago
• XueruiSu / Trust-Region-Preference-Approximation
  Trust Region Preference Approximation: A simple and stable reinforcement learning algorithm for LLM reasoning
  ☆12Updated last month
• HKUNLP / diffusion-vs-ar
  [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"
  ☆69Updated 5 months ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆81Updated 9 months ago
• wzq016 / PINE
  Offcial Repo of Paper "Eliminating Position Bias of Language Models: A Mechanistic Approach""
  ☆14Updated last month
• kuleshov-group / remdm
  Remasking Discrete Diffusion Models with Inference-Time Scaling
  ☆36Updated 5 months ago
• qiuzh20 / gated_attention
  The official implementation for Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
  ☆46Updated 2 months ago
• dvruette / gidd
  Code accompanying the paper "Generalized Interpolating Discrete Diffusion"
  ☆97Updated 2 months ago
• IdoAmos / not-from-scratch
  ☆33Updated 9 months ago
• uservan / ThinkPO
  ☆18Updated last week
• convergence-ai / lm2
  Official repo of paper LM2
  ☆41Updated 5 months ago
• bethgelab / sober-reasoning
  A Sober Look at Language Model Reasoning
  ☆81Updated last month
• gregorbachmann / Next-Token-Failures
  ☆89Updated last year
• dllm-reasoning / d1
  Official Implementation for the paper "d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning"
  ☆255Updated last month
• ScalingIntelligence / large_language_monkeys
  ☆101Updated 10 months ago
• assafbk / DeciMamba
  DeciMamba: Exploring the Length Extrapolation Potential of Mamba (ICLR 2025)
  ☆28Updated 3 months ago
• bansky-cl / diffusion-nlp-paper-arxiv
  Auto get diffusion nlp papers in Axriv. More papers Information can be found in another repository "Diffusion-LM-Papers".
  ☆160Updated this week
• chuanyang-Zheng / DAPE
  The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"
  ☆38Updated 9 months ago
• TianjinYellow / SPAM-Optimizer
  ☆34Updated 4 months ago