ML-GSAI / LLaDA
Official PyTorch implementation for "Large Language Diffusion Models"
☆1,556Updated this week
Alternatives and similar repositories for LLaDA:
Users that are interested in LLaDA are comparing it to the libraries listed below
- Dream 7B, a large diffusion language model☆613Updated this week
- An Open-source RL System from ByteDance Seed and Tsinghua AIR☆1,198Updated 3 weeks ago
- Official Repo for Open-Reasoner-Zero☆1,904Updated last month
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models☆569Updated 3 weeks ago
- Muon is Scalable for LLM Training☆1,039Updated last month
- Training Large Language Model to Reason in a Continuous Latent Space☆1,094Updated 3 months ago
- Pretraining code for a large-scale depth-recurrent language model☆755Updated 3 weeks ago
- Code for BLT research paper☆1,546Updated this week
- Scalable RL solution for advanced reasoning of language models☆1,529Updated last month
- Understanding R1-Zero-Like Training: A Critical Perspective☆908Updated 3 weeks ago
- An Open Large Reasoning Model for Real-World Solutions☆1,488Updated 2 months ago
- RAGEN leverages reinforcement learning to train LLM reasoning agents in interactive, stochastic environments.☆1,698Updated this week
- Muon optimizer: +>30% sample efficiency with <3% wallclock overhead☆597Updated last month
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,048Updated 3 months ago
- Recipes to scale inference-time compute of open models☆1,066Updated 2 months ago
- Democratizing Reinforcement Learning for LLMs☆3,182Updated 3 weeks ago
- Large Reasoning Models☆804Updated 5 months ago
- Simple RL training for reasoning☆3,519Updated 3 weeks ago
- LIMO: Less is More for Reasoning☆927Updated last month
- Next-Token Prediction is All You Need☆2,111Updated last month
- Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper☆607Updated last month
- Search-R1: An Efficient, Scalable RL Training Framework for Reasoning & Search Engine Calling interleaved LLM based on veRL☆2,127Updated last week
- Witness the aha moment of VLM with less than $3.☆3,622Updated 2 months ago
- Unofficial implementation of Titans, SOTA memory for transformers, in Pytorch☆1,310Updated 3 weeks ago
- A fork to add multimodal model training to open-r1☆1,245Updated 3 months ago
- [ICLR 2025] Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling☆867Updated last week
- ☆524Updated 3 weeks ago
- ☆924Updated 3 months ago
- ☆1,356Updated 5 months ago
- [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation☆775Updated 7 months ago