ML-GSAI / LLaDA
Official PyTorch implementation for "Large Language Diffusion Models"
☆1,313Updated 2 weeks ago
Alternatives and similar repositories for LLaDA:
Users that are interested in LLaDA are comparing it to the libraries listed below
- Muon is Scalable for LLM Training☆974Updated 3 weeks ago
- Block Diffusion: Interpolating Between Autoregressive and Diffusion Language Models☆397Updated this week
- Pretraining code for a large-scale depth-recurrent language model☆697Updated last week
- An Open Large Reasoning Model for Real-World Solutions☆1,475Updated 3 weeks ago
- Democratizing Reinforcement Learning for LLMs☆2,113Updated last month
- Recipes to scale inference-time compute of open models☆1,044Updated last month
- Scalable RL solution for advanced reasoning of language models☆1,419Updated last week
- Official Repo for Open-Reasoner-Zero☆1,667Updated 3 weeks ago
- Next-Token Prediction is All You Need☆2,042Updated last week
- An Open-source RL System from ByteDance Seed and Tsinghua AIR☆767Updated last week
- Code for BLT research paper☆1,436Updated this week
- A Self-adaptation Framework🐙 that adapts LLMs for unseen tasks in real-time!☆1,013Updated last month
- ☆1,348Updated 4 months ago
- RAGEN leverages reinforcement learning to train LLM reasoning agents in interactive, stochastic environments.☆1,210Updated this week
- ☆910Updated 2 months ago
- Large Reasoning Models☆799Updated 3 months ago
- Training Large Language Model to Reason in a Continuous Latent Space☆998Updated 2 months ago
- Witness the aha moment of VLM with less than $3.☆3,376Updated 3 weeks ago
- [ICML2024 (Oral)] Official PyTorch implementation of DoRA: Weight-Decomposed Low-Rank Adaptation☆748Updated 5 months ago
- Autoregressive Model Beats Diffusion: 🦙 Llama for Scalable Image Generation☆1,623Updated 7 months ago
- MoBA: Mixture of Block Attention for Long-Context LLMs☆1,687Updated 2 weeks ago
- Implementation of the sparse attention pattern proposed by the Deepseek team in their "Native Sparse Attention" paper☆561Updated this week
- Unofficial implementation of Titans, SOTA memory for transformers, in Pytorch☆1,230Updated last week
- [ICLR2025 Spotlight🔥] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters☆539Updated last month
- verl: Volcano Engine Reinforcement Learning for LLMs☆5,693Updated this week
- LLaVA-CoT, a visual language model capable of spontaneous, systematic reasoning☆1,910Updated 2 months ago
- Fully open data curation for reasoning models☆1,576Updated last week
- This is a replicate of DeepSeek-R1-Zero and DeepSeek-R1 training on small models with limited data☆3,223Updated this week
- O1 Replication Journey☆1,977Updated 2 months ago
- OLMoE: Open Mixture-of-Experts Language Models☆693Updated last week