facebookresearch / PhysicsLM4Links
Physics of Language Models: Part 4.2, Canon Layers at Scale where Synthetic Pretraining Resonates in Reality
☆317Updated last month
Alternatives and similar repositories for PhysicsLM4
Users that are interested in PhysicsLM4 are comparing it to the libraries listed below
Sorting:
- The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…☆84Updated last year
- 🔥 A minimal training framework for scaling FLA models☆344Updated 2 months ago
- [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models☆139Updated last month
- ☆105Updated 11 months ago
- Implementation for FP8/INT8 Rollout for RL training without performence drop.☆289Updated 3 months ago
- A brief and partial summary of RLHF algorithms.☆144Updated 11 months ago
- ☆55Updated 7 months ago
- ☆388Updated 3 months ago
- A collection of papers on discrete diffusion models☆168Updated 7 months ago
- ☆112Updated last year
- Official PyTorch implementation for ICLR2025 paper "Scaling up Masked Diffusion Models on Text"☆364Updated last year
- The official github repo for "Diffusion Language Models are Super Data Learners".☆221Updated 3 months ago
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆246Updated 4 months ago
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch☆182Updated 7 months ago
- Spectral Sphere Optimizer☆94Updated 3 weeks ago
- A Gym for Agentic LLMs☆444Updated 2 weeks ago
- Code for "Reasoning to Learn from Latent Thoughts"☆124Updated 10 months ago
- [ICLR2025] Codebase for "ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing", built on Megatron-LM.☆105Updated last year
- Async pipelined version of Verl☆124Updated 10 months ago
- A scalable asynchronous reinforcement learning implementation with in-flight weight updates.☆361Updated this week
- [NeurIPS'24 Spotlight] Observational Scaling Laws☆58Updated last year
- ☆120Updated last week
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆186Updated 3 weeks ago
- Understand and test language model architectures on synthetic tasks.☆252Updated 3 weeks ago
- ☆203Updated 9 months ago
- ThetaEvolve: Test-time Learning on Open Problems, enabling RL training on AlphaEvolve/OpenEvolve and emphasizing scaling test-time comput…☆120Updated last month
- [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆362Updated 8 months ago
- Normalized Transformer (nGPT)☆198Updated last year
- [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"☆86Updated 11 months ago
- The HELMET Benchmark☆198Updated 2 months ago