facebookresearch / PhysicsLM4Links
Physics of Language Models, Part 4
☆232Updated 3 weeks ago
Alternatives and similar repositories for PhysicsLM4
Users that are interested in PhysicsLM4 are comparing it to the libraries listed below
Sorting:
- ☆80Updated 5 months ago
- The code for creating the iGSM datasets in papers "Physics of Language Models Part 2.1, Grade-School Math and the Hidden Reasoning Proces…☆74Updated 7 months ago
- 🔥 A minimal training framework for scaling FLA models☆228Updated last week
- Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch☆179Updated 2 months ago
- A brief and partial summary of RLHF algorithms.☆132Updated 5 months ago
- [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models☆122Updated last week
- ☆101Updated 10 months ago
- Code for "Reasoning to Learn from Latent Thoughts"☆115Updated 4 months ago
- 📖 This is a repository for organizing papers, codes, and other resources related to Latent Reasoning.☆192Updated last week
- Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"☆219Updated 5 months ago
- ☆85Updated 3 weeks ago
- [ICLR2025] Codebase for "ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing", built on Megatron-LM.☆87Updated 8 months ago
- Flash-Muon: An Efficient Implementation of Muon Optimizer☆160Updated 2 months ago
- Some preliminary explorations of Mamba's context scaling.☆216Updated last year
- ☆187Updated 4 months ago
- The evaluation framework for training-free sparse attention in LLMs☆90Updated 2 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆81Updated 9 months ago
- ☆98Updated 4 months ago
- Long Context Extension and Generalization in LLMs☆58Updated 11 months ago
- Implementation for FP8/INT8 Rollout for RL training without performence drop.☆124Updated this week
- [NeurIPS 2024] Can LLMs Learn by Teaching for Better Reasoning? A Preliminary Study☆53Updated 9 months ago
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆176Updated 5 months ago
- [ICLR2025] DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆276Updated 2 months ago
- ☆325Updated 3 weeks ago
- [ICLR 2025] Code for the paper "Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning"☆70Updated 6 months ago
- Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"☆95Updated last month
- AnchorAttention: Improved attention for LLMs long-context training☆212Updated 7 months ago
- A repo for open research on building large reasoning models☆90Updated this week
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆86Updated 10 months ago
- Simple and efficient pytorch-native transformer training and inference (batched)☆78Updated last year