Muon fsdp 2
☆55Aug 8, 2025Updated 7 months ago
Alternatives and similar repositories for muon_fsdp_2
Users that are interested in muon_fsdp_2 are comparing it to the libraries listed below
Sorting:
- LongAttn ：Selecting Long-context Training Data via Token-level Attention☆15Jul 16, 2025Updated 7 months ago
- ☆13Dec 12, 2025Updated 2 months ago
- Stick-breaking attention☆62Jul 1, 2025Updated 8 months ago
- Measuring the Signal to Noise Ratio in Language Model Evaluation☆28Aug 19, 2025Updated 6 months ago
- Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"☆19Jun 11, 2025Updated 8 months ago
- ☆50Aug 21, 2025Updated 6 months ago
- ☆20Oct 10, 2025Updated 4 months ago
- Research work aimed at addressing the problem of modeling infinite-length context☆47Dec 18, 2025Updated 2 months ago
- Spectral Sphere Optimizer☆104Jan 14, 2026Updated last month
- Product Quantization k-Nearest Neighbors☆21Jun 24, 2021Updated 4 years ago
- Simple and scalable tools for data-driven pretraining data selection.☆29Jun 9, 2025Updated 9 months ago
- [ACL 2023 Findings] Emergent Modularity in Pre-trained Transformers☆26Jun 7, 2023Updated 2 years ago
- 🔥 A minimal training framework for scaling FLA models☆353Nov 15, 2025Updated 3 months ago
- Fast sparse deep learning on CPUs☆56Sep 28, 2022Updated 3 years ago
- The repository contains code for Adaptive Data Optimization☆32Dec 9, 2024Updated last year
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆29Feb 6, 2026Updated last month
- CUDA project for uni subject☆26Oct 26, 2020Updated 5 years ago
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- DeMo: Decoupled Momentum Optimization☆198Dec 2, 2024Updated last year
- Gemstones: A Model Suite for Multi-Faceted Scaling Laws (NeurIPS 2025)☆33Sep 28, 2025Updated 5 months ago
- Official pytorch implementation of "AlphaFlow: Understanding and Improving MeanFlow Models"☆103Oct 24, 2025Updated 4 months ago
- ☆64Apr 9, 2024Updated last year
- PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"☆37Oct 11, 2023Updated 2 years ago
- Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales☆32Jul 17, 2023Updated 2 years ago
- Official implementation for DenseMixer: Improving MoE Post-Training with Precise Router Gradient☆66Aug 3, 2025Updated 7 months ago
- [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling☆40Dec 2, 2023Updated 2 years ago
- A GPU-based LZSS compression algorithm, highly tuned for NVIDIA GPGPUs and for streaming data, leveraging the respective strengths of CPU…☆38Dec 10, 2015Updated 10 years ago
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆133Feb 21, 2026Updated 2 weeks ago
- Kinematic and dynamic models of continuum and articulated soft robots.☆15Nov 22, 2025Updated 3 months ago
- ☆11Apr 17, 2021Updated 4 years ago
- Reinforcement learning modular with pytorch☆11Jan 18, 2021Updated 5 years ago
- [NeurIPS 2025 Spotlight] Co-Evolving LLM Coder and Unit Tester via Reinforcement Learning☆152Sep 19, 2025Updated 5 months ago
- ☆55Feb 24, 2026Updated last week
- ✨ A synthetic dataset generation framework that produces diverse coding questions and verifiable solutions - all in one framwork☆312Sep 6, 2025Updated 6 months ago
- Debiasing Through Data Attribution☆12May 23, 2024Updated last year
- ☆14Apr 14, 2025Updated 10 months ago
- Create string diagrams with LaTeX!☆14Jan 3, 2025Updated last year
- A virtual musical instrument built using Google MediaPipe.☆12Oct 10, 2022Updated 3 years ago
- An artificial matrix generator in C☆12Feb 16, 2023Updated 3 years ago