Muon fsdp 2
☆55Aug 8, 2025Updated 8 months ago
Alternatives and similar repositories for muon_fsdp_2
Users that are interested in muon_fsdp_2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official pytorch code for "APP: Anytime Progressive Pruning" (DyNN @ ICML, 2022; CLL @ ACML, 2022, SNN @ ICML, 2022 and SlowDNN 2023)☆16Nov 22, 2022Updated 3 years ago
- LongAttn ：Selecting Long-context Training Data via Token-level Attention☆15Jul 16, 2025Updated 9 months ago
- Clustered Compositional Embeddings☆12Oct 25, 2023Updated 2 years ago
- Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"☆19Jun 11, 2025Updated 10 months ago
- ☆12Sep 16, 2024Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Stick-breaking attention☆63Jul 1, 2025Updated 9 months ago
- Measuring the Signal to Noise Ratio in Language Model Evaluation☆29Aug 19, 2025Updated 8 months ago
- Solidity contracts for the decentralized Prime Network protocol☆26Jul 6, 2025Updated 9 months ago
- ☆13Dec 12, 2025Updated 4 months ago
- Find context neurons in Pythia models.☆13Jun 13, 2023Updated 2 years ago
- Little article showing how to load pytorch's models with linear memory consumption☆34Aug 29, 2022Updated 3 years ago
- Asynchronous P2P communication backend for decentralized pipeline parallelism☆44Jun 9, 2025Updated 10 months ago
- ☆52Mar 9, 2026Updated last month
- Code for lin-RFM used for sparse recovery tasks☆16Mar 13, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 5 months ago
- 🔥 A minimal training framework for scaling FLA models☆374Nov 15, 2025Updated 5 months ago
- [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling☆40Dec 2, 2023Updated 2 years ago
- [ACL 2023 Findings] Emergent Modularity in Pre-trained Transformers☆26Jun 7, 2023Updated 2 years ago
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆29Feb 6, 2026Updated 2 months ago
- Research work aimed at addressing the problem of modeling infinite-length context☆48Dec 18, 2025Updated 4 months ago
- ☆23Oct 10, 2025Updated 6 months ago
- PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"☆37Oct 11, 2023Updated 2 years ago
- DeMo: Decoupled Momentum Optimization☆199Dec 2, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Spectral Sphere Optimizer☆114Mar 23, 2026Updated 3 weeks ago
- ☆64Apr 9, 2024Updated 2 years ago
- [ICLR 2024] Dynamic Sparse Training with Structured Sparsity☆22Apr 12, 2024Updated 2 years ago
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- ☆18Oct 15, 2020Updated 5 years ago
- Create string diagrams with LaTeX!☆14Jan 3, 2025Updated last year
- Dion optimizer algorithm☆465Apr 14, 2026Updated last week
- Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales☆32Jul 17, 2023Updated 2 years ago
- This repository contains the code for our CVPR 2022 paper on "Non-isotropy Regularization for Proxy-based Deep Metric Learning".☆15Mar 10, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Simple and scalable tools for data-driven pretraining data selection.☆29Jun 9, 2025Updated 10 months ago
- The repository contains code for Adaptive Data Optimization☆36Dec 9, 2024Updated last year
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated last year
- [CVPR2026 Highlight] Cubic Discrete Diffusion: Discrete Visual Generation on High-Dimensional Representation Tokens https://arxiv.org/abs…☆55Apr 10, 2026Updated last week
- The Compositionality article class.☆13Mar 16, 2026Updated last month
- ☆35Apr 12, 2024Updated 2 years ago
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆139Apr 8, 2026Updated last week