Muon fsdp 2
☆59Aug 8, 2025Updated 10 months ago
Alternatives and similar repositories for muon_fsdp_2
Users that are interested in muon_fsdp_2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official pytorch code for "APP: Anytime Progressive Pruning" (DyNN @ ICML, 2022; CLL @ ACML, 2022, SNN @ ICML, 2022 and SlowDNN 2023)☆16Nov 22, 2022Updated 3 years ago
- Fast Inference in Denoising Diffusion Models via MMD Finetuning☆19Dec 4, 2023Updated 2 years ago
- LongAttn ：Selecting Long-context Training Data via Token-level Attention☆15Jul 16, 2025Updated 10 months ago
- Clustered Compositional Embeddings☆13Oct 25, 2023Updated 2 years ago
- Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"☆19Jun 11, 2025Updated 11 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆12Sep 16, 2024Updated last year
- Stick-breaking attention☆63Jul 1, 2025Updated 11 months ago
- Solidity contracts for the decentralized Prime Network protocol☆26Jul 6, 2025Updated 11 months ago
- ☆13Dec 12, 2025Updated 5 months ago
- Dockerfile for johnsmith0031/alpaca_lora_4bit☆12Apr 10, 2023Updated 3 years ago
- Little article showing how to load pytorch's models with linear memory consumption☆33Aug 29, 2022Updated 3 years ago
- ☆52Mar 9, 2026Updated 3 months ago
- ☆11Mar 31, 2022Updated 4 years ago
- Code for lin-RFM used for sparse recovery tasks☆17Mar 13, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 6 months ago
- 🔥 A minimal training framework for scaling FLA models☆391Apr 22, 2026Updated last month
- [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling☆40Dec 2, 2023Updated 2 years ago
- [ACL 2023 Findings] Emergent Modularity in Pre-trained Transformers☆26Jun 7, 2023Updated 3 years ago
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆30Feb 6, 2026Updated 4 months ago
- Research work aimed at addressing the problem of modeling infinite-length context☆48Dec 18, 2025Updated 5 months ago
- ☆24Oct 10, 2025Updated 7 months ago
- DiffClass: Diffusion-Based Class Incremental Learning☆12Sep 26, 2024Updated last year
- DeMo: Decoupled Momentum Optimization☆201Dec 2, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Spectral Sphere Optimizer☆118Mar 23, 2026Updated 2 months ago
- oracle-structured minimization method☆13Sep 1, 2021Updated 4 years ago
- ☆64Apr 9, 2024Updated 2 years ago
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- Create string diagrams with LaTeX!☆14Jan 3, 2025Updated last year
- Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales☆32Jul 17, 2023Updated 2 years ago
- Compact and Agent-Native MoE Training System☆144Updated this week
- Simple and scalable tools for data-driven pretraining data selection.☆29Jun 9, 2025Updated 11 months ago
- The repository contains code for Adaptive Data Optimization☆36Dec 9, 2024Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- ☆20Jul 19, 2024Updated last year
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated last year
- ☆19Jul 24, 2025Updated 10 months ago
- [CVPR2026 Highlight] Cubic Discrete Diffusion: Discrete Visual Generation on High-Dimensional Representation Tokens https://arxiv.org/abs…☆55Apr 10, 2026Updated last month
- aigc evals☆10Dec 2, 2023Updated 2 years ago
- ☆35Apr 12, 2024Updated 2 years ago
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆142May 6, 2026Updated last month