Muon fsdp 2
☆56Aug 8, 2025Updated 9 months ago
Alternatives and similar repositories for muon_fsdp_2
Users that are interested in muon_fsdp_2 are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official pytorch code for "APP: Anytime Progressive Pruning" (DyNN @ ICML, 2022; CLL @ ACML, 2022, SNN @ ICML, 2022 and SlowDNN 2023)☆16Nov 22, 2022Updated 3 years ago
- LongAttn ：Selecting Long-context Training Data via Token-level Attention☆15Jul 16, 2025Updated 10 months ago
- Clustered Compositional Embeddings☆13Oct 25, 2023Updated 2 years ago
- Codebase the paper "The Remarkable Robustness of LLMs: Stages of Inference?"☆19Jun 11, 2025Updated 11 months ago
- Measuring the Signal to Noise Ratio in Language Model Evaluation☆29Aug 19, 2025Updated 9 months ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Solidity contracts for the decentralized Prime Network protocol☆26Jul 6, 2025Updated 10 months ago
- ☆13Dec 12, 2025Updated 5 months ago
- Find context neurons in Pythia models.☆13Jun 13, 2023Updated 2 years ago
- Little article showing how to load pytorch's models with linear memory consumption☆33Aug 29, 2022Updated 3 years ago
- ☆52Mar 9, 2026Updated 2 months ago
- All-in-one benchmarking platform for evaluating LLM.☆15Nov 12, 2025Updated 6 months ago
- 🔥 A minimal training framework for scaling FLA models☆389Apr 22, 2026Updated 3 weeks ago
- [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling☆40Dec 2, 2023Updated 2 years ago
- [ACL 2023 Findings] Emergent Modularity in Pre-trained Transformers☆26Jun 7, 2023Updated 2 years ago
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆30Feb 6, 2026Updated 3 months ago
- Research work aimed at addressing the problem of modeling infinite-length context☆48Dec 18, 2025Updated 5 months ago
- PyTorch codes for the paper "An Empirical Study of Multimodal Model Merging"☆37Oct 11, 2023Updated 2 years ago
- DeMo: Decoupled Momentum Optimization☆201Dec 2, 2024Updated last year
- Spectral Sphere Optimizer☆116Mar 23, 2026Updated last month
- ☆64Apr 9, 2024Updated 2 years ago
- [ICLR 2024] Dynamic Sparse Training with Structured Sparsity☆24Apr 12, 2024Updated 2 years ago
- PostgreSQL extension for working with AcoustID fingerprints☆13Nov 13, 2022Updated 3 years ago
- FlexAttention w/ FlashAttention3 Support☆27Oct 5, 2024Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- ☆18Oct 15, 2020Updated 5 years ago
- Manage ML configuration with pydantic☆16Mar 18, 2026Updated 2 months ago
- Create string diagrams with LaTeX!☆14Jan 3, 2025Updated last year
- Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales☆32Jul 17, 2023Updated 2 years ago
- The repository contains code for Adaptive Data Optimization☆36Dec 9, 2024Updated last year
- ☆20Jul 19, 2024Updated last year
- Code to reproduce key results accompanying "SAEs (usually) Transfer Between Base and Chat Models"☆13Jul 18, 2024Updated last year
- ☆19Jul 24, 2025Updated 9 months ago
- [CVPR2026 Highlight] Cubic Discrete Diffusion: Discrete Visual Generation on High-Dimensional Representation Tokens https://arxiv.org/abs…☆54Apr 10, 2026Updated last month
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- ☆35Apr 12, 2024Updated 2 years ago
- The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…☆142May 6, 2026Updated last week
- An annotated implementation of the Hyena Hierarchy paper☆34May 28, 2023Updated 2 years ago
- A repository with some Deep Reinforcement Learning baselines written in julia using Flux.☆12Mar 28, 2023Updated 3 years ago
- 在监控画质下实现对校园自行车的重识别，包含REID模型识别，向量数据库检索，UI展示☆11Feb 13, 2024Updated 2 years ago
- Gemstones: A Model Suite for Multi-Faceted Scaling Laws (NeurIPS 2025)☆34Sep 28, 2025Updated 7 months ago
- Repository for paper Decrypting Cryptic Crosswords☆11Jan 15, 2022Updated 4 years ago