Sparse Backpropagation for Mixture-of-Expert Training
☆30Jul 2, 2024Updated 2 years ago
Alternatives and similar repositories for SparseMixer
Users that are interested in SparseMixer are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official Implementation of "RTop-K: Ultra-Fast Row-Wise Top-K Selection for Neural Network Acceleration on GPUs"☆30Jul 23, 2025Updated last year
- Beyond Straight-Through☆111Apr 29, 2023Updated 3 years ago
- A Vector Caching Scheme for Streaming FPGA SpMV Accelerators☆10Sep 7, 2015Updated 11 years ago
- [ACL 2023 Findings] Emergent Modularity in Pre-trained Transformers☆26Jun 7, 2023Updated 3 years ago
- ☆17May 19, 2026Updated 5 months ago
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- ☆16Sep 4, 2025Updated last year
- The open-source Mixture of Depths code and the official implementation of the paper "Router-Tuning: A Simple and Effective Approach for E…☆34Oct 2, 2026Updated 3 weeks ago
- ☆13Oct 13, 2025Updated last year
- Official implementation of Vector-ICL: In-context Learning with Continuous Vector Representations (ICLR 2025)☆25Jun 2, 2025Updated last year
- Mamba support for transformer lens☆20Sep 17, 2024Updated 2 years ago
- ☆20Mar 25, 2025Updated last year
- Mirror of Plan 9 4th Edition from p9f☆14Mar 23, 2021Updated 5 years ago
- High-performance RDMA for Python and PyTorch (ibverbs, efa, NVMe-oF)☆14Sep 2, 2026Updated last month
- ☆21May 5, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Triton-based implementation of Sparse Mixture of Experts.☆281Oct 3, 2025Updated last year
- Official PyTorch Implementation for Paper "No More Adam: Learning Rate Scaling at Initialization is All You Need"☆54Jan 27, 2025Updated last year
- The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":☆49Oct 2, 2026Updated 3 weeks ago
- ☆12Apr 27, 2013Updated 13 years ago
- ☆20Nov 5, 2024Updated last year
- [ICML 2024] Code for the paper "MoE-RBench: Towards Building Reliable Language Models with Sparse Mixture-of-Experts"☆11Jul 1, 2024Updated 2 years ago
- kubernetes client to☆11May 27, 2022Updated 4 years ago
- VSS: A Storage System for Video Analytics☆13Jul 9, 2021Updated 5 years ago
- An FPGA integration and acceleration of the popular FAISS framework for approximate similarity search☆25Jul 20, 2019Updated 7 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- [COLM'25] A Controlled Study on Long Context Extension and Generalization in LLMs☆65Mar 9, 2026Updated 7 months ago
- ☆21Apr 16, 2025Updated last year
- [EMNLP 2024] Multi-modal reasoning problems via code generation.☆28Apr 14, 2026Updated 6 months ago
- Minimal codebase for efficiently training Natural Language Autoencoders (NLAs). Built on Celeste's nanoNLA: https://github.com/ceselder/n…☆14Jul 10, 2026Updated 3 months ago
- Codes for "Visual Prompting Upgrades Neural Network Sparsification: A Data-Model Perspective" (AAAI 2025)☆12Dec 5, 2023Updated 2 years ago
- The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".☆32Nov 12, 2024Updated last year
- Code for "Fine-Tuning by Curriculum Learning for Non-Autoregressive Neural Machine Translation"☆13Jul 10, 2020Updated 6 years ago
- [ICLR 2025] Monet: Mixture of Monosemantic Experts for Transformers☆79Jun 23, 2025Updated last year
- Open-Pandora: On-the-fly Control Video Generation☆35Nov 28, 2024Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆22Apr 17, 2025Updated last year
- ☆39Jul 25, 2024Updated 2 years ago
- ☆12Aug 26, 2025Updated last year
- The official repo of our research work "Interactive Editing for Text Summarization".☆23Jun 3, 2023Updated 3 years ago
- ☆21Dec 14, 2024Updated last year
- ☆146Jul 21, 2024Updated 2 years ago
- ☆13Apr 3, 2024Updated 2 years ago