some mixture of experts architecture implementations
☆27Mar 22, 2024Updated 2 years ago
Alternatives and similar repositories for MoE
Users that are interested in MoE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15Apr 26, 2022Updated 4 years ago
- nanoGPT-like codebase for LLM training☆117Nov 7, 2025Updated 6 months ago
- Optimize GEMM with tensorcore step by step☆37Dec 17, 2023Updated 2 years ago
- ☆19Apr 16, 2025Updated last year
- a fast implementation of BM25☆10Sep 15, 2022Updated 3 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- ☆25Apr 23, 2026Updated 2 weeks ago
- Official code for Class Tokens Infusion for Weakly Supervised Semantic Segmentation, CVPR2024☆23Oct 26, 2024Updated last year
- ☆16May 14, 2025Updated 11 months ago
- [ICLRW'26] EoRA: Fine-tuning-free Compensation for Compressed LLM with Eigenspace Low-Rank Approximation☆41Apr 21, 2026Updated 2 weeks ago
- An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspace☆19Oct 21, 2024Updated last year
- Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [ICLR 2025]☆29Feb 20, 2026Updated 2 months ago
- Solidity library for implementing Rain compatible interpreters.☆15Apr 28, 2026Updated last week
- ☆65Updated this week
- A Rust library for creating solvers in the OP Stack's dispute protocol☆19Jan 15, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Qwen3-0.6B megakernel: 527 tok/s decode on RTX 3090 (3.8x faster than PyTorch)☆98Feb 10, 2026Updated 2 months ago
- Slides and other materials for club meetings☆17Jun 26, 2022Updated 3 years ago
- Dynamic Telegram Trading Bot☆20Feb 21, 2025Updated last year
- General Matrix Multiplication using NVIDIA Tensor Cores☆28Jan 25, 2025Updated last year
- Manifold-Mixup implementation for fastai V1☆19Oct 1, 2020Updated 5 years ago
- Adversarial Erasing Framework via Triplet with Gated Pyramid Pooling Layer for Weakly Supervised Semantic Segmentation, ECCV2022☆31Jul 8, 2024Updated last year
- GitHub Action to automatically format Rust code and fix clippy lints.☆27Nov 24, 2025Updated 5 months ago
- Minimal implementation of the Self-Play Fine-Tuning Converts Weak Language Models to Strong Language Models paper (ArXiv 20232401.01335)☆29Mar 1, 2024Updated 2 years ago
- A collection of different ways to implement accessing and modifying internal model activations for LLMs☆24Oct 18, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Compression schema for gradients of activations in backward pass☆45Jul 26, 2023Updated 2 years ago
- ☆17Dec 11, 2022Updated 3 years ago
- Deep Learning CNN using FastAI for the Stanford MRNet Knee MRI diagnosis challenge☆16May 18, 2019Updated 6 years ago
- PyTorch implementation of "MLP-Mixer: An all-MLP Architecture for Vision" Tolstikhin et al. (2021)☆31May 13, 2021Updated 4 years ago
- Anima Machina☆39Updated this week
- ☆25Mar 15, 2023Updated 3 years ago
- Official repository of "Event-guided Deblurring of Unknown Exposure Time Videos" ECCV 2022 paper(Oral).☆40Nov 29, 2022Updated 3 years ago
- Subscriptions using Porto.☆27Jul 5, 2025Updated 10 months ago
- Towards Understanding the Mixture-of-Experts Layer in Deep Learning☆35Dec 12, 2023Updated 2 years ago
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Compress input tokens, save time and money☆60Mar 7, 2026Updated 2 months ago
- Pytorch implementation of "Oscillation-Reduced MXFP4 Training for Vision Transformers" on DeiT Model Pre-training☆39Jun 20, 2025Updated 10 months ago
- [NeurIPS 2024] The official implementation of "Kangaroo: Lossless Self-Speculative Decoding for Accelerating LLMs via Double Early Exitin…☆68Jun 26, 2024Updated last year
- [ICLR 2025] SWIFT: On-the-Fly Self-Speculative Decoding for LLM Inference Acceleration☆66Feb 21, 2025Updated last year
- [🧠] Platform is a Bittensor subnet built to advance collaborative AI research through multiple simultaneous challenges powered by sub-su…☆160Apr 27, 2026Updated last week
- A playground for Uniswap v4 hooks☆30Sep 28, 2023Updated 2 years ago
- The official repo of continuous speculative decoding☆34Mar 28, 2025Updated last year