PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
☆83Oct 5, 2023Updated 3 years ago
Alternatives and similar repositories for soft-mixture-of-experts
Users that are interested in soft-mixture-of-experts are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch☆390Jun 17, 2024Updated 2 years ago
- Federated learning using a mixture of experts☆17Feb 16, 2021Updated 5 years ago
- A collection of AWESOME things about mixture-of-experts☆1,287Dec 8, 2024Updated last year
- GMoE could be the next backbone model for many kinds of generalization task.☆274Mar 21, 2023Updated 3 years ago
- ☆728Oct 28, 2026Updated last week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Implementation of MixCE method described in ACL 2023 paper by Zhang et al.☆20May 29, 2023Updated 3 years ago
- Unofficial Implementation of Selective Attention Transformer☆20Oct 31, 2024Updated 2 years ago
- PyTorch implementation of BYOL: a fantastically simple method for self-supervised image representation learning with SOTA performance.☆11Mar 24, 2021Updated 5 years ago
- Federated Learning - PyTorch☆15Jun 27, 2021Updated 5 years ago
- RAG application to answer questions about PDF documents using LLMs.☆16Dec 1, 2023Updated 2 years ago
- Towards Understanding the Mixture-of-Experts Layer in Deep Learning☆37Dec 12, 2023Updated 2 years ago
- YOLO v8과 SAM (Sagment Anything Model)을 결합한 해충 (pest) detection model☆13Apr 28, 2024Updated 2 years ago
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆39Jun 11, 2025Updated last year
- ☆10Oct 27, 2022Updated 4 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- List of papers on Hallucination in LMM☆10Nov 29, 2023Updated 2 years ago
- ☆13Jan 27, 2019Updated 7 years ago
- An easy-to-use library for GLU (Gated Linear Units) and GLU variants in TensorFlow.☆20Feb 22, 2023Updated 3 years ago
- Experiments to assess SPADE on different LLM pipelines.☆18Apr 7, 2024Updated 2 years ago
- Provably (and non-vacuously) bounding test error of deep neural networks under distribution shift with unlabeled test data.☆10Feb 27, 2024Updated 2 years ago
- a fast implementation of BM25☆10Sep 15, 2022Updated 4 years ago
- [CVPR 2024] Edge-Aware 3D Instance Segmentation Network with Intelligent Semantic Prior☆10Oct 5, 2026Updated last month
- A fast MoE impl for PyTorch☆1,859Feb 10, 2025Updated last year
- MLO group setup for kubernetes cluster☆13Oct 14, 2020Updated 6 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Supervised Training of Conditional Monge Maps☆20Oct 30, 2023Updated 3 years ago
- Implementation of "Towards Understanding Mixture of Experts in Deep Learning", NeurIPS 2022☆10Jan 6, 2023Updated 3 years ago
- Based on https://github.com/Project-MONAI/research-contributions/tree/main/SwinUNETR/Pretrain☆10Apr 24, 2023Updated 3 years ago
- An Integrated Research Suite for Building Open-Ended Embodied Agents in Crafter☆15Updated this week
- [MICCAI 2024] Swin SMT: Global Sequential Modeling for Enhancing 3D Medical Image Segmentation☆29Oct 10, 2024Updated 2 years ago
- Reimplementation of https://github.com/montemac/algebraic_value_editing in pure PyTorch for efficiency on large models☆11Jun 28, 2023Updated 3 years ago
- ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training (EMNLP 2024)☆1,005Dec 6, 2024Updated last year
- UWSOD: Toward Fully-Supervised-Level Capacity Weakly Supervised Object Detection☆23Mar 30, 2021Updated 5 years ago
- ☆14Updated this week
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Triton-based implementation of Sparse Mixture of Experts.☆281Oct 3, 2025Updated last year
- "Tail-Aware Sperm Analysis for Transparent Tracking of Spermatozoa" Official Implementation☆10Jan 21, 2026Updated 9 months ago
- ☆11Jun 16, 2026Updated 4 months ago
- optimize neuro-centric parameters instead of weights to solve RL tasks☆14Oct 2, 2023Updated 3 years ago
- [IEEE TNSRE] Mixture of Experts for EEG-Based Seizure Subtype Classification☆11Aug 20, 2024Updated 2 years ago
- A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (http…☆105Nov 24, 2023Updated 2 years ago
- This is the official Pytorch implementation for "Boosting Semi-Supervised Face Recognition with Noise Robustness"☆11Jul 22, 2021Updated 5 years ago