PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)
☆82Oct 5, 2023Updated 2 years ago
Alternatives and similar repositories for soft-mixture-of-experts
Users that are interested in soft-mixture-of-experts are comparing it to the libraries listed below
Sorting:
- Implementation of MixCE method described in ACL 2023 paper by Zhang et al.☆20May 29, 2023Updated 2 years ago
- Dynamic Neural Representational Decoders for High-Resolution Semantic Segmentation☆19Nov 28, 2022Updated 3 years ago
- GPT-J 6B inference on TensorRT with INT-8 precision☆11Apr 5, 2023Updated 2 years ago
- ☆707Dec 6, 2025Updated 3 months ago
- Preprocessing of datasets of chemical reactions: standardization, filtering, augmentation, tokenization, etc.☆16Sep 10, 2025Updated 6 months ago
- ☆13Jan 27, 2019Updated 7 years ago
- A collection of AWESOME things about mixture-of-experts☆1,269Dec 8, 2024Updated last year
- Map (deep learning) model weights between different model implementations.☆19Jan 30, 2025Updated last year
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆39Jun 11, 2025Updated 8 months ago
- Federated Learning - PyTorch☆15Jun 27, 2021Updated 4 years ago
- Unofficial Implementation of Selective Attention Transformer☆21Oct 31, 2024Updated last year
- Included the standard NMS, Rotate NMS，standard SoftNMS, Rotate SoftNMS, Weighted NMS, Rotate Weighted NMS, Weighted-Boxes-Fusion, Rotate …☆15Oct 11, 2021Updated 4 years ago
- ☆19Oct 31, 2022Updated 3 years ago
- this code shows the train and test of a YOLOV5 convolutional neural network for detection of electronics components☆26Nov 21, 2024Updated last year
- ☆26May 30, 2023Updated 2 years ago
- Federated learning using a mixture of experts☆17Feb 16, 2021Updated 5 years ago
- ☆20Apr 22, 2021Updated 4 years ago
- ☆23Aug 2, 2024Updated last year
- Neuron Activation☆26Nov 21, 2024Updated last year
- [ICRA'25] DoorBot: Closed-Loop Task Planning and Manipulation for Door Opening in the Wild with Haptic Feedback☆38Oct 21, 2025Updated 4 months ago
- RT-DETR family algorithms implemented based on MMDetection, including RT-DETR, RT-DETRv2, RT-DETRv4, DFINE, DEIM and DEIMv2.☆41Feb 1, 2026Updated last month
- ☆29May 4, 2024Updated last year
- UWSOD: Toward Fully-Supervised-Level Capacity Weakly Supervised Object Detection☆23Mar 30, 2021Updated 4 years ago
- A simple but robust PyTorch implementation of RetNet from "Retentive Network: A Successor to Transformer for Large Language Models" (http…☆106Nov 24, 2023Updated 2 years ago
- PyTorch implementation of soft-nms☆31Nov 24, 2025Updated 3 months ago
- ASCEND Chinese-English code-switching dataset☆30Jul 12, 2022Updated 3 years ago
- FUSION is an open-source project aimed at revolutionizing networking through the simulation of advanced SD-EONs and AI-enhanced networks,…☆13Mar 3, 2026Updated last week
- [ACL 2023] Code for ContraCLM: Contrastive Learning For Causal Language Model☆35Dec 20, 2023Updated 2 years ago
- Methods and evaluation for aligning language models temporally☆30Mar 2, 2024Updated 2 years ago
- Learning generative models with Sinkhorn Loss☆30Nov 9, 2018Updated 7 years ago
- A curated reading list of research in Mixture-of-Experts(MoE).☆661Oct 30, 2024Updated last year
- PyTorch Re-Implementation of "The Sparsely-Gated Mixture-of-Experts Layer" by Noam Shazeer et al. https://arxiv.org/abs/1701.06538☆1,232Apr 19, 2024Updated last year
- [ICLR 2025] DeFT: Decoding with Flash Tree-attention for Efficient Tree-structured LLM Inference☆49Jun 17, 2025Updated 8 months ago
- ☆13Jan 8, 2024Updated 2 years ago
- This project showcases engaging interactions between two AI chatbots.☆10Jan 10, 2024Updated 2 years ago
- ☆31Nov 15, 2022Updated 3 years ago
- Transport means detection using image detection by Yolo. It can count free parking places and transport means in the parking area☆10Oct 6, 2021Updated 4 years ago
- Artifact code release for paper "Uniform-Cost Multi-Path Routing for Reconfigurable Data Center Networks"☆12Sep 5, 2024Updated last year
- Kinematic and dynamic models of continuum and articulated soft robots.☆15Nov 22, 2025Updated 3 months ago