Mixture of A Million Experts
☆56Jul 30, 2024Updated last year
Alternatives and similar repositories for PEER
Users that are interested in PEER are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14Dec 22, 2024Updated last year
- [NeurIPS'25] Towards Interpretability Without Sacrifice: Faithful Dense Layer Decomposition with Mixture of Decoders☆16May 28, 2025Updated last year
- BFloat16 Fused Adam Operator for PyTorch☆20Nov 16, 2024Updated last year
- ☆22Sep 3, 2024Updated last year
- The official implementation of HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization☆19Mar 7, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Hacks for PyTorch☆19Apr 18, 2023Updated 3 years ago
- Open-sourcing code associated with the AAAI-25 paper "On the Expressiveness and Length Generalization of Selective State-Space Models on …☆16Sep 18, 2025Updated 10 months ago
- ☆12Sep 8, 2025Updated 10 months ago
- Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆123Updated this week
- Unofficial Scalable-Softmax Is Superior for Attention☆21May 30, 2025Updated last year
- The code repository for "MINGLE: Mixture of Null-Space Gated Low-Rank Experts for Test-Time Continual Model Merging"(NeurIPS25) in PyTorc…☆15Jun 2, 2026Updated last month
- Multi-agent orchestration for OllamaJS. Includes TTS synthesis and speech recognition for simplified testing. Connected to telegram bot w…☆13Feb 13, 2025Updated last year
- Something like objdump☆16Jan 23, 2019Updated 7 years ago
- This repo contains the official implementation of ICCV 2025 paper "MoSiC: Optimal-Transport Motion Trajectory for Dense Self-Supervised L…☆22Sep 12, 2025Updated 10 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆14Jul 13, 2025Updated last year
- ☆16Jun 11, 2025Updated last year
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆30Feb 6, 2026Updated 5 months ago
- Code and dataset for NAACL 2022 paper "CoSIm: Commonsense Reasoning for Counterfactual Scene Imagination" Hyounghun Kim, Abhay Zala, Mohi…☆16Nov 26, 2022Updated 3 years ago
- Clustered Compositional Embeddings☆13Oct 25, 2023Updated 2 years ago
- codes and plots for "Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs"☆11Dec 30, 2024Updated last year
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆101Sep 30, 2024Updated last year
- ☆12Sep 16, 2024Updated last year
- Official PyTorch Implementation of the Longhorn Deep State Space Model☆57Dec 4, 2024Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- ☆14May 9, 2024Updated 2 years ago
- Xmixers: A collection of SOTA efficient token/channel mixers☆29Sep 4, 2025Updated 10 months ago
- Official implementation for "Let Offline RL Flow: Training Conservative Agents in the Latent Space of Normalizing Flows", NeurIPS 2022, O…☆12Jan 31, 2023Updated 3 years ago
- sigma-MoE layer☆21Jan 5, 2024Updated 2 years ago
- Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆175Jun 20, 2024Updated 2 years ago
- ☆16Jul 8, 2024Updated 2 years ago
- iADMM for a low-rank representation optimization problem☆13Feb 5, 2021Updated 5 years ago
- ☆10Jun 27, 2024Updated 2 years ago
- ☆20Oct 19, 2022Updated 3 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Code for experiments on transformers using Markovian data.☆22Nov 22, 2024Updated last year
- ☆12Jan 17, 2024Updated 2 years ago
- Official pytorch code for "APP: Anytime Progressive Pruning" (DyNN @ ICML, 2022; CLL @ ACML, 2022, SNN @ ICML, 2022 and SlowDNN 2023)☆16Nov 22, 2022Updated 3 years ago
- The implement of "COTSAE: CO-Training of Structure and Attribute Embeddings for Entity Alignment"☆14Nov 18, 2019Updated 6 years ago
- Find context neurons in Pythia models.☆13Jun 13, 2023Updated 3 years ago
- Audio Demo for "FastSVC: Fast Cross-Domain Singing Voice Conversion with Feature-wise Linear Modulation"☆21Apr 7, 2021Updated 5 years ago
- Code implementation for paper "On the Efficacy of Small Self-Supervised Contrastive Models without Distillation Signals".☆17Dec 15, 2021Updated 4 years ago