Mixture of A Million Experts
☆56Jul 30, 2024Updated last year
Alternatives and similar repositories for PEER
Users that are interested in PEER are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆137Nov 1, 2025Updated 8 months ago
- ☆13Dec 22, 2024Updated last year
- Official implementation of the paper: "NeoBabel: A Multilingual Open Tower for Visual Generation"☆24Aug 4, 2025Updated 11 months ago
- ☆22Sep 3, 2024Updated last year
- Hacks for PyTorch☆19Apr 18, 2023Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- BFloat16 Fused Adam Operator for PyTorch☆20Nov 16, 2024Updated last year
- ☆11Sep 8, 2025Updated 10 months ago
- PyTorch Implementation of the paper "Probabilistic Abduction for Visual Abstract Reasoning via Learning Rules in Vector-symbolic Architec…☆10Sep 18, 2025Updated 9 months ago
- Implementation of the paper: "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆122Jun 22, 2026Updated 2 weeks ago
- [ICML 2026] Elastic Diffusion Transformer: Accelerating SOTA generation models (e.g., Qwen-Image, Hunyuan3d ) through adaptive computatio…☆45May 1, 2026Updated 2 months ago
- code for the paper, "flexible multitask computation in recurrent networks utilizes shared dynamical motifs"☆13Mar 2, 2025Updated last year
- Experiments on the impact of depth in transformers and SSMs.☆41Oct 23, 2025Updated 8 months ago
- ☆16May 16, 2023Updated 3 years ago
- GAME was designed for the functional genomics community to create seamless communication across pre-trained models and genomics datasets.…☆21Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- [AAAI 2024] History Matters: Temporal Knowledge Editing in Large Language Model☆13Dec 17, 2023Updated 2 years ago
- The official implementation of HybridNorm: Towards Stable and Efficient Transformer Training via Hybrid Normalization☆19Mar 7, 2025Updated last year
- [EMNLP 2025] Circuit-Aware Editing Enables Generalizable Knowledge Learners☆19Nov 17, 2025Updated 7 months ago
- ☆14Jul 13, 2025Updated 11 months ago
- Official Pytorch implementation of Chromatic Graph Transformers☆10Jun 14, 2023Updated 3 years ago
- ☆20Jun 23, 2025Updated last year
- Clustered Compositional Embeddings☆13Oct 25, 2023Updated 2 years ago
- Ἀνατομή is a PyTorch library to analyze representation of neural networks☆13Jan 31, 2024Updated 2 years ago
- codes and plots for "Active-Dormant Attention Heads: Mechanistically Demystifying Extreme-Token Phenomena in LLMs"☆11Dec 30, 2024Updated last year
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Don't just regulate gradients like in Muon, regulate the weights too☆32Jul 30, 2025Updated 11 months ago
- Experimental GPU language with meta-programming☆31Sep 6, 2024Updated last year
- A Zen approach to configuring your Python project☆17Feb 27, 2026Updated 4 months ago
- ☆12Sep 16, 2024Updated last year
- Multi-Layer Sparse Autoencoders (ICLR 2025)☆30Feb 6, 2026Updated 5 months ago
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆101Sep 30, 2024Updated last year
- Official PyTorch Implementation of the Longhorn Deep State Space Model☆57Dec 4, 2024Updated last year
- Low memory full parameter finetuning of LLMs☆54Jul 18, 2025Updated 11 months ago
- Official implementation for "Let Offline RL Flow: Training Conservative Agents in the Latent Space of Normalizing Flows", NeurIPS 2022, O…☆12Jan 31, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- ☆14May 9, 2024Updated 2 years ago
- Unofficial Scalable-Softmax Is Superior for Attention☆21May 30, 2025Updated last year
- ☆28Oct 2, 2025Updated 9 months ago
- "Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiw…☆34May 7, 2024Updated 2 years ago
- Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆175Jun 20, 2024Updated 2 years ago
- ☆10Jun 27, 2024Updated 2 years ago
- ☆16Jul 8, 2024Updated 2 years ago