A curated reading list of research in Adaptive Computation, Inference-Time Computation & Mixture of Experts (MoE).
☆164Jan 1, 2025Updated last year
Alternatives and similar repositories for awesome-adaptive-computation
Users that are interested in awesome-adaptive-computation are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆21Aug 27, 2023Updated 3 years ago
- A collection of AWESOME things about mixture-of-experts☆1,287Dec 8, 2024Updated last year
- Mixture of Expert (MoE) techniques for enhancing LLM performance through expert-driven prompt mapping and adapter combinations.☆11Feb 11, 2024Updated 2 years ago
- Implementation for our paper "How Far Can Transformers Reason? The Locality Barrier and Inductive Scratchpad"☆12Jun 11, 2024Updated 2 years ago
- Aioli: A unified optimization framework for language model data mixing☆34Jan 17, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Block Transformer: Global-to-Local Language Modeling for Fast Inference (NeurIPS 2024)☆166Apr 13, 2025Updated last year
- https://nnsmith-asplos.rtfd.io Artifact of "NNSmith: Generating Diverse and Valid Test Cases for Deep Learning Compilers" ASPLOS'23☆11Mar 29, 2023Updated 3 years ago
- [ICLR 2025] Dynamic Mixture of Experts: An Auto-Tuning Approach for Efficient Transformer Models☆165Jul 9, 2025Updated last year
- batched loras☆352Sep 6, 2023Updated 3 years ago
- Problem solving by engaging multiple AI agents in conversation with each other and the user.☆12Jul 27, 2023Updated 3 years ago
- A library for squeakily cleaning and filtering language datasets.☆50Jul 10, 2023Updated 3 years ago
- A family of open-sourced Mixture-of-Experts (MoE) Large Language Models☆1,703Mar 8, 2024Updated 2 years ago
- CRAI is a multimodal large language model based on the Mixture of Experts (MoE) architecture, supporting text and image cross-modal tasks…☆16Apr 29, 2025Updated last year
- Provably (and non-vacuously) bounding test error of deep neural networks under distribution shift with unlabeled test data.☆10Feb 27, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- A curated list for Efficient Large Language Models☆11Mar 25, 2024Updated 2 years ago
- [ICML 2025] Code for "R2-T2: Re-Routing in Test-Time for Multimodal Mixture-of-Experts"☆19Mar 10, 2025Updated last year
- Unofficial implementation for the paper "Mixture-of-Depths: Dynamically allocating compute in transformer-based language models"☆176Jun 20, 2024Updated 2 years ago
- Tutel MoE: Optimized Mixture-of-Experts Library, Support GLM/Kimi/Gpt/DeepSeek/Qwen using FP8/NVFP4/MXFP4☆1,028Updated this week
- Attribution-based Parameter Decomposition☆35Jun 11, 2025Updated last year
- [ACL 2023 Findings] Emergent Modularity in Pre-trained Transformers☆26Jun 7, 2023Updated 3 years ago
- AutoMoE: Neural Architecture Search for Efficient Sparsely Activated Transformers☆48Oct 21, 2022Updated 4 years ago
- Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)☆12Dec 27, 2021Updated 4 years ago
- Triton-based implementation of Sparse Mixture of Experts.☆281Oct 3, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Official PyTorch Implementation of EMoE: Unlocking Emergent Modularity in Large Language Models [main conference @ NAACL2024]☆41May 28, 2024Updated 2 years ago
- A tiny easily hackable implementation of a feature dashboard.☆18Oct 21, 2025Updated last year
- HydraNet is a state-of-the-art transformer architecture that combines Multi-Query Attention (MQA), Mixture of Experts (MoE), and continuo…☆14Updated this week
- Understand and test language model architectures on synthetic tasks.☆291Mar 22, 2026Updated 7 months ago
- ☆17May 19, 2026Updated 5 months ago
- [ACL 2026] G2RPO-A: Guided Group Relative Policy Optimization with Adaptive Guidance☆16Sep 15, 2026Updated last month
- ☆79Apr 29, 2024Updated 2 years ago
- A bibliography and survey of the papers surrounding o1☆1,214Jul 7, 2026Updated 4 months ago
- GPU operators for sparse tensor operations☆37Mar 11, 2024Updated 2 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A curated list of early exiting (LLM, CV, NLP, etc)☆74Aug 21, 2024Updated 2 years ago
- A curated reading list of research in Mixture-of-Experts(MoE).☆672Oct 30, 2024Updated 2 years ago
- ☆279Oct 31, 2023Updated 3 years ago
- [TMLR 2026] LibMoE: A LIBRARY FOR COMPREHENSIVE BENCHMARKING MIXTURE OF EXPERTS IN LARGE LANGUAGE MODELS☆52May 26, 2026Updated 5 months ago
- ☆21Oct 15, 2022Updated 4 years ago
- ☆146Jul 21, 2024Updated 2 years ago
- QLoRA with Enhanced Multi GPU Support☆38Aug 8, 2023Updated 3 years ago