[ICML 2025 Oral] Mixture of Lookup Experts
☆82Dec 3, 2025Updated 11 months ago
Alternatives and similar repositories for MoLE
Users that are interested in MoLE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Solving Token Gradient Conflict in Mixture-of-Experts for Large Vision-Language Model☆13Feb 11, 2025Updated last year
- [ASPLOS'26] HILOS: A Cost-Effective Near-Storage Processing Solution for Offline Inference of Long-Context LLMs☆22Jan 18, 2026Updated 9 months ago
- An implementation is provided here for the NeurIPS2024 paper "MemoryFormer : Minimize Transformer Computation by Removing Fully-Connected…☆16Mar 24, 2026Updated 7 months ago
- [ICLR 2025] Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization☆26Oct 5, 2025Updated last year
- The code of 《M4: Multi-Proxy Multi-Gate Mixture of Experts Network for Multiple Instance Learning in Histopathology Image Analysis》☆14Mar 31, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- TeLLMe: An Efficient End-to-End Ternary LLM Prefill and Decode Accelerator with Table-Lookup Matmul on Edge FPGAs [FPGA2026]☆40Mar 11, 2026Updated 7 months ago
- PyTorch implementation of the paper "Does a Neural Network Really Encode Symbolic Concept?" (ICML 2023)☆10Aug 19, 2024Updated 2 years ago
- [ACL 2026 Main] Official Repo for Paper "Which Reasoning Trajectories Teach Students to Reason Better? A Simple Metric of Informative Ali…☆17Jul 1, 2026Updated 4 months ago
- ☆16Jun 5, 2023Updated 3 years ago
- ☆16Jun 5, 2023Updated 3 years ago
- ☆11Jun 19, 2025Updated last year
- Archive for AI grand challenge☆20Jun 6, 2023Updated 3 years ago
- ☆16Jun 5, 2023Updated 3 years ago
- [ICML 2024] Memory-Space Visual Prompting for Efficient Vision-Language Fine-Tuning☆49May 12, 2024Updated 2 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated☆36Aug 14, 2024Updated 2 years ago
- This is the repository for the work "DegVoC: Rethinking Neural Vocoder from a Degradation Perspective", which is accepted at AAAI 2026.☆13Apr 29, 2026Updated 6 months ago
- HydraNet is a state-of-the-art transformer architecture that combines Multi-Query Attention (MQA), Mixture of Experts (MoE), and continuo…☆14Updated this week
- [ICLR 2025, IEEE TPAMI 2026] Mixture Compressor & MC#☆79Feb 12, 2025Updated last year
- ☆22Dec 11, 2024Updated last year
- ☆16Sep 29, 2026Updated last month
- [ICML 2022] "Linearity Grafting: Relaxed Neuron Pruning Helps Certifiable Robustness" by Tianlong Chen*, Huan Zhang*, Zhenyu Zhang, Shiyu…☆16Jun 22, 2022Updated 4 years ago
- Repository for the COLM 2025 paper SpecDec++: Boosting Speculative Decoding via Adaptive Candidate Lengths☆19Jul 10, 2025Updated last year
- ☆47Sep 27, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Chain of Experts (CoE) enables communication between experts within Mixture-of-Experts (MoE) models☆233Nov 4, 2025Updated last year
- 把 On-Policy Distillation 接到 DSpark。☆19Jun 28, 2026Updated 4 months ago
- A benchmark for evaluating realistic preference-following in personalized user-LLM interactions.☆12Mar 13, 2026Updated 7 months ago
- Official PyTorch Implementation of Federated Learning with Positive and Unlabeled Data☆10Aug 12, 2022Updated 4 years ago
- Joint image and Depth inpainting, ldm3d☆16Apr 28, 2024Updated 2 years ago
- [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models☆60Feb 7, 2025Updated last year
- pytorch implementation of DeepSeek Engram☆19Mar 24, 2026Updated 7 months ago
- ☆12Mar 31, 2022Updated 4 years ago
- The source code for WebConf 2025 paper "Multimodal Graph-Based Variational Mixture of Experts Network for Zero-Shot Multimodal Informatio…☆11Feb 17, 2025Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆11Jun 16, 2026Updated 4 months ago
- Implementation for IceCache: Memory-Efficient KV-cache Management for Long-Sequence LLMs (ICLR 2026).☆25Jun 9, 2026Updated 4 months ago
- Residual vector quantization for KV cache compression in large language model☆12Oct 22, 2024Updated 2 years ago
- [ECCV 2022] Contrastive Prototypical Network with Wasserstein Confidence Penalty☆11Oct 20, 2022Updated 4 years ago
- [ACL'24 Oral] Code for 'Rewriting the Code: A Simple Method for Large Language Model Augmented Code Search'☆18Sep 30, 2024Updated 2 years ago
- Scaling Laws for Mixture of Experts Models☆16Feb 25, 2025Updated last year
- This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?☆13May 31, 2023Updated 3 years ago