Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging. Arxiv, 2024.
☆16Oct 28, 2024Updated 2 years ago
Alternatives and similar repositories for Efficient-WEMoE
Users that are interested in Efficient-WEMoE are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Official Implementation of "Learning to Refuse: Towards Mitigating Privacy Risks in LLMs"☆10Dec 13, 2024Updated last year
- Code for paper "Merging Multi-Task Models via Weight-Ensembling Mixture of Experts"☆35Jun 7, 2024Updated 2 years ago
- Official repository for Activation-Informed Merging (AIM) of Large Language Models☆25Feb 10, 2025Updated last year
- Official implementation of OPD-Aha for fine-grained visual perception and multimodal reasoning☆14Sep 16, 2026Updated last month
- ☆20Jun 21, 2025Updated last year
- Deploy open-source AI quickly and easily - Special Bonus Offer • AdRunpod Hub is built for open source. One-click deployment and autoscaling endpoints without provisioning your own infrastructure.
- FusionBench: A Comprehensive Benchmark/Toolkit of Deep Model Fusion☆244Oct 27, 2026Updated last week
- Official repo for NeurIPS'24 paper "WAGLE: Strategic Weight Attribution for Effective and Modular Unlearning in Large Language Models"☆19Dec 16, 2024Updated last year
- 🌏 UI component library for the future, based on WebComponent.☆23Nov 12, 2024Updated last year
- Continual Model Merging without Data: Dual Projections for Balancing Stability and Plasticity. NeurIPS, 2025.☆13Oct 12, 2025Updated last year
- ☆29Oct 6, 2024Updated 2 years ago
- DELLA-Merging: Reducing Interference in Model Merging through Magnitude-Based Sampling☆39Jul 12, 2024Updated 2 years ago
- SyMerge: From Non-Interference to Synergistic Merging via Single-Layer Adaptation☆12Jul 6, 2026Updated 4 months ago
- Official repo for EMNLP'24 paper "SOUL: Unlocking the Power of Second-Order Optimization for LLM Unlearning"☆31Oct 1, 2024Updated 2 years ago
- ☆35Aug 9, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Official repository of the "Transformer Fusion with Optimal Transport" paper, published as a conference paper at ICLR 2024.☆31Apr 19, 2024Updated 2 years ago
- [ICML 2026] Hybrid Policy Distillation (HPD) is a practical distillation framework for reasoning-oriented language models. This repositor…☆24Apr 24, 2026Updated 6 months ago
- ☆15May 4, 2024Updated 2 years ago
- ☆49Oct 1, 2024Updated 2 years ago
- ☆31Sep 16, 2026Updated last month
- Converter for EN16931 invoices from CII to UBL☆47Updated this week
- Repo for "STAR: Spectral Truncation and Rescale for Model Merging" [NAACL 2025]☆11Oct 22, 2026Updated 2 weeks ago
- Pytorch code for NeurIPS 2025 paper "Accurate and Efficient Low-Rank Model Merging in Core Space"☆42Feb 2, 2026Updated 9 months ago
- Code and data for the FACTOR paper☆54Nov 15, 2023Updated 2 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- ☆44Feb 26, 2024Updated 2 years ago
- QAQ: Quality Adaptive Quantization for LLM KV Cache☆55Mar 27, 2024Updated 2 years ago
- “悟道”数据☆52Jul 5, 2021Updated 5 years ago
- This is the official code for the paper "Vaccine: Perturbation-aware Alignment for Large Language Models" (NeurIPS2024)☆54Jan 15, 2026Updated 9 months ago
- Official repository for the paper "ALERT: A Comprehensive Benchmark for Assessing Large Language Models’ Safety through Red Teaming"☆59Sep 20, 2024Updated 2 years ago
- Official implementation of "Modeling Multi-Task Model Merging as Adaptive Projective Gradient Descent".☆23May 23, 2025Updated last year
- ☆33Jul 8, 2024Updated 2 years ago
- [ICLR 2025] A Closer Look at Machine Unlearning for Large Language Models☆51Dec 4, 2024Updated last year
- [ICLR 2025] Official implementation of "Mitigating Parameter Interference in Model Merging via Sharpness-Aware Fine-Tuning"☆11Apr 21, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Benchmarking Complex Instruction-Following with Multiple Constraints Composition (NeurIPS 2024 Datasets and Benchmarks Track)☆105Feb 20, 2025Updated last year
- Exploring Model Kinship for Merging Large Language Models☆28Apr 16, 2025Updated last year
- ☆62Aug 22, 2024Updated 2 years ago
- A toolkit for building dense retrievers with deep language models.☆63Sep 24, 2021Updated 5 years ago
- [ICML 2024] Code release for "On the Emergence of Cross-Task Linearity in Pretraining-Finetuning Paradigm"☆11Feb 20, 2025Updated last year
- ☆59Apr 24, 2024Updated 2 years ago
- An easy python package to run quick basic QA evaluations. This package includes standardized QA evaluation metrics and semantic evaluatio…☆65Jul 18, 2025Updated last year