qiuzh20 / EMoE
Official PyTorch Implementation of EMoE: Unlocking Emergent Modularity in Large Language Models [main conference @ NAACL2024]
☆23Updated 3 months ago
Related projects: ⓘ
- One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning☆36Updated last year
- A curated list of awesome resources dedicated to Scaling Laws for LLMs☆61Updated last year
- Semi-Parametric Editing with a Retrieval-Augmented Counterfactual Model☆59Updated last year
- Restore safety in fine-tuned language models through task arithmetic☆25Updated 5 months ago
- [NeurIPS 2023] Github repository for "Composing Parameter-Efficient Modules with Arithmetic Operations"☆54Updated 9 months ago
- ☆32Updated 5 months ago
- Methods and evaluation for aligning language models temporally☆24Updated 6 months ago
- ☆26Updated last year
- Code & Data for our Paper "Alleviating Hallucinations of Large Language Models through Induced Hallucinations"☆56Updated 6 months ago
- ☆32Updated 10 months ago
- Knowledge Circuits in Pretrained Transformers☆46Updated this week
- [ICML'2024] Can AI Assistants Know What They Don't Know?☆62Updated 7 months ago
- 🍼 Official implementation of Dynamic Data Mixing Maximizes Instruction Tuning for Mixture-of-Experts☆33Updated 2 months ago
- ☆23Updated last year
- The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":☆31Updated 5 months ago
- Code for M4LE: A Multi-Ability Multi-Range Multi-Task Multi-Domain Long-Context Evaluation Benchmark for Large Language Models☆22Updated last month
- The repository of the project "Fine-tuning Large Language Models with Sequential Instructions", code base comes from open-instruct and LA…☆30Updated 2 months ago
- GSM-Plus: Data, Code, and Evaluation for Enhancing Robust Mathematical Reasoning in Math Word Problems.☆38Updated 2 months ago
- Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"☆62Updated 3 months ago
- [ACL 2024] A Prospector of Long-Dependency Data for Large Language Models☆48Updated last month
- Visual and Embodied Concepts evaluation benchmark☆21Updated 11 months ago
- ☆24Updated 4 months ago
- ☆42Updated 5 months ago
- TRACE: A Comprehensive Benchmark for Continual Learning in Large Language Models☆56Updated 7 months ago
- ☆69Updated 10 months ago
- Evaluating the Ripple Effects of Knowledge Editing in Language Models☆45Updated 5 months ago
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models☆42Updated last week
- ☆25Updated 11 months ago
- ☆39Updated 9 months ago
- Self-Explore to avoid ️the p️️it! Improving the Reasoning Capabilities of Language Models with Fine-grained Rewards☆39Updated 4 months ago