kpup1710 / CAMEx
[ICLR 2025] CAMEx: Curvature-Aware Merging of Experts
☆19Updated 2 months ago
Alternatives and similar repositories for CAMEx
Users that are interested in CAMEx are comparing it to the libraries listed below
Sorting:
- LibMoE: A LIBRARY FOR COMPREHENSIVE BENCHMARKING MIXTURE OF EXPERTS IN LARGE LANGUAGE MODELS☆37Updated 2 weeks ago
- This is the public github for our paper "Transformer with a Mixture of Gaussian Keys"☆26Updated 2 years ago
- ☆22Updated 8 months ago
- ☆22Updated 4 months ago
- RecGPT: Generative Pre-training for Text-based Recommendation (ACL 2024)☆32Updated 7 months ago
- From Implicit to Explicit Feedback: A deep neural network for modeling sequential behaviours and long-short term preferences of online us…☆1Updated last year
- ☆58Updated 3 months ago
- [CVPR 2025] h-Edit: Effective and Flexible Diffusion-Based Editing via Doob’s h-Transform☆45Updated last month
- Code and benchmark for the paper: "A Practitioner's Guide to Continual Multimodal Pretraining" [NeurIPS'24]☆54Updated 5 months ago
- Implementation for MomentumSMoE☆17Updated 3 weeks ago
- PyTorch implementation of Soft MoE by Google Brain in "From Sparse to Soft Mixtures of Experts" (https://arxiv.org/pdf/2308.00951.pdf)☆72Updated last year
- code for the ddp tutorial☆32Updated 3 years ago
- Source code for a LoRA-based continual relation extraction method.☆12Updated last year
- Official PyTorch implementation for NeurIPS'24 paper "Knowledge Composition using Task Vectors with Learned Anisotropic Scaling"☆19Updated 2 months ago
- MambaFormer in-context learning experiments and implementation for https://arxiv.org/abs/2402.04248☆52Updated 10 months ago
- The official GitHub page for the survey paper "A Survey of RWKV".☆26Updated 4 months ago
- The repository of paper Personalized Multimodal Response Generation with Large Language Models☆13Updated 10 months ago
- PyTorch implementation of "From Sparse to Soft Mixtures of Experts"☆56Updated last year
- Code for T-MARS data filtering☆35Updated last year
- Official implementation of "Mixture of Experts Meets Prompt-Based Continual Learning" (NeurIPS 2024)☆28Updated 3 months ago
- ☆21Updated 2 years ago
- Code for the paper "Cottention: Linear Transformers With Cosine Attention"☆17Updated 6 months ago
- 🔱 Sailor2: Sailing in South-East Asia with Inclusive Multilingual LLMs☆60Updated last month
- Pioneering in Vietnamese Multimodal Large Language Model☆47Updated 3 months ago
- Video descriptions of research papers relating to foundation models and scaling☆31Updated 2 years ago
- ☆45Updated 3 months ago
- ScrollNet for Continual Learning☆11Updated last year
- This repository contains papers for a comprehensive survey on accelerated generation techniques in Large Language Models (LLMs).☆11Updated 11 months ago
- [NeurIPS 2024] Official implementation of the paper "MambaLRP: Explaining Selective State Space Sequence Models".☆38Updated 6 months ago
- Residual Prompt Tuning: a method for faster and better prompt tuning.☆54Updated 2 years ago