NJUNLP / MoE-LPR
☆12Updated 4 months ago
Alternatives and similar repositories for MoE-LPR:
Users that are interested in MoE-LPR are comparing it to the libraries listed below
- Code for paper "Patch-Level Training for Large Language Models"☆82Updated 5 months ago
- Official PyTorch implementation of LoRI: Reducing Cross-Task Interference in Multi-Task Low-Rank Adaptation.☆11Updated last week
- [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models☆49Updated 2 months ago
- ☆13Updated 3 months ago
- [EMNLP 2023]Context Compression for Auto-regressive Transformers with Sentinel Tokens☆24Updated last year
- OpenOmni: Official implementation of Advancing Open-Source Omnimodal Large Language Models with Progressive Multimodal Alignment and Rea…☆40Updated last month
- [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…☆50Updated 2 years ago
- Open-Pandora: On-the-fly Control Video Generation☆34Updated 4 months ago
- ☆74Updated last month
- Enable Next-sentence Prediction for Large Language Models with Faster Speed, Higher Accuracy and Longer Context☆31Updated 8 months ago
- Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"☆36Updated last month
- ☆17Updated 3 months ago
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆37Updated 6 months ago
- Code for "Everybody Prune Now: Structured Pruning of LLMs with only Forward Passes"☆27Updated last year
- Triton implement of bi-directional (non-causal) linear attention☆46Updated 2 months ago
- [NeurIPS 2023 spotlight] Official implementation of HGRN in our NeurIPS 2023 paper - Hierarchically Gated Recurrent Neural Network for Se…☆64Updated 11 months ago
- [ICML 2024 Oral] This project is the official implementation of our Accurate LoRA-Finetuning Quantization of LLMs via Information Retenti…☆64Updated last year
- Repository for "TESS-2: A Large-Scale, Generalist Diffusion Language Model"☆33Updated 2 months ago
- [ICML 2024] When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models☆30Updated 10 months ago
- ☆14Updated last year
- ☆37Updated 6 months ago
- TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆128Updated last month
- [NeurIPS'24] Weak-to-Strong Search: Align Large Language Models via Searching over Small Language Models☆58Updated 4 months ago
- The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".☆20Updated 5 months ago
- Keras implement of Finite Scalar Quantization☆71Updated last year
- ☆39Updated last month
- We introduce ScaleQuest, a scalable, novel and cost-effective data synthesis method to unleash the reasoning capability of LLMs.☆61Updated 5 months ago
- ☆23Updated 6 months ago
- SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper☆32Updated 10 months ago
- Scaling Sparse Fine-Tuning to Large Language Models☆16Updated last year