mikecovlee / mLoRA
This repository has transferred to https://github.com/TUDB-Labs/MoE-PEFT
☆22Updated 6 months ago
Alternatives and similar repositories for mLoRA:
Users that are interested in mLoRA are comparing it to the libraries listed below
- [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"☆105Updated 5 months ago
- [SIGIR'24] The official implementation code of MOELoRA.☆149Updated 7 months ago
- The code and data of DPA-RAG☆57Updated last month
- State-of-the-art Parameter-Efficient MoE Fine-tuning Method☆141Updated 6 months ago
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆115Updated 4 months ago
- [EMNLP 2024 (Oral)] Leave No Document Behind: Benchmarking Long-Context LLMs with Extended Multi-Doc QA☆114Updated 4 months ago
- The demo, code and data of FollowRAG☆70Updated 3 months ago
- [Neurips2024] Source code for xRAG: Extreme Context Compression for Retrieval-augmented Generation with One Token☆127Updated 8 months ago
- The repo for In-context Autoencoder☆111Updated 10 months ago
- [NAACL 2024 Outstanding Paper] Source code for the NAACL 2024 paper entitled "R-Tuning: Instructing Large Language Models to Say 'I Don't…☆107Updated 8 months ago
- ☆80Updated last year
- this is an implementation for the paper Improve Mathematical Reasoning in Language Models by Automated Process Supervision from google de…☆24Updated 2 months ago
- The code of arxiv paper: "CoT-based Synthesizer: Enhancing LLM Performance through Answer Synthesis"☆23Updated 2 months ago
- Implementation for the research paper "Enhancing LLM Reasoning via Critique Models with Test-Time and Training-Time Supervision".☆51Updated 3 months ago
- ☆126Updated 7 months ago
- A collection of survey papers and resources related to Large Language Models (LLMs).☆40Updated last year
- A list of papers about data quality in Large Language Models (LLMs)☆25Updated last year
- [ICLR 2025] InstructRAG: Instructing Retrieval-Augmented Generation via Self-Synthesized Rationales☆77Updated last month
- ☆49Updated 4 months ago
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆106Updated 11 months ago
- Small Models, Big Insights: Leveraging Slim Proxy Models To Decide When and What to Retrieve for LLMs (ACL 2024)☆59Updated 4 months ago
- RAG methods, benchmarks, and toolkits☆15Updated 3 months ago
- Adapt an LLM model to a Mixture-of-Experts model using Parameter Efficient finetuning (LoRA), injecting the LoRAs in the FFN.☆27Updated 4 months ago
- [ICLR'25] UniGen: A Unified Framework for Dataset Generation via Large Language Model☆40Updated this week
- ☆51Updated 4 months ago
- A Survey on Data Selection for Language Models☆218Updated 4 months ago
- [ICLR 2025] This is the code repo for our ICLR’25 paper "RAG-DDR: Optimizing Retrieval-Augmented Generation Using Differentiable Data Rew…☆27Updated last month