XMUDeepLIT / QGCLinks
Code for "Retaining Key Information under High Compression Rates: Query-Guided Compressor for LLMs" (ACL 2024)
☆17Updated last year
Alternatives and similar repositories for QGC
Users that are interested in QGC are comparing it to the libraries listed below
Sorting:
- The repo for In-context Autoencoder☆136Updated last year
- Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning☆163Updated last year
- Model merging is a highly efficient approach for long-to-short reasoning.☆80Updated 3 months ago
- [ACL 2024] The official codebase for the paper "Self-Distillation Bridges Distribution Gap in Language Model Fine-tuning".☆128Updated 10 months ago
- [ACL 2024 (Oral)] A Prospector of Long-Dependency Data for Large Language Models☆56Updated last year
- [SIGIR'24] The official implementation code of MOELoRA.☆177Updated last year
- Code for ACL 2024 accepted paper titled "SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language …☆35Updated 7 months ago
- Implementation code for ACL2024：Advancing Parameter Efficiency in Fine-tuning via Representation Editing☆14Updated last year
- TokenSkip: Controllable Chain-of-Thought Compression in LLMs☆174Updated 2 months ago
- ☆28Updated last year
- LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation☆27Updated 2 months ago
- [ICLR 2025] Language Imbalance Driven Rewarding for Multilingual Self-improving☆21Updated last week
- Code associated with Tuning Language Models by Proxy (Liu et al., 2024)☆114Updated last year
- A versatile toolkit for applying Logit Lens to modern large language models (LLMs). Currently supports Llama-3.1-8B and Qwen-2.5-7B, enab…☆99Updated 3 weeks ago
- code for ACL24 "MELoRA: Mini-Ensemble Low-Rank Adapter for Parameter-Efficient Fine-Tuning"☆32Updated 6 months ago
- Awesome-Long2short-on-LRMs is a collection of state-of-the-art, novel, exciting long2short methods on large reasoning models. It contains…☆244Updated 3 weeks ago
- [EMNLP 2024] The official GitHub repo for the survey paper "Knowledge Conflicts for LLMs: A Survey"☆134Updated 11 months ago
- ☆83Updated 8 months ago
- ☆24Updated 2 years ago
- Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"☆62Updated last year
- ☆151Updated last year
- Laser: Learn to Reason Efficiently with Adaptive Length-based Reward Shaping☆52Updated 3 months ago
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same…☆59Updated last week
- EMNLP'2023: Explore-Instruct: Enhancing Domain-Specific Instruction Coverage through Active Exploration☆36Updated last year
- ☆43Updated last week
- One Network, Many Masks: Towards More Parameter-Efficient Transfer Learning☆40Updated 2 years ago
- This repository contains a regularly updated paper list for LLMs-reasoning-in-latent-space.☆153Updated 2 weeks ago
- A method of ensemble learning for heterogeneous large language models.☆60Updated last year
- Implementation for the paper "The Surprising Effectiveness of Negative Reinforcement in LLM Reasoning"☆100Updated last week
- Code for paper 'Are We Falling in a Middle-Intelligence Trap? An Analysis and Mitigation of the Reversal Curse'☆14Updated last year