RUCAIBox / QuantizedEmpirical
☆14Updated 11 months ago
Related projects: ⓘ
- The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":☆31Updated 5 months ago
- Implementation of "Decoding-time Realignment of Language Models", ICML 2024.☆13Updated 3 months ago
- Towards Systematic Measurement for Long Text Quality☆27Updated 2 weeks ago
- [NAACL 24 Oral] LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models☆19Updated 3 weeks ago
- Llama-3-SynE: A Significantly Enhanced Version of Llama-3 with Advanced Scientific Reasoning and Chinese Language Capabilities | 继续预训练提升 …☆19Updated last month
- [ICML'2024] Can AI Assistants Know What They Don't Know?☆62Updated 7 months ago
- Offical code repository for PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillation, EMNLP 2023☆10Updated 9 months ago
- The source code and dataset mentioned in the paper Seal-Tools: Self-Instruct Tool Learning Dataset for Agent Tuning and Detailed Benchmar…☆31Updated last month
- ☆13Updated 2 months ago
- [Findings of EMNLP22] From Mimicking to Integrating: Knowledge Integration for Pre-Trained Language Models☆19Updated last year
- This the implementation of LeCo☆16Updated 2 months ago
- ☆15Updated last week
- Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…☆34Updated 2 months ago
- OPT-Tree: Speculative Decoding with Adaptive Draft Tree Structure☆15Updated last month
- Official repository for MATES: Model-Aware Data Selection for Efficient Pretraining with Data Influence Models☆42Updated last week
- [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…☆42Updated last year
- Quantized Side Tuning: Fast and Memory-Efficient Tuning of Quantized Large Language Models☆27Updated last week
- ☆14Updated 4 months ago
- The code and data for the paper JiuZhang3.0☆29Updated 3 months ago
- ☆87Updated 4 months ago
- Source code for our AAAI'22 paper 《From Dense to Sparse: Contrastive Pruning for Better Pre-trained Language Model Compression》☆23Updated 2 years ago
- ☆31Updated 5 months ago
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆72Updated 6 months ago
- Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".☆22Updated 5 months ago
- [EMNLP 2023]Context Compression for Auto-regressive Transformers with Sentinel Tokens☆20Updated 10 months ago
- Code for ACL 2023 paper titled "Lifting the Curse of Capacity Gap in Distilling Language Models"☆28Updated last year
- ☆31Updated 3 months ago
- Repo for Paper "Dual-Space Knowledge Distillation for Large Language Models".☆29Updated 2 weeks ago
- [ICLR'24 spotlight] Tool-Augmented Reward Modeling☆33Updated 6 months ago
- An Experiment on Dynamic NTK Scaling RoPE☆59Updated 9 months ago