RUCAIBox / QuantizedEmpiricalLinks
☆14Updated 2 years ago
Alternatives and similar repositories for QuantizedEmpirical
Users that are interested in QuantizedEmpirical are comparing it to the libraries listed below
Sorting:
- Implementation of "Decoding-time Realignment of Language Models", ICML 2024.☆19Updated last year
- [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection☆51Updated 10 months ago
- Due to the huge vocaburary size (151,936) of Qwen models, the Embedding and LM Head weights are excessively heavy. Therefore, this projec…☆27Updated last year
- [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”☆123Updated 8 months ago
- Official completion of “Training on the Benchmark Is Not All You Need”.☆35Updated 8 months ago
- [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization☆40Updated 6 months ago
- ☆18Updated 11 months ago
- The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":☆38Updated last year
- Codebase for Instruction Following without Instruction Tuning☆35Updated last year
- ☆104Updated 2 months ago
- ☆116Updated last year
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆78Updated last year
- ☆22Updated 5 months ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆163Updated last year
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆58Updated last year
- ☆26Updated last year
- Code for ICML 25 paper "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"☆42Updated 2 months ago
- [AAAI 2024] DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning☆15Updated last year
- Counting-Stars (★)☆83Updated 3 months ago
- [ICLR 2025] MiniPLM: Knowledge Distillation for Pre-Training Language Models☆61Updated 10 months ago
- ☆49Updated last year
- Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"☆63Updated last year
- Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales☆32Updated 2 years ago
- Towards Systematic Measurement for Long Text Quality☆37Updated last year
- SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper☆33Updated last year
- ☆15Updated 10 months ago
- ☆13Updated 11 months ago
- ☆63Updated last year
- ☆18Updated 9 months ago
- Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)☆25Updated 10 months ago