RUCAIBox / QuantizedEmpiricalLinks
☆14Updated last year
Alternatives and similar repositories for QuantizedEmpirical
Users that are interested in QuantizedEmpirical are comparing it to the libraries listed below
Sorting:
- Implementation of "Decoding-time Realignment of Language Models", ICML 2024.☆19Updated last year
- [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection☆51Updated 10 months ago
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆78Updated last year
- ☆13Updated 11 months ago
- [ACL 2024] Long-Context Language Modeling with Parallel Encodings☆157Updated last year
- Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales☆32Updated 2 years ago
- [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”☆123Updated 7 months ago
- ☆104Updated last month
- Due to the huge vocaburary size (151,936) of Qwen models, the Embedding and LM Head weights are excessively heavy. Therefore, this projec…☆26Updated last year
- ☆18Updated 10 months ago
- This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…☆58Updated last year
- ☆18Updated 9 months ago
- Codebase for Instruction Following without Instruction Tuning☆35Updated 11 months ago
- ☆15Updated 9 months ago
- Repo for the EMNLP'24 Paper "Dual-Space Knowledge Distillation for Large Language Models". A general white-box KD framework for both same…☆59Updated last week
- SELF-GUIDE: Better Task-Specific Instruction Following via Self-Synthetic Finetuning. COLM 2024 Accepted Paper☆33Updated last year
- Code for paper "Patch-Level Training for Large Language Models"☆86Updated 9 months ago
- The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":☆38Updated last year
- ☆63Updated last year
- Official completion of “Training on the Benchmark Is Not All You Need”.☆35Updated 8 months ago
- [AAAI 2024] DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning☆15Updated last year
- ☆18Updated 2 months ago
- ☆109Updated last year
- [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization☆41Updated 6 months ago
- Inference Code for Paper "Harder Tasks Need More Experts: Dynamic Routing in MoE Models"☆60Updated last year
- Code for ICML 25 paper "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"☆42Updated 2 months ago
- WideSearch: Benchmarking Agentic Broad Info-Seeking☆87Updated 3 weeks ago
- [NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding☆18Updated 10 months ago
- [EMNLP 2023]Context Compression for Auto-regressive Transformers with Sentinel Tokens☆25Updated last year
- An Experiment on Dynamic NTK Scaling RoPE☆64Updated last year