Alternatives and similar repositories for QuantizedEmpirical

Users that are interested in QuantizedEmpirical are comparing it to the libraries listed below

• liutianlin0121 / decoding-time-realignment
  Implementation of "Decoding-time Realignment of Language Models", ICML 2024.
  ☆19Updated last year
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆49Updated 9 months ago
• KaihuaTang / Qwen-Tokenizer-Pruner
  Due to the huge vocaburary size (151,936) of Qwen models, the Embedding and LM Head weights are excessively heavy. Therefore, this projec…
  ☆24Updated 11 months ago
• princeton-nlp / CEPE
  [ACL 2024] Long-Context Language Modeling with Parallel Encodings
  ☆157Updated last year
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆78Updated last year
• Shwai-He / MEO
  The source code of "Merging Experts into One: Improving Computational Efficiency of Mixture of Experts (EMNLP 2023)":
  ☆38Updated last year
• yegcjs / mixinglaws
  ☆104Updated 3 weeks ago
• YuchuanTian / RethinkTinyLM
  [ICML'24] The official implementation of “Rethinking Optimization and Architecture for Tiny Language Models”
  ☆123Updated 6 months ago
• hemingkx / SpecDec
  Codes for our paper "Speculative Decoding: Exploiting Speculative Execution for Accelerating Seq2seq Generation" (EMNLP 2023 Findings)
  ☆42Updated last year
• TemporaryLoRA / Temp-LoRA
  ☆108Updated last year
• huangyuxiang03 / Locret
  ☆13Updated 10 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆35Updated 10 months ago
• cofe-ai / Mu-scaling
  Research without Re-search: Maximal Update Parametrization Yields Accurate Loss Prediction across Scales
  ☆32Updated 2 years ago
• DAMO-NLP-SG / LongPO
  [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
  ☆40Updated 5 months ago
• USTC-StarTeam / ZIP
  ☆23Updated last year
• chtmp223 / suri
  Suri: Multi-constraint instruction following for long-form text generation (EMNLP’24)
  ☆25Updated 9 months ago
• raymin0223 / fast_robust_early_exit
  Fast and Robust Early-Exiting Framework for Autoregressive Language Models with Synchronized Parallel Decoding (EMNLP 2023 Long)
  ☆61Updated 10 months ago
• jiahe7ay / infini-mini-transformer
  This is a personal reimplementation of Google's Infini-transformer, utilizing a small 2b model. The project includes both model and train…
  ☆58Updated last year
• princeton-pli / MeCo
  Code for ICML 25 paper "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"
  ☆41Updated last month
• namespace-Pt / UltraGist
  ☆18Updated 8 months ago
• bigai-nlco / CREAM
  [NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding
  ☆18Updated 10 months ago
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆37Updated 11 months ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆53Updated 2 years ago
• RUCAIBox / BAMBOO
  ☆35Updated last year
• FlagOpen / Infinity-Instruct
  ☆49Updated last year
• Jikai0Wang / OPT-Tree
  ☆25Updated 2 months ago
• abdelfattah-lab / SplitReason
  ☆18Updated last month
• xinghaow99 / DenoSent
  [AAAI 2024] DenoSent: A Denoising Objective for Self-Supervised Sentence Representation Learning
  ☆15Updated last year
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆52Updated 6 months ago
• feiyang-k / AutoScale
  Official Code Repository for [AutoScale–Automatic Prediction of Compute-optimal Data Compositions for Training LLMs]
  ☆12Updated 6 months ago