Alternatives and similar repositories for knnlm-limits

Users that are interested in knnlm-limits are comparing it to the libraries listed below

• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆62Updated last year
• nathanhu0 / CaMeLS
  Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.
  ☆25Updated last year
• yuzhaouoe / pretraining-data-packing
  [ACL'24 Oral] Analysing The Impact of Sequence Composition on Language Model Pre-Training
  ☆22Updated last year
• HazyResearch / skill-it
  Skill-It! A Data-Driven Skills Framework for Understanding and Training Language Models
  ☆47Updated 2 years ago
• r-three / RAD
  Reference implementation for Reward-Augmented Decoding: Efficient Controlled Text Generation With a Unidirectional Reward Model
  ☆44Updated last month
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆48Updated 8 months ago
• allenai / bff
  ☆39Updated last year
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆28Updated 11 months ago
• casmlab / NPHardEval
  Repository for NPHardEval, a quantified-dynamic benchmark of LLMs
  ☆60Updated last year
• berlino / seq_icl
  ☆53Updated last year
• MadryLab / DsDm
  ☆51Updated last year
• hadasah / btm
  ☆76Updated last year
• HazyResearch / prefix-linear-attention
  ☆57Updated last year
• mcleish7 / gemstone-scaling-laws
  Gemstones: A Model Suite for Multi-Faceted Scaling Laws (NeurIPS 2025)
  ☆29Updated last month
• epfl-dlab / llm-latent-language
  Repo accompanying our paper "Do Llamas Work in English? On the Latent Language of Multilingual Transformers".
  ☆80Updated last year
• nkandpa2 / long_tail_knowledge
  Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"
  ☆78Updated 2 years ago
• XiangLi1999 / AutoBencher
  ☆32Updated last year
• sjelassi / transformers_ssm_copy
  ☆35Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆85Updated last year
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆36Updated last year
• srush / LLM-Talk
  ☆52Updated last year
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆31Updated 9 months ago
• kaistAI / factual-knowledge-acquisition
  ☆23Updated 3 weeks ago
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆100Updated last year
• formll / resolving-scaling-law-discrepancies
  ☆20Updated 2 weeks ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆55Updated 2 years ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• hughbzhang / o1_inference_scaling_laws
  Replicating O1 inference-time scaling laws
  ☆90Updated 11 months ago
• EleutherAI / pile_dedupe
  Pile Deduplication Code
  ☆19Updated 2 years ago
• JacobPfau / fillerTokens
  ☆75Updated last year