Alternatives and similar repositories for LCEG

Users that are interested in LCEG are comparing it to the libraries listed below

• PKU-ML / LongPPL
  Code for ICLR 2025 Paper "What is Wrong with Perplexity for Long-context Language Modeling?"
  ☆91Updated last month
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆52Updated 5 months ago
• qiuzh20 / gated_attention
  The official implementation for Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Free
  ☆44Updated 2 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆35Updated 9 months ago
• HKUNLP / STRING
  [ICLR'25] Data and code for our paper "Why Does the Effective Context Length of LLMs Fall Short?"
  ☆77Updated 7 months ago
• ScalerLab / JudgeBench
  ☆87Updated 8 months ago
• SalesforceAIResearch / GemFilter
  ☆80Updated 5 months ago
• ScalingIntelligence / large_language_monkeys
  ☆96Updated 9 months ago
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆47Updated 4 months ago
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆52Updated 2 years ago
• Zanette-Labs / SpeculativeRejection
  [NeurIPS 2024] Fast Best-of-N Decoding via Speculative Rejection
  ☆47Updated 8 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆33Updated 3 months ago
• locuslab / scaling_laws_data_filtering
  ☆64Updated last year
• SynthLabsAI / big-math
  A Large-Scale, High-Quality Math Dataset for Reinforcement Learning in Language Models
  ☆58Updated 4 months ago
• princeton-nlp / HELMET
  The HELMET Benchmark
  ☆155Updated 2 months ago
• snu-mllab / Context-Memory
  Pytorch implementation for "Compressed Context Memory For Online Language Model Interaction" (ICLR'24)
  ☆61Updated last year
• VITA-Group / Ms-PoE
  "Found in the Middle: How Language Models Use Long Contexts Better via Plug-and-Play Positional Encoding" Zhenyu Zhang, Runjin Chen, Shiw…
  ☆29Updated last year
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆48Updated last year
• chujiezheng / LLM-Extrapolation
  Official repository for ACL 2025 paper "Model Extrapolation Expedites Alignment"
  ☆74Updated last month
• DAMO-NLP-SG / LongPO
  [ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
  ☆38Updated 4 months ago
• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆211Updated 4 months ago
• HKUNLP / critic-rl
  [ICML 2025] Teaching Language Models to Critique via Reinforcement Learning
  ☆102Updated 2 months ago
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆86Updated 9 months ago
• MLE-Dojo / MLE-Dojo
  ☆54Updated 2 weeks ago
• gregorbachmann / Next-Token-Failures
  ☆86Updated last year
• Infini-AI-Lab / gsm_infinite
  ☆47Updated last month
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆97Updated last year
• RZFan525 / Awesome-ScalingLaws
  A curated list of awesome resources dedicated to Scaling Laws for LLMs
  ☆75Updated 2 years ago
• CodeCreator / WebOrganizer
  Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
  ☆56Updated 2 months ago
• zhiyuanhubj / LongRecipe
  LongRecipe: Recipe for Efficient Long Context Generalization in Large Language Models
  ☆76Updated 8 months ago