Alternatives and similar repositories for nanoLM:

Users that are interested in nanoLM are comparing it to the libraries listed below

• yegcjs / mixinglaws
  ☆98Updated 6 months ago
• princeton-pli / MeCo
  Code for preprint "Metadata Conditioning Accelerates Language Model Pre-training (MeCo)"
  ☆36Updated last month
• DAMO-NLP-SG / CLEX
  [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
  ☆76Updated last year
• princeton-nlp / ProLong
  Homepage for ProLong (Princeton long-context language models) and paper "How to Train Long-Context Language Models (Effectively)"
  ☆175Updated last month
• chujiezheng / LLM-Extrapolation
  Official repository for paper "Weak-to-Strong Extrapolation Expedites Alignment"
  ☆74Updated 10 months ago
• GAIR-NLP / AIME-Preview
  ☆57Updated last month
• sanyalsunny111 / LLM-Inheritune
  This is the official repository for Inheritune.
  ☆111Updated 2 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆53Updated 7 months ago
• GAIR-NLP / Entropy-ABF
  Official implementation for 'Extending LLMs’ Context Window with 100 Samples'
  ☆76Updated last year
• hkust-nlp / llm-compression-intelligence
  Official github repo for the paper "Compression Represents Intelligence Linearly" [COLM 2024]
  ☆131Updated 7 months ago
• fe1ixxu / CPO_SIMPO
  This repository contains the joint use of CPO and SimPO method for better reference-free preference learning methods.
  ☆53Updated 8 months ago
• SALT-NLP / demonstrated-feedback
  ☆120Updated 6 months ago
• ars22 / scaling-LLM-math-synthetic-data
  Code and data used in the paper: "Training on Incorrect Synthetic Data via RL Scales LLM Math Reasoning Eight-Fold"
  ☆30Updated 10 months ago
• princeton-nlp / HELMET
  The HELMET Benchmark
  ☆129Updated last week
• sail-sg / regmix
  [ICLR 2025] 🧬 RegMix: Data Mixture as Regression for Language Model Pre-training (Spotlight)
  ☆127Updated 2 months ago
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆55Updated last week
• swj0419 / in-context-pretraining
  ☆48Updated last year
• gpt4life / alpagasus
  Unofficial implementation of AlpaGasus
  ☆90Updated last year
• OpenLMLab / LongWanjuan
  Towards Systematic Measurement for Long Text Quality
  ☆34Updated 7 months ago
• TIGER-AI-Lab / General-Reasoner
  General Reasoner: Advancing LLM Reasoning Across All Domains
  ☆54Updated this week
• dwzhu-pku / PoSE
  Positional Skip-wise Training for Efficient Context Window Extension of LLMs to Extremely Length (ICLR 2024)
  ☆205Updated 11 months ago
• NormXU / Consistent-DynamicNTKRoPE
  An Experiment on Dynamic NTK Scaling RoPE
  ☆63Updated last year
• meowpass / FollowComplexInstruction
  Official implementation of the paper "From Complex to Simple: Enhancing Multi-Constraint Complex Instruction Following Ability of Large L…
  ☆48Updated 9 months ago
• CodeCreator / WebOrganizer
  Organize the Web: Constructing Domains Enhances Pre-Training Data Curation
  ☆42Updated 2 months ago
• ZitongYang / Synthetic_Continued_Pretraining
  Code implementation of synthetic continued pretraining
  ☆101Updated 3 months ago
• yifanzhang-pro / AutoMathText
  Official implementation of paper "Autonomous Data Selection with Language Models for Mathematical Texts" (As Huggingface Daily Papers: ht…
  ☆80Updated 5 months ago
• QwenLM / ProcessBench
  ☆148Updated 4 months ago
• sail-sg / scaling-with-vocab
  [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623
  ☆82Updated 6 months ago
• Alice1998 / URS
  URS Benchmark: Evaluating LLMs on User Reported Scenarios
  ☆26Updated last month
• orionw / FollowIR
  FollowIR: Evaluating and Teaching Information Retrieval Models to Follow Instructions
  ☆42Updated 9 months ago