LLM360 / k2-trainLinks
☆50Updated last year
Alternatives and similar repositories for k2-train
Users that are interested in k2-train are comparing it to the libraries listed below
Sorting:
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated 10 months ago
- This is the official repository for Inheritune.☆111Updated 5 months ago
- A repository for research on medium sized language models.☆77Updated last year
- [NeurIPS 2024] Low rank memory efficient optimizer without SVD☆30Updated 2 weeks ago
- ☆35Updated last year
- Code for PHATGOOSE introduced in "Learning to Route Among Specialized Experts for Zero-Shot Generalization"☆86Updated last year
- ☆48Updated 10 months ago
- ☆73Updated 2 months ago
- Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"☆98Updated 9 months ago
- Aioli: A unified optimization framework for language model data mixing☆27Updated 5 months ago
- Lightweight toolkit package to train and fine-tune 1.58bit Language models☆81Updated last month
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆33Updated 3 months ago
- EvaByte: Efficient Byte-level Language Models at Scale☆103Updated 2 months ago
- ☆80Updated 6 months ago
- ☆82Updated 10 months ago
- Verifiers for LLM Reinforcement Learning☆64Updated 3 months ago
- Co-LLM: Learning to Decode Collaboratively with Multiple Language Models☆116Updated last year
- [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs☆90Updated 8 months ago
- Official Repo for InSTA: Towards Internet-Scale Training For Agents☆48Updated last week
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆33Updated 4 months ago
- Esoteric Language Models☆87Updated 3 weeks ago
- Organize the Web: Constructing Domains Enhances Pre-Training Data Curation☆56Updated 2 months ago
- Codebase for Instruction Following without Instruction Tuning☆35Updated 9 months ago
- The official repo for "LLoCo: Learning Long Contexts Offline"☆117Updated last year
- ☆33Updated 6 months ago
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆86Updated 9 months ago
- ☆69Updated last month
- [ICML 2025] Predictive Data Selection: The Data That Predicts Is the Data That Teaches☆51Updated 4 months ago
- Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)☆42Updated last year
- Exploration of automated dataset selection approaches at large scales.☆47Updated 4 months ago