Alternatives and similar repositories for LiNeS:

Users that are interested in LiNeS are comparing it to the libraries listed below

• kyleliang919 / Online-Subspace-Descent
  This repo is based on https://github.com/jiaweizzhao/GaLore
  ☆26Updated 6 months ago
• RobertCsordas / moeut
  ☆75Updated 7 months ago
• katiekang1998 / reasoning_generalization
  ☆31Updated 3 months ago
• formll / resolving-scaling-law-discrepancies
  ☆18Updated 9 months ago
• sail-sg / SkyLadder
  The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling
  ☆28Updated 3 weeks ago
• Infini-AI-Lab / S2FT
  ☆16Updated 3 months ago
• john-hewitt / implicit-ins
  Codebase for Instruction Following without Instruction Tuning
  ☆34Updated 6 months ago
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆35Updated last month
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆20Updated 4 months ago
• ShiZhengyan / InstructionModelling
  [NeurIPS 2024 Main Track] Code for the paper titled "Instruction Tuning With Loss Over Instructions"
  ☆36Updated 10 months ago
• locuslab / scaling_laws_data_filtering
  ☆64Updated last year
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 7 months ago
• mcleish7 / gemstone-scaling-laws
  ☆22Updated 2 months ago
• allenai / easy-to-hard-generalization
  Code for the arXiv preprint "The Unreasonable Effectiveness of Easy Training Data"
  ☆47Updated last year
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆39Updated 5 months ago
• NathanGodey / qfilters
  Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)
  ☆27Updated last month
• ContextualAI / CLAIR_and_APO
  Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment
  ☆55Updated 7 months ago
• gstoica27 / KnOTS
  Model Merging with SVD to Tie the KnOTS [ICLR 2025]
  ☆49Updated last week
• liziniu / cold_start_rl
  Code for Blog Post: Can Better Cold-Start Strategies Improve RL Training for LLMs?
  ☆16Updated last month
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆71Updated 5 months ago
• VITA-Group / WeLore
  From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…
  ☆44Updated 8 months ago
• fal-ai-community / nano-mdm
  Tiny re-implementation of MDM in style of LLaDA and nano-gpt speedrun
  ☆46Updated last month
• uscnlp-lime / safer-instruct
  This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"
  ☆17Updated last year
• IST-DASLab / RoSA
  Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)
  ☆40Updated last year
• sfeucht / footprints
  https://footprints.baulab.info
  ☆17Updated 6 months ago
• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• hkust-nlp / PreSelect
  ☆43Updated last month
• allenai / sso
  Repository for Skill Set Optimization
  ☆12Updated 8 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆26Updated 11 months ago
• zjunlp / unlearn
  Knowledge Unlearning for Large Language Models
  ☆25Updated last week