danbider / lora-tradeoffsLinks
Information and artifacts for "LoRA Learns Less and Forgets Less" (TMLR, 2024)
☆19Updated last year
Alternatives and similar repositories for lora-tradeoffs
Users that are interested in lora-tradeoffs are comparing it to the libraries listed below
Sorting:
- ☆52Updated 10 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆88Updated last year
- ☆33Updated last year
- A MAD laboratory to improve AI architecture designs 🧪☆137Updated last year
- AlgoTune is a NeurIPS 2025 benchmark made up of 154 math, physics, and computer science problems. The goal is write code that solves each…☆86Updated last week
- ☆112Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.☆186Updated 2 weeks ago
- Physics of Language Models: Part 4.2, Canon Layers at Scale where Synthetic Pretraining Resonates in Reality☆316Updated last month
- 📄Small Batch Size Training for Language Models☆80Updated 4 months ago
- ☆74Updated last year
- Understand and test language model architectures on synthetic tasks.☆252Updated 3 weeks ago
- Defeating the Training-Inference Mismatch via FP16☆181Updated 2 months ago
- The evaluation framework for training-free sparse attention in LLMs☆114Updated last week
- Reinforcing General Reasoning without Verifiers☆96Updated 7 months ago
- [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models☆138Updated last month
- ☆147Updated this week
- ☆191Updated 2 weeks ago
- ☆53Updated last year
- Esoteric Language Models☆110Updated 2 months ago
- This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.☆106Updated last year
- ☆31Updated 10 months ago
- ☆34Updated 2 years ago
- AIRA-dojo: a framework for developing and evaluating AI research agents☆125Updated 2 weeks ago
- ☆108Updated last year
- nanoGPT-like codebase for LLM training☆113Updated 2 months ago
- Replicating O1 inference-time scaling laws☆92Updated last year
- ☆83Updated 2 years ago
- ☆91Updated last year
- [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training☆36Updated 9 months ago
- Unofficial Implementation of Selective Attention Transformer☆20Updated last year