Alternatives and similar repositories for lora-tradeoffs

Users that are interested in lora-tradeoffs are comparing it to the libraries listed below

• katiekang1998 / reasoning_generalization
  ☆33Updated last year
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆52Updated 10 months ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆87Updated last year
• oripress / AlgoTune
  AlgoTune is a NeurIPS 2025 benchmark made up of 154 math, physics, and computer science problems. The goal is write code that solves each…
  ☆85Updated this week
• BorealisAI / flora-opt
  This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.
  ☆105Updated last year
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆185Updated 6 months ago
• JoshEngels / MultiDimensionalFeatures
  Code for reproducing our paper "Not All Language Model Features Are Linear"
  ☆83Updated last year
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆136Updated last year
• epfml / llm-baselines
  nanoGPT-like codebase for LLM training
  ☆114Updated 2 months ago
• ablghtianyi / ICL_Modular_Arithmetic
  ☆19Updated 9 months ago
• Leiay / looped_transformer
  ☆33Updated 2 years ago
• fangyuan-ksgk / selective-attention-transformer
  Unofficial Implementation of Selective Attention Transformer
  ☆20Updated last year
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆193Updated last year
• facebookresearch / PhysicsLM4
  Physics of Language Models, Part 4
  ☆306Updated 2 weeks ago
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆250Updated last week
• VsonicV / es-fine-tuning-paper
  This repo contains the source code for the paper "Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning"
  ☆285Updated last month
• Silent-Zebra / twisted-smc-lm
  ☆31Updated 9 months ago
• jonhue / activeft
  PyTorch library for Active Fine-Tuning
  ☆96Updated 3 months ago
• Parallel-Reasoning / APR
  [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models
  ☆137Updated last month
• OSU-NLP-Group / GrokkedTransformer
  Code for NeurIPS'24 paper 'Grokked Transformers are Implicit Reasoners: A Mechanistic Journey to the Edge of Generalization'
  ☆234Updated 6 months ago
• sail-sg / Precision-RL
  Defeating the Training-Inference Mismatch via FP16
  ☆176Updated 2 months ago
• ScalingIntelligence / large_language_monkeys
  ☆112Updated last year
• Jiaxin-Wen / Unsupervised-Elicitation
  ☆39Updated 6 months ago
• facebookresearch / MemoryMosaics
  Memory Mosaics are networks of associative memories working in concert to achieve a prediction task.
  ☆57Updated 11 months ago
• CASE-Lab-UMD / LLM-Drop
  The official implementation of the paper "What Matters in Transformers? Not All Attention is Needed".
  ☆188Updated 2 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆46Updated 3 months ago
• PiotrNawrot / sparse-frontier
  The evaluation framework for training-free sparse attention in LLMs
  ☆110Updated 3 months ago
• JinjieNi / dlms-are-super-data-learners
  The official github repo for "Diffusion Language Models are Super Data Learners".
  ☆218Updated 2 months ago
• facebookresearch / aira-dojo
  AIRA-dojo: a framework for developing and evaluating AI research agents
  ☆124Updated 2 months ago
• MadryLab / DsDm
  ☆51Updated last year