Alternatives and similar repositories for lora-tradeoffs

Users that are interested in lora-tradeoffs are comparing it to the libraries listed below

• katiekang1998 / reasoning_generalization
  ☆34Updated 8 months ago
• probabilistic-inference-scaling / probabilistic-inference-scaling
  ☆51Updated 5 months ago
• fangyuan-ksgk / selective-attention-transformer
  Unofficial Implementation of Selective Attention Transformer
  ☆17Updated 10 months ago
• JacobPfau / fillerTokens
  ☆72Updated last year
• Leiay / looped_transformer
  ☆32Updated last year
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆82Updated 10 months ago
• ablghtianyi / ICL_Modular_Arithmetic
  ☆19Updated 5 months ago
• Bradley-Butcher / Conformers
  Unofficial implementation of Conformal Language Modeling by Quach et al
  ☆29Updated 2 years ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆128Updated 8 months ago
• BorealisAI / flora-opt
  This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.
  ☆104Updated last year
• Silent-Zebra / twisted-smc-lm
  ☆30Updated 5 months ago
• SalesforceAIResearch / Elastic-Reasoning
  Make reasoning models scalable
  ☆45Updated 3 months ago
• codezakh / DataEnvGym
  A testbed for agents and environments that can automatically improve models through data generation.
  ☆27Updated 6 months ago
• wmn-231314 / diffusion-data-constraint
  Official PyTorch implementation and models for paper "Diffusion Beats Autoregressive in Data-Constrained Settings". We find diffusion mod…
  ☆88Updated last week
• sail-sg / VeriFree
  Reinforcing General Reasoning without Verifiers
  ☆80Updated 2 months ago
• mistralai / mistral-evals
  ☆77Updated 2 weeks ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆42Updated 10 months ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆157Updated 2 months ago
• ahans30 / goldfish-loss
  [NeurIPS 2024] Goldfish Loss: Mitigating Memorization in Generative LLMs
  ☆91Updated 9 months ago
• ScalingIntelligence / large_language_monkeys
  ☆103Updated 11 months ago
• PiotrNawrot / sparse-frontier
  The evaluation framework for training-free sparse attention in LLMs
  ☆91Updated 2 months ago
• RodkinIvan / associative-recurrent-memory-transformer
  [ICML 24 NGSM workshop] Associative Recurrent Memory Transformer implementation and scripts for training and evaluation
  ☆51Updated this week
• RobertCsordas / moeut
  ☆85Updated last year
• Parallel-Reasoning / APR
  [COLM 2025] Code for Paper: Learning Adaptive Parallel Reasoning with Language Models
  ☆125Updated 3 weeks ago
• oripress / AlgoTune
  AlgoTune is a benchmark made up of 154 math, physics, and computer science problems. The goal is write code that solves each problem, and…
  ☆55Updated 2 weeks ago
• formll / resolving-scaling-law-discrepancies
  ☆20Updated last year
• sail-sg / Attention-Sink
  [ICLR 2025] When Attention Sink Emerges in Language Models: An Empirical View (Spotlight)
  ☆119Updated last month
• IdoAmos / not-from-scratch
  ☆33Updated 10 months ago
• locuslab / massive-activations
  Code accompanying the paper "Massive Activations in Large Language Models"
  ☆176Updated last year
• YefanZhou / TempBalance
  [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training
  ☆35Updated 5 months ago