Alternatives and similar repositories for Expressive_Power_of_LoRA:

Users that are interested in Expressive_Power_of_LoRA are comparing it to the libraries listed below

• formll / resolving-scaling-law-discrepancies
  ☆17Updated 8 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆26Updated 10 months ago
• ethz-spylab / superhuman-ai-consistency
  ☆28Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆44Updated last year
• rtaori / data_feedback
  Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"
  ☆15Updated 2 years ago
• katiekang1998 / reasoning_generalization
  ☆30Updated 2 months ago
• JonasGeiping / dataaugs
  ☆17Updated 2 years ago
• tml-epfl / icl-alignment
  Is In-Context Learning Sufficient for Instruction Following in LLMs? [ICLR 2025]
  ☆29Updated last month
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated 9 months ago
• sjelassi / transformers_ssm_copy
  ☆30Updated last year
• cassidylaidlaw / orpo
  ☆14Updated 4 months ago
• nathanhu0 / CaMeLS
  Codebase for Context-aware Meta-learned Loss Scaling (CaMeLS). https://arxiv.org/abs/2305.15076.
  ☆25Updated last year
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆79Updated last year
• sustcsonglin / gated_linear_attention_layer
  ☆33Updated last year
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆15Updated last month
• uclaml / PDE
  Official repo of Progressive Data Expansion: data, code and evaluation
  ☆28Updated last year
• peterljq / Parsimonious-Concept-Engineering
  Implementation of PaCE: Parsimonious Concept Engineering for Large Language Models (NeurIPS 2024)
  ☆33Updated 4 months ago
• ablghtianyi / ICL_Modular_Arithmetic
  ☆18Updated 4 months ago
• PAIR-code / pretraining-tda
  ☆13Updated last month
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆71Updated 4 months ago
• jmerullo / lm_vector_arithmetic
  ☆33Updated last year
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆20Updated 3 months ago
• srush / mamba-scans
  Blog post
  ☆17Updated last year
• dunzeng / MORE
  Code for EMNLP'24 paper - On Diversified Preferences of Large Language Model Alignment
  ☆15Updated 7 months ago
• xiamengzhou / training_trajectory_analysis
  [ACL 2023]: Training Trajectories of Language Models Across Scales https://arxiv.org/pdf/2212.09803.pdf
  ☆23Updated last year
• RandallBalestriero / SplineLLM
  ☆15Updated last year
• RobertCsordas / linear_layer_as_attention
  The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns …
  ☆16Updated last year
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆45Updated last month