Alternatives and similar repositories for Expressive_Power_of_LoRA

Users that are interested in Expressive_Power_of_LoRA are comparing it to the libraries listed below

• formll / resolving-scaling-law-discrepancies
  ☆19Updated 10 months ago
• dangxingyu / rnn-icrag
  Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"
  ☆27Updated last year
• cassidylaidlaw / orpo
  ☆15Updated 6 months ago
• VITA-Group / Junk_DNA_Hypothesis
  [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…
  ☆16Updated last month
• allenbai01 / transformers-as-statisticians
  ☆32Updated last year
• yidingjiang / ado
  The repository contains code for Adaptive Data Optimization
  ☆24Updated 5 months ago
• ethz-spylab / superhuman-ai-consistency
  ☆29Updated last year
• JonasGeiping / dataaugs
  ☆18Updated 2 years ago
• hamishivi / automated-instruction-selection
  Exploration of automated dataset selection approaches at large scales.
  ☆41Updated 3 months ago
• tml-epfl / sharpness-vs-generalization
  A modern look at the relationship between sharpness and generalization [ICML 2023]
  ☆43Updated last year
• IBM / ColPret
  Efficient Scaling laws and collaborative pretraining.
  ☆16Updated 4 months ago
• epfml / schedules-and-scaling
  Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"
  ☆73Updated 7 months ago
• rtaori / data_feedback
  Code for the paper "Data Feedback Loops: Model-driven Amplification of Dataset Biases"
  ☆16Updated 2 years ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated 4 months ago
• JeanKaddour / LAWA
  Latest Weight Averaging (NeurIPS HITY 2022)
  ☆30Updated last year
• sustcsonglin / gated_linear_attention_layer
  ☆32Updated last year
• kamanphoebe / Look-into-MoEs
  [NAACL 2025] A Closer Look into Mixture-of-Experts in Large Language Models
  ☆52Updated 3 months ago
• mcleish7 / gemstone-scaling-laws
  ☆25Updated 3 months ago
• yikangshen / megablocks
  ☆20Updated last year
• abhishekpanigrahi1996 / transformer_in_transformer
  ☆45Updated last year
• BrachioLab / incontext_influences
  In-context Example Selection with Influences
  ☆15Updated 2 years ago
• JeanKaddour / NoTrainNoGain
  Revisiting Efficient Training Algorithms For Transformer-based Language Models (NeurIPS 2023)
  ☆80Updated last year
• princeton-nlp / LM-Kernel-FT
  A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643
  ☆76Updated last year
• hartvigsen-group / composable-interventions
  ☆28Updated 3 months ago
• Leiay / looped_transformer
  ☆26Updated last year
• VITA-Group / Random-MoE-as-Dropout
  [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…
  ☆51Updated 2 years ago
• wenzhe-li / Self-MoA
  ☆18Updated 4 months ago
• Doraemonzzz / hgru2-pytorch
  ☆23Updated 8 months ago
• Leooyii / LCEG
  Long Context Extension and Generalization in LLMs
  ☆56Updated 8 months ago
• Asap7772 / understanding-rlhf
  Learning from preferences is a common paradigm for fine-tuning language models. Yet, many algorithmic design decisions come into play. Ou…
  ☆29Updated last year