UW-Madison-Lee-Lab / Expressive_Power_of_LoRALinks
Code for "The Expressive Power of Low-Rank Adaptation".
☆20Updated last year
Alternatives and similar repositories for Expressive_Power_of_LoRA
Users that are interested in Expressive_Power_of_LoRA are comparing it to the libraries listed below
Sorting:
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆27Updated last year
- ☆20Updated 11 months ago
- [ICML 2024] Junk DNA Hypothesis: A Task-Centric Angle of LLM Pre-trained Weights through Sparsity; Lu Yin*, Ajay Jaiswal*, Shiwei Liu, So…☆16Updated 2 months ago
- Efficient Scaling laws and collaborative pretraining.☆16Updated 4 months ago
- ☆32Updated 5 months ago
- Exploration of automated dataset selection approaches at large scales.☆45Updated 3 months ago
- ☆28Updated 3 months ago
- ☆17Updated 4 months ago
- A Kernel-Based View of Language Model Fine-Tuning https://arxiv.org/abs/2210.05643☆75Updated last year
- [ICLR 2023] "Sparse MoE as the New Dropout: Scaling Dense and Self-Slimmable Transformers" by Tianlong Chen*, Zhenyu Zhang*, Ajay Jaiswal…☆52Updated 2 years ago
- ICML 2024 - Official Repository for EXO: Towards Efficient Exact Optimization of Language Model Alignment☆57Updated last year
- ☆19Updated 3 months ago
- ☆29Updated 2 years ago
- Implementation of Influence Function approximations for differently sized ML models, using PyTorch☆15Updated last year
- ☆32Updated last year
- ☆45Updated last year
- Minimum Description Length probing for neural network representations☆18Updated 4 months ago
- Recycling diverse models☆44Updated 2 years ago
- Code for reproducing our paper "Low Rank Adapting Models for Sparse Autoencoder Features"☆10Updated 2 months ago
- Code for NeurIPS 2024 Spotlight: "Scaling Laws and Compute-Optimal Training Beyond Fixed Training Durations"☆74Updated 7 months ago
- The repository contains code for Adaptive Data Optimization☆25Updated 6 months ago
- ☆29Updated 11 months ago
- ☆26Updated 4 months ago
- ☆20Updated last year
- ☆14Updated last year
- ☆27Updated 2 years ago
- Self-Supervised Alignment with Mutual Information☆19Updated last year
- Using FlexAttention to compute attention with different masking patterns☆44Updated 9 months ago
- Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…☆27Updated 2 years ago
- ☆22Updated 3 years ago