kiddyboots216 / lottery-ticket-adaptationLinks
Lottery Ticket Adaptation
☆39Updated 6 months ago
Alternatives and similar repositories for lottery-ticket-adaptation
Users that are interested in lottery-ticket-adaptation are comparing it to the libraries listed below
Sorting:
- ☆32Updated 4 months ago
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆32Updated 2 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆28Updated 8 months ago
- [ICLR 2025] Official Pytorch Implementation of "Mix-LN: Unleashing the Power of Deeper Layers by Combining Pre-LN and Post-LN" by Pengxia…☆21Updated 5 months ago
- Make reasoning models scalable☆32Updated this week
- Official repository of "LiNeS: Post-training Layer Scaling Prevents Forgetting and Enhances Model Merging"☆26Updated 7 months ago
- Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More☆31Updated 2 weeks ago
- Official implementation of "Reasoning Path Compression: Compressing Generation Trajectories for Efficient LLM Reasoning"☆14Updated last week
- Efficient Scaling laws and collaborative pretraining.☆16Updated 4 months ago
- ☆17Updated last month
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆57Updated 9 months ago
- Official implementation of ECCV24 paper: POA☆24Updated 9 months ago
- Aioli: A unified optimization framework for language model data mixing☆25Updated 4 months ago
- ☆17Updated 5 months ago
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Updated last year
- From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…☆47Updated last month
- https://footprints.baulab.info☆17Updated 8 months ago
- The official implementation of Regularized Policy Gradient (RPG) (https://arxiv.org/abs/2505.17508)☆27Updated last week
- A repository for research on medium sized language models.☆76Updated last year
- Exploration of automated dataset selection approaches at large scales.☆41Updated 3 months ago
- Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"☆37Updated last year
- Code Implementation, Evaluations, Documentation, Links and Resources for Min P paper☆35Updated 2 months ago
- Repository for the Q-Filters method (https://arxiv.org/pdf/2503.02812)☆31Updated 2 months ago
- An official implementation of "Catastrophic Failure of LLM Unlearning via Quantization" (ICLR 2025)☆27Updated 3 months ago
- Codebase for Instruction Following without Instruction Tuning☆34Updated 8 months ago
- ☆34Updated 11 months ago
- Code for experiments on self-prediction as a way to measure introspection in LLMs☆13Updated 5 months ago
- Repo hosting codes and materials related to speeding LLMs' inference using token merging.☆36Updated last year
- Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)☆42Updated last year
- ☆45Updated 3 months ago