kiddyboots216 / lottery-ticket-adaptationLinks
Lottery Ticket Adaptation
☆39Updated 7 months ago
Alternatives and similar repositories for lottery-ticket-adaptation
Users that are interested in lottery-ticket-adaptation are comparing it to the libraries listed below
Sorting:
- A testbed for agents and environments that can automatically improve models through data generation.☆24Updated 4 months ago
- Resa: Transparent Reasoning Models via SAEs☆39Updated last month
- A repository for research on medium sized language models.☆77Updated last year
- The official implementation of Regularized Policy Gradient (RPG) (https://arxiv.org/abs/2505.17508)☆35Updated last week
- Official Repository for Task-Circuit Quantization☆20Updated last month
- Official implementation of ECCV24 paper: POA☆24Updated 11 months ago
- The code implementation of MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models…☆35Updated last year
- This is the oficial repository for "Safer-Instruct: Aligning Language Models with Automated Preference Data"☆17Updated last year
- The official repository for SkyLadder: Better and Faster Pretraining via Context Window Scheduling☆33Updated 3 months ago
- Anchored Preference Optimization and Contrastive Revisions: Addressing Underspecification in Alignment☆60Updated 10 months ago
- Aioli: A unified optimization framework for language model data mixing☆27Updated 5 months ago
- A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.☆33Updated last year
- Official implementation of "Reasoning Path Compression: Compressing Generation Trajectories for Efficient LLM Reasoning"☆18Updated last month
- ☆33Updated 6 months ago
- Code for "Accelerating Training with Neuron Interaction and Nowcasting Networks" [to appear at ICLR 2025]☆19Updated last month
- Code, results and other artifacts from the paper introducing the WildChat-50m dataset and the Re-Wild model family.☆29Updated 3 months ago
- Efficient Scaling laws and collaborative pretraining.☆16Updated 5 months ago
- Official repository for "BLEUBERI: BLEU is a surprisingly effective reward for instruction following"☆25Updated last month
- ☆13Updated 7 months ago
- From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients. Ajay Jaiswal, Lu Yin, Zhenyu Zhang, Shiwei Liu,…☆47Updated 2 months ago
- [NeurIPS 2024] Low rank memory efficient optimizer without SVD☆30Updated 2 weeks ago
- Official Code Repository for EnvGen: Generating and Adapting Environments via LLMs for Training Embodied Agents (COLM 2024)☆34Updated last year
- The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".☆23Updated 8 months ago
- ☆35Updated last year
- Q-Probe: A Lightweight Approach to Reward Maximization for Language Models☆41Updated last year
- Understanding the correlation between different LLM benchmarks☆29Updated last year
- ☆33Updated 3 weeks ago
- Efficient Dictionary Learning with Switch Sparse Autoencoders (SAEs)☆25Updated 7 months ago
- ☆23Updated 7 months ago
- Learning to Retrieve by Trying - Source code for Grounding by Trying: LLMs with Reinforcement Learning-Enhanced Retrieval☆39Updated 8 months ago