Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)
☆46May 20, 2026Updated 5 months ago
Alternatives and similar repositories for RoSA
Users that are interested in RoSA are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆15May 4, 2024Updated 2 years ago
- ☆16Sep 27, 2023Updated 3 years ago
- Collection of autoregressive model implementation☆85Oct 1, 2026Updated last month
- Code for ICML 2022 paper "SPDY: Accurate Pruning with Speedup Guarantees"☆20May 3, 2023Updated 3 years ago
- [ICLR 2025] Linear Combination of Saved Checkpoints Makes Consistency and Diffusion Models Better☆16Feb 15, 2025Updated last year
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- AN EFFICIENT AND GENERAL FRAMEWORK FOR LAYERWISE-ADAPTIVE GRADIENT COMPRESSION☆16Oct 27, 2023Updated 3 years ago
- neural network and deep learning course projects to work and design on different problems such as classification, regression, optimisatio…☆16Aug 29, 2024Updated 2 years ago
- Using modal.com to process FineWeb-edu data☆21Sep 12, 2026Updated 2 months ago
- AFPQ code implementation☆23Nov 6, 2023Updated 3 years ago
- Benchmarking ChatGPT for Persian: A Preliminary Study☆21Apr 6, 2024Updated 2 years ago
- ☆12Oct 22, 2024Updated 2 years ago
- ☆24Jun 16, 2024Updated 2 years ago
- [ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models☆78Mar 12, 2024Updated 2 years ago
- Code for the paper "QMoE: Practical Sub-1-Bit Compression of Trillion-Parameter Models".☆279Nov 3, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Introduction to Quantization☆20Mar 3, 2024Updated 2 years ago
- ☆30Jul 22, 2024Updated 2 years ago
- [ICLR 2023] Eva: Practical Second-order Optimization with Kronecker-vectorized Approximation☆12Jul 31, 2023Updated 3 years ago
- ☆12Aug 22, 2023Updated 3 years ago
- [ICLR25] Official Implementation of "Decoupling Angles and Strength in Low-rank Adaptation"☆15Dec 12, 2025Updated 11 months ago
- MOTIF: Modular Thinking via Reinforcement Fine-tuning in LLMs☆17Jul 6, 2025Updated last year
- Code for data-aware compression of DeepSeek models☆75Dec 11, 2025Updated 11 months ago
- Second-Order Fine-Tuning without Pain for LLMs: a Hessian Informed Zeroth-Order Optimizer☆28Feb 11, 2025Updated last year
- ☆10Aug 22, 2023Updated 3 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Robust Differentially Private Training of Deep Neural Networks☆12Dec 10, 2020Updated 5 years ago
- ☆26Nov 23, 2023Updated 2 years ago
- Code accompanying the NeurIPS 2020 paper: WoodFisher (Singh & Alistarh, 2020)☆54Mar 8, 2021Updated 5 years ago
- ☆15Mar 20, 2025Updated last year
- Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna☆60Oct 18, 2025Updated last year
- Pytorch distributed backend extension with compression support☆17Mar 24, 2025Updated last year
- [EMNLP 2024] Quantize LLM to extremely low-bit, and finetune the quantized LLMs☆17Jul 18, 2024Updated 2 years ago
- [ICLR 2026] Autoregressive Image Generation with Randomized Parallel Decoding☆94Feb 16, 2026Updated 9 months ago
- Open addressing hash table on C++☆14Jan 19, 2015Updated 11 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆22Jul 30, 2024Updated 2 years ago
- Evaluation code for the EMNLP 2024 Findings paper introducing LongGenBench, a benchmark for long-context generation by large language mod…☆25Oct 8, 2024Updated 2 years ago
- HKUST(GZ) Marpit Template for Presentation☆10Nov 21, 2022Updated 3 years ago
- High Performance FP8 GEMM Kernels for SM89 and later GPUs.☆21Jan 24, 2025Updated last year
- Code for the ICML 2023 paper "SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot".☆905Aug 20, 2024Updated 2 years ago
- MiSS is a novel PEFT method that features a low-rank structure but introduces a new update mechanism distinct from LoRA, achieving an exc…☆37Mar 9, 2026Updated 8 months ago
- Implementation for our paper "Gradient Regularization prevents Reward Hacking in RLHF and RLVR". Implemented TRL and for Huggingface Tran…☆12Feb 24, 2026Updated 8 months ago
Are these results useful?