This project is a implementation in PyTorch for ZO-AdaMU optimization: Adapting Perturbation with the Momentum and Uncertainty in Zeroth-order Optimization.
☆15Dec 12, 2023Updated 2 years ago
Alternatives and similar repositories for ZO-AdaMU
Users that are interested in ZO-AdaMU are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code the ICML 2024 paper: "Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models"☆12Jun 25, 2024Updated 2 years ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆76Oct 9, 2024Updated 2 years ago
- [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)☆15Nov 4, 2024Updated 2 years ago
- ☆22Dec 5, 2024Updated last year
- Fine-tuning Quantized Neural Networks with Zeroth-order Optimization☆24Sep 17, 2025Updated last year
- End-to-end encrypted cloud storage - Proton Drive • AdSpecial offer: 40% Off Yearly / 80% Off First Month. Protect your most important files, photos, and documents from prying eyes.
- Official Repository for Frame Representation Hypothesis paper☆10Oct 26, 2026Updated 3 weeks ago
- [ICML2025] Test-Time Learning for Large Language Models☆63Jan 31, 2026Updated 9 months ago
- [EMNLP 24] Source code for paper 'AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tu…☆13Dec 15, 2024Updated last year
- easydel jax kernels writen in triton for gpus and pallas for tpus☆31Oct 25, 2026Updated 3 weeks ago
- [ICLR 2025] AdaFisher: Adaptive Second Order Optimization via Fisher Information☆54Feb 7, 2025Updated last year
- [NeurIPS 2024] Codes for "Understanding Linear Probing then Fine-tuning Language Models from NTK Perspective"☆11Dec 22, 2024Updated last year
- A collection of niche / personally useful PyTorch optimizers with modified code.☆28Aug 23, 2026Updated 2 months ago
- An implementation of a Brownian motion using ClojureScript with re-frame and Highcharts☆11Feb 8, 2019Updated 7 years ago
- Parallel, Concurrent, and Distributed Programming in Java Specialization☆12Mar 4, 2019Updated 7 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ☆11Oct 11, 2022Updated 4 years ago
- LSVerifier - Large Systems Verifier☆13Dec 3, 2025Updated 11 months ago
- query-level uncertainty in LLMs☆13Mar 27, 2026Updated 7 months ago
- ☆10Feb 18, 2024Updated 2 years ago
- Does all kind of cool stuff to make analyzing meta classes easier. Now featuring WRedLogger.py, the previous backend of NetDbg☆10Jun 7, 2023Updated 3 years ago
- Repo to submit jobs to the AMD cluster☆12Oct 30, 2024Updated 2 years ago
- YouTube Assistant☆12May 15, 2023Updated 3 years ago
- ☆10Dec 30, 2023Updated 2 years ago
- Noise Substitution in Vector Quantization for Machine Learning☆12Oct 14, 2026Updated last month
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- HGRN2: Gated Linear RNNs with State Expansion☆59Aug 20, 2024Updated 2 years ago
- ☆10May 14, 2025Updated last year
- Brax + Pufferlib + CARBS for gpu-accelerated robotics RL☆12Jun 12, 2025Updated last year
- ☆12Nov 20, 2025Updated 11 months ago
- Common code library☆15Feb 3, 2018Updated 8 years ago
- Fourier Spatial-Temporal Network for Multivariate Time Series Forecasting☆11Jan 1, 2023Updated 3 years ago
- A 12 week intensive course about Python and data science.☆22May 3, 2024Updated 2 years ago
- The official implementation of ImageBind-LLM and Whisper-LLM from the paper "Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Compre…☆20Oct 30, 2023Updated 3 years ago
- (NeurIPS 2025) Official Code for L²M: Mutual Information Scaling Law for Long-Context Language Modeling☆14Nov 9, 2025Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- HomebrewNLP in JAX flavour for maintable TPU-Training☆50Jan 20, 2024Updated 2 years ago
- ☆14Jul 18, 2025Updated last year
- ☆11Dec 8, 2022Updated 3 years ago
- [MICCAI 2025 Early Accept] PRETI: Patient-Aware Retinal Foundation Model via Metadata-Guided Representation Learning☆12Aug 1, 2025Updated last year
- [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆131Jul 6, 2025Updated last year
- [ICML 2025] On the Emergence of Position Bias in Transformers☆11Nov 12, 2025Updated last year
- ☆52Jan 18, 2024Updated 2 years ago
Are these results useful?