This project is a implementation in PyTorch for ZO-AdaMU optimization: Adapting Perturbation with the Momentum and Uncertainty in Zeroth-order Optimization.
☆15Dec 12, 2023Updated 2 years ago
Alternatives and similar repositories for ZO-AdaMU
Users that are interested in ZO-AdaMU are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Code the ICML 2024 paper: "Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models"☆12Jun 25, 2024Updated 2 years ago
- [ICML 2024] SIRFShampoo: Structured inverse- and root-free Shampoo in PyTorch (https://arxiv.org/abs/2402.03496)☆15Nov 4, 2024Updated last year
- ☆21Dec 5, 2024Updated last year
- [ICML2025] Test-Time Learning for Large Language Models☆63Jan 31, 2026Updated 8 months ago
- A implement of run-length encoding for Pytorch tensor using CUDA☆13Apr 7, 2021Updated 5 years ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Official Repository for Frame Representation Hypothesis paper☆10Aug 14, 2026Updated 2 months ago
- A collection of niche / personally useful PyTorch optimizers with modified code.☆28Aug 23, 2026Updated 2 months ago
- easydel jax kernels writen in triton for gpus and pallas for tpus☆31Oct 22, 2026Updated last week
- [ICLR 2025] AdaFisher: Adaptive Second Order Optimization via Fisher Information☆54Feb 7, 2025Updated last year
- ☆11Dec 8, 2016Updated 9 years ago
- Building the Bi-LSTM & the CNN-GAN models to compose Classical Music in different eras☆12Aug 2, 2021Updated 5 years ago
- Automated Design of Agentic Systems☆10Sep 7, 2024Updated 2 years ago
- An implementation of a Brownian motion using ClojureScript with re-frame and Highcharts☆11Feb 8, 2019Updated 7 years ago
- ☆11Oct 11, 2022Updated 4 years ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- LSVerifier - Large Systems Verifier☆13Dec 3, 2025Updated 10 months ago
- Mini Model Daemon☆13Nov 9, 2024Updated last year
- ☆10Feb 18, 2024Updated 2 years ago
- [ICRA 2023] This is the official implementation of "Tac-VGNN: A Voronoi Graph Neural Network for Pose-Based Tactile Servoing".☆11Jun 7, 2023Updated 3 years ago
- (NeurIPS 2025) Official Code for L²M: Mutual Information Scaling Law for Long-Context Language Modeling☆14Nov 9, 2025Updated 11 months ago
- ☆32May 17, 2026Updated 5 months ago
- Repo to submit jobs to the AMD cluster☆12Oct 30, 2024Updated 2 years ago
- ☆11Oct 14, 2026Updated 2 weeks ago
- [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆132Jul 6, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- ☆15May 9, 2024Updated 2 years ago
- Official pytorch code for "APP: Anytime Progressive Pruning" (DyNN @ ICML, 2022; CLL @ ACML, 2022, SNN @ ICML, 2022 and SlowDNN 2023)☆16Nov 22, 2022Updated 3 years ago
- ☆13Oct 22, 2024Updated 2 years ago
- LLM-MemoryInspector is a Python-based toolkit designed to explore how LLMs memorize and retrieve MovieLens-1M specific information using …☆10Mar 21, 2026Updated 7 months ago
- Official Implementation of AttnTrace☆15Apr 23, 2026Updated 6 months ago
- ☆13Jan 31, 2025Updated last year
- ☆16Mar 22, 2025Updated last year
- HGRN2: Gated Linear RNNs with State Expansion☆59Aug 20, 2024Updated 2 years ago
- YouTube Assistant☆12May 15, 2023Updated 3 years ago
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- ☆10Dec 30, 2023Updated 2 years ago
- ☆13Jul 27, 2025Updated last year
- GoldFinch and other hybrid transformer components☆17Dec 9, 2025Updated 10 months ago
- Brax + Pufferlib + CARBS for gpu-accelerated robotics RL☆12Jun 12, 2025Updated last year
- Fourier Spatial-Temporal Network for Multivariate Time Series Forecasting☆11Jan 1, 2023Updated 3 years ago
- LLM Uncertainty Quantification with Attention Chain☆11Mar 24, 2025Updated last year
- The official implementation of ImageBind-LLM and Whisper-LLM from the paper "Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Compre…☆20Oct 30, 2023Updated 3 years ago