Second-Order Fine-Tuning without Pain for LLMs: a Hessian Informed Zeroth-Order Optimizer
☆28Feb 11, 2025Updated last year
Alternatives and similar repositories for HiZOO
Users that are interested in HiZOO are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆22Dec 5, 2024Updated last year
- Zeroth-Order Fine-Tuning of LLMs in Random Subspaces (ICCV 2025)☆21Nov 22, 2024Updated last year
- [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆131Jul 6, 2025Updated last year
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆76Oct 9, 2024Updated 2 years ago
- [EMNLP 24] Source code for paper 'AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tu…☆13Dec 15, 2024Updated last year
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆37May 28, 2024Updated 2 years ago
- ☆15May 4, 2024Updated 2 years ago
- Fine-tuning Quantized Neural Networks with Zeroth-order Optimization☆24Sep 17, 2025Updated last year
- Codes for paper: "LaMP-QA: A Benchmark for Personalized Long-form Question Answering"☆13Jun 3, 2025Updated last year
- Using PyTorch autograd to compute Hessian of Perplexity for Large Language Models☆31Apr 17, 2025Updated last year
- A fork of the PEFT library, supporting Robust Adaptation (RoSA)☆16Aug 16, 2024Updated 2 years ago
- Repo for "STAR: Spectral Truncation and Rescale for Model Merging" [NAACL 2025]☆11Oct 22, 2026Updated 3 weeks ago
- Official implementation of the ICML 2024 paper RoSA (Robust Adaptation)☆46May 20, 2026Updated 6 months ago
- Official implementation of the paper "Step-by-Step Unmasking for Parameter-Efficient Fine-tuning of Large Language Models"☆11Jul 2, 2025Updated last year
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Parse command line arguments by defining dataclasses☆14Oct 12, 2026Updated last month
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆39Apr 4, 2024Updated 2 years ago
- Code for paper: "LASeR: Learning to Adaptively Select Reward Models with Multi-Arm Bandits"☆14Sep 19, 2025Updated last year
- This is code associated with the paper: Broderick, T., Kulis, B. and Jordan, M. I. "MAD-bayes: MAP-based asymptotic derivations from Baye…☆10Jun 3, 2014Updated 12 years ago
- ☆14May 5, 2025Updated last year
- 基于ResNet50的图像分类小程序☆10Jun 20, 2021Updated 5 years ago
- Matlab mex wrappers to cuSPARSE (NVIDIA)☆11Dec 10, 2025Updated 11 months ago
- ☆10Sep 11, 2023Updated 3 years ago
- Implementation of Bayesian Logistic Regression using Expectation Propagation for approximate inference☆11Jun 1, 2018Updated 8 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- ☆11Mar 14, 2024Updated 2 years ago
- Implementation of DAC'22 paper: Hierarchical Memory-Constrained Operator Scheduling of Neural Architecture Search Networks.☆11Sep 5, 2022Updated 4 years ago
- BH hackathon☆14Apr 4, 2024Updated 2 years ago
- Code for paper "Why Do Transformers Fail to Forecast Time Series In-Context?"☆14Oct 15, 2025Updated last year
- This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?☆13May 31, 2023Updated 3 years ago
- SVIP: Towards Verifiable Inference of Open-Source Large Language Models☆15Jun 3, 2025Updated last year
- [ACL 2025] Understanding In-Context Machine Translation for Low-Resource Languages: A Case Study on Manchu☆13Sep 27, 2025Updated last year
- This repository is pytorch version implement of LRU from the paper "Resurrecting Recurrent Neural Networks for Long Sequences" (https://a…☆12May 22, 2023Updated 3 years ago
- ☆12Aug 17, 2022Updated 4 years ago
- Virtual machines for every use case on DigitalOcean • AdGet dependable uptime with 99.99% SLA, simple security tools, and predictable monthly pricing with DigitalOcean's virtual machines, called Droplets.
- [ICLR'24] Heterogeneous Personalized Federated Learning by Local-Global Updates Mixing via Convergence Rate☆14Jun 17, 2025Updated last year
- Comparative Analysis of Graph Neural Networks for Node Regression task on Wiki-Squirrel dataset (Bachelor's Research Project)☆14Nov 6, 2025Updated last year
- Connect a Ublox NEO-6M/NE0-M8N gps module to a WiPy2.0/3.0☆10Apr 29, 2018Updated 8 years ago
- ☆11Oct 12, 2024Updated 2 years ago
- Communication-Efficient Stochastic Zeroth-Order Optimization for Federated Learning☆12Oct 8, 2022Updated 4 years ago
- ☆13Sep 25, 2023Updated 3 years ago
- Official implementation of "Half-order Fine-Tuning for Diffusion Model: A Recursive Likelihood Ratio Optimizer", accepted by ICLR 2026 (o…☆14Apr 5, 2026Updated 7 months ago
Are these results useful?