Second-Order Fine-Tuning without Pain for LLMs: a Hessian Informed Zeroth-Order Optimizer
☆27Feb 11, 2025Updated last year
Alternatives and similar repositories for HiZOO
Users that are interested in HiZOO are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆21Dec 5, 2024Updated last year
- [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆130Jul 6, 2025Updated last year
- ☆15May 4, 2024Updated 2 years ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆76Oct 9, 2024Updated last year
- ☆27Feb 22, 2024Updated 2 years ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- A fork of the PEFT library, supporting Robust Adaptation (RoSA)☆15Aug 16, 2024Updated 2 years ago
- Pytorch implementation of KFAC - this is a port of https://github.com/tensorflow/kfac/☆33Jun 6, 2024Updated 2 years ago
- Code to generate figures of paper "When do spectral gradient updates help in deep learning?"☆17Dec 3, 2025Updated 9 months ago
- [NeurIPS 2023] MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333☆1,174Jan 11, 2024Updated 2 years ago
- ☆38Mar 12, 2026Updated 6 months ago
- Using PyTorch autograd to compute Hessian of Perplexity for Large Language Models☆29Apr 17, 2025Updated last year
- LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning☆39Apr 4, 2024Updated 2 years ago
- Python B+ Tree basic implementation and Visualization☆13Sep 29, 2019Updated 6 years ago
- Fun project to run your own LLM chat bot using llama.cpp☆11Jun 9, 2023Updated 3 years ago
- AI Agents on DigitalOcean Gradient AI Platform • AdBuild production-ready AI agents using customizable tools or access multiple LLMs through a single endpoint. Create custom knowledge bases or connect external data.
- Distributed SDDMM Kernel☆13Jul 8, 2022Updated 4 years ago
- A implement of run-length encoding for Pytorch tensor using CUDA☆13Apr 7, 2021Updated 5 years ago
- Burrows-Wheeler-Scott transform☆13Jun 7, 2013Updated 13 years ago
- Implementation of the FedPM framework by the authors of the ICLR 2023 paper "Sparse Random Networks for Communication-Efficient Federated…☆30Feb 10, 2023Updated 3 years ago
- Matlab mex wrappers to cuSPARSE (NVIDIA)☆11Dec 10, 2025Updated 9 months ago
- This repository is pytorch version implement of LRU from the paper "Resurrecting Recurrent Neural Networks for Long Sequences" (https://a…☆12May 22, 2023Updated 3 years ago
- The dataset of our work where the application of portable Raman spectroscopy coupled with several supervised machine-learning techniques,…☆15Nov 21, 2019Updated 6 years ago
- Active Learning in the era of Foundation Models☆14Apr 16, 2025Updated last year
- This is the official implementation of the ICML 2023 paper - Can Forward Gradient Match Backpropagation ?☆13May 31, 2023Updated 3 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- SVIP: Towards Verifiable Inference of Open-Source Large Language Models☆15Jun 3, 2025Updated last year
- [ICLR'24] Heterogeneous Personalized Federated Learning by Local-Global Updates Mixing via Convergence Rate☆13Jun 17, 2025Updated last year
- BH hackathon☆14Apr 4, 2024Updated 2 years ago
- [ICML 2025] Official implementation for "The Emperor's New Clothes in Benchmarking? A Rigorous Examination of Mitigation Strategies for L…☆15May 23, 2025Updated last year
- Official PyTorch implementation of CD-MOE☆12Mar 18, 2026Updated 6 months ago
- This is the official implementation of TAGCOS: Task-agnostic Gradient Clustered Coreset Selection for Instruction Tuning Data☆13Jul 21, 2024Updated 2 years ago
- Python-code to analyse Raman spectroscopy☆15Apr 19, 2019Updated 7 years ago
- MLPerf Mobile benchmarks☆16Apr 28, 2026Updated 4 months ago
- ☆24Dec 6, 2025Updated 9 months ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- The official implementation of ImageBind-LLM and Whisper-LLM from the paper "Dynamic-SUPERB: Towards A Dynamic, Collaborative, and Compre…☆20Oct 30, 2023Updated 2 years ago
- ☆21Apr 20, 2026Updated 5 months ago
- Connect a Ublox NEO-6M/NE0-M8N gps module to a WiPy2.0/3.0☆10Apr 29, 2018Updated 8 years ago
- LLM4HWDesign Starting Toolkit☆20Oct 4, 2024Updated last year
- ☆13Sep 25, 2023Updated 2 years ago
- LLMA = LLM + Arithmetic coder, which use LLM to do insane text data compression. LLMA=大模型+算术编码，它能使用LLM对文本数据进行暴力的压缩，达到极高的压缩率。☆22Nov 24, 2024Updated last year
- Provides the code for the paper "EBPC: Extended Bit-Plane Compression for Deep Neural Network Inference and Training Accelerators" by Luk…☆17Oct 6, 2019Updated 6 years ago