Zeroth-Order Fine-Tuning of LLMs in Random Subspaces (ICCV 2025)
☆20Nov 22, 2024Updated last year
Alternatives and similar repositories for SubZero
Users that are interested in SubZero are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Second-Order Fine-Tuning without Pain for LLMs: a Hessian Informed Zeroth-Order Optimizer☆27Feb 11, 2025Updated last year
- [EMNLP 24] Source code for paper 'AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tu…☆13Dec 15, 2024Updated last year
- Implementation of "Federated Full-Parameter Tuning of Billion-Sized Language Models with Communication Cost under 18 Kilobytes" (https://…☆13May 6, 2024Updated 2 years ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆75Oct 9, 2024Updated last year
- Parse command line arguments by defining dataclasses☆14Aug 18, 2026Updated 2 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Data and visualizations for the photontorch paper (Scientific Reports)☆18Aug 4, 2020Updated 6 years ago
- Code for the article "Accelerated Forward-Backward Optimization using Deep Learning"☆12Sep 15, 2021Updated 4 years ago
- Audio Masking Methods☆12Nov 15, 2019Updated 6 years ago
- ☆11Dec 8, 2016Updated 9 years ago
- Two methods: Multi-Frame method with MAP&Total variation&sparse representation&total variation in time domain and Singe-Frame with CNN ne…☆13Nov 16, 2018Updated 7 years ago
- Experimenting with Lapped Transforms Jupyter Notebook☆14Jun 13, 2025Updated last year
- Fine-tuning Quantized Neural Networks with Zeroth-order Optimization☆23Sep 17, 2025Updated 11 months ago
- ☆20Apr 20, 2026Updated 4 months ago
- ☆32Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- AAAI2025☆13Apr 18, 2025Updated last year
- LLMA = LLM + Arithmetic coder, which use LLM to do insane text data compression. LLMA=大模型+算术编码，它能使用LLM对文本数据进行暴力的压缩，达到极高的压缩率。☆22Nov 24, 2024Updated last year
- Code Repository for the EMCL 2021 "Multitask Recalibrated Aggregation Network for Medical Code Prediction"☆13Sep 7, 2021Updated 4 years ago
- The present project aims to predict air pollution in Beijing, China, using the data set "Beijing Multi-Site Air-Quality Data Data Set"☆15Jul 1, 2023Updated 3 years ago
- Python translation of Mike TIpping's SparseBayes MATLAB program☆14Jul 22, 2015Updated 11 years ago
- A 12 week intensive course about Python and data science.☆22May 3, 2024Updated 2 years ago
- Repository to run the Tensor Convolutional Dictionary Learning with FISTA (TC-FISTA) algorithm☆12Jun 22, 2022Updated 4 years ago
- An up-to-date list of progress made in next-generation AI.☆10Apr 2, 2023Updated 3 years ago
- Task Aware Downscaling for efficient storing and accurate reconstruction in image and video domain☆12Jul 25, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- ☆11Aug 28, 2017Updated 9 years ago
- ☆14May 29, 2025Updated last year
- Data for the scico project☆14Updated this week
- ☆14Apr 12, 2026Updated 4 months ago
- ☆23May 6, 2022Updated 4 years ago
- survery of small language models☆18Jul 23, 2024Updated 2 years ago
- SQL注入测试靶场☆10Mar 22, 2017Updated 9 years ago
- [IEEE ICASSP 2021] "A fast randomized adaptive CP decomposition for streaming tensors". In 46th IEEE International Conference on Acoustic…☆12Feb 16, 2023Updated 3 years ago
- ☆27Feb 22, 2024Updated 2 years ago
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Implementation of PReLUNet by chainer (Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification: https…☆11Feb 2, 2017Updated 9 years ago
- Robust natural language watermarking using invariant features☆28Oct 15, 2023Updated 2 years ago
- ☆35Dec 14, 2023Updated 2 years ago
- Code for Neural Networks journal paper - StoCFL: A stochastically clustered federated learning framework for Non-IID data with dynamic cl…☆13Apr 28, 2024Updated 2 years ago
- Pytorch implementation of Hebbian learning algorithms to train deep convolutional neural networks.☆26Jul 2, 2024Updated 2 years ago
- ☆22Dec 21, 2020Updated 5 years ago
- Large-scale Bound-constrained Optimization☆20May 8, 2026Updated 3 months ago