4-bit Shampoo for Memory-Efficient Network Training (NeurIPS 2024)
☆13Feb 13, 2025Updated last year
Alternatives and similar repositories for low-bit-Shampoo
Users that are interested in low-bit-Shampoo are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Zeroth-Order Fine-Tuning of LLMs in Random Subspaces (ICCV 2025)☆21Nov 22, 2024Updated last year
- Single-thread, end-to-end C++ implementation of the Bitnet (1.58-bit weight) model☆15Nov 17, 2024Updated last year
- Denoising-Stage-Aligned Quantization-Aware Training for Video Generation☆14Sep 4, 2026Updated 2 months ago
- Harness for Codex-style agents working on matching decompilation goals☆10Jun 16, 2026Updated 4 months ago
- [WACV 2025] Exploiting VLM Localizability and Semantics for Open Vocabulary Action Detection☆17Mar 23, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- [WACV 2025] 🌍🚗 SpaGBOL: Spatial-Graph-Based Orientated Localisation 📡🗺️☆14Apr 9, 2025Updated last year
- Repo to submit jobs to the AMD cluster☆12Oct 30, 2024Updated 2 years ago
- MCP server for Nile Database - Manage and query databases, tenants, users, auth using LLMs☆19Mar 10, 2025Updated last year
- PyTorch implementation of Hessian Free optimisation☆45Dec 19, 2019Updated 6 years ago
- LaionBox: Fine-tuned DramaBox TTS with Multi-Auxiliary Differentiable Losses☆16Jun 14, 2026Updated 4 months ago
- implementation of https://arxiv.org/pdf/2312.09299☆21Jul 3, 2024Updated 2 years ago
- Implementation of Q-Learning using TD error to navigate a maze avoiding obstacles and a moving enemy☆10Mar 4, 2018Updated 8 years ago
- Official implementation of ICLR 2025 'LORO: Parameter and Memory Efficient Pretraining via Low-rank Riemannian Optimization'☆19Apr 24, 2025Updated last year
- The official implementation of "GAReT: Cross-view Video Geolocalization with Adapters and Auto-Regressive Transformers" [European Confere…☆13Dec 13, 2024Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A modern, GPU-accelerated Reservoir Computing library for PyTorch. ResDAG brings the power of Echo State Networks (ESNs) and reservoir c…☆14Oct 24, 2026Updated last week
- Fast, Numerically Stable, and Auto-Differentiable Spectral Clipping via Newton-Schulz Iteration☆12Jun 21, 2025Updated last year
- Official Implementation of "GRIFFIN: Effective Token Alignment for Faster Speculative Decoding"[NeurIPS 2025]☆21May 12, 2025Updated last year
- A repo based on XiLin Li's PSGD repo that extends some of the experiments.☆14Oct 7, 2024Updated 2 years ago
- Implementation of the multi-objective genetic optimization algorithm NSGA-II☆12Jun 22, 2025Updated last year
- A meta MCP server that seamlessly scales LLMs to 1000+ MCP servers through automatic routing.☆17May 22, 2025Updated last year
- A fully trainable state space model (SSM)☆16Mar 18, 2025Updated last year
- Johnson-Lindenstrauss transform (JLT), random projections (RP), fast Johnson-Lindenstrauss transform (FJLT), and randomized Hadamard tran…☆24Jul 11, 2023Updated 3 years ago
- KANs and MLPs☆12Jun 7, 2024Updated 2 years ago
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models☆14Aug 2, 2026Updated 3 months ago
- Train to 94% on CIFAR-10 in 4.4 seconds on a single A100☆12Dec 30, 2023Updated 2 years ago
- This is a detailed code demo on how to conduct Full-Param Supervised Fine-tuning (SFT) and DPO (Direct Preference Optimization)☆21Jan 9, 2025Updated last year
- ☆13Apr 25, 2024Updated 2 years ago
- ☆18Jun 16, 2026Updated 4 months ago
- Implementation of PSGD optimizer in JAX☆41Dec 31, 2024Updated last year
- ☆19Dec 7, 2025Updated 10 months ago
- ☆12Sep 1, 2026Updated 2 months ago
- Leverage on recent advances in graph convolution and sequence modeling to design neural networks for spatio-temporal forecasting, which i…☆26Oct 6, 2020Updated 6 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.☆19Jul 24, 2025Updated last year
- idk☆13Jan 23, 2026Updated 9 months ago
- This is the official repository for the paper "Learning Sequence Descriptor based on Spatio-Temporal Attention for Visual Place Recogniti…☆18Oct 9, 2023Updated 3 years ago
- An implementation of DecorrelatedBN by tensorflow☆13Jun 30, 2022Updated 4 years ago
- [IROS 2024] 🦜🌍 BEV-CV: Birds-Eye-View Transform for Cross-View Geo-Localisation 📡🗺️☆16Mar 4, 2025Updated last year
- Python trust-region subproblem solvers for nonlinear optimization☆31Updated this week
- Trust Region Optimization in Python☆28Oct 25, 2026Updated last week