An extention to the GaLore paper, to perform Natural Gradient Descent in low rank subspace
☆19Oct 21, 2024Updated 2 years ago
Alternatives and similar repositories for Natural-GaLore
Users that are interested in Natural-GaLore are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆14May 4, 2026Updated 6 months ago
- A simple tool for adapting a pretrained Huggingface model to a new vocabulary with (almost) no training.☆13Aug 12, 2025Updated last year
- [ICML 2025] From Low Rank Gradient Subspace Stabilization to Low-Rank Weights: Observations, Theories and Applications☆52Oct 30, 2025Updated last year
- Official implementation for "Mixture of In-Context Experts Enhance LLMs’ Awareness of Long Contexts" (Accepted by Neurips2024)☆14Jan 7, 2025Updated last year
- This repository contains code for the MicroAdam paper.☆21Dec 14, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients.☆207Jul 17, 2024Updated 2 years ago
- [EMNLP 25] An effective and interpretable weight-editing method for mitigating overly short reasoning in LLMs, and a mechanistic study un…☆21Aug 24, 2026Updated 2 months ago
- A PyQt5-based interactive tool for aligning and visualizing molecular analogs with customizable highlighting, transformations, and high-r…☆13Apr 29, 2026Updated 6 months ago
- Official code implementation for the ACL 2025 paper: 'Dynamic Scaling of Unit Tests for Code Reward Modeling'☆27May 16, 2025Updated last year
- ☆11Aug 26, 2024Updated 2 years ago
- Mixture of Lora Experts☆11Apr 7, 2024Updated 2 years ago
- Input geometries and scripts for the paper Reliable and Efficient Automated Transition-State Searches with Machine-Learned Interatomic Po…☆12May 2, 2026Updated 6 months ago
- Code for paper "Factual Confidence of LLMs: on Reliability and Robustness of Current Estimators"☆17Dec 4, 2024Updated last year
- [TMLR] "Can You Win Everything with Lottery Ticket?" by Tianlong Chen, Zhenyu Zhang, Jun Wu, Randy Huang, Sijia Liu, Shiyu Chang, Zhangy…☆10Sep 8, 2022Updated 4 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- A json Dataset with 25696 kpop songs. (2000 ~ 2023)☆11Dec 3, 2023Updated 2 years ago
- Updated fast, rule-free atom mapping for chemical reactions with a full pipeline to train, select, and evaluate your own RXNMapper/ALBERT…☆22Aug 20, 2026Updated 2 months ago
- An easy to use off-policy synthetic data distillation engine for LLMs.☆22Oct 4, 2026Updated last month
- CCLoco: Scaling Up Top-K Error Feedback with Local Optimizers☆29Aug 22, 2025Updated last year
- Code for lin-RFM used for sparse recovery tasks☆17Mar 13, 2025Updated last year
- ☆15Dec 2, 2024Updated last year
- Official implementation of ECCV24 paper: POA☆24Aug 8, 2024Updated 2 years ago
- ☆24Aug 23, 2026Updated 2 months ago
- a rubric driven prioritized replay rl algo to maximise continual learning☆16Oct 12, 2025Updated last year
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Token Omission Via Attention☆130Oct 13, 2024Updated 2 years ago
- ☆49Oct 30, 2026Updated 2 weeks ago
- ☆57Nov 6, 2024Updated 2 years ago
- Batched optimisation algorithms for neural network potential driven molecular dynamics.☆17Nov 27, 2025Updated 11 months ago
- ☆52Oct 29, 2024Updated 2 years ago
- Repository used to store the GKE AI Labs content for "Tutorials and Examples" section☆13Updated this week
- ☆33Nov 11, 2024Updated 2 years ago
- [COLM 2025] SEAL: Steerable Reasoning Calibration of Large Language Models for Free☆65Apr 6, 2025Updated last year
- Code for the EACL 2024 paper: "Small Language Models Improve Giants by Rewriting Their Outputs"☆12Apr 20, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- Adapters Strike Back (CVPR 2024)☆44Jul 24, 2024Updated 2 years ago
- A bLaZiNgLy fast search engine for browsing math problems to try. All problems scraped from the AoPS forums.☆11Jul 26, 2026Updated 3 months ago
- ☆57Oct 20, 2026Updated 3 weeks ago
- ☆10May 27, 2024Updated 2 years ago
- ☆10Jan 28, 2019Updated 7 years ago
- ☆12Feb 10, 2025Updated last year
- wandb-compatible single-process server, and a bad pun☆17Mar 24, 2026Updated 7 months ago
Are these results useful?