This is the official repository for the paper "Flora: Low-Rank Adapters Are Secretly Gradient Compressors" in ICML 2024.
☆106Jul 1, 2024Updated last year
Alternatives and similar repositories for flora-opt
Users that are interested in flora-opt are comparing it to the libraries listed below
Sorting:
- ☆82Nov 11, 2024Updated last year
- The hearth of The Pulsar App, fast, secure and shared inference with modern UI☆59Dec 1, 2024Updated last year
- GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection☆1,677Oct 28, 2024Updated last year
- ☆13Jan 15, 2025Updated last year
- Extend the Conditioning of Stable Diffusion to take Audio Embeddings Instead of Text Embeddings using Wav2Vec2-BERT model☆13Sep 25, 2024Updated last year
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆34Jun 20, 2024Updated last year
- a browser gui for nvidia smi☆20Mar 17, 2025Updated 11 months ago
- ☆33Jan 14, 2021Updated 5 years ago
- Fira: Can We Achieve Full-rank Training of LLMs Under Low-rank Constraint?☆119Oct 21, 2024Updated last year
- A Field-Theoretic Approach to Unbounded Memory in Large Language Models☆20Apr 15, 2025Updated 10 months ago
- The open-source materials for paper "Sparsing Law: Towards Large Language Models with Greater Activation Sparsity".☆30Nov 12, 2024Updated last year
- Simple LLM inference server☆20Jun 13, 2024Updated last year
- CompChomper is a framework for measuring how LLMs perform at code completion.☆21Apr 29, 2025Updated 10 months ago
- Official code for ReLoRA from the paper Stack More Layers Differently: High-Rank Training Through Low-Rank Updates☆473Apr 21, 2024Updated last year
- [ICML‘24] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".☆124Jul 6, 2025Updated 7 months ago
- Preprint: Asymmetry in Low-Rank Adapters of Foundation Models☆38Feb 27, 2024Updated 2 years ago
- ☆25Oct 31, 2024Updated last year
- Your personal ArXiv Feed☆23Dec 18, 2024Updated last year
- [ICDCS 2023] Evaluation and Optimization of Gradient Compression for Distributed Deep Learning☆10Apr 28, 2023Updated 2 years ago
- ☆71Jul 11, 2024Updated last year
- ☆24Jan 22, 2025Updated last year
- ☆46May 20, 2025Updated 9 months ago
- Official code for our paper, "LoRA-Pro: Are Low-Rank Adapters Properly Optimized? "☆144Apr 8, 2025Updated 10 months ago
- Automated LLM novelist☆46Apr 11, 2024Updated last year
- ☆108Mar 12, 2024Updated last year
- Setup an MCP server in 60 seconds.☆13Dec 12, 2024Updated last year
- ☆17Feb 18, 2026Updated last week
- ☆15Apr 9, 2025Updated 10 months ago
- Get aid from local LLMs right in your PowerShell☆15May 2, 2025Updated 9 months ago
- Token Omission Via Attention☆127Oct 13, 2024Updated last year
- Create text chunks which end at natural stopping points without using a tokenizer☆26Nov 26, 2025Updated 3 months ago
- ☆49Mar 9, 2025Updated 11 months ago
- Powerful LLM Query Framework with YAML Prompt Templates. Made for Automation☆34Sep 20, 2025Updated 5 months ago
- GoldFinch and other hybrid transformer components☆12Dec 9, 2025Updated 2 months ago
- ☆12Jul 30, 2025Updated 7 months ago
- Project of Singing Voice Conversion.☆16Oct 27, 2023Updated 2 years ago
- An official implementation for the EMNLP 2023 Findings paper "Prompt-Based Editing for Text Style Transfer"☆13Dec 9, 2023Updated 2 years ago
- Official code for "IT³: Idempotent Test-Time Training" (ICML 2025)☆14Jun 25, 2025Updated 8 months ago
- A repo to do interpretability of pre-trained acoustic models☆15Oct 15, 2023Updated 2 years ago