Bayesian Low-Rank Adaptation for Large Language Models
☆36Jun 22, 2024Updated last year
Alternatives and similar repositories for bayesian_lora
Users that are interested in bayesian_lora are comparing it to the libraries listed below
Sorting:
- Bayesian low-rank adaptation for large language models☆28May 4, 2024Updated last year
- ☆12Jul 30, 2025Updated 7 months ago
- This is the repository for "Model Merging by Uncertainty-Based Gradient Matching", ICLR 2024.☆29May 15, 2024Updated last year
- This repo is to demo the concept of lossless compression with Transformers as encoder and decoder.☆14May 2, 2024Updated last year
- ☆15Sep 24, 2023Updated 2 years ago
- A repository with implementations of major papers on Gaussian Process regression models, implemented from scratch in Python, notably incl…☆14Nov 19, 2022Updated 3 years ago
- Official implementation of "How Reliable is Your Regression Model's Uncertainty Under Real-World Distribution Shifts?", TMLR 2023.☆18Mar 21, 2024Updated last year
- Scaling Sparse Fine-Tuning to Large Language Models☆18Jan 31, 2024Updated 2 years ago
- Source Code for the ICML 2020 Paper on Uncertainty & Robustness in Deep Learning☆17Aug 28, 2023Updated 2 years ago
- The code repository for the CURLoRA research paper. Stable LLM continual fine-tuning and catastrophic forgetting mitigation.☆53Aug 28, 2024Updated last year
- [ICLR 2025] Official implementation of paper "Dynamic Low-Rank Sparse Adaptation for Large Language Models".☆23Mar 16, 2025Updated 11 months ago
- Code accompanying the ICML'24 paper "Feature Contamination: Neural Networks Learn Uncorrelated Features and Fail to Generalize"☆23Feb 13, 2025Updated last year
- PyTorch implementation of Probabilistic MIMO U-Net☆22Aug 15, 2024Updated last year
- Discrete Bayesian optimization with LLMs, PEFT finetuning methods, and the Laplace approximation.☆22Jul 30, 2024Updated last year
- MiSS is a novel PEFT method that features a low-rank structure but introduces a new update mechanism distinct from LoRA, achieving an exc…☆31Jan 28, 2026Updated last month
- Quantification of Uncertainty with Adversarial Models☆29Jul 11, 2023Updated 2 years ago
- ☆33Jul 8, 2024Updated last year
- Code for paper "Parameter Efficient Multi-task Model Fusion with Partial Linearization"☆24Sep 13, 2024Updated last year
- quick playground to animate pippin☆14Nov 11, 2024Updated last year
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆34Jun 20, 2024Updated last year
- ☆30Jul 22, 2024Updated last year
- Repository for CPU Kernel Generation for LLM Inference☆28Jul 13, 2023Updated 2 years ago
- Official Implementation of the ICML 2023 paper: "Neural Wave Machines: Learning Spatiotemporally Structured Representations with Locally …☆77May 30, 2023Updated 2 years ago
- Conic10K: A large-scale dataset for closed-vocabulary math problem understanding. Accepted to EMNLP2023 Findings.☆31Dec 6, 2023Updated 2 years ago
- Implementation of LPLR algorithm for matrix compression☆31Nov 21, 2023Updated 2 years ago
- Exploring how to to deal with uncertain inputs with gaussian process regression models.☆27Apr 16, 2021Updated 4 years ago
- (NeurIPS 2024) QuanTA: Efficient High-Rank Fine-Tuning of LLMs with Quantum-Informed Tensor Adaptation☆35Nov 18, 2025Updated 3 months ago
- Implementation of the FedPM framework by the authors of the ICLR 2023 paper "Sparse Random Networks for Communication-Efficient Federated…☆30Feb 10, 2023Updated 3 years ago
- ☆37Dec 19, 2024Updated last year
- [ICLR 2026] ParallelBench: Understanding the Tradeoffs of Parallel Decoding in Diffusion LLMs☆30Updated this week
- Libraries, guides, blueprints, and sample code, to enable rapidly building 0-1 applications on iOS, Android and web.☆11May 12, 2023Updated 2 years ago
- Compressed LLMs for Efficient Text Generation [ICLR'24 Workshop]☆90Sep 13, 2024Updated last year
- Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry☆42Jan 15, 2024Updated 2 years ago
- Multi-Candidate Speculative Decoding☆39Apr 22, 2024Updated last year
- Failsafe value retrieval, modification and utils using json-pointer spec☆14Dec 20, 2025Updated 2 months ago
- The PyTorch implementation of paper "KERMIT: Knowledge Graph Completion of Enhanced Relation Modeling with Inverse Transformation"☆15Jul 4, 2025Updated 7 months ago
- A conditional expression compiler☆15Jun 26, 2025Updated 8 months ago
- Development repository for the Digital Terraria Lab implementation of the Sugarscape agent-based societal simulation.☆15Updated this week
- Dewey Data Inc. Python API☆14Jul 2, 2025Updated 8 months ago