quanta-fine-tuning / quantaLinks
(NeurIPS 2024) QuanTA: Efficient High-Rank Fine-Tuning of LLMs with Quantum-Informed Tensor Adaptation
☆28Updated 6 months ago
Alternatives and similar repositories for quanta
Users that are interested in quanta are comparing it to the libraries listed below
Sorting:
- A thoroughly investigated survey for tensorial neural networks.☆135Updated 4 months ago
- Tensor-Train decomposition in pytorch☆64Updated 4 months ago
- 😎 A curated list of tensor decomposition resources for model compression.☆68Updated 2 weeks ago
- A JAX based package designed for efficient second order operators (e.g., laplacian) computation.☆72Updated last year
- Experiements on how conditional mutual information affects the performance of neural quantum states.☆13Updated 7 months ago
- Efficient Riemannian Optimization on Stiefel Manifold via Cayley Transform☆40Updated 6 years ago
- Pytorch implementation of KFAC - this is a port of https://github.com/tensorflow/kfac/☆25Updated last year
- source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"☆26Updated 11 months ago
- Collect optimizer related papers, data, repositories☆91Updated 6 months ago
- ☆32Updated 8 months ago
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆59Updated 2 months ago
- Physics-inspired transformer modules based on mean-field dynamics of vector-spin models in JAX☆41Updated last year
- Implementation of Forward Laplacian algorithm in JAX☆76Updated last week
- This repo contains papers, books, tutorials and resources on Riemannian optimization.☆36Updated last week
- JAX accelerated Quantum Monte Carlo☆78Updated last week
- Forward mode laplacian implemented in JAX tracer☆29Updated 3 months ago
- Quantum error correction code AI-discovery with Jax☆39Updated last week
- A JAX library for Density Functional Theory.☆53Updated this week
- Python Algorithms for Randomized Linear Algebra☆54Updated 2 years ago
- ☆13Updated 4 months ago
- ☆28Updated this week
- Compressible Dynamics in Deep Overparameterized Low-Rank Learning & Adaptation (ICML'24 Oral)☆14Updated 10 months ago
- Smooth integration of tensor networks in machine learning☆43Updated 2 months ago
- TensorLy-Torch: Deep Tensor Learning with TensorLy and PyTorch☆78Updated 11 months ago
- Distributed K-FAC preconditioner for PyTorch☆87Updated last week
- Riemannian Optimization Using JAX☆49Updated last year
- Code for lin-RFM used for sparse recovery tasks☆14Updated 2 months ago
- PyTorch implementation for our ICLR 2024 paper "Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory…☆24Updated last year
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆31Updated 7 months ago
- JAX implementation of Kolmogorov Arnold Networks (KANs).☆10Updated last year