quanta-fine-tuning / quanta
(NeurIPS 2024) QuanTA: Efficient High-Rank Fine-Tuning of LLMs with Quantum-Informed Tensor Adaptation
☆26Updated 4 months ago
Alternatives and similar repositories for quanta:
Users that are interested in quanta are comparing it to the libraries listed below
- A thoroughly investigated survey for tensorial neural networks.☆128Updated 3 months ago
- Experiements on how conditional mutual information affects the performance of neural quantum states.☆13Updated 5 months ago
- Quantum error correction code AI-discovery with Jax☆29Updated 4 months ago
- Pytorch implementation of KFAC - this is a port of https://github.com/tensorflow/kfac/☆23Updated 10 months ago
- Smooth integration of tensor networks in machine learning☆39Updated 2 weeks ago
- A JAX based package designed for efficient second order operators (e.g., laplacian) computation.☆71Updated last year
- Tensor-Train decomposition in pytorch☆60Updated 2 months ago
- Omnigrok: Grokking Beyond Algorithmic Data☆55Updated 2 years ago
- Efficient and Accurate Neural-Network Ansatz for Quantum Monte Carlo☆63Updated 4 months ago
- JAX accelerated Quantum Monte Carlo☆74Updated last month
- Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024☆104Updated 4 months ago
- Our LLM for Rydberg atom physics☆36Updated 9 months ago
- DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule☆60Updated last year
- ☆10Updated 3 months ago
- A JAX library for Density Functional Theory.☆53Updated last month
- Official code for the paper "Predicting Properties of Quantum Systems with Conditional Generative Models"☆33Updated 2 years ago
- SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)☆30Updated 5 months ago
- ☆14Updated 11 months ago
- [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…☆53Updated 6 months ago
- PyTorch implementation for our ICLR 2024 paper "Diffusion Generative Flow Samplers: Improving learning signals through partial trajectory…☆24Updated last year
- Automatic Functional Differentiation in JAX☆70Updated 3 weeks ago
- 😎 A curated list of tensor decomposition resources for model compression.☆59Updated last week
- ☆31Updated 6 months ago
- Automatic High-Order Optimization for Tensors☆23Updated 2 years ago
- Riemannian optimization for quantum technologies☆59Updated 2 years ago
- Collecting research materials on neural samplers with diffusion/flow models☆45Updated last month
- This repository contains the official code for Energy Transformer---an efficient Energy-based Transformer variant for graph classificatio…☆23Updated last year
- Code for the paper: Why Transformers Need Adam: A Hessian Perspective☆56Updated last month
- Unofficial Implementation of Selective Attention Transformer☆16Updated 5 months ago
- This repo contains papers, books, tutorials and resources on Riemannian optimization.☆31Updated 4 months ago