Alternatives and similar repositories for quanta

Users that are interested in quanta are comparing it to the libraries listed below

• zyushun / hessian-spectrum
  Code for the paper: Why Transformers Need Adam: A Hessian Perspective
  ☆60Updated 4 months ago
• tnbar / awesome-tensorial-neural-networks
  A thoroughly investigated survey for tensorial neural networks.
  ☆137Updated 6 months ago
• KindXiaoming / Omnigrok
  Omnigrok: Grokking Beyond Algorithmic Data
  ☆61Updated 2 years ago
• zoq / Awesome-Optimizer
  Collect optimizer related papers, data, repositories
  ☆94Updated 8 months ago
• fangyuan-ksgk / selective-attention-transformer
  Unofficial Implementation of Selective Attention Transformer
  ☆17Updated 9 months ago
• YefanZhou / TempBalance
  [NeurIPS 2023 Spotlight] Temperature Balancing, Layer-wise Weight Analysis, and Neural Network Training
  ☆35Updated 4 months ago
• Lemon-cmd / energy-transformer-graph
  This repository contains the official code for Energy Transformer---an efficient Energy-based Transformer variant for graph classificatio…
  ☆25Updated last year
• sail-sg / stde
  Official implementation of Stochastic Taylor Derivative Estimator (STDE) NeurIPS2024
  ☆115Updated 8 months ago
• zqOuO / GWT
  ☆13Updated 6 months ago
• AndPotap / einsum-search
  ☆32Updated 10 months ago
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆53Updated last month
• n-gao / pytorch-kfac
  Pytorch implementation of KFAC - this is a port of https://github.com/tensorflow/kfac/
  ☆26Updated last year
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆63Updated last year
• pvti / Awesome-Tensor-Decomposition
  😎 A curated list of tensor decomposition resources for model compression.
  ☆77Updated last week
• andyjm3 / SLTrain
  SLTrain: a sparse plus low-rank approach for parameter and memory efficient pretraining (NeurIPS 2024)
  ☆32Updated 9 months ago
• Graph-COM / HEPT
  [ICML 2024 Oral] LSH-Based Efficient Point Transformer (HEPT)
  ☆20Updated 6 months ago
• OpenMOSS / LongLLaDA
  LongLLaDA: Unlocking Long Context Capabilities in Diffusion LLMs
  ☆26Updated 2 weeks ago
• kwignb / NeuralTangentKernel-Papers
  Neural Tangent Kernel Papers
  ☆115Updated 6 months ago
• ablghtianyi / ICL_Modular_Arithmetic
  ☆19Updated 4 months ago
• chengxiang / LinearTransformer
  Pytorch code for experiments on Linear Transformers
  ☆21Updated last year
• ion-g-ion / torchTT
  Tensor-Train decomposition in pytorch
  ☆72Updated 6 months ago
• deep-spin / adasplash
  AdaSplash: Adaptive Sparse Flash Attention (aka Flash Entmax Attention)
  ☆19Updated 3 weeks ago
• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆66Updated 10 months ago
• pilancilab / Riemannian_Preconditioned_LoRA
  source code for paper "Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models"
  ☆30Updated last year
• gpauloski / kfac-pytorch
  Distributed K-FAC preconditioner for PyTorch
  ☆89Updated this week
• TianjinYellow / SPAM-Optimizer
  ☆34Updated 4 months ago
• yifanycc / loretta
  [NAACL 24 Oral] LoRETTA: Low-Rank Economic Tensor-Train Adaptation for Ultra-Low-Parameter Fine-Tuning of Large Language Models
  ☆36Updated 7 months ago
• WeiHuang05 / Awesome_Large_Foundation_Model_Theory
  Welcome to the 'In Context Learning Theory' Reading Group
  ☆29Updated 9 months ago
• epfml / optML-pku
  summer school materials
  ☆44Updated 2 years ago
• insuhan / hyper-attn
  ☆81Updated last year