miniHuiHui / awesome-high-order-neural-network

Related projects: ⓘ

• jwzhanggy / tinyBIG
  tinybig for deep function learning
  ☆35Updated 2 weeks ago
• kyegomez / SwitchTransformers
  Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficien…
  ☆44Updated last week
• zugexiaodui / torch_flops
  A library for calculating the FLOPs in the forward() process based on torch.fx
  ☆72Updated 2 weeks ago
• WailordHe / DenseSSM
  A repository for DenseSSMs
  ☆86Updated 5 months ago
• OPTML-Group / DeepZero
  [ICLR'24] "DeepZero: Scaling up Zeroth-Order Optimization for Deep Model Training" by Aochuan Chen*, Yimeng Zhang*, Jinghan Jia, James Di…
  ☆35Updated 6 months ago
• zeke-xie / deep-learning-dynamics-paper-list
  This is a list of peer-reviewed representative papers on deep learning dynamics (optimization dynamics of neural networks). The success o…
  ☆241Updated 5 months ago
• transformer-vq / transformer_vq
  ☆170Updated 9 months ago
• kyegomez / Griffin
  Implementation of Griffin from the paper: "Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models"
  ☆48Updated last week
• yuanyige / pde-add
  [AAAI 2024] PDE+: Enhancing Generalization via PDE with Adaptive Distributional Diffusion
  ☆18Updated 6 months ago
• JacksonWuxs / Forward-Forward-Network
  Implementation of Forward Forward Network proposed by Hinton in NIPS 2022.
  ☆161Updated last year
• ZO-Bench / ZO-LLM
  [ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".
  ☆62Updated 2 months ago
• badripatro / mamba360
  State Space Models
  ☆55Updated 4 months ago
• zeke-xie / adaptive-inertia-adai
  [ICML 2022, Oral] The PyTorch Implementation of Adaptive Inertia Methods. The algorithms are based on our paper: "Adaptive Inertia: Dise…
  ☆138Updated last year
• zbh2047 / SortNet
  [NeurIPS 2022] A novel 1-Lipschitz network that can be efficiently trained to achieve certified L-infinity robustness for free!
  ☆30Updated last year
• changwxx / Awesome-Optimal-Transport-in-Deep-Learning
  a collection of AWESOME things about Optimal Transport in Deep Learning
  ☆172Updated 4 months ago
• minyoungg / vqtorch
  ☆103Updated 6 months ago
• ycjing / Awesome-Model-Merging
  A curated list of Model Merging methods.
  ☆71Updated this week
• jokofa / torch_kmeans
  PyTorch implementations of KMeans, Soft-KMeans and Constrained-KMeans which can be run on GPU and work on (mini-)batches of data.
  ☆50Updated last year
• zeke-xie / stable-weight-decay-regularization
  [NeurIPS 2023] The PyTorch Implementation of Scheduled (Stable) Weight Decay.
  ☆57Updated 7 months ago
• Chaos96 / fourierft
  ☆119Updated last week
• WeiHuang05 / Awesome-Feature-Learning-in-Deep-Learning-Thoery
  Welcome to the Awesome Feature Learning in Deep Learning Thoery Reading Group! This repository serves as a collaborative platform for sch…
  ☆137Updated last month
• xxgege / GAM
  The official repo for CVPR2023 highlight paper "Gradient Norm Aware Minimization Seeks First-Order Flatness and Improves Generalization".
  ☆76Updated last year
• XueFuzhao / WideNet_Code
  Implementation of AAAI 2022 Paper: Go wider instead of deeper
  ☆32Updated last year
• pengzhangzhi / Awesome-Mamba
  Awesome list of papers that extend Mamba to various applications.
  ☆124Updated 3 weeks ago
• ML-GSAI / Understanding-GDA
  Towards understanding modern generative data augmentation techniques.
  ☆22Updated last year
• zhangyikaii / LAMDA-ZhiJian
  ZhiJian: A Unifying and Rapidly Deployable Toolbox for Pre-trained Model Reuse
  ☆49Updated last year
• Hsu1023 / DuQuant
  Rotation and Permutation for Advanced Outlier Management and Efficient Quantization of LLMs
  ☆24Updated last week
• TianjinYellow / UGTs-LoG
  This is the official code for UGTs.
  ☆13Updated last year
• i404788 / s5-pytorch
  Pytorch implementation of Simplified Structured State-Spaces for Sequence Modeling (S5)
  ☆58Updated 4 months ago
• THUMNLab / CurML
  ☆73Updated last year