Alternatives and similar repositories for TransformerX

Users that are interested in TransformerX are comparing it to the libraries listed below

• rasbt / cvpr2023
  ☆133Updated 2 years ago
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆122Updated last year
• slds-lmu / seminar_multimodal_dl
  https://slds-lmu.github.io/seminar_multimodal_dl/
  ☆171Updated 3 years ago
• rasbt / faster-pytorch-blog
  Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracy
  ☆129Updated 2 years ago
• NVlabs / gbrl
  Gradient Boosting Reinforcement Learning (GBRL)
  ☆135Updated 2 months ago
• rasbt / pytorch-memory-optim
  This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…
  ☆92Updated 2 years ago
• HenryNdubuaku / nanodl
  A Jax-based library for building transformers, includes implementations of GPT, Gemma, LlaMa, Mixtral, Whisper, SWin, ViT and more.
  ☆298Updated last year
• warner-benjamin / commented-transformers
  Highly commented implementations of Transformers in PyTorch
  ☆138Updated 2 years ago
• sidhu2690 / Deep-KAN
  This repository contains a better implementation of Kolmogorov-Arnold networks
  ☆63Updated 7 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆103Updated last year
• rasbt / RAGs
  RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systems
  ☆141Updated last year
• eduardoleao052 / Autograd-from-scratch
  Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.
  ☆122Updated last year
• muellerzr / minimal-trainer-zoo
  Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 lines
  ☆196Updated last year
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆126Updated last year
• Chris-hughes10 / pytorch-accelerated
  A lightweight library designed to accelerate the process of training PyTorch models by providing a minimal, but extensible training loop …
  ☆193Updated 3 weeks ago
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆53Updated last year
• dpressel / mint
  MinT: Minimal Transformer Library and Tutorials
  ☆260Updated 3 years ago
• epfml / DenseFormer
  ☆82Updated last year
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆170Updated 11 months ago
• sayakpaul / keras-xla-benchmarks
  Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.
  ☆37Updated 2 years ago
• Lightning-AI / tutorials
  Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.
  ☆319Updated 5 months ago
• kyegomez / swarms-pytorch
  Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch 😊
  ☆136Updated last week
• jiaweizzhao / ZerO-initialization
  ☆75Updated 3 years ago
• nreHieW / loss
  Visualising Losses in Deep Neural Networks
  ☆16Updated last year
• rasbt / dora-from-scratch
  LoRA and DoRA from Scratch Implementations
  ☆215Updated last year
• jxbz / agd
  Automatic gradient descent
  ☆217Updated 2 years ago
• ariG23498 / timm-wrapper-examples
  Notebooks to demonstrate TimmWrapper
  ☆16Updated last year
• MrPio / KAN-Continual_Learning_tests
  Collection of tests performed during the study of the new Kolmogorov-Arnold Neural Networks (KAN)
  ☆41Updated 11 months ago
• andrewgcodes / xlstm
  my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architecture
  ☆134Updated last year
• Atcold / NYU-DLFL22
  NYU Deep Learning Fall 2022
  ☆63Updated last year