tensorops / TransformerXLinks
Flexible Python library providing building blocks (layers) for reproducible Transformers research (Tensorflow β
, Pytorch π, and Jax π)
β53Updated last year
Alternatives and similar repositories for TransformerX
Users that are interested in TransformerX are comparing it to the libraries listed below
Sorting:
- This repository contains a better implementation of Kolmogorov-Arnold networksβ63Updated 3 months ago
- Gradient Boosting Reinforcement Learning (GBRL)β118Updated 3 weeks ago
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 linesβ197Updated last year
- ML/DL Math and Method notesβ63Updated last year
- Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.β37Updated 2 years ago
- β134Updated last year
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog poβ¦β92Updated 2 years ago
- my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architectureβ131Updated last year
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"β101Updated 8 months ago
- A miniture AI training framework for PyTorchβ42Updated 7 months ago
- Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.β52Updated last year
- Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracyβ128Updated 2 years ago
- Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.β120Updated last year
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of newβ¦β124Updated last year
- Highly commented implementations of Transformers in PyTorchβ137Updated 2 years ago
- RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systemsβ124Updated 7 months ago
- β75Updated 2 years ago
- A set of of fundamental operations and deep learning models using JAXβ14Updated 4 years ago
- β82Updated last year
- β99Updated 2 months ago
- Training small GPT-2 style models using Kolmogorov-Arnold networks.β121Updated last year
- Train fastai models faster (and other useful tools)β70Updated 3 months ago
- Collection of autoregressive model implementationβ86Updated 4 months ago
- A lightweight library designed to accelerate the process of training PyTorch models by providing a minimal, but extensible training loop β¦β190Updated 2 months ago
- Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch πβ129Updated 3 weeks ago
- β59Updated last year
- β32Updated last year
- several types of attention modules written in PyTorch for learning purposesβ53Updated 11 months ago
- Repository containing awesome resources regarding Hugging Face tooling.β48Updated last year
- Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.β319Updated last month