tensorops / TransformerXLinks
Flexible Python library providing building blocks (layers) for reproducible Transformers research (Tensorflow β
, Pytorch π, and Jax π)
β53Updated last year
Alternatives and similar repositories for TransformerX
Users that are interested in TransformerX are comparing it to the libraries listed below
Sorting:
- β133Updated 2 years ago
- Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracyβ129Updated 2 years ago
- Highly commented implementations of Transformers in PyTorchβ139Updated 2 years ago
- This repository contains a better implementation of Kolmogorov-Arnold networksβ63Updated 7 months ago
- Gradient Boosting Reinforcement Learning (GBRL)β131Updated 2 months ago
- Collection of Pytorch lightning tutorial form as rich scripts automatically transformed to ipython notebooks.β320Updated 5 months ago
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 linesβ196Updated last year
- A miniture AI training framework for PyTorchβ42Updated 11 months ago
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"β103Updated last year
- https://slds-lmu.github.io/seminar_multimodal_dl/β171Updated 2 years ago
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog poβ¦β92Updated 2 years ago
- β101Updated last month
- Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.β37Updated 2 years ago
- A lightweight library designed to accelerate the process of training PyTorch models by providing a minimal, but extensible training loop β¦β193Updated last week
- ML/DL Math and Method notesβ65Updated 2 years ago
- Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch πβ136Updated 2 months ago
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of newβ¦β126Updated last year
- Training small GPT-2 style models using Kolmogorov-Arnold networks.β122Updated last year
- Train fastai models faster (and other useful tools)β72Updated 7 months ago
- Implementation of the Llama architecture with RLHF + Q-learningβ170Updated 11 months ago
- RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systemsβ141Updated 11 months ago
- Materials for workshops on the Hugging Face ecosystemβ150Updated 2 years ago
- β15Updated 2 years ago
- β75Updated 3 years ago
- A project template where PyTorch Lightning, Pydantic, and more! being used for training MNIST as an example.β28Updated 3 years ago
- my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architectureβ134Updated last year
- Cyclemoid implementation for PyTorchβ90Updated 3 years ago
- Repository containing awesome resources regarding Hugging Face tooling.β48Updated 2 years ago
- Getting Started with PyTorch Lightning, Published by Packtβ163Updated 3 weeks ago
- LoRA and DoRA from Scratch Implementationsβ215Updated last year