tensorops / TransformerXLinks
Flexible Python library providing building blocks (layers) for reproducible Transformers research (Tensorflow β
, Pytorch π, and Jax π)
β53Updated last year
Alternatives and similar repositories for TransformerX
Users that are interested in TransformerX are comparing it to the libraries listed below
Sorting:
- β133Updated last year
- Presents comprehensive benchmarks of XLA-compatible pre-trained models in Keras.β37Updated last year
- This repository contains a better implementation of Kolmogorov-Arnold networksβ62Updated last month
- Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"β101Updated 6 months ago
- Outlining techniques for improving the training performance of your PyTorch model without compromising its accuracyβ128Updated 2 years ago
- Gradient Boosting Reinforcement Learning (GBRL)β116Updated last month
- Training small GPT-2 style models using Kolmogorov-Arnold networks.β120Updated last year
- RAGs: Simple implementations of Retrieval Augmented Generation (RAG) Systemsβ123Updated 6 months ago
- ML/DL Math and Method notesβ61Updated last year
- Documented and Unit Tested educational Deep Learning framework with Autograd from scratch.β117Updated last year
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog poβ¦β92Updated 2 years ago
- my attempts at implementing various bits of Sepp Hochreiter's new xLSTM architectureβ130Updated last year
- ICLR 2025 - official implementation for "I-Con: A Unifying Framework for Representation Learning"β102Updated 3 weeks ago
- Conference schedule, top papers, and analysis of the data for NeurIPS 2023!β119Updated last year
- Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of newβ¦β124Updated 11 months ago
- β81Updated last year
- Highly commented implementations of Transformers in PyTorchβ136Updated last year
- Minimal example scripts of the Hugging Face Trainer, focused on staying under 150 linesβ197Updated last year
- Representation Learning MSc course Summer Semester 2023β80Updated 2 years ago
- Swarming algorithms like PSO, Ant Colony, Sakana, and more in PyTorch πβ126Updated last month
- Notebooks for fine tuning pali gemmaβ111Updated 3 months ago
- A miniture AI training framework for PyTorchβ42Updated 5 months ago
- several types of attention modules written in PyTorch for learning purposesβ53Updated 9 months ago
- Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-expertsβ120Updated 9 months ago
- β31Updated last year
- https://slds-lmu.github.io/seminar_multimodal_dl/β169Updated 2 years ago
- Repository containing awesome resources regarding Hugging Face tooling.β47Updated last year
- β58Updated last year
- deep learning with pytorch lightningβ1Updated 8 months ago
- β124Updated 8 months ago