feather-ai / transformers-tutorialLinks
The code for the video tutorial series on building a Transformer from scratch: https://www.youtube.com/watch?v=XR4VDnJzB8o
☆18Updated 2 years ago
Alternatives and similar repositories for transformers-tutorial
Users that are interested in transformers-tutorial are comparing it to the libraries listed below
Sorting:
- Implementation of Tranception, an attention network, paired with retrieval, that is SOTA for protein fitness prediction☆32Updated 3 years ago
- Little article showing how to load pytorch's models with linear memory consumption☆34Updated 2 years ago
- This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.☆14Updated 3 years ago
- An implementation of Transformer with Expire-Span, a circuit for learning which memories to retain☆34Updated 4 years ago
- Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"☆58Updated last year
- The Forward-Forward Algorithm for Drug Discovery☆34Updated 2 years ago
- notebooks of cool EBM visualizations☆15Updated 4 years ago
- Implementation of CaiT models in TensorFlow and ImageNet-1k checkpoints. Includes code for inference and fine-tuning.☆12Updated 2 years ago
- Materials for "Transformers from the Ground Up" at PyData Jeddah on August 5, 2021☆20Updated 3 years ago
- JAX implementation of Learning to learn by gradient descent by gradient descent☆27Updated 8 months ago
- Simple illustrative examples for energy-based models in PyTorch☆62Updated 5 years ago
- This project shows how to build a simple handwriting recognizer in Keras with the IAM dataset.☆13Updated 3 years ago
- NLP Examples using the 🤗 libraries☆41Updated 4 years ago
- Basic guidance on how to contribute to Papers with Code☆23Updated 3 years ago
- Contains my experiments with the `big_vision` repo to train ViTs on ImageNet-1k.☆22Updated 2 years ago
- ☆13Updated 3 weeks ago
- Simply Numpy implementation of the FAVOR+ attention mechanism, https://teddykoker.com/2020/11/performers/☆38Updated 4 years ago
- Utilities for PyTorch distributed☆24Updated 3 months ago
- Intro to GAN Tutorial for the International Summer School of Deep Learning 2021 in Gdansk☆24Updated 3 years ago
- Implementation of N-Grammer, augmenting Transformers with latent n-grams, in Pytorch☆74Updated 2 years ago
- ☆24Updated 2 years ago
- Contains Colab Notebooks show cool use-cases of different GCP ML APIs.☆10Updated 4 years ago
- Contrastive Language-Image Pretraining☆38Updated 11 months ago
- Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network☆50Updated 11 months ago
- ☆26Updated 2 years ago
- This code repository contains the code used for my "Optimizing Memory Usage for Training LLMs and Vision Transformers in PyTorch" blog po…☆92Updated last year
- Implementation of Denoising Diffusion for protein design, but using the new Equiformer (successor to SE3 Transformers) with some addition…☆57Updated 2 years ago
- Introductory lecture on Pytorch☆17Updated 3 years ago
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆49Updated 3 years ago
- Pytorch reimplementation of Molecule Attention Transformer, which uses a transformer to tackle the graph-like structure of molecules☆59Updated 4 years ago