Rishit-dagli / Fast-Transformer
An implementation of Fastformer: Additive Attention Can Be All You Need, a Transformer Variant in TensorFlow
☆150Updated 2 years ago
Related projects ⓘ
Alternatives and complementary repositories for Fast-Transformer
- State of the art faster Transformer with Tensorflow 2.0 ( NLP, Computer Vision, Audio ).☆85Updated last year
- Code for the Shortformer model, from the ACL 2021 paper by Ofir Press, Noah A. Smith and Mike Lewis.☆145Updated 3 years ago
- Implementation of Perceiver, General Perception with Iterative Attention in TensorFlow☆86Updated 3 years ago
- An attempt at the implementation of GLOM, Geoffrey Hinton's paper for emergent part-whole hierarchies from data☆37Updated 3 years ago
- Dense Passage Retrieval using tensorflow-keras on TPU☆15Updated 3 years ago
- Accelerated NLP pipelines for fast inference on CPU. Built with Transformers and ONNX runtime.☆126Updated 3 years ago
- ☆38Updated last year
- Unofficial PyTorch implementation of Fastformer based on paper "Fastformer: Additive Attention Can Be All You Need"."☆134Updated 3 years ago
- Stabilize and achieve excellent performance with transformers☆41Updated 2 years ago
- Implementation of Fast Transformer in Pytorch☆171Updated 3 years ago
- High Performance Tensorflow Data Pipeline with State of Art Augmentations and low level optimizations.☆86Updated 2 years ago
- 🛠️ Tools for Transformers compression using PyTorch Lightning ⚡☆79Updated last week
- Instantly improve your training performance of TensorFlow models with just 2 lines of code!☆105Updated 2 years ago
- A Simple but Powerful CNN Trainer For PyTorch☆26Updated 3 years ago
- DiffQ performs differentiable quantization using pseudo quantization noise. It can automatically tune the number of bits used per weight …☆234Updated last year
- A python library for highly configurable transformers - easing model architecture search and experimentation.☆49Updated 2 years ago
- Management Dashboard for Torchserve☆121Updated last year
- Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP models…☆37Updated 2 years ago
- Minimal implementation of PAWS (https://arxiv.org/abs/2104.13963) in TensorFlow.☆45Updated 3 years ago
- Neural Search System on Arxiv AI/ML Papers☆52Updated 3 years ago
- GPT, but made only out of MLPs☆87Updated 3 years ago
- This repository hosts code for converting the original Vision Transformer models (JAX) to TensorFlow.☆34Updated 2 years ago
- A deep learning library based on Pytorch focussed on low resource language research and robustness☆69Updated 2 years ago
- This project shows how to derive the total number of training tokens from a large text dataset from 🤗 datasets with Apache Beam and Data…☆24Updated 2 years ago
- A GPT, made only of MLPs, in Jax☆55Updated 3 years ago
- Version control for software 2.0☆64Updated 3 years ago
- Neural networks in pandas☆51Updated 2 years ago
- Python Research Framework☆107Updated 2 years ago
- An Easy To Use PyTorch Computer Vision Library☆51Updated last year
- A library to synthesize text datasets using Large Language Models (LLM)☆151Updated last year