Rishit-dagli / Nystromformer
An implementation of the Nyströmformer, using Nystrom method to approximate standard self attention
☆57Updated 2 years ago
Alternatives and similar repositories for Nystromformer:
Users that are interested in Nystromformer are comparing it to the libraries listed below
- An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches☆43Updated 2 years ago
- Brzozowski derivative python sketch☆83Updated 9 months ago
- Unifying Python/C++/CUDA memory: Python buffered array ↔️ `std::vector` ↔️ CUDA managed memory☆81Updated 3 weeks ago
- A library for incremental loading of large PyTorch checkpoints☆56Updated last year
- duralava is a neural network which can simulate a lava lamp in an infinite loop.☆90Updated last year
- convert a scikit-learn decision tree into a Keras model☆39Updated last year
- ☆18Updated 2 years ago
- There are C language computer programs about the simulator, transformation, and test statistic of continuous Bernoulli distribution. More…☆25Updated 8 months ago
- Designing bridge trusses with Pytorch autograd☆61Updated 11 months ago
- An experiment with "freely" wired neural networks (no layers)☆163Updated 6 months ago
- ☆38Updated 2 years ago
- Minimal deep learning library written from scratch in Python, using NumPy/CuPy.☆120Updated 2 years ago
- 🧮 Reading group about differential, integral and logical calculi.☆26Updated 8 months ago
- Just a small test to see which language is better for extending python when using lists of lists☆31Updated last year
- Testing various image matching algorithms' performance on the Pinecone vector DB☆43Updated last year
- An attempt at the implementation of GLOM, Geoffrey Hinton's paper for emergent part-whole hierarchies from data☆37Updated 3 years ago
- My name is Ananda Seelan and this is my blog☆44Updated 4 years ago
- A simple optical illusion in python☆41Updated 4 years ago
- Reproduce parallax effect for an user whose point of view is tracked by a camera☆69Updated 4 years ago
- Beating the `bisect` module's implementation using C-extensions.☆30Updated last year
- Statistical classifier for immune repertoires☆45Updated 2 years ago
- analysis of complete spotify streaming dataset (endsong_*.json)☆66Updated 10 months ago
- C++ raytracer that supports custom models. Supports running the calculations on the CPU using C++11 threads or in the GPU via CUDA.☆75Updated 2 years ago
- ☆32Updated 2 weeks ago
- A star for organising blocks and playing with transformers.☆23Updated 9 months ago
- A Detailed Introduction to My Favorite Statistical Measure, Hoeffding's D☆97Updated 11 months ago
- [Archived] A scalable differentiable probabilistic Datalog engine, with Rust☆72Updated 3 years ago
- A BERT that you can train on a (gaming) laptop.☆210Updated last year
- CLI tool for exploring arXiv (inspired by karpathy's brilliant ArXiv Sanity Preserver)☆39Updated 3 years ago
- This is a numpy implementation of the Skip-gram algorithm described in Mikolov et al's Word2Vec paper. It is intended for didactic purpos…☆35Updated last year