Rishit-dagli / Nystromformer
An implementation of the Nyströmformer, using Nystrom method to approximate standard self attention
☆57Updated 2 years ago
Alternatives and similar repositories for Nystromformer:
Users that are interested in Nystromformer are comparing it to the libraries listed below
- An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches☆43Updated 3 years ago
- convert a scikit-learn decision tree into a Keras model☆39Updated last year
- Unifying Python/C++/CUDA memory: Python buffered array ↔️ `std::vector` ↔️ CUDA managed memory☆81Updated this week
- duralava is a neural network which can simulate a lava lamp in an infinite loop.☆90Updated last year
- A library for incremental loading of large PyTorch checkpoints☆56Updated last year
- Just a small test to see which language is better for extending python when using lists of lists☆31Updated last year
- ☆18Updated 2 years ago
- Testing various image matching algorithms' performance on the Pinecone vector DB☆43Updated last year
- An experiment with "freely" wired neural networks (no layers)☆163Updated 6 months ago
- There are C language computer programs about the simulator, transformation, and test statistic of continuous Bernoulli distribution. More…☆25Updated 9 months ago
- Brzozowski derivative python sketch☆85Updated 10 months ago
- Designing bridge trusses with Pytorch autograd☆61Updated last year
- This is a numpy implementation of the Skip-gram algorithm described in Mikolov et al's Word2Vec paper. It is intended for didactic purpos…☆35Updated last year
- A simple transformer implementation without difficult syntax and extra bells and whistles.☆44Updated last year
- 1.2% test error on MNIST using only least squares and numpy calls.☆17Updated last year
- ☆126Updated last year
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆104Updated last year
- A runtime shape checker and auto-annotator for tensor programs (pronounced "stanley")☆39Updated 5 years ago
- A fast Tsetlin Machine implementation employing bit-wise operators, with MNIST demo.☆67Updated 5 years ago
- Tensorflow implementation of Collaborative Sampling for Image inpainting☆35Updated 4 years ago
- C++ raytracer that supports custom models. Supports running the calculations on the CPU using C++11 threads or in the GPU via CUDA.☆75Updated 2 years ago
- ☆19Updated 4 years ago
- ☆39Updated 2 years ago
- Blazing fast, composable, Pythonic quantile filters.☆135Updated last year
- A simple optical illusion in python☆41Updated 4 years ago
- A BERT that you can train on a (gaming) laptop.☆210Updated last year
- Experiments with applying Fourier transofrms to various plane-filling curves and patterns☆66Updated last year
- Minimal deep learning library written from scratch in Python, using NumPy/CuPy.☆120Updated 2 years ago
- Test prompts for GPT-J-6B and the resulting AI-generated texts☆53Updated 3 years ago
- My name is Ananda Seelan and this is my blog☆44Updated 4 years ago