Rishit-dagli / NystromformerLinks
An implementation of the Nyströmformer, using Nystrom method to approximate standard self attention
☆57Updated 3 years ago
Alternatives and similar repositories for Nystromformer
Users that are interested in Nystromformer are comparing it to the libraries listed below
Sorting:
- Unifying Python/C++/CUDA memory: Python buffered array ↔️ `std::vector` ↔️ CUDA managed memory☆83Updated 2 weeks ago
- convert a scikit-learn decision tree into a Keras model☆39Updated 2 years ago
- An experiment with "freely" wired neural networks (no layers)☆164Updated last year
- Testing various image matching algorithms' performance on the Pinecone vector DB☆43Updated 2 years ago
- An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches☆43Updated 3 years ago
- 1.2% test error on MNIST using only least squares and numpy calls.☆20Updated 2 years ago
- Interactive Model Iteration with Weak Supervision and Pre-Trained Embeddings☆77Updated 3 years ago
- Small deep learning library written from scratch in Python, using NumPy/CuPy.☆124Updated 3 years ago
- fast combinations calculation in jax☆39Updated last year
- There are C language computer programs about the simulator, transformation, and test statistic of continuous Bernoulli distribution. More…☆25Updated last year
- duralava is a neural network which can simulate a lava lamp in an infinite loop.☆90Updated 2 years ago
- A "build to learn" Alpha Zero implementation using Gradient Boosted Decision Trees (LightGBM)☆86Updated 9 months ago
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- Reference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All…☆172Updated 2 years ago
- Just a small test to see which language is better for extending python when using lists of lists☆32Updated 2 years ago
- Run compute jobs on AWS as if you were running them locally.☆124Updated 4 years ago
- ☆20Updated 4 years ago
- Designing bridge trusses with Pytorch autograd☆61Updated last year
- Grow virtual creatures in static and physics simulated environments.☆53Updated last year
- Revealing example of self-attention, the building block of transformer AI models☆131Updated 2 years ago
- Beating the `bisect` module's implementation using C-extensions.☆30Updated 2 years ago
- A copy of ONNX models, datasets, and code all in one GitHub repository. Follow the README to learn more.☆105Updated 2 years ago
- Lazy, a tool for running things in idle time☆48Updated 4 years ago
- ☆127Updated 2 years ago
- Test prompts for GPT-J-6B and the resulting AI-generated texts☆53Updated 4 years ago
- Experiments with applying Fourier transofrms to various plane-filling curves and patterns☆66Updated 2 years ago
- A BERT that you can train on a (gaming) laptop.☆210Updated 2 years ago
- A Detailed Introduction to My Favorite Statistical Measure, Hoeffding's D☆100Updated last year
- Agent Based Model on GPU using CUDA 12.2.1 and OpenGL 4.5 (CUDA OpenGL interop) on Windows/Linux☆75Updated 9 months ago
- ☆12Updated 3 years ago