Rishit-dagli / NystromformerLinks
An implementation of the Nyströmformer, using Nystrom method to approximate standard self attention
☆56Updated 3 years ago
Alternatives and similar repositories for Nystromformer
Users that are interested in Nystromformer are comparing it to the libraries listed below
Sorting:
- Unifying Python/C++/CUDA memory: Python buffered array ↔️ `std::vector` ↔️ CUDA managed memory☆82Updated 3 weeks ago
- An experiment with "freely" wired neural networks (no layers)☆163Updated last year
- convert a scikit-learn decision tree into a Keras model☆39Updated last year
- Interactive Model Iteration with Weak Supervision and Pre-Trained Embeddings☆77Updated 3 years ago
- ☆126Updated 2 years ago
- An Implementation of Transformer in Transformer in TensorFlow for image classification, attention inside local patches☆43Updated 3 years ago
- Testing various image matching algorithms' performance on the Pinecone vector DB☆43Updated 2 years ago
- ☆254Updated 2 years ago
- A library for incremental loading of large PyTorch checkpoints☆56Updated 2 years ago
- Brzozowski derivative python sketch☆85Updated 4 months ago
- Reference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All…☆172Updated 2 years ago
- A Detailed Introduction to My Favorite Statistical Measure, Hoeffding's D☆99Updated last year
- duralava is a neural network which can simulate a lava lamp in an infinite loop.☆90Updated 2 years ago
- Run compute jobs on AWS as if you were running them locally.☆125Updated 3 years ago
- Python library for embedding large graphs in 2D space, using force-directed layouts.☆163Updated 2 years ago
- C++ raytracer that supports custom models. Supports running the calculations on the CPU using C++11 threads or in the GPU via CUDA.☆76Updated 2 years ago
- Beating the `bisect` module's implementation using C-extensions.☆30Updated 2 years ago
- Small deep learning library written from scratch in Python, using NumPy/CuPy.☆124Updated 2 years ago
- Grow virtual creatures in static and physics simulated environments.☆53Updated last year
- A BERT that you can train on a (gaming) laptop.☆209Updated last year
- Designing bridge trusses with Pytorch autograd☆61Updated last year
- Test prompts for GPT-J-6B and the resulting AI-generated texts☆53Updated 4 years ago
- There are C language computer programs about the simulator, transformation, and test statistic of continuous Bernoulli distribution. More…☆25Updated last year
- Revealing example of self-attention, the building block of transformer AI models☆131Updated 2 years ago
- A playground to make it easy to try crazy things☆33Updated 2 months ago
- Experiments with applying Fourier transofrms to various plane-filling curves and patterns☆66Updated 2 years ago
- Just a small test to see which language is better for extending python when using lists of lists☆31Updated 2 years ago
- 🧮 Reading group about differential, integral and logical calculi.☆26Updated last year
- A star for organising blocks and playing with transformers.☆23Updated last year
- What if Git worked with Programming Languages?☆99Updated 3 years ago