AryaAftab / rotary-embedding-tensorflow
Implementation of Rotary Embeddings, from the Roformer paper, in Tensorflow
☆12Updated 3 years ago
Related projects ⓘ
Alternatives and complementary repositories for rotary-embedding-tensorflow
- ☆34Updated 4 years ago
- To be a next-generation DL-based phenotype prediction from genome mutations.☆19Updated 3 years ago
- This repository contains code for reproducing results in our paper Interpreting Potts and Transformer Protein Models Through the Lens of …☆56Updated 2 years ago
- ☆25Updated 2 years ago
- Official Implementation of "Transferring Inductive Biases Through Knowledge Distillation"☆14Updated 4 years ago
- Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch☆12Updated 2 years ago
- UCSF BMI219 Deep Learning (2017), Coding example (Prediction of protein folding with RNN and CNN)☆15Updated 7 years ago
- Usable implementation of Mogrifier, a circuit for enhancing LSTMs and potentially other networks, from Deepmind☆16Updated 5 months ago
- Tensorflow NCE loss in Keras☆34Updated 6 years ago
- Implementation of the Triangle Multiplicative module, used in Alphafold2 as an efficient way to mix rows or columns of a 2d feature map, …☆29Updated 3 years ago
- ☆17Updated last year
- ☆32Updated 3 years ago
- Generate and train embeddings with a graph neural network and deploy as an API in a few lines of code☆9Updated 4 years ago
- Easy & Pretrained SOTA Deep Learning for RNA strings☆12Updated 2 years ago
- Implementation of "Semi-supervised learning of hierarchical representations of molecules using neural message passing" (arXiv:1711.10168)☆14Updated 6 years ago
- Tensorflow port implementation of Single Headed Attention RNN☆16Updated 4 years ago
- Deep learning based alignment-free method for protein family modeling and prediction☆17Updated 6 years ago
- A molecule generation benchmarking platform☆13Updated 6 years ago
- Unofficial Tensorflow-Keras implementation of Fastformer based on paper [Fastformer: Additive Attention Can Be All You Need](https://arxi…☆13Updated 3 years ago
- Deterministic Decoding for Discrete Data in Variational Autoencoders☆24Updated 4 years ago
- ☆12Updated 3 years ago
- ☆19Updated 7 years ago
- Pytorch reimplementation of Molecule Attention Transformer, which uses a transformer to tackle the graph-like structure of molecules☆58Updated 3 years ago
- A simple Transformer where the softmax has been replaced with normalization☆18Updated 4 years ago
- This repository contains notebooks showing how to perform mixed precision training in tf.keras 2.0☆12Updated 4 years ago
- A tool for predicting the effects of missense mutations on protein stability changes upon missense mutation using protein sequence only. …☆21Updated last year