AryaAftab / rotary-embedding-tensorflow
Implementation of Rotary Embeddings, from the Roformer paper, in Tensorflow
☆12Updated 3 years ago
Alternatives and similar repositories for rotary-embedding-tensorflow:
Users that are interested in rotary-embedding-tensorflow are comparing it to the libraries listed below
- Fourth place solution to the "OpenVaccine: COVID-19 mRNA Vaccine Degradation Prediction" organized by Stanford University and Kaggle☆20Updated 4 years ago
- ☆34Updated 4 years ago
- Official Implementation of "Transferring Inductive Biases Through Knowledge Distillation"☆14Updated 4 years ago
- This repository contains code for reproducing results in our paper Interpreting Potts and Transformer Protein Models Through the Lens of …☆58Updated 2 years ago
- ☆17Updated 2 years ago
- Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch☆12Updated 3 years ago
- ☆25Updated 2 years ago
- To be a next-generation DL-based phenotype prediction from genome mutations.☆19Updated 3 years ago
- Usable implementation of Mogrifier, a circuit for enhancing LSTMs and potentially other networks, from Deepmind☆17Updated 9 months ago
- Simple implementations of attention modules adapted for the biological data domain.☆13Updated 4 months ago
- A molecule generation benchmarking platform☆13Updated 7 years ago
- Easy & Pretrained SOTA Deep Learning for RNA strings☆12Updated 2 years ago
- Implementation of the Triangle Multiplicative module, used in Alphafold2 as an efficient way to mix rows or columns of a 2d feature map, …☆29Updated 3 years ago
- Pytorch reimplementation of Molecule Attention Transformer, which uses a transformer to tackle the graph-like structure of molecules☆58Updated 4 years ago
- ☆33Updated 3 years ago
- Tensorflow NCE loss in Keras☆34Updated 6 years ago
- Unofficial Tensorflow-Keras implementation of Fastformer based on paper [Fastformer: Additive Attention Can Be All You Need](https://arxi…☆13Updated 3 years ago
- ☆12Updated 4 years ago
- Minimalistic TensorFlow2+ deep metric/similarity learning library with loss functions, miners, and utils as embedding projector.☆37Updated 2 years ago
- Tensorflow port implementation of Single Headed Attention RNN☆16Updated 5 years ago
- A mini-framework to build and train neural networks for molecular biology.☆10Updated 7 years ago
- Code for the CHAMPS Predicting Molecular Properties Kaggle competition☆51Updated 5 years ago
- Gold medal #2 Kaggle "Predicting Molecular Properties" compatition☆61Updated 5 years ago
- Shows how to create basic image adversaries, and train adversarially robust image classifiers (to some extent).☆13Updated 4 years ago
- Implementation of Stochastic Depth Networks in Keras☆13Updated 8 years ago
- A TensorFlow implementation of the paper 'Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networks'☆31Updated 10 months ago
- Interpreting graph convolutional filters of target prediction network☆48Updated 6 years ago
- Histopathologic Cancer Detection model based on Kaggle Challenge https://www.kaggle.com/c/histopathologic-cancer-detection (top 1%)☆11Updated 4 years ago
- UCSF BMI219 Deep Learning (2017), Coding example (Prediction of protein folding with RNN and CNN)☆16Updated 7 years ago
- Extract Molecular SMILES embeddings from language models pre-trained with various objectives architectures.☆16Updated last year