AryaAftab / rotary-embedding-tensorflowLinks
Implementation of Rotary Embeddings, from the Roformer paper, in Tensorflow
☆12Updated 3 years ago
Alternatives and similar repositories for rotary-embedding-tensorflow
Users that are interested in rotary-embedding-tensorflow are comparing it to the libraries listed below
Sorting:
- Fourth place solution to the "OpenVaccine: COVID-19 mRNA Vaccine Degradation Prediction" organized by Stanford University and Kaggle☆20Updated 4 years ago
- This repository contains code for reproducing results in our paper Interpreting Potts and Transformer Protein Models Through the Lens of …☆58Updated 2 years ago
- ☆34Updated 4 years ago
- ☆25Updated 3 years ago
- Unofficially Implements https://arxiv.org/abs/2112.05682 to get Linear Memory Cost on Attention for PyTorch☆12Updated 3 years ago
- ☆17Updated 2 years ago
- UCSF BMI219 Deep Learning (2017), Coding example (Prediction of protein folding with RNN and CNN)☆16Updated 8 years ago
- Code for the CHAMPS Predicting Molecular Properties Kaggle competition☆52Updated 5 years ago
- Implementation of the Triangle Multiplicative module, used in Alphafold2 as an efficient way to mix rows or columns of a 2d feature map, …☆29Updated 3 years ago
- Official Implementation of "Transferring Inductive Biases Through Knowledge Distillation"☆14Updated 5 years ago
- To be a next-generation DL-based phenotype prediction from genome mutations.☆19Updated 4 years ago
- Tensorflow port implementation of Single Headed Attention RNN☆16Updated 5 years ago
- A molecule generation benchmarking platform☆13Updated 7 years ago
- Unofficial Tensorflow-Keras implementation of Fastformer based on paper [Fastformer: Additive Attention Can Be All You Need](https://arxi…☆13Updated 3 years ago
- Gold medal #2 Kaggle "Predicting Molecular Properties" compatition☆61Updated 5 years ago
- Easy & Pretrained SOTA Deep Learning for RNA strings☆12Updated 3 years ago
- A TensorFlow implementation of the paper 'Set Transformer: A Framework for Attention-based Permutation-Invariant Neural Networks'☆31Updated last year
- Implementation of Stochastic Depth Networks in Keras☆13Updated 8 years ago
- Pytorch reimplementation of Molecule Attention Transformer, which uses a transformer to tackle the graph-like structure of molecules☆59Updated 4 years ago
- This repository contains notebooks showing how to perform mixed precision training in tf.keras 2.0☆12Updated 5 years ago
- ☆12Updated 4 years ago
- Tensorflow NCE loss in Keras☆34Updated 6 years ago
- JAX implementation of Learning to learn by gradient descent by gradient descent☆27Updated 7 months ago
- ☆34Updated last month
- A tool for predicting the effects of missense mutations on protein stability changes upon missense mutation using protein sequence only. …☆22Updated 2 years ago
- f-divergence based t-SNE☆16Updated 2 years ago
- KDD Cup 2019 AutoML Track 5th solution☆18Updated 5 years ago
- Implementation of Tranception, an attention network, paired with retrieval, that is SOTA for protein fitness prediction☆32Updated 2 years ago
- Implementation of Denoising Diffusion for protein design, but using the new Equiformer (successor to SE3 Transformers) with some addition…☆56Updated 2 years ago
- Replication attempt for the Protein Folding Model described in https://www.biorxiv.org/content/10.1101/2021.08.02.454840v1☆37Updated 3 years ago