konstantinosKokos / apeLinks
🧮 Algebraic Positional Encodings.
☆18Updated 4 months ago
Alternatives and similar repositories for ape
Users that are interested in ape are comparing it to the libraries listed below
Sorting:
- The Energy Transformer block, in JAX☆63Updated 2 years ago
- ☆33Updated last year
- ☆31Updated 9 months ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- Scalable and Stable Parallelization of Nonlinear RNNS☆28Updated 2 months ago
- Simple Scalable Discrete Diffusion for text in PyTorch☆37Updated last year
- Source code for the paper "Positional Attention: Expressivity and Learnability of Algorithmic Computation"☆14Updated 7 months ago
- Code for GFlowNet-EM, a novel algorithm for fitting latent variable models with compositional latents and an intractable true posterior.☆41Updated last year
- Meta-learning inductive biases in the form of useful conserved quantities.☆39Updated 3 years ago
- A Scalable Approximate Method for Probabilistic Neurosymbolic Inference☆22Updated 11 months ago
- ☆13Updated 3 weeks ago
- PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023☆20Updated 2 years ago
- JAX/Flax implementation of the Hyena Hierarchy☆34Updated 2 years ago
- ☆18Updated last year
- ☆22Updated 4 years ago
- ☆62Updated last year
- RWKV model implementation☆38Updated 2 years ago
- ☆42Updated 3 years ago
- An annotated implementation of the Hyena Hierarchy paper☆34Updated 2 years ago
- Curse-of-memory phenomenon of RNNs in sequence modelling☆19Updated 8 months ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated 2 years ago
- Code for the paper: https://arxiv.org/pdf/2309.06979.pdf☆21Updated last year
- A centralized place for deep thinking code and experiments☆87Updated 2 years ago
- Official repository for the paper "Can You Learn an Algorithm? Generalizing from Easy to Hard Problems with Recurrent Networks"☆60Updated 3 years ago
- A domain-specific probabilistic programming language for modeling and inference with language models☆140Updated 8 months ago
- Repository for Sparse Universal Transformers☆20Updated 2 years ago
- Learning Universal Predictors☆81Updated last year
- Fast singularity detection with kernel☆37Updated 2 years ago
- Implementation of the Triangle Multiplicative module, used in Alphafold2 as an efficient way to mix rows or columns of a 2d feature map, …☆39Updated 4 years ago
- Implementation of approximate free-energy minimization in PyTorch☆21Updated 4 years ago