konstantinosKokos / apeLinks
🧮 Algebraic Positional Encodings.
☆16Updated 2 months ago
Alternatives and similar repositories for ape
Users that are interested in ape are comparing it to the libraries listed below
Sorting:
- The Energy Transformer block, in JAX☆58Updated last year
- ☆33Updated last year
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated last year
- ☆13Updated 5 months ago
- ☆22Updated 3 years ago
- Meta-learning inductive biases in the form of useful conserved quantities.☆37Updated 2 years ago
- An annotated implementation of the Hyena Hierarchy paper☆34Updated 2 years ago
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- RWKV model implementation☆38Updated 2 years ago
- Code Release for "Broken Neural Scaling Laws" (BNSL) paper☆59Updated 2 years ago
- Blog post☆17Updated last year
- A Scalable Approximate Method for Probabilistic Neurosymbolic Inference☆16Updated 9 months ago
- JAX/Flax implementation of the Hyena Hierarchy☆34Updated 2 years ago
- PyTorch implementation for "Probabilistic Circuits for Variational Inference in Discrete Graphical Models", NeurIPS 2020☆17Updated 4 years ago
- ☆32Updated 7 months ago
- Source code for the paper "Positional Attention: Expressivity and Learnability of Algorithmic Computation"☆14Updated 5 months ago
- Code for GFlowNet-EM, a novel algorithm for fitting latent variable models with compositional latents and an intractable true posterior.☆41Updated last year
- Code for "Discovering Non-monotonic Autoregressive Orderings with Variational Inference" (paper and code updated from ICLR 2021)☆12Updated last year
- Scalable and Stable Parallelization of Nonlinear RNNS☆23Updated last week
- Implementation of deep implicit attention in PyTorch☆65Updated 4 years ago
- Simple Scalable Discrete Diffusion for text in PyTorch☆37Updated last year
- Curse-of-memory phenomenon of RNNs in sequence modelling☆18Updated 5 months ago
- Understanding how features learned by neural networks evolve throughout training☆39Updated last year
- ☆11Updated 2 years ago
- PyTorch implementation for "Long Horizon Temperature Scaling", ICML 2023☆20Updated 2 years ago
- Companion repository to "Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Models"☆14Updated 2 years ago
- Code for the paper: https://arxiv.org/pdf/2309.06979.pdf☆21Updated last year
- ☆58Updated last year
- Experiments on the impact of depth in transformers and SSMs.☆36Updated last week
- Graphically structured diffusion model.☆21Updated 2 years ago