FutureComputing4AI / Hrrformer
Hrrformer: A Neuro-symbolic Self-attention Model (ICML23)
☆50Updated last year
Alternatives and similar repositories for Hrrformer:
Users that are interested in Hrrformer are comparing it to the libraries listed below
- Holographic Reduced Representations☆23Updated 2 months ago
- Official code repo for paper "Great Memory, Shallow Reasoning: Limits of kNN-LMs"☆21Updated 5 months ago
- Code for the paper: https://arxiv.org/pdf/2309.06979.pdf☆18Updated 6 months ago
- [NeurIPS 2023] Sparse Modular Activation for Efficient Sequence Modeling☆35Updated last year
- Minimum Description Length probing for neural network representations☆18Updated this week
- ☆32Updated last year
- ☆44Updated last year
- Adding new tasks to T0 without catastrophic forgetting☆32Updated 2 years ago
- Engineering the state of RNN language models (Mamba, RWKV, etc.)☆32Updated 8 months ago
- An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols☆14Updated 3 years ago
- Stick-breaking attention☆41Updated 2 weeks ago
- Evaluation of neuro-symbolic engines☆34Updated 5 months ago
- The Energy Transformer block, in JAX☆54Updated last year
- Official implementation of the transformer (TF) architecture suggested in a paper entitled "Looped Transformers as Programmable Computers…☆24Updated last year
- An unofficial implementation of the Infini-gram model proposed by Liu et al. (2024)☆29Updated 7 months ago
- ☆49Updated 6 months ago
- Experiments on the impact of depth in transformers and SSMs.☆22Updated 2 months ago
- ☆19Updated last year
- Companion repository to "Prompt Compression and Contrastive Conditioning for Controllability and Toxicity Reduction in Language Models"☆13Updated last year
- The Codebase for Causal Distillation for Language Models (NAACL '22)☆25Updated 2 years ago
- Source-to-Source Debuggable Derivatives in Pure Python☆15Updated last year
- The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".☆32Updated 3 years ago
- Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification☆11Updated last year
- ☆29Updated 3 months ago
- Code for EMNLP'24 paper - On Diversified Preferences of Large Language Model Alignment☆15Updated 5 months ago
- ☆46Updated last year
- ☆18Updated 8 months ago
- ☆25Updated 3 years ago
- ☆13Updated last month
- JAX/Flax implementation of the Hyena Hierarchy☆33Updated last year