google-research / meliadLinks
☆256Updated 2 weeks ago
Alternatives and similar repositories for meliad
Users that are interested in meliad are comparing it to the libraries listed below
Sorting:
- Neural Networks and the Chomsky Hierarchy☆205Updated last year
- Recurrent Memory Transformer☆149Updated last year
- Sequence modeling with Mega.☆296Updated 2 years ago
- Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT☆214Updated 10 months ago
- Emergent world representations: Exploring a sequence model trained on a synthetic task☆181Updated last year
- Code for the paper "The Impact of Positional Encoding on Length Generalization in Transformers", NeurIPS 2023☆136Updated last year
- ☆355Updated last year
- Implementation of Block Recurrent Transformer - Pytorch☆219Updated 10 months ago
- Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"☆208Updated last year
- ☆166Updated last year
- Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch☆409Updated 5 months ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"☆235Updated 2 weeks ago
- Pytorch implementation of Compressive Transformers, from Deepmind☆160Updated 3 years ago
- Understand and test language model architectures on synthetic tasks.☆217Updated last week
- Implementation of the conditionally routed attention in the CoLT5 architecture, in Pytorch☆230Updated 9 months ago
- Language Modeling with the H3 State Space Model☆519Updated last year
- seqax = sequence modeling + JAX☆159Updated last week
- Train very large language models in Jax.☆204Updated last year
- Implementation of https://srush.github.io/annotated-s4☆498Updated 2 years ago
- JAX implementation of the Llama 2 model☆218Updated last year
- Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate …☆635Updated last year
- unofficial re-implementation of "Grokking: Generalization Beyond Overfitting on Small Algorithmic Datasets"☆78Updated 2 years ago
- Randomized Positional Encodings Boost Length Generalization of Transformers☆81Updated last year
- Implementation of a Transformer that Ponders, using the scheme from the PonderNet paper☆81Updated 3 years ago
- [NeurIPS 2023] Learning Transformer Programs☆161Updated last year
- ☆64Updated 9 months ago
- Repository for the code of the "PPL-MCTS: Constrained Textual Generation Through Discriminator-Guided Decoding" paper, NAACL'22☆66Updated 2 years ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)☆190Updated last year
- ☆292Updated 5 months ago
- Python library which enables complex compositions of language models such as scratchpads, chain of thought, tool use, selection-inference…☆208Updated 2 weeks ago