PolymathicAI / xValLinks
Repository for code used in the xVal paper
โ134Updated last year
Alternatives and similar repositories for xVal
Users that are interested in xVal are comparing it to the libraries listed below
Sorting:
- A MAD laboratory to improve AI architecture designs ๐งชโ116Updated 5 months ago
- Explorations into the recently proposed Taylor Series Linear Attentionโ99Updated 9 months ago
- Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)โ190Updated last year
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmindโ126Updated 9 months ago
- Understand and test language model architectures on synthetic tasks.โ197Updated 3 months ago
- Implementation of ๐ฅฅ Coconut, Chain of Continuous Thought, in Pytorchโ170Updated 5 months ago
- The simplest, fastest repository for training/finetuning medium-sized GPTs.โ128Updated 3 weeks ago
- Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-expertsโ119Updated 7 months ago
- Implementation of Infini-Transformer in Pytorchโ111Updated 5 months ago