lucidrains / coconut-pytorch
Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
☆60Updated this week
Alternatives and similar repositories for coconut-pytorch:
Users that are interested in coconut-pytorch are comparing it to the libraries listed below
- DiffuGPT and DiffuLLaMA: Scaling Diffusion Language Models via Adaptation from Autoregressive Models☆64Updated 3 weeks ago
- Official PyTorch Implementation of Gated Delta Networks: Improving Mamba2 with Delta Rule☆45Updated this week
- Source code for paper "A Spark of Vision-Language Intelligence: 2-Dimensional Autoregressive Transformer for Efficient Finegrained Image …☆57Updated last week
- ☆66Updated 2 months ago
- Implementation of Infini-Transformer in Pytorch☆106Updated 2 months ago
- [NeurIPS-2024] 📈 Scaling Laws with Vocabulary: Larger Models Deserve Larger Vocabularies https://arxiv.org/abs/2407.13623☆71Updated 2 months ago
- Code for paper "Diffusion Language Models Can Perform Many Tasks with Scaling and Instruction-Finetuning"☆63Updated 10 months ago
- Official implementation of Bootstrapping Language Models via DPO Implicit Rewards☆41Updated 4 months ago
- Official PyTorch Implementation for Task Vectors are Cross-Modal☆14Updated last week
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind☆115Updated 3 months ago
- The this is the official implementation of "DAPE: Data-Adaptive Positional Encoding for Length Extrapolation"☆33Updated 2 months ago
- ☆64Updated 3 months ago
- ☆38Updated 4 months ago
- This repo is based on https://github.com/jiaweizzhao/GaLore☆21Updated 3 months ago
- [NeurIPS 2024 Spotlight] Code and data for the paper "Finding Transformer Circuits with Edge Pruning".☆29Updated last week
- Official implementation of MAIA, A Multimodal Automated Interpretability Agent☆66Updated 4 months ago
- Language models scale reliably with over-training and on downstream tasks☆94Updated 8 months ago
- LL3M: Large Language and Multi-Modal Model in Jax☆66Updated 7 months ago
- ☆27Updated last year
- ☆46Updated last year
- Auto Interpretation Pipeline and many other functionalities for Multimodal SAE Analysis.☆69Updated 3 weeks ago
- [NeurIPS 2024] Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"☆89Updated 9 months ago
- ☆60Updated last month
- Official repository of paper "RNNs Are Not Transformers (Yet): The Key Bottleneck on In-context Retrieval"☆25Updated 8 months ago
- PyTorch implementation of StableMask (ICML'24)☆12Updated 5 months ago