alxndrTL / othello_mambaLinks
Evaluating the Mamba architecture on the Othello game
โ48Updated last year
Alternatives and similar repositories for othello_mamba
Users that are interested in othello_mamba are comparing it to the libraries listed below
Sorting:
- Griffin MQA + Hawk Linear RNN Hybridโ89Updated last year
- A MAD laboratory to improve AI architecture designs ๐งชโ131Updated 10 months ago
- โ58Updated last year
- The simplest, fastest repository for training/finetuning medium-sized GPTs.โ168Updated 3 months ago
- โ81Updated last year
- Understand and test language model architectures on synthetic tasks.โ233Updated last month
- Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.โ52Updated last year
- Implementation of GateLoop Transformer in Pytorch and Jaxโ90Updated last year
- Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAXโ88Updated last year
- โ34Updated last year
- โ53Updated last year
- A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIMโ59Updated last year
- Mixture of A Million Expertsโ48Updated last year
- Experiments on the impact of depth in transformers and SSMs.โ36Updated 11 months ago
- Implementation of the Llama architecture with RLHF + Q-learningโ167Updated 8 months ago
- Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT trainingโ132Updated last year
- โ33Updated 11 months ago
- Fast modular code to create and train cutting edge LLMsโ68Updated last year
- Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmindโ129Updated last year
- Token Omission Via Attentionโ127Updated last year
- Some preliminary explorations of Mamba's context scaling.โ216Updated last year
- Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amountโฆโ52Updated 2 years ago
- RWKV-7: Surpassing GPTโ98Updated 11 months ago
- Normalized Transformer (nGPT)โ192Updated 11 months ago
- Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"โ241Updated 4 months ago
- nanoGPT-like codebase for LLM trainingโ109Updated 5 months ago
- โ166Updated 2 years ago
- โ38Updated last year
- โ102Updated 3 months ago
- โ91Updated last year