Oxen-AI / mamba-dive

Related projects: ⓘ

• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆62Updated 2 weeks ago
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆46Updated 5 months ago
• akjindal53244 / Arithmo
  Small and Efficient Mathematical Reasoning LLMs
  ☆69Updated 7 months ago
• johnma2006 / candle
  Deep learning library implemented from scratch in numpy. Mixtral, Mamba, LLaMA, GPT, ResNet, and other experiments.
  ☆47Updated 5 months ago
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆156Updated 4 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆36Updated 5 months ago
• alxndrTL / othello_mamba
  Evaluating the Mamba architecture on the Othello game
  ☆41Updated 4 months ago
• geronimi73 / phi2-finetune
  ☆85Updated 7 months ago
• cognitivecomputations / spectrum
  ☆75Updated 3 weeks ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆82Updated 3 weeks ago
• epfml / DenseFormer
  ☆73Updated 5 months ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆86Updated 3 months ago
• RobertCsordas / moeut
  ☆50Updated last month
• kjslag / spacebyte
  A byte-level decoder architecture that matches the performance of tokenized Transformers.
  ☆57Updated 4 months ago
• melisa-writer / short-transformers
  Prune transformer layers
  ☆60Updated 3 months ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆84Updated 4 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆38Updated 3 months ago
• wdlctc / mini-s
  ☆26Updated this week
• LegallyCoder / mamba-hf
  Implementation of the Mamba SSM with hf_integration.
  ☆55Updated 2 weeks ago
• euclaise / supertrainer2000
  ☆48Updated 6 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆94Updated 2 weeks ago
• kyegomez / MambaTransformer
  Integrating Mamba/SSMs with Transformer for Enhanced Long Context and High-Quality Sequence Modeling
  ☆153Updated last week
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆70Updated last month
• joshuacnf / Ctrl-G
  ☆68Updated 2 months ago
• SALT-NLP / demonstrated-feedback
  ☆105Updated this week
• imoneoi / multipack_sampler
  Multipack distributed sampler for fast padding-free training of LLMs
  ☆170Updated last month
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆105Updated 3 months ago
• Zyphra / BlackMamba
  Code repository for Black Mamba
  ☆218Updated 7 months ago
• lucidrains / PEER-pytorch
  Pytorch implementation of the PEER block from the paper, Mixture of A Million Experts, by Xu Owen He at Deepmind
  ☆105Updated 3 weeks ago
• kyegomez / Jamba
  PyTorch Implementation of Jamba: "Jamba: A Hybrid Transformer-Mamba Language Model"
  ☆120Updated last week