Alternatives and similar repositories for marin

Users that are interested in marin are comparing it to the libraries listed below

• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆139Updated this week
• HazyResearch / zoology
  Understand and test language model architectures on synthetic tasks.
  ☆219Updated 3 weeks ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆123Updated 6 months ago
• google-deepmind / nanodo
  ☆270Updated 11 months ago
• justinchiu / openlogprobs
  Extract full next-token probabilities via language model APIs
  ☆247Updated last year
• cloneofsimo / scaling-guide
  WIP
  ☆93Updated 10 months ago
• cloneofsimo / min-fsdp
  ☆78Updated 11 months ago
• allenai / OLMo-core
  PyTorch building blocks for the OLMo ecosystem
  ☆241Updated this week
• ServiceNow / PipelineRL
  A scalable asynchronous reinforcement learning implementation with in-flight weight updates.
  ☆127Updated this week
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆163Updated 2 weeks ago
• huggingface / picotron_tutorial
  ☆194Updated 4 months ago
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆190Updated last year
• apoorvkh / academic-pretraining
  $100K or 100 Days: Trade-offs when Pre-Training with Academic Resources
  ☆140Updated last month
• mlfoundations / scaling
  Language models scale reliably with over-training and on downstream tasks
  ☆97Updated last year
• HazyResearch / based
  Code for exploring Based models from "Simple linear attention language models balance the recall-throughput tradeoff"
  ☆237Updated 3 weeks ago
• google-deepmind / mishax
  ☆134Updated 3 months ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆129Updated last year
• EleutherAI / delphi
  Delphi was the home of a temple to Phoebus Apollo, which famously had the inscription, 'Know Thyself.' This library lets language models …
  ☆187Updated last week
• srush / GPTWorld
  A puzzle to learn about prompting
  ☆130Updated 2 years ago
• stanford-crfm / levanter
  Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
  ☆599Updated this week
• ekinakyurek / marc
  Public repository for "The Surprising Effectiveness of Test-Time Training for Abstract Reasoning"
  ☆317Updated 7 months ago
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆159Updated last week
• modula-systems / modula
  🧱 Modula software package
  ☆202Updated 3 months ago
• lucidrains / coconut-pytorch
  Implementation of 🥥 Coconut, Chain of Continuous Thought, in Pytorch
  ☆176Updated last week
• iliao2345 / CompressARC
  ☆159Updated 2 months ago
• jzhang38 / LongMamba
  Some preliminary explorations of Mamba's context scaling.
  ☆214Updated last year
• McGill-NLP / VinePPO
  Code for the paper "VinePPO: Unlocking RL Potential For LLM Reasoning Through Refined Credit Assignment"
  ☆164Updated last month
• srush / do-we-need-attention
  ☆166Updated last year
• callummcdougall / sae_vis
  Create feature-centric and prompt-centric visualizations for sparse autoencoders (like those from Anthropic's published research).
  ☆203Updated 6 months ago
• kyo-takano / chinchilla
  A toolkit for scaling law research ⚖
  ☆49Updated 5 months ago