Alternatives and similar repositories for transformer_ngrams

Users that are interested in transformer_ngrams are comparing it to the libraries listed below

• MekkCyber / TritonAcademy
  A repository to unravel the language of GPUs, making their kernel conversations easy to understand
  ☆194Updated 5 months ago
• divyamakkar0 / JAXformer
  A zero-to-one guide on scaling modern transformers with n-dimensional parallelism.
  ☆104Updated last month
• iliao2345 / CompressARC
  ☆197Updated 2 months ago
• goodfire-ai / r1-interpretability
  Open source interpretability artefacts for R1.
  ☆163Updated 6 months ago
• PrimeIntellect-ai / prime-environments
  Training-Ready RL Environments + Evals
  ☆158Updated this week
• clement-bonnet / lpn
  Latent Program Network (from the "Searching Latent Program Spaces" paper)
  ☆102Updated last month
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆170Updated 4 months ago
• Jaykef / Triton-nanoGPT
  Custom triton kernels for training Karpathy's nanoGPT.
  ☆19Updated last year
• mcleish7 / arithmetic
  Code to reproduce "Transformers Can Do Arithmetic with the Right Embeddings", McLeish et al (NeurIPS 2024)
  ☆193Updated last year
• google-deepmind / mishax
  ☆142Updated last month
• modula-systems / modula
  🧱 Modula software package
  ☆299Updated 2 months ago
• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆72Updated 6 months ago
• google-deepmind / regress-lm
  Library for text-to-text regression, applicable to any input string representation and allows pretraining and fine-tuning over multiple r…
  ☆281Updated this week
• da-fr / arc-prize-2024
  Our solution for the arc challenge 2024
  ☆182Updated 4 months ago
• tokenbender / avataRL
  rl from zero pretrain, can it be done? yes.
  ☆279Updated last month
• LeonGuertler / UnstableBaselines
  ☆106Updated last week
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆298Updated this week
• martin-marek / batch-size
  📄Small Batch Size Training for Language Models
  ☆63Updated 3 weeks ago
• facebookresearch / llm-speedrunner
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆109Updated 3 weeks ago
• microsoft / dion
  Dion optimizer algorithm
  ☆374Updated last month
• Lossfunk / KernelBench-v2
  KernelBench v2: Can LLMs Write GPU Kernels? - Benchmark with Torch -> Triton (and more!) problems
  ☆21Updated 3 months ago
• eth-sri / matharena
  Evaluation of LLMs on latest math competitions
  ☆175Updated last week
• arcprize / hierarchical-reasoning-model-analysis
  ☆149Updated 2 months ago
• kanpuriyanawab / minbpe.c
  a Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization in pure C.
  ☆22Updated last year
• vtabbott / Algebraic-NCD
  A package for defining deep learning models using categorical algebraic expressions.
  ☆61Updated last year
• marin-community / marin
  Open-source framework for the research and development of foundation models.
  ☆574Updated this week
• yash-srivastava19 / arrakis
  Arrakis is a library to conduct, track and visualize mechanistic interpretability experiments.
  ☆31Updated 6 months ago
• flowersteam / SOAR
  Implementation of SOAR
  ☆42Updated last month
• changjonathanc / flex-nano-vllm
  FlexAttention based, minimal vllm-style inference engine for fast Gemma 2 inference.
  ☆300Updated 2 months ago
• arcprize / ARC-AGI-2
  ☆502Updated 5 months ago