Alternatives and similar repositories for tiny-transformers:

Users that are interested in tiny-transformers are comparing it to the libraries listed below

• lucidrains / esbn-transformer
  An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols
  ☆15Updated 3 years ago
• jxbz / entropix
  📰 Computing the information content of trained neural networks
  ☆21Updated 3 years ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆19Updated last month
• srush / drop7
  ☆18Updated 10 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆20Updated last month
• HazyResearch / embroid
  Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
  ☆11Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated 9 months ago
• facebookresearch / coocmap
  code for paper "Accessing higher dimensions for unsupervised word translation"
  ☆21Updated last year
• srush / tangent
  Source-to-Source Debuggable Derivatives in Pure Python
  ☆15Updated last year
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆17Updated last year
• codekansas / rwkv
  RWKV model implementation
  ☆37Updated last year
• EleutherAI / equivariance
  A framework for implementing equivariant DL
  ☆10Updated 3 years ago
• lucidrains / token-shift-gpt
  Implementation of Token Shift GPT - An autoregressive model that solely relies on shifting the sequence space for mixing
  ☆48Updated 3 years ago
• joey00072 / microjax
  Jax like function transformation engine but micro, microjax
  ☆30Updated 4 months ago
• EleutherAI / training-jacobian
  ☆21Updated 3 months ago
• ColinQiyangLi / AdaCat
  AdaCat
  ☆49Updated 2 years ago
• catid / lllm
  Latent Large Language Models
  ☆17Updated 6 months ago
• crowsonkb / dice-mc
  DiCE: The Infinitely Differentiable Monte-Carlo Estimator
  ☆31Updated last year
• jquesnelle / ctranslate2-rs
  Rust bindings for CTranslate2
  ☆14Updated last year
• modal-labs / ci-on-modal
  A sample pattern for running CI tests on Modal
  ☆15Updated 5 months ago
• catid / dataloader
  High-performance tokenized language data-loader for Python C++ extension
  ☆12Updated 7 months ago
• RandallBalestriero / SplineLLM
  ☆15Updated last year
• EleutherAI / features-across-time
  Understanding how features learned by neural networks evolve throughout training
  ☆33Updated 4 months ago
• ethansmith2000 / MazeSolver
  ☆11Updated 9 months ago
• tchaton / pytorch2lightning
  ☆15Updated 3 years ago
• kyegomez / MM1
  PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"
  ☆23Updated last month
• soumik12345 / nerf.jax
  A minimal TPU compatible Jax implementation of NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis.
  ☆13Updated 2 years ago
• catid / spectral_ssm
  Implementation of Spectral State Space Models
  ☆16Updated last year