Alternatives and similar repositories for tiny-transformers:

Users that are interested in tiny-transformers are comparing it to the libraries listed below

• lucidrains / esbn-transformer
  An attempt to merge ESBN with Transformers, to endow Transformers with the ability to emergently bind symbols
  ☆14Updated 3 years ago
• catid / spectral_ssm
  Implementation of Spectral State Space Models
  ☆16Updated 11 months ago
• jxbz / entropix
  📰 Computing the information content of trained neural networks
  ☆21Updated 3 years ago
• srush / drop7
  ☆18Updated 9 months ago
• EleutherAI / training-jacobian
  ☆15Updated last month
• crowsonkb / dice-mc
  DiCE: The Infinitely Differentiable Monte-Carlo Estimator
  ☆31Updated last year
• sayakpaul / parameter-ensemble-differential-evolution
  Shows how to do parameter ensembling using differential evolution.
  ☆10Updated 3 years ago
• BobMcDear / flaim
  Flax Image Models - State-of-the-art pre-trained vision backbones for Flax.
  ☆17Updated last year
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆32Updated 7 months ago
• joey00072 / microjax
  Jax like function transformation engine but micro, microjax
  ☆30Updated 2 months ago
• sayakpaul / EvoNorms-in-TensorFlow-2
  Implements EvoNorms B0 and S0 as proposed in Evolving Normalization-Activation Layers.
  ☆11Updated 4 years ago
• lucidrains / holodeck-pytorch
  Implementation of a holodeck, written in Pytorch
  ☆17Updated last year
• TomFrederik / grokking
  Re-implementation of 'Grokking: Generalization beyond overfitting on small algorithmic datasets'
  ☆38Updated 3 years ago
• katzurik / Knowledge_Navigator
  ☆18Updated 2 months ago
• maxencefaldor / Leniabreeder
  Repository for "Toward Artificial Open-Ended Evolution within Lenia using Quality-Diversity" (ALIFE 2024).
  ☆16Updated 6 months ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated this week
• HazyResearch / embroid
  Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
  ☆11Updated last year
• catid / lllm
  Latent Large Language Models
  ☆17Updated 4 months ago
• sayakpaul / BiT-jax2tf
  This repository hosts the code to port NumPy model weights of BiT-ResNets to TensorFlow SavedModel format.
  ☆14Updated 3 years ago
• codekansas / rwkv
  RWKV model implementation
  ☆37Updated last year
• EleutherAI / exploring-contrastive-topology
  ☆15Updated 2 years ago
• Z-T-WANG / LaProp-Optimizer
  Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"
  ☆26Updated 4 years ago
• Avmb / inverse_scaling_prize_code_identifier_swap
  Submission to the inverse scaling prize
  ☆23Updated last year
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆57Updated 3 months ago
• facebookresearch / coocmap
  code for paper "Accessing higher dimensions for unsupervised word translation"
  ☆21Updated last year
• trisongz / pylines
  Simplifying parsing of large jsonline files in NLP Workflows
  ☆12Updated 3 years ago