Alternatives and similar repositories for tokenizer-vs-tokenizer:

Users that are interested in tokenizer-vs-tokenizer are comparing it to the libraries listed below

• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆87Updated 9 months ago
• lessw2020 / transformer_central
  Various transformers for FSDP research
  ☆37Updated 2 years ago
• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆68Updated last year
• NathanGodey / headless-lm
  Training and evaluation code for the paper "Headless Language Models: Learning without Predicting with Contrastive Weight Tying" (https:/…
  ☆26Updated 11 months ago
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆53Updated last year
• shikaiqiu / compute-better-spent
  ☆52Updated 5 months ago
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆48Updated last week
• crowsonkb / torch-dist-utils
  Utilities for PyTorch distributed
  ☆23Updated 3 weeks ago
• lucidrains / light-recurrent-unit-pytorch
  Implementation of a Light Recurrent Unit in Pytorch
  ☆47Updated 5 months ago
• lucidrains / kalman-filtering-attention
  Implementation of the Kalman Filtering Attention proposed in "Kalman Filtering Attention for User Behavior Modeling in CTR Prediction"
  ☆57Updated last year
• warner-benjamin / optimi
  Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers
  ☆87Updated 8 months ago
• epfml / DenseFormer
  ☆79Updated 11 months ago
• lucidrains / self-reasoning-tokens-pytorch
  Exploration into the proposed "Self Reasoning Tokens" by Felipe Bonetto
  ☆55Updated 10 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆98Updated 3 months ago
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆90Updated last week
• ethansmith2000 / TransformerExperiments
  ☆19Updated 5 months ago
• BlinkDL / SmallInitEmb
  LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
  ☆60Updated 3 years ago
• ltgoslo / gpt-bert
  Official implementation of "GPT or BERT: why not both?"
  ☆49Updated last week
• crowsonkb / dice-mc
  DiCE: The Infinitely Differentiable Monte-Carlo Estimator
  ☆31Updated last year
• formll / dog
  DoG is SGD's Best Friend: A Parameter-Free Dynamic Step Size Schedule
  ☆60Updated last year
• cat-state / tinypar
  ☆20Updated last year
• teddykoker / learning-to-learn-jax
  JAX implementation of Learning to learn by gradient descent by gradient descent
  ☆27Updated 5 months ago
• evanatyourservice / kron_torch
  An implementation of PSGD Kron second-order optimizer for PyTorch
  ☆84Updated last month
• apple / ml-ademamix
  ☆58Updated 4 months ago
• morganmcg1 / wandb_spectrogram
  ☆15Updated 2 years ago
• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆23Updated 2 months ago
• cloneofsimo / zeroshampoo
  ☆33Updated 6 months ago
• mgmalek / efficient_cross_entropy
  ☆95Updated 9 months ago
• ag1988 / dss
  Sequence Modeling with Structured State Spaces
  ☆63Updated 2 years ago
• layer6ai-labs / calo-forest
  A scalable implementation of diffusion and flow-matching with XGBoost models, applied to calorimeter data.
  ☆17Updated 4 months ago