Alternatives and similar repositories for TinyStories-cleaner:

Users that are interested in TinyStories-cleaner are comparing it to the libraries listed below

• JD-P / minihf
  MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…
  ☆164Updated this week
• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆68Updated last year
• fal-ai / diffusion-speedrun
  Focused on fast experimentation and simplicity
  ☆65Updated last month
• euclaise / supertrainer2000
  ☆49Updated 11 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆81Updated this week
• cg123 / bitnet
  Modeling code for a BitNet b1.58 Llama-style model.
  ☆23Updated 9 months ago
• ethansmith2000 / fsdp_optimizers
  supporting pytorch FSDP for optimizers
  ☆76Updated 2 months ago
• ClashLuke / SOAP
  ☆21Updated 3 months ago
• cloneofsimo / ezmup
  Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam
  ☆73Updated 6 months ago
• schwartz-lab-NLP / TOVA
  Token Omission Via Attention
  ☆123Updated 4 months ago
• ethansmith2000 / TransformerExperiments
  ☆19Updated 4 months ago
• davisyoshida / qax
  If it quacks like a tensor...
  ☆56Updated 3 months ago
• SinatrasC / entropix-smollm
  smolLM with Entropix sampler on pytorch
  ☆150Updated 3 months ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆95Updated 3 months ago
• SonicCodes / lucid-v1
  realtime latent world model inference demo
  ☆39Updated 3 months ago
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆129Updated this week
• alxndrTL / othello_mamba
  Evaluating the Mamba architecture on the Othello game
  ☆44Updated 9 months ago
• cloneofsimo / minSAE
  ☆24Updated 2 months ago
• cloneofsimo / min-max-gpt
  Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training
  ☆122Updated 10 months ago
• warner-benjamin / optimi
  Fast, Modern, Memory Efficient, and Low Precision PyTorch Optimizers
  ☆82Updated 7 months ago
• cloneofsimo / minDinoV2
  ☆17Updated 4 months ago
• ayaka14732 / llama-2-jax
  JAX implementation of the Llama 2 model
  ☆215Updated last year
• vgel / biblically-accurate-sampler
  llm sampler that only allows words that are in the bible
  ☆24Updated 2 months ago
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆28Updated last week
• huyphan168 / PEER
  Mixture of A Million Experts
  ☆39Updated 6 months ago
• HomebrewML / HeavyBall
  Efficient optimizers
  ☆169Updated this week
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated last year
• cloneofsimo / scaling-guide
  WIP
  ☆93Updated 6 months ago
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆143Updated 7 months ago