Alternatives and similar repositories for tinynarrations

Users that are interested in tinynarrations are comparing it to the libraries listed below

• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆73Updated 2 years ago
• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆67Updated last year
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆107Updated 7 months ago
• Algomancer / The-Daily-Train
  Training Models Daily
  ☆16Updated last year
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆86Updated 6 months ago
• thesephist / spectre
  Sparse autoencoders for Contra text embedding models
  ☆25Updated last year
• CarperAI / treasure_trove
  ☆22Updated 2 years ago
• catid / lllm
  Latent Large Language Models
  ☆19Updated last year
• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆69Updated 2 years ago
• xjdr-alt / muzero_sketch
  ☆40Updated last year
• deepshard / mixtral-8x7b-Inference
  Eh, simple and works.
  ☆27Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated last month
• naklecha / replicate-local
  Retrieve the source code for any model made available on replicate.com!
  ☆34Updated last year
• okarthikb / state-space-models
  ☆28Updated last year
• ClashLuke / SOAP
  ☆21Updated 11 months ago
• NousResearch / StripedHyenaTrainer
  ☆61Updated last year
• main-horse / hnet-old
  H-Net Dynamic Hierarchical Architecture
  ☆80Updated last month
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆21Updated last year
• euclaise / supertrainer2000
  ☆50Updated last year
• CERC-AAI / Robin
  ☆63Updated last year
• SpellcraftAI / turing
  Turing machines, Rule 110, and A::B reversal using Claude 3 Opus.
  ☆58Updated last year
• kubernetes-bad / reward-composer
  Lego for GRPO
  ☆30Updated 5 months ago
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆58Updated last week
• tobiaskatsch / GatedLinearRNN
  ☆29Updated last year
• JD-P / minihf
  MiniHF is an inference, human preference data collection, and fine-tuning tool for local language models. It is intended to help the user…
  ☆181Updated 2 weeks ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆62Updated 2 years ago
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆18Updated 3 months ago
• kyegomez / OpenStrawberry
  An open source replication of the stawberry method that leverages Monte Carlo Search with PPO and or DPO
  ☆29Updated this week
• google-deepmind / asyncdiloco
  ☆46Updated last year
• yacineMTB / just-large-models
  Just large language models. Hackable, with as little abstraction as possible. Done for my own purposes, feel free to rip.
  ☆44Updated 2 years ago