Alternatives and similar repositories for tinynarrations

Users that are interested in tinynarrations are comparing it to the libraries listed below

• tensoic / Cerule
  Cerule - A Tiny Mighty Vision Model
  ☆67Updated last year
• notarussianteenager / srf-attention
  Simplex Random Feature attention, in PyTorch
  ☆73Updated 2 years ago
• Algomancer / The-Daily-Train
  Training Models Daily
  ☆16Updated last year
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆107Updated 7 months ago
• Zyphra / zcookbook
  Training hybrid models for dummies.
  ☆27Updated 2 weeks ago
• okarthikb / state-space-models
  ☆28Updated last year
• main-horse / hnet-old
  H-Net Dynamic Hierarchical Architecture
  ☆80Updated last month
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆86Updated 6 months ago
• crowsonkb / LDLM
  Latent Diffusion Language Models
  ☆69Updated 2 years ago
• NousResearch / StripedHyenaTrainer
  ☆61Updated last year
• tobiaskatsch / GatedLinearRNN
  ☆29Updated last year
• euclaise / SlimTrainer
  Full finetuning of large language models without large memory requirements
  ☆93Updated last month
• CERC-AAI / Robin
  ☆63Updated last year
• thesephist / spectre
  Sparse autoencoders for Contra text embedding models
  ☆25Updated last year
• euclaise / supertrainer2000
  ☆50Updated last year
• xjdr-alt / muzero_sketch
  ☆40Updated last year
• knoriy / CLARA
  ☆62Updated last year
• ClashLuke / SOAP
  ☆21Updated 11 months ago
• fal-ai-community / NativeSparseAttention
  research impl of Native Sparse Attention (2502.11089)
  ☆62Updated 8 months ago
• thevoicecompany / gazelle-train
  Joint speech-language model - respond directly to audio!
  ☆30Updated last year
• s-smits / grpo-optuna
  Optimizing Causal LMs through GRPO with weighted reward functions and automated hyperparameter tuning using Optuna
  ☆58Updated 2 weeks ago
• kaiokendev / cutoff-len-is-context-len
  Demonstration that finetuning RoPE model on larger sequences than the pre-trained model adapts the model context limit
  ☆62Updated 2 years ago
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆28Updated 5 months ago
• Birch-san / booru-embed
  [WIP] Transformer to embed Danbooru labelsets
  ☆13Updated last year
• SonicCodes / subcloning
  implementation of https://arxiv.org/pdf/2312.09299
  ☆21Updated last year
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆18Updated 3 months ago
• deepshard / mixtral-8x7b-Inference
  Eh, simple and works.
  ☆27Updated last year
• vikhyat / mixtral-inference
  inference code for mixtral-8x7b-32kseqlen
  ☆102Updated last year
• catid / lllm
  Latent Large Language Models
  ☆19Updated last year
• bloc97 / DeMo
  DeMo: Decoupled Momentum Optimization
  ☆195Updated 11 months ago