Alternatives and similar repositories for torch_activation

Users that are interested in torch_activation are comparing it to the libraries listed below

• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆101Updated 7 months ago
• LAION-AI / AIW
  Alice in Wonderland code base for experiments and raw experiments data
  ☆131Updated last week
• QuixiAI / grokadamw
  ☆134Updated 11 months ago
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆94Updated 8 months ago
• xjdr-alt / muzero_sketch
  ☆38Updated last year
• epfml / DenseFormer
  ☆81Updated last year
• Mihaiii / backtrack_sampler
  An easy-to-understand framework for LLM samplers that rewind and revise generated tokens
  ☆146Updated 5 months ago
• lucidrains / HRM
  Exploration into the proposed architecture from Sapient Intelligence of Singapore 🇸🇬
  ☆47Updated last week
• reka-ai / rekaquant
  ☆57Updated last month
• evanatyourservice / llm-jax
  Train a SmolLM-style llm on fineweb-edu in JAX/Flax with an assortment of optimizers.
  ☆19Updated 2 weeks ago
• AnswerDotAI / fastkmeans
  ☆64Updated last month
• evanatyourservice / kron_torch
  An implementation of PSGD Kron second-order optimizer for PyTorch
  ☆94Updated 2 weeks ago
• Zyphra / transformers_zamba2
  ☆48Updated 6 months ago
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆104Updated 3 months ago
• euclaise / supertrainer2000
  ☆49Updated last year
• flawedmatrix / mamba-ssm
  Implementation of mamba with rust
  ☆88Updated last year
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆67Updated 11 months ago
• shobrook / weightgain
  Train an adapter for any embedding model in under a minute
  ☆110Updated 4 months ago
• LucasPrietoAl / grokking-at-the-edge-of-numerical-stability
  ☆100Updated 2 weeks ago
• kubernetes-bad / reward-composer
  Lego for GRPO
  ☆28Updated 2 months ago
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆41Updated last year
• kjslag / spacebyte
  A byte-level decoder architecture that matches the performance of tokenized Transformers.
  ☆65Updated last year
• ElleLeonne / Lightning-ReLoRA
  A public implementation of the ReLoRA pretraining method, built on Lightning-AI's Pytorch Lightning suite.
  ☆34Updated last year
• arcee-ai / DAM
  ☆53Updated 9 months ago
• Pleias / Quest-Best-Tokens
  An introduction to LLM Sampling
  ☆79Updated 7 months ago
• RWKV / ZeroCoT
  https://x.com/BlinkDL_AI/status/1884768989743882276
  ☆28Updated 3 months ago
• fal-ai-community / llmdifftracker
  Lightweight package that tracks and summarizes code changes using LLMs (Large Language Models)
  ☆33Updated 5 months ago
• ChrisHayduk / qlora-multi-gpu
  QLoRA with Enhanced Multi GPU Support
  ☆37Updated 2 years ago
• minosvasilias / simple_grpo
  Simple GRPO scripts and configurations.
  ☆59Updated 6 months ago
• Aleph-Alpha-Research / trigrams
  ☆56Updated 3 months ago