Alternatives and similar repositories for noise_step

Users that are interested in noise_step are comparing it to the libraries listed below

• VatsaDev / NanoPoor
  NanoGPT-speedrunning for the poor T4 enjoyers
  ☆73Updated 7 months ago
• SakanaAI / evo-memory
  Code to train and evaluate Neural Attention Memory Models to obtain universally-applicable memory systems for transformers.
  ☆330Updated last year
• BlinkDL / nanoRWKV
  RWKV in nanoGPT style
  ☆196Updated last year
• bloc97 / DeMo
  DeMo: Decoupled Momentum Optimization
  ☆197Updated last year
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆108Updated 9 months ago
• PrimeIntellect-ai / pi-quant
  SIMD quantization kernels
  ☆93Updated 3 months ago
• haraschax / nograd
  Gradient descent is cool and all, but what if we could delete it?
  ☆104Updated 3 months ago
• jerber / lang-jepa
  ☆129Updated 11 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated last year
• neurallambda / neurallambda
  Reasoning Computers. Lambda Calculus, Fully Differentiable. Also Neural Stacks, Queues, Arrays, Lists, Trees, and Latches.
  ☆283Updated last year
• microsoft / ArchScale
  Simple & Scalable Pretraining for Neural Architecture Research
  ☆304Updated last month
• microsoft / GRIN-MoE
  GRadient-INformed MoE
  ☆264Updated last year
• VsonicV / es-fine-tuning-paper
  This repo contains the source code for the paper "Evolution Strategies at Scale: LLM Fine-Tuning Beyond Reinforcement Learning"
  ☆272Updated 2 weeks ago
• Jellyfish042 / Sudoku-RWKV
  ☆148Updated last year
• KindXiaoming / grow-crystals
  Getting crystal-like representations with harmonic loss
  ☆192Updated 8 months ago
• brendanhogan / DeepSeekRL-Extended
  Exploring Applications of GRPO
  ☆249Updated 3 months ago
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆193Updated last year
• QuixiAI / grokadamw
  ☆136Updated last year
• joey00072 / Tinytorch
  A really tiny autograd engine
  ☆96Updated 6 months ago
• facebookresearch / memory
  Memory layers use a trainable key-value lookup mechanism to add extra parameters to a model without increasing FLOPs. Conceptually, spars…
  ☆359Updated last year
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆186Updated 10 months ago
• facebookresearch / llm-speedrunner
  The Automated LLM Speedrunning Benchmark measures how well LLM agents can reproduce previous innovations and discover new ones in languag…
  ☆112Updated 2 months ago
• kyegomez / LFM
  An open source implementation of LFMs from Liquid AI: Liquid Foundation Models
  ☆197Updated last week
• astramind-ai / BitMat
  An efficent implementation of the method proposed in "The Era of 1-bit LLMs"
  ☆155Updated last year
• xjdr-alt / simple_transformer
  Simple Transformer in Jax
  ☆139Updated last year
• tokenbender / avataRL
  rl from zero pretrain, can it be done? yes.
  ☆282Updated 2 months ago
• naklecha / llm-inference-optimizations-explained
  in this repository, i'm going to implement increasingly complex llm inference optimizations
  ☆73Updated 6 months ago
• BlinkDL / fast.c
  Prepare for DeekSeek R1 inference: Benchmark CPU, DRAM, SSD, iGPU, GPU, ... with efficient code.
  ☆73Updated 10 months ago
• PrimeIntellect-ai / OpenDiloco
  OpenDiLoCo: An Open-Source Framework for Globally Distributed Low-Communication Training
  ☆550Updated 10 months ago
• kroggen / mamba.c
  Inference of Mamba models in pure C
  ☆194Updated last year