ironjr / grokfast

Related projects: ⓘ

• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆445Updated 6 months ago
• KellerJordan / modded-nanogpt
  GPT-2 (124M) quality in 5B tokens
  ☆227Updated last week
• microsoft / Samba
  Official implementation of "Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modeling"
  ☆778Updated last month
• kvfrans / jax-diffusion-transformer
  Implementation of Diffusion Transformer (DiT) in JAX
  ☆246Updated 3 months ago
• google-deepmind / recurrentgemma
  Open weights language model from Google DeepMind, based on Griffin.
  ☆595Updated 2 months ago
• clu0 / unet.cu
  UNet diffusion model in pure CUDA
  ☆562Updated 2 months ago
• CG80499 / KAN-GPT-2
  Training small GPT-2 style models using Kolmogorov-Arnold networks.
  ☆105Updated 3 months ago
• Zyphra / BlackMamba
  Code repository for Black Mamba
  ☆218Updated 7 months ago
• redotvideo / mamba-chat
  Mamba-Chat: A chat LLM based on the state-space model architecture 🐍
  ☆897Updated 6 months ago
• facebookresearch / schedule_free
  Schedule-Free Optimization in PyTorch
  ☆1,809Updated last month
• pbelcak / fastfeedforward
  A repository for log-time feedforward networks
  ☆215Updated 5 months ago
• BobMcDear / attorch
  A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.
  ☆452Updated last week
• minyoungg / platonic-rep
  ☆428Updated last month
• nanowell / AdEMAMix-Optimizer-Pytorch
  The AdEMAMix Optimizer: Better, Faster, Older.
  ☆132Updated last week
• apple / ml-sigma-reparam
  ☆288Updated 2 months ago
• open-thought / system-2-research
  System 2 Reasoning Link Collection
  ☆605Updated this week
• HazyResearch / m2
  Repo for "Monarch Mixer: A Simple Sub-Quadratic GEMM-Based Architecture"
  ☆530Updated 4 months ago
• PeaBrane / mamba-tiny
  Simple, minimal implementation of the Mamba SSM in one pytorch file. More efficient than using for loops, but probably less efficient tha…
  ☆89Updated 5 months ago
• pbelcak / UltraFastBERT
  The repository for the code of the UltraFastBERT paper
  ☆508Updated 5 months ago
• dingo-actual / infini-transformer
  PyTorch implementation of Infini-Transformer from "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention…
  ☆271Updated 4 months ago
• zyushun / Adam-mini
  Code for Adam-mini: Use Fewer Learning Rates To Gain More https://arxiv.org/abs/2406.16793
  ☆285Updated this week
• kyegomez / zeta
  Build high-performance AI models with modular building blocks
  ☆377Updated this week
• SynodicMonth / ChebyKAN
  Kolmogorov-Arnold Networks (KAN) using Chebyshev polynomials instead of B-splines.
  ☆336Updated 4 months ago
• TorchJD / torchjd
  Library for Jacobian descent with PyTorch. It enables optimization of neural networks with multiple losses (e.g. multi-task learning).
  ☆126Updated this week
• EurekaLabsAI / tensor
  The Tensor (or Array)
  ☆388Updated last month
• gautierdag / bpeasy
  Fast bare-bones BPE for modern tokenizer training
  ☆138Updated 3 weeks ago
• HMUNACHI / nanodl
  A Jax-based library for designing and training transformer models from scratch.
  ☆272Updated 3 weeks ago
• EleutherAI / sae
  Sparse autoencoders
  ☆297Updated last week
• kyegomez / MambaByte
  Implementation of MambaByte in "MambaByte: Token-free Selective State Space Model" in Pytorch and Zeta
  ☆103Updated last week
• EGjoni / DRUGS
  Stop messing around with finicky sampling parameters and just use DRµGS!
  ☆313Updated 3 months ago