srush / annotated-s4

Related projects ⓘ

Alternatives and complementary repositories for annotated-s4

• lindermanlab / S5
  ☆261Updated 3 months ago
• srush / annotated-mamba
  Annotated version of the Mamba paper
  ☆457Updated 8 months ago
• facebookresearch / mega
  Sequence modeling with Mega.
  ☆298Updated last year
• google-research / long-range-arena
  Long Range Arena for Benchmarking Efficient Transformers
  ☆729Updated 11 months ago
• HazyResearch / hippo-code
  ☆167Updated 5 months ago
• facebookresearch / optimizers
  For optimization algorithm research and development.
  ☆449Updated this week
• lucidrains / rotary-embedding-torch
  Implementation of Rotary Embeddings, from the Roformer paper, in Pytorch
  ☆571Updated last week
• google / flaxformer
  ☆334Updated 7 months ago
• facebookresearch / torchdim
  Named tensors with first-class dimensions for PyTorch
  ☆322Updated last year
• stanford-crfm / levanter
  Legible, Scalable, Reproducible Foundation Models with Named Tensors and Jax
  ☆516Updated this week
• state-spaces / s4
  Structured state space sequence models
  ☆2,470Updated 4 months ago
• ctlllll / SGConv
  ☆164Updated last year
• krasserm / perceiver-io
  A PyTorch implementation of Perceiver, Perceiver IO and Perceiver AR with PyTorch Lightning scripts for distributed training
  ☆437Updated 10 months ago
• google / grain
  ☆303Updated this week
• pytorch / tensordict
  TensorDict is a pytorch dedicated tensor container.
  ☆840Updated this week
• google-deepmind / nanodo
  ☆197Updated 4 months ago
• kach / gradient-descent-the-ultimate-optimizer
  Code for our NeurIPS 2022 paper
  ☆363Updated last year
• google-research / jaxpruner
  ☆207Updated 6 months ago
• google-research / meliad
  ☆251Updated 2 years ago
• proger / accelerated-scan
  Accelerated First Order Parallel Associative Scan
  ☆163Updated 3 months ago
• google-deepmind / neural_networks_chomsky_hierarchy
  Neural Networks and the Chomsky Hierarchy
  ☆187Updated 7 months ago
• google / CommonLoopUtils
  CLU lets you write beautiful training loops in JAX.
  ☆321Updated this week
• lucidrains / Mega-pytorch
  Implementation of Mega, the Single-head Attention with Multi-headed EMA architecture that currently holds SOTA on Long Range Arena
  ☆203Updated last year
• srush / do-we-need-attention
  ☆161Updated last year
• lucidrains / local-attention
  An implementation of local windowed attention for language modeling
  ☆384Updated 2 months ago
• DarshanDeshpande / jax-models
  Unofficial JAX implementations of deep learning research papers
  ☆151Updated 2 years ago
• HazyResearch / H3
  Language Modeling with the H3 State Space Model
  ☆513Updated last year
• lucidrains / st-moe-pytorch
  Implementation of ST-Moe, the latest incarnation of MoE after years of research at Brain, in Pytorch
  ☆293Updated 5 months ago
• ofirpress / attention_with_linear_biases
  Code for the ALiBi method for transformer language models (ICLR 2022)
  ☆507Updated last year
• archinetai / surgeon-pytorch
  A library to inspect and extract intermediate layers of PyTorch models.
  ☆470Updated 2 years ago