shikaiqiu / compute-better-spent

Related projects ⓘ

Alternatives and complementary repositories for compute-better-spent

• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆95Updated 6 months ago
• berlino / seq_icl
  ☆50Updated 6 months ago
• dvruette / barrel-rec-pytorch
  ☆53Updated 10 months ago
• nikhilvyas / SOAP
  ☆128Updated this week
• radarFudan / mamba-minimal-jax
  ☆29Updated 2 months ago
• vvvm23 / mamba-jax
  Unofficial but Efficient Implementation of "Mamba: Linear-Time Sequence Modeling with Selective State Spaces" in JAX
  ☆79Updated 9 months ago
• tml-epfl / why-weight-decay
  Why Do We Need Weight Decay in Modern Deep Learning? [NeurIPS 2024]
  ☆52Updated last month
• Leiay / looped_transformer
  ☆20Updated 11 months ago
• epfml / schedules-and-scaling
  ☆53Updated 3 weeks ago
• ruke1ire / RTF
  A State-Space Model with Rational Transfer Function Representation.
  ☆70Updated 6 months ago
• expz / annotated-hyena
  An annotated implementation of the Hyena Hierarchy paper
  ☆31Updated last year
• lucidrains / pause-transformer
  Yet another random morning idea to be quickly tried and architecture shared if it works; to allow the transformer to pause for any amount…
  ☆49Updated last year
• AndPotap / einsum-search
  ☆25Updated last month
• srush / mamba-primer
  ☆35Updated 7 months ago
• Ping-C / optimizer
  This repository includes code to reproduce the tables in "Loss Landscapes are All You Need: Neural Network Generalization Can Be Explaine…
  ☆34Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated 11 months ago
• gregorbachmann / scaling_mlps
  ☆51Updated 5 months ago
• epfml / llm-baselines
  NanoGPT-like codebase for LLM training
  ☆75Updated this week
• maximzubkov / fft-scan
  Efficient PScan implementation in PyTorch
  ☆15Updated 10 months ago
• johnryan465 / pscan
  ☆36Updated 10 months ago
• google-deepmind / spectral_ssm
  ☆27Updated 7 months ago
• epfml / DenseFormer
  ☆76Updated 7 months ago
• machine-discovery / deer
  Parallelizing non-linear sequential models over the sequence length
  ☆45Updated 3 weeks ago
• google-deepmind / asyncdiloco
  ☆39Updated 10 months ago
• cloneofsimo / zeroshampoo
  ☆31Updated 2 months ago
• proger / hippogriff
  Griffin MQA + Hawk Linear RNN Hybrid
  ☆85Updated 6 months ago
• srush / mamba-scans
  Blog post
  ☆16Updated 9 months ago
• sustcsonglin / mamba-triton
  ☆45Updated 9 months ago
• thjashin / multires-conv
  Sequence Modeling with Multiresolution Convolutional Memory (ICML 2023)
  ☆120Updated last year
• NVIDIA / ngpt
  Normalized Transformer (nGPT)
  ☆66Updated this week