CLAIRE-Labo / StructuredFFN

Related projects ⓘ

Alternatives and complementary repositories for StructuredFFN

• RobertCsordas / moe
  Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"
  ☆36Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated 11 months ago
• ssokota / mec
  Code for minimum-entropy coupling.
  ☆30Updated 4 months ago
• codekansas / rwkv
  RWKV model implementation
  ☆38Updated last year
• lucaslingle / mu_transformer
  Transformer with Mu-Parameterization, implemented in Jax/Flax. Supports FSDP on TPU pods.
  ☆29Updated 2 weeks ago
• google-deepmind / spectral_ssm
  ☆28Updated 7 months ago
• proger / nanokitchen
  Parallel Associative Scan for Language Models
  ☆18Updated 10 months ago
• radarFudan / mamba-minimal-jax
  ☆29Updated 2 months ago
• ethancaballero / broken_neural_scaling_laws
  Code Release for "Broken Neural Scaling Laws" (BNSL) paper
  ☆57Updated last year
• berlino / seq_icl
  ☆50Updated 6 months ago
• johnryan465 / pscan
  ☆36Updated 10 months ago
• shikaiqiu / compute-better-spent
  ☆46Updated last month
• sustcsonglin / mamba-triton
  ☆45Updated 9 months ago
• UKPLab / on-emergence
  Codes and files for the paper Are Emergent Abilities in Large Language Models just In-Context Learning
  ☆34Updated 8 months ago
• conglu1997 / intelligent-go-explore
  Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models
  ☆45Updated 5 months ago
• joey00072 / microjax
  Jax like function transformation engine but micro, microjax
  ☆26Updated 3 weeks ago
• ethansmith2000 / TransformerExperiments
  ☆18Updated last month
• epfml / schedules-and-scaling
  ☆53Updated 3 weeks ago
• dvruette / barrel-rec-pytorch
  ☆53Updated 10 months ago
• sjelassi / transformers_ssm_copy
  ☆24Updated 8 months ago
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆26Updated 2 weeks ago
• maximzubkov / fft-scan
  Efficient PScan implementation in PyTorch
  ☆15Updated 10 months ago
• recursal / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆39Updated 4 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆40Updated 2 months ago
• yikangshen / megablocks
  ☆18Updated 5 months ago
• tobiaskatsch / GatedLinearRNN
  ☆24Updated 8 months ago
• sustcsonglin / gated_linear_attention_layer
  ☆31Updated 10 months ago
• thecharlieblake / lovely-llama
  An implementation of the Llama architecture, to instruct and delight
  ☆21Updated 3 months ago
• Z-T-WANG / LaProp-Optimizer
  Codes accompanying the paper "LaProp: a Better Way to Combine Momentum with Adaptive Gradient"
  ☆21Updated 4 years ago