lucidrains / hyena-dna

Related projects: ⓘ

• LiibanMo / scikit-jax
  Your favourite classical machine learning algos on the GPU/TPU
  ☆20Updated this week
• lucidrains / flash-genomics-model
  My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…
  ☆51Updated last year
• irhum / hyena
  JAX/Flax implementation of the Hyena Hierarchy
  ☆29Updated last year
• Algomancer / VCReg
  Minimal Implimentation of VCRec (2024) for collapse provention.
  ☆14Updated 5 months ago
• lucidrains / gateloop-transformer
  Implementation of GateLoop Transformer in Pytorch and Jax
  ☆86Updated 3 months ago
• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆45Updated last month
• lucidrains / coordinate-descent-hierarchical-memory
  ☆14Updated this week
• smearle / autoverse
  Generative cellular automaton-like learning environments for RL.
  ☆19Updated last month
• andrew-silva / clean-rl-mlx
  Clean RL implementation using MLX
  ☆26Updated 6 months ago
• google-deepmind / understanding_deep_generative_models_with_generalized_empirical_likelihood
  ☆33Updated last year
• lucidrains / hyena-pytorch
  ☆23Updated this week
• lucidrains / genetic-algorithm-pytorch
  Toy genetic algorithm in Pytorch
  ☆28Updated 6 months ago
• lucidrains / decomp-opt-pytorch
  ☆29Updated this week
• okarthikb / state-space-models
  ☆27Updated 2 months ago
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated 3 months ago
• expz / annotated-hyena
  An annotated implementation of the Hyena Hierarchy paper
  ☆30Updated last year
• lucidrains / firefly-torch
  Exploration into the Firefly algorithm in Pytorch
  ☆31Updated this week
• LumenPallidium / jepa
  Experiments in Joint Embedding Predictive Architectures (JEPAs).
  ☆32Updated 8 months ago
• lucidrains / tranception-pytorch
  Implementation of Tranception, an attention network, paired with retrieval, that is SOTA for protein fitness prediction
  ☆31Updated 2 years ago
• KhoomeiK / complexity-scaling
  gzip Predicts Data-dependent Scaling Laws
  ☆31Updated 3 months ago
• lucidrains / coordinate-descent-attention
  Implementation of an Attention layer where each head can attend to more than just one token, using coordinate descent to pick topk
  ☆46Updated last year
• crowsonkb / torch-dist-utils
  Utilities for PyTorch distributed
  ☆23Updated 11 months ago
• AakashKumarNain / mistral_jax
  This is a port of Mistral-7B model in JAX
  ☆29Updated 2 months ago
• lucidrains / JEPA-pytorch
  ☆114Updated this week
• kyegomez / MambaFormer
  Implementation of MambaFormer in Pytorch ++ Zeta from the paper: "Can Mamba Learn How to Learn? A Comparative Study on In-Context Learnin…
  ☆20Updated last week
• drisspg / transformer_nuggets
  A place to store reusable transformer components of my own creation or found on the interwebs
  ☆43Updated 3 weeks ago
• lucidrains / ReST-EM-pytorch
  ☆42Updated this week
• EleutherAI / rnngineering
  Engineering the state of RNN language models (Mamba, RWKV, etc.)
  ☆31Updated 3 months ago
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆40Updated 7 months ago
• lightonai / RITA
  RITA is a family of autoregressive protein models, developed by LightOn in collaboration with the OATML group at Oxford and the Debora Ma…
  ☆89Updated last year