ogchen / nanofold

Related projects ⓘ

Alternatives and complementary repositories for nanofold

• lucidrains / flash-genomics-model
  My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…
  ☆52Updated last year
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆85Updated 2 months ago
• charlesfrye / cuda-substrings
  Because it's there.
  ☆14Updated 2 months ago
• ElanaPearl / InterPLM
  Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders
  ☆91Updated this week
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆104Updated last month
• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆48Updated 3 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆104Updated last month
• KellerJordan / Muon
  Muon optimizer for neural networks: >30% extra sample efficiency, <3% wallclock overhead
  ☆113Updated this week
• LiibanMo / scikit-jax
  Your favourite classical machine learning algos on the GPU/TPU
  ☆20Updated 2 months ago
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆50Updated 7 months ago
• okarthikb / state-space-models
  ☆27Updated 4 months ago
• togethercomputer / stripedhyena
  Repository for StripedHyena, a state-of-the-art beyond Transformer architecture
  ☆298Updated 8 months ago
• EleutherAI / nanoGPT-mup
  The simplest, fastest repository for training/finetuning medium-sized GPTs.
  ☆84Updated this week
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆38Updated 5 months ago
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆59Updated 3 months ago
• xjdr-alt / muzero_sketch
  ☆36Updated 3 months ago
• epfml / DenseFormer
  ☆77Updated 7 months ago
• da-fr / arc-prize-2024
  Our solution for the arc challenge 2024
  ☆33Updated last week
• etowahadams / interprot
  ☆61Updated this week
• shivance / picograd
  Rust Implementation of micrograd
  ☆51Updated 4 months ago
• lucidrains / firefly-torch
  Exploration into the Firefly algorithm in Pytorch
  ☆35Updated 2 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆58Updated last month
• NousResearch / StripedHyenaTrainer
  ☆57Updated 11 months ago
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated 5 months ago
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆21Updated 5 months ago
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆157Updated 11 months ago
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆158Updated this week
• Hanziwww / AlphaFold3-GUI
  AFusion: AlphaFold 3 GUI
  ☆42Updated this week
• cognitivecomputations / grokadamw
  ☆118Updated 3 months ago
• AakashKumarNain / mistral_jax
  This is a port of Mistral-7B model in JAX
  ☆30Updated 4 months ago