Alternatives and similar repositories for nanofold:

Users that are interested in nanofold are comparing it to the libraries listed below

• metagene-ai / metagene-pretrain
  Pretraining Code for METAGENE-1
  ☆64Updated 3 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆98Updated 4 months ago
• ElanaPearl / InterPLM
  Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders
  ☆167Updated 2 months ago
• lucidrains / firefly-torch
  Exploration into the Firefly algorithm in Pytorch
  ☆38Updated 2 months ago
• lucidrains / flash-genomics-model
  My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…
  ☆52Updated last year
• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆49Updated 8 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆96Updated last month
• epfml / DenseFormer
  ☆79Updated last year
• jadechip / nanoXLSTM
  The simplest, fastest repository for training/finetuning medium-sized xLSTMs.
  ☆42Updated 10 months ago
• charlesfrye / cuda-substrings
  Because it's there.
  ☆16Updated 7 months ago
• LumenPallidium / jepa
  Experiments in Joint Embedding Predictive Architectures (JEPAs).
  ☆39Updated last year
• NousResearch / StripedHyenaTrainer
  ☆61Updated last year
• lucidrains / transformer-directed-evolution
  Explorations into whether a transformer with RL can direct a genetic algorithm to converge faster
  ☆64Updated this week
• subhashk01 / LLM-addition
  LLMs represent numbers on a helix and manipulate that helix to do addition.
  ☆21Updated 2 months ago
• kuleshov-group / caduceus
  Bi-Directional Equivariant Long-Range DNA Sequence Modeling
  ☆178Updated 3 months ago
• lamm-mit / Graph-Aware-Transformers
  Graph-Aware Attention for Adaptive Dynamics in Transformers
  ☆58Updated 3 months ago
• xjdr-alt / muzero_sketch
  ☆38Updated 8 months ago
• etowahadams / interprot
  ☆99Updated last month
• okarthikb / state-space-models
  ☆27Updated 9 months ago
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆54Updated last year
• lucidrains / quartic-transformer
  Exploring an idea where one forgets about efficiency and carries out attention across each edge of the nodes (tokens)
  ☆50Updated 3 weeks ago
• heyyanshuman / picograd
  Rust Implementation of micrograd
  ☆51Updated 9 months ago
• Pleias / Various-Finetuning
  Set of scripts to finetune LLMs
  ☆37Updated last year
• BlinkDL / modded-nanogpt-rwkv
  RWKV-7: Surpassing GPT
  ☆83Updated 5 months ago
• microsoft / encoder-decoder-slm
  Efficient encoder-decoder architecture for small language models (≤1B parameters) with cross-architecture knowledge distillation and visi…
  ☆23Updated 2 months ago
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated 10 months ago
• apple / ml-hypercloning
  ☆46Updated 5 months ago
• lucidrains / GAF-microbatch-pytorch
  Implementation of Gradient Agreement Filtering, from Chaubard et al. of Stanford, but for single machine microbatches, in Pytorch
  ☆23Updated 3 months ago
• MNoorFawi / curlora
  The code repository for the CURLoRA research paper. Stable LLM continual fine-tuning and catastrophic forgetting mitigation.
  ☆43Updated 7 months ago
• Future-House / ldp
  Agent framework for constructing language model agents and training on constructive tasks.
  ☆72Updated last week