Alternatives and similar repositories for minBERT:

Users that are interested in minBERT are comparing it to the libraries listed below

• ElanaPearl / InterPLM
  Discovering Interpretable Features in Protein Language Models via Sparse Autoencoders
  ☆167Updated 2 months ago
• lucidrains / perceiver-ar-pytorch
  Implementation of Perceiver AR, Deepmind's new long-context attention network based on Perceiver architecture, in Pytorch
  ☆87Updated 2 years ago
• ogchen / nanofold
  A nano protein structure prediction model based on DeepMind's AlphaFold paper
  ☆24Updated 10 months ago
• lucidrains / transformer-directed-evolution
  Explorations into whether a transformer with RL can direct a genetic algorithm to converge faster
  ☆64Updated this week
• lucidrains / minGRU-pytorch
  Implementation of the proposed minGRU in Pytorch
  ☆285Updated last month
• smsharma / minified-generative-models
  Bare-bones implementations of some generative models in Jax: diffusion, normalizing flows, consistency models, flow matching, (beta)-VAEs…
  ☆128Updated last year
• madaan / minimal-text-diffusion
  A minimal implementation of diffusion models for text generation
  ☆360Updated last year
• BlinkDL / SmallInitEmb
  LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence
  ☆60Updated 3 years ago
• lucidrains / flash-genomics-model
  My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…
  ☆52Updated last year
• kuleshov-group / caduceus
  Bi-Directional Equivariant Long-Range DNA Sequence Modeling
  ☆178Updated 3 months ago
• BlackHC / neural_net_checklist
  ☆150Updated 8 months ago
• recursionpharma / gflownet
  GFlowNet library specialized for graph & molecular data
  ☆238Updated last week
• zqevans / audio-diffusion
  ☆84Updated last year
• chaitjo / geometric-rna-design
  gRNAde: Geometric Deep Learning for 3D RNA inverse design (ICLR 2025 Spotlight)
  ☆192Updated last month
• lucidrains / ttt-rl
  Reinforcement Learning example in Nim, playing tic tac toe. Based off original C version from the great Antirez
  ☆13Updated 2 weeks ago
• TorchDR / TorchDR
  TorchDR - PyTorch Dimensionality Reduction
  ☆107Updated 2 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆96Updated last month
• archinetai / a-unet
  A toolbox that provides hackable building blocks for generic 1D/2D/3D UNets, in PyTorch.
  ☆85Updated last year
• GFNOrg / torchgfn
  A modular, easy to extend GFlowNet library
  ☆260Updated this week
• KindXiaoming / grow-crystals
  Getting crystal-like representations with harmonic loss
  ☆182Updated 2 weeks ago
• juraam / snake-diffusion
  Implementation snake game based on Diffusion model
  ☆90Updated 3 months ago
• vvvm23 / TchAIkovsky
  Using JAX to generate piano music as MIDI
  ☆39Updated last year
• nanowell / AdEMAMix-Optimizer-Pytorch
  The AdEMAMix Optimizer: Better, Faster, Older.
  ☆180Updated 7 months ago
• zdhNarsil / Awesome-GFlowNets
  A curated list of resources about generative flow networks (GFlowNets).
  ☆458Updated 6 months ago
• pbelcak / fastfeedforward
  A repository for log-time feedforward networks
  ☆221Updated last year
• lucidrains / gradnorm-pytorch
  A practical implementation of GradNorm, Gradient Normalization for Adaptive Loss Balancing, in Pytorch
  ☆91Updated last year
• lucidrains / enformer-pytorch
  Implementation of Enformer, Deepmind's attention network for predicting gene expression, in Pytorch
  ☆474Updated 6 months ago
• togethercomputer / stripedhyena
  Repository for StripedHyena, a state-of-the-art beyond Transformer architecture
  ☆363Updated last year
• HannesStark / dirichlet-flow-matching
  ☆106Updated 11 months ago
• fkodom / dilated-attention-pytorch
  (Unofficial) Implementation of dilated attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens" (https://arxiv.org/abs/2307…
  ☆50Updated last year