ogchen / nanofold

Related projects: ⓘ

• lucidrains / flash-genomics-model
  My own attempt at a long context genomics model, leveraging recent advances in long context attention modeling (Flash Attention + other h…
  ☆51Updated last year
• shivance / picograd
  Rust Implementation of micrograd
  ☆51Updated 2 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆82Updated 3 weeks ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆94Updated 2 weeks ago
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆53Updated last month
• okarthikb / state-space-models
  ☆27Updated 2 months ago
• NousResearch / StripedHyenaTrainer
  ☆55Updated 9 months ago
• timduignan / Scalable-Electrolyte-Simulation
  This repository contains the data and scripts necessary to reproduce the results presented in the paper: **"Scalable molecular simulation…
  ☆35Updated 3 months ago
• andrew-silva / mlx-rlhf
  An example implementation of RLHF (or, more accurately, RLAIF) built on MLX and HuggingFace.
  ☆21Updated 2 months ago
• ml-jku / hopfield-boosting
  ☆25Updated 4 months ago
• Aleph-Alpha / trigrams
  ☆29Updated 3 weeks ago
• google-deepmind / asyncdiloco
  ☆38Updated 8 months ago
• joey00072 / ohara
  Collection of autoregressive model implementation
  ☆62Updated 2 weeks ago
• tanaymeh / mamba-train
  A single repo with all scripts and utils to train / fine-tune the Mamba model with or without FIM
  ☆46Updated 5 months ago
• epfml / DenseFormer
  ☆73Updated 5 months ago
• lucidrains / frame-averaging-pytorch
  Pytorch implementation of a simple way to enable (Stochastic) Frame Averaging for any network
  ☆45Updated last month
• joey00072 / Attention-as-graph
  alternative way to calculating self attention
  ☆18Updated 3 months ago
• togethercomputer / stripedhyena
  Repository for StripedHyena, a state-of-the-art beyond Transformer architecture
  ☆253Updated 6 months ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆100Updated last month
• Zyphra / Zamba2
  PyTorch implementation of models from the Zamba2 series.
  ☆63Updated last month
• PolymathicAI / xVal
  Repository for code used in the xVal paper
  ☆110Updated 5 months ago
• vtabbott / Algebraic-NCD
  A package for defining deep learning models using categorical algebraic expressions.
  ☆53Updated last month
• catid / lllm
  Latent Large Language Models
  ☆16Updated 3 weeks ago
• LiibanMo / scikit-jax
  Your favourite classical machine learning algos on the GPU/TPU
  ☆20Updated this week
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆84Updated 4 months ago
• predibase / lora_bakeoff
  ☆16Updated 2 weeks ago
• Lagooon / LeanSTaR
  ☆19Updated last week
• mag- / gpu_benchmark
  Gpu benchmark
  ☆35Updated 2 weeks ago
• lucidrains / ReST-EM-pytorch
  ☆42Updated this week
• mobiusml / gemlite
  Simple and fast low-bit matmul kernels in CUDA
  ☆48Updated this week