Alternatives and similar repositories for power-attention

Users that are interested in power-attention are comparing it to the libraries listed below

• google-deepmind / neural_networks_solomonoff_induction
  Learning Universal Predictors
  ☆74Updated 10 months ago
• xjdr-alt / muzero_sketch
  ☆38Updated 10 months ago
• xjdr-alt / llmri
  look how they massacred my boy
  ☆63Updated 7 months ago
• athms / mad-lab
  A MAD laboratory to improve AI architecture designs 🧪
  ☆116Updated 5 months ago
• JackCai1206 / arithmetic-self-improve
  ☆33Updated 3 months ago
• LucasPrietoAl / grokking-at-the-edge-of-numerical-stability
  ☆95Updated 4 months ago
• OpenEvaByte / evabyte
  EvaByte: Efficient Byte-level Language Models at Scale
  ☆101Updated last month
• google-deepmind / asyncdiloco
  ☆44Updated last year
• kanishkg / stream-of-search
  Repository for the paper Stream of Search: Learning to Search in Language
  ☆147Updated 4 months ago
• doomslide / hyperobject
  Plotting (entropy, varentropy) for small LMs
  ☆97Updated 2 weeks ago
• iliao2345 / CompressARC
  ☆154Updated last month
• okarthikb / state-space-models
  ☆27Updated 10 months ago
• Zyphra / tree_attention
  Tree Attention: Topology-aware Decoding for Long-Context Attention on GPU clusters
  ☆126Updated 6 months ago
• jerber / lang-jepa
  ☆111Updated 5 months ago
• Amplify-Partners / annotation-reading-list
  A reading list of relevant papers and projects on foundation model annotation
  ☆27Updated 3 months ago
• young-geng / mintext
  Minimal but scalable implementation of large language models in JAX
  ☆34Updated 7 months ago
• HazyResearch / train-tk
  train with kittens!
  ☆57Updated 7 months ago
• test-time-training / ttt-tk
  ☆31Updated 2 months ago
• PrimeIntellect-ai / pccl
  PCCL (Prime Collective Communications Library) implements fault tolerant collective communications over IP
  ☆88Updated 2 weeks ago
• dvruette / barrel-rec-pytorch
  ☆53Updated last year
• MatX-inc / seqax
  seqax = sequence modeling + JAX
  ☆155Updated last month
• apple / ml-planner
  ☆51Updated last year
• OpenPipe / deductive-reasoning
  Train your own SOTA deductive reasoning model
  ☆93Updated 3 months ago
• SinatrasC / entropix-smollm
  smolLM with Entropix sampler on pytorch
  ☆150Updated 7 months ago
• jax-ml / jax-llm-examples
  ☆118Updated 2 weeks ago
• METR / RE-Bench
  ☆76Updated last month
• neoneye / ARC-Interactive-History-Dataset
  The history files when recording human interaction while solving ARC tasks
  ☆110Updated 2 weeks ago
• yashbonde / rasp
  Implementing RASP transformer programming language https://arxiv.org/pdf/2106.06981.pdf.
  ☆54Updated 3 years ago
• harmonic-ai / datasets
  Harmonic Datasets
  ☆40Updated 10 months ago
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆100Updated 3 months ago