Alternatives and similar repositories for flash-attention

Users that are interested in flash-attention are comparing it to the libraries listed below

• LAION-AI / Open-GIA
  O-GIA is an umbrella for research, infrastructure and projects ecosystem that should provide open source, reproducible datasets, models, …
  ☆87Updated 2 years ago
• openai / consistency_models_cifar10
  Consistency models trained on CIFAR-10, in JAX.
  ☆150Updated 2 years ago
• ayaka14732 / llama-2-jax
  JAX implementation of the Llama 2 model
  ☆216Updated 2 years ago
• yk / recipe-ai
  ☆31Updated 2 years ago
• sfcompute / tinynarrations
  A synthetic story narration dataset to study small audio LMs.
  ☆31Updated 2 years ago
• huggingface / zapier
  Hugging Face's Zapier Integration 🤗⚡️
  ☆50Updated 2 years ago
• kyegomez / EXA-1
  An EXA-Scale repository of Multi-Modality AI resources from papers and models, to foundational libraries!
  ☆40Updated 2 years ago
• huggingface / optimum-graphcore
  Blazing fast training of 🤗 Transformers on Graphcore IPUs
  ☆87Updated last year
• idiap / sigma-gpt
  σ-GPT: A New Approach to Autoregressive Models
  ☆70Updated last year
• geohot / dumbrl
  Can RL solve simple problems?
  ☆54Updated 2 years ago
• varunshenoy / coauthor
  Convert natural language to LaTeX within Overleaf using LLMs
  ☆120Updated 3 years ago
• apple / ml-selfcond
  Self-Conditioning Pre-Trained Language Models, ICML 2022
  ☆34Updated 3 years ago
• Datura-ai / cortex.t
  ☆63Updated last year
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆122Updated last year
• bhosmer / mm
  ☆138Updated last year
• yixiaoer / mistral-v0.2-jax
  JAX implementation of the Mistral 7b v0.2 model
  ☆35Updated last year
• JoeLi12345 / nGPT
  an open source reproduction of NVIDIA's nGPT (Normalized Transformer with Representation Learning on the Hypersphere)
  ☆110Updated 11 months ago
• openai / chz
  ☆217Updated 2 months ago
• fal-ai / lavender-data
  Load & manage evolving datasets efficiently
  ☆23Updated 5 months ago
• facebookresearch / DIG-In
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Updated last year
• lucidrains / llama-qrlhf
  Implementation of the Llama architecture with RLHF + Q-learning
  ☆170Updated last year
• macrocosmcorp / alexandria-pipeline
  Runs the InstructorXL model to compute embeddings from a Parquet file. Please contribute and improve!
  ☆39Updated 2 years ago
• ggerganov / bert.cpp
  GGML implementation of BERT model with Python bindings and quantization.
  ☆26Updated 2 years ago
• lucidrains / taylor-series-linear-attention
  Explorations into the recently proposed Taylor Series Linear Attention
  ☆100Updated last year
• hyhieu / easy_pybind
  ☆32Updated last year
• SmerkyG / GoldFinch-paper
  GoldFinch and other hybrid transformer components
  ☆12Updated last month
• NousResearch / StripedHyenaTrainer
  ☆62Updated 2 years ago
• lucidrains / TPDNE
  Thispersondoesnotexist went down, so this time, while building it back up, I am going to open source all of it.
  ☆91Updated 2 years ago
• lucidrains / openevolve
  Open-source implementation of AlphaEvolve
  ☆23Updated 8 months ago
• knowrohit / know_medical_dialogues
  KMD is a collection of conversational exchanges between patients and doctors on various medical topics. It aims to capture the intricaci…
  ☆24Updated 2 years ago