Alternatives and similar repositories for flash-attention-rocm

Users that are interested in flash-attention-rocm are comparing it to the libraries listed below

• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆25Updated last month
• ibm-granite / granite-embedding-models
  ☆37Updated last week
• casper-hansen / AutoAWQ_kernels
  ☆78Updated 9 months ago
• tile-ai / tvm
  Open deep learning compiler stack for cpu, gpu and specialized accelerators
  ☆19Updated last week
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆86Updated last year
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆56Updated 3 weeks ago
• FrancescoSaverioZuppichini / pytorch-2.0-benchmark
  Benchmarking PyTorch 2.0 different models
  ☆20Updated 2 years ago
• tridao / flash-attention-wheels
  ☆55Updated last year
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated 2 years ago
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆40Updated 9 months ago
• rayleizhu / vllm-ra
  [ACL 2024] RelayAttention for Efficient Large Language Model Serving with Long System Prompts
  ☆40Updated last year
• HazyResearch / embroid
  Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
  ☆11Updated 2 years ago
• juvi21 / CoPE-cuda
  Contextual Position Encoding but with some custom CUDA Kernels https://arxiv.org/abs/2405.18719
  ☆22Updated last year
• kyegomez / Reka-Torch
  Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch
  ☆29Updated 3 weeks ago
• nanowell / Q-Sparse-LLM
  My Implementation of Q-Sparse: All Large Language Models can be Fully Sparsely-Activated
  ☆33Updated last year
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆56Updated 2 years ago
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆32Updated 4 months ago
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated 2 years ago
• clabrugere / scratch-llm
  Implements a LLM similar to Meta's Llama 2 from the ground up in PyTorch, for educational purposes.
  ☆37Updated 6 months ago
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated 2 years ago
• iantbutler01 / ditty
  A library for simplifying fine tuning with multi gpu setups in the Huggingface ecosystem.
  ☆16Updated 10 months ago
• softmax1 / Flash-Attention-Softmax-N
  CUDA and Triton implementations of Flash Attention with SoftmaxN.
  ☆73Updated last year
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆13Updated 8 months ago
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆58Updated 11 months ago
• shreyansh26 / Attention-Mask-Patterns
  Using FlexAttention to compute attention with different masking patterns
  ☆44Updated 11 months ago
• qdrant / bm42_eval
  Evaluation of bm42 sparse indexing algorithm
  ☆68Updated last year
• deepspeedai / DeepSpeed-Kernels
  ☆74Updated 5 months ago
• anyscale / long-context-fine-tuning-blogpost
  ☆17Updated last year
• Doraemonzzz / Awesome-Triton-Resources
  Awesome Triton Resources
  ☆33Updated 4 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆131Updated 3 months ago