Alternatives and similar repositories for flash-attention-rocm

Users that are interested in flash-attention-rocm are comparing it to the libraries listed below

• yuzhenmao / IceFormer
  Implementation of IceFormer: Accelerated Inference with Long-Sequence Transformers on CPUs (ICLR 2024).
  ☆25Updated last week
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• kyegomez / Infini-attention
  Implementation of the paper: "Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention" from Google in pyTO…
  ☆55Updated 3 weeks ago
• facebookresearch / coocmap
  code for paper "Accessing higher dimensions for unsupervised word translation"
  ☆21Updated 2 years ago
• kyegomez / EAOT
  The open source implementation of "Connecting Large Language Models with Evolutionary Algorithms Yields Powerful Prompt Optimizers"
  ☆19Updated last year
• Michaelvll / llm-ie-benchmarks
  A collection of reproducible inference engine benchmarks
  ☆32Updated 3 months ago
• kyegomez / Reka-Torch
  Implementation of the model: "Reka Core, Flash, and Edge: A Series of Powerful Multimodal Language Models" in PyTorch
  ☆30Updated this week
• umass-ml4ed / mathGPT
  A GPT-based generative LM for combined text and math formulas, leveraging tree-based formula encoding.
  ☆40Updated 2 years ago
• EleutherAI / mdl
  Minimum Description Length probing for neural network representations
  ☆18Updated 5 months ago
• liujch1998 / infini-gram
  ☆55Updated last week
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆57Updated last year
• FreedomIntelligence / FastLLM
  Fast LLM Training CodeBase With dynamic strategy choosing [Deepspeed+Megatron+FlashAttention+CudaFusionKernel+Compiler];
  ☆40Updated last year
• kemingy / vllm-env
  setup the env for vllm users
  ☆16Updated last year
• casper-hansen / AutoAWQ_kernels
  ☆76Updated 7 months ago
• mrcabbage972 / simple-toolformer
  A Python implementation of Toolformer using Huggingface Transformers
  ☆14Updated 2 years ago
• Percent-BFD / neurips_submission
  ☆16Updated last year
• kyegomez / LM-Infinite
  Implementation of "LM-Infinite: Simple On-the-Fly Length Generalization for Large Language Models"
  ☆40Updated 8 months ago
• IST-DASLab / QIGen
  Repository for CPU Kernel Generation for LLM Inference
  ☆26Updated 2 years ago
• UmerHA / triton_util
  Make triton easier
  ☆47Updated last year
• kyegomez / MM1
  PyTorch Implementation of the paper "MM1: Methods, Analysis & Insights from Multimodal LLM Pre-training"
  ☆24Updated 3 weeks ago
• facebookresearch / tce
  Library for the Test-based Calibration Error (TCE) metric to quantify the degree to classifier calibration.
  ☆13Updated last year
• Doraemonzzz / Awesome-Triton-Resources
  Awesome Triton Resources
  ☆32Updated 2 months ago
• srush / LLM-Talk
  ☆51Updated last year
• HazyResearch / embroid
  Embroid: Unsupervised Prediction Smoothing Can Improve Few-Shot Classification
  ☆11Updated last year
• OpenNLPLab / LASP
  Linear Attention Sequence Parallelism (LASP)
  ☆85Updated last year
• juvi21 / CoPE-cuda
  Contextual Position Encoding but with some custom CUDA Kernels https://arxiv.org/abs/2405.18719
  ☆22Updated last year
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆48Updated 10 months ago
• qdrant / bm42_eval
  Evaluation of bm42 sparse indexing algorithm
  ☆68Updated last year
• NolanoOrg / llama-int4-quant
  ☆26Updated 2 years ago
• D-Star-AI / KITE
  KITE (Knowledge-Intensive Task Evaluation) is an end-to-end benchmark for RAG pipelines
  ☆19Updated 11 months ago