Alternatives and similar repositories for lightning-Habana:

Users that are interested in lightning-Habana are comparing it to the libraries listed below

• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models" [AISTATS …
  ☆59Updated 6 months ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆110Updated 3 months ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆57Updated last year
• lucidrains / tableformer-pytorch
  Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch
  ☆37Updated 3 years ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆73Updated last year
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆33Updated last year
• mgmalek / efficient_cross_entropy
  ☆101Updated 11 months ago
• daemyung / practice-triton
  삼각형의 실전! Triton
  ☆16Updated last year
• huggingface / kernels
  Load compute kernels from the Hub
  ☆115Updated this week
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆47Updated last year
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 7 months ago
• insuhan / hyper-attn
  ☆81Updated last year
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆78Updated last year
• google-deepmind / randomized_positional_encodings
  Randomized Positional Encodings Boost Length Generalization of Transformers
  ☆80Updated last year
• Doraemonzzz / Awesome-Triton-Resources
  Awesome Triton Resources
  ☆26Updated 3 weeks ago
• srush / mamba-primer
  ☆37Updated last year
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆57Updated last year
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆80Updated 3 years ago
• dame-cell / Triformer
  Transformers components but in Triton
  ☆32Updated last month
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆40Updated last year
• hpcaitech / Elixir
  Elixir: Train a Large Language Model on a Small GPU Cluster
  ☆14Updated last year
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆82Updated last year
• apple / ml-hypercloning
  ☆47Updated 5 months ago
• ahennequ / pytorch-custom-mma
  ☆29Updated 2 years ago
• pytorch-labs / tritonbench
  Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.
  ☆116Updated this week
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆41Updated 4 months ago
• tridao / flash-attention-wheels
  ☆48Updated last year
• google-deepmind / asyncdiloco
  ☆43Updated last year
• cloneofsimo / min-fsdp
  ☆78Updated 9 months ago
• HanGuo97 / lq-lora
  ☆125Updated last year