Alternatives and similar repositories for lightning-Habana:

Users that are interested in lightning-Habana are comparing it to the libraries listed below

• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆109Updated 2 months ago
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆32Updated 10 months ago
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆59Updated 5 months ago
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆86Updated last month
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆47Updated last year
• facebookexperimental / protoquant
  Prototype routines for GPU quantization written using PyTorch.
  ☆19Updated 3 weeks ago
• mgmalek / efficient_cross_entropy
  ☆94Updated 9 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 6 months ago
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆91Updated 3 months ago
• srush / mamba-primer
  ☆37Updated 11 months ago
• lucidrains / tableformer-pytorch
  Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch
  ☆37Updated 2 years ago
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆57Updated 11 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆37Updated 4 months ago
• insuhan / hyper-attn
  ☆80Updated last year
• Lightning-Universe / lightning-ColossalAI
  Large Scale Distributed Model Training strategy with Colossal AI and Lightning AI
  ☆57Updated last year
• catie-aq / flashT5
  A fast implementation of T5/UL2 in PyTorch using Flash Attention
  ☆83Updated last month
• srush / triton-autodiff
  Experiment of using Tangent to autodiff triton
  ☆76Updated last year
• frankxwang / dpo-prefix-sharing
  DPO, but faster 🚀
  ☆40Updated 3 months ago
• daemyung / practice-triton
  삼각형의 실전! Triton
  ☆15Updated last year
• xrsrke / pipegoose
  Large scale 4D parallelism pre-training for 🤗 transformers in Mixture of Experts *(still work in progress)*
  ☆81Updated last year
• PiotrNawrot / nano-sparse-attention
  The simplest implementation of recent Sparse Attention patterns for efficient LLM inference.
  ☆58Updated last month
• google-deepmind / randomized_positional_encodings
  Randomized Positional Encodings Boost Length Generalization of Transformers
  ☆79Updated 11 months ago
• mnoukhov / async_rlhf
  Code and Configs for Asynchronous RLHF: Faster and More Efficient RL for Language Models
  ☆32Updated 3 months ago
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆116Updated 4 months ago
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆68Updated 11 months ago
• lucidrains / light-recurrent-unit-pytorch
  Implementation of a Light Recurrent Unit in Pytorch
  ☆47Updated 5 months ago
• google-deepmind / asyncdiloco
  ☆43Updated last year
• Lightning-Universe / Research-poster
  Quickest way to share everything about your research within a single app
  ☆17Updated last year