Alternatives and similar repositories for lightning-Habana:

Users that are interested in lightning-Habana are comparing it to the libraries listed below

• daemyung / practice-triton
  삼각형의 실전! Triton
  ☆15Updated 11 months ago
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆58Updated 3 months ago
• google-deepmind / asyncdiloco
  ☆41Updated last year
• mgmalek / efficient_cross_entropy
  ☆85Updated 8 months ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆79Updated 2 years ago
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆32Updated 9 months ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆109Updated 3 weeks ago
• srush / mamba-primer
  ☆37Updated 9 months ago
• graphcore-research / unit-scaling
  A library for unit scaling in PyTorch
  ☆122Updated 2 months ago
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆47Updated 5 months ago
• pytorch-labs / torchfix
  TorchFix - a linter for PyTorch-using code with autofix support
  ☆122Updated 3 weeks ago
• andravin / spio
  Efficient CUDA kernels for training convolutional neural networks with PyTorch.
  ☆38Updated this week
• google-deepmind / randomized_positional_encodings
  Randomized Positional Encodings Boost Length Generalization of Transformers
  ☆79Updated 10 months ago
• huggingface / peft-pytorch-conference
  Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…
  ☆14Updated last year
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated last year
• foundation-model-stack / bamba
  Train, tune, and infer Bamba model
  ☆80Updated 2 weeks ago
• mengxiayu / LLMSuperWeight
  Code for studying the super weight in LLM
  ☆72Updated last month
• Ryu1845 / hyena-jax
  Implementation of Hyena Hierarchy in JAX
  ☆10Updated last year
• IST-DASLab / SparseFinetuning
  Repository for Sparse Finetuning of LLMs via modified version of the MosaicML llmfoundry
  ☆40Updated last year
• cloneofsimo / min-fsdp
  ☆75Updated 6 months ago
• huggingface / chug
  Minimal sharded dataset loaders, decoders, and utils for multi-modal document, image, and text datasets.
  ☆155Updated 9 months ago
• mistralai / mistral-evals
  ☆57Updated this week
• lucidrains / pytorch-custom-utils
  Just some miscellaneous utility functions / decorators / modules related to Pytorch and Accelerate to help speed up implementation of new…
  ☆119Updated 6 months ago
• pytorch / torchdistx
  Torch Distributed Experimental
  ☆115Updated 5 months ago
• kshitij12345 / torchnnprofiler
  Context Manager to profile the forward and backward times of PyTorch's nn.Module
  ☆84Updated last year
• Upaya07 / NeurIPS-llm-efficiency-challenge
  Code for NeurIPS LLM Efficiency Challenge
  ☆54Updated 9 months ago
• NX-AI / flashrnn
  FlashRNN - Fast RNN Kernels with I/O Awareness
  ☆71Updated last month
• eth-easl / fmengine
  Utilities for Training Very Large Models
  ☆57Updated 4 months ago
• pytorch / torchsnapshot
  A performant, memory-efficient checkpointing library for PyTorch applications, designed with large, complex distributed workloads in mind…
  ☆153Updated last month