Lightning-AI / lightning-Habana

Related projects ⓘ

Alternatives and complementary repositories for lightning-Habana

• tanyuqian / redco
  NAACL '24 (Best Demo Paper RunnerUp) / MlSys @ NeurIPS '23 - RedCoast: A Lightweight Tool to Automate Distributed Training and Inference
  ☆61Updated last month
• mgmalek / efficient_cross_entropy
  ☆77Updated 5 months ago
• lucidrains / infini-transformer-pytorch
  Implementation of Infini-Transformer in Pytorch
  ☆104Updated last month
• lucidrains / autoregressive-linear-attention-cuda
  CUDA implementation of autoregressive linear attention, with all the latest research findings
  ☆43Updated last year
• huggingface / peft-pytorch-conference
  Code for the examples presented in the talk "Training a Llama in your backyard: fine-tuning very large models on consumer hardware" given…
  ☆14Updated last year
• apple / ml-hypercloning
  ☆35Updated 2 weeks ago
• microsoft / mutransformers
  some common Huggingface transformers in maximal update parametrization (µP)
  ☆76Updated 2 years ago
• amirzandieh / HyperAttention
  Triton Implementation of HyperAttention Algorithm
  ☆46Updated 11 months ago
• hpcaitech / Elixir
  Elixir: Train a Large Language Model on a Small GPU Cluster
  ☆13Updated last year
• siyan-zhao / prepacking
  The source code of our work "Prepacking: A Simple Method for Fast Prefilling and Increased Throughput in Large Language Models"
  ☆56Updated last month
• lucidrains / mixture-of-attention
  Some personal experiments around routing tokens to different autoregressive attention, akin to mixture-of-experts
  ☆108Updated last month
• Edward-Sun / gpt-accelera
  Simple and efficient pytorch-native transformer training and inference (batched)
  ☆61Updated 7 months ago
• facebookresearch / mexma
  MEXMA: Token-level objectives improve sentence representations
  ☆34Updated 2 weeks ago
• facebookresearch / DIG-In
  This library supports evaluating disparities in generated image quality, diversity, and consistency between geographic regions.
  ☆20Updated 5 months ago
• facebookresearch / lss_eval
  This is a new metric that can be used to evaluate faithfulness of text generated by LLMs. The work behind this repository can be found he…
  ☆31Updated last year
• aniquetahir / JORA
  JORA: JAX Tensor-Parallel LoRA Library (ACL 2024)
  ☆29Updated 6 months ago
• ml-jku / EVA
  One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
  ☆29Updated last month
• epfml / DenseFormer
  ☆76Updated 7 months ago
• lucidrains / sinkhorn-router-pytorch
  Self contained pytorch implementation of a sinkhorn based router, for mixture of experts or otherwise
  ☆31Updated 2 months ago
• lucidrains / tableformer-pytorch
  Implementation of TableFormer, Robust Transformer Modeling for Table-Text Encoding, in Pytorch
  ☆36Updated 2 years ago
• mistralai / mistral-evals
  ☆48Updated last month
• SeunghyunSEO / optimized_hf_llama_class_for_training
  ☆45Updated 2 months ago
• lucidrains / light-recurrent-unit-pytorch
  Implementation of a Light Recurrent Unit in Pytorch
  ☆46Updated last month
• Lightning-AI / utilities
  Common Python utilities and GitHub Actions in Lightning Ecosystem
  ☆51Updated this week
• yixiaoer / tpu-training-example
  ☆13Updated 4 months ago
• lucidrains / grokfast-pytorch
  Explorations into the proposal from the paper "Grokfast, Accelerated Grokking by Amplifying Slow Gradients"
  ☆85Updated 2 months ago
• daemyung / practice-triton
  삼각형의 실전! Triton
  ☆15Updated 9 months ago
• BlinkDL / LinearAttentionArena
  Here we will test various linear attention designs.
  ☆56Updated 6 months ago