Alternatives and similar repositories for Gaudi-tutorials

Users that are interested in Gaudi-tutorials are comparing it to the libraries listed below

• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆33Updated 3 months ago
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆97Updated 2 months ago
• HabanaAI / Model-References
  Reference models for Intel(R) Gaudi(R) AI Accelerator
  ☆164Updated last month
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆188Updated this week
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆76Updated this week
• HabanaAI / Gaudi-solutions
  Full End-to-End examples showing how to use First-gen Gaudi and Gaudi2 in common use cases
  ☆12Updated 6 months ago
• ROCm / MAD
  ☆19Updated this week
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆132Updated 2 months ago
• HabanaAI / SynapseAI_Core
  SynapseAI Core is a reference implementation of the SynapseAI API running on Habana Gaudi
  ☆42Updated 4 months ago
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆13Updated 6 months ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆61Updated last week
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆214Updated last year
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆322Updated last week
• intel / torch-xpu-ops
  ☆46Updated this week
• north-numerical-computing / tensor-cores-numerical-behavior
  Test suite for probing the numerical behavior of NVIDIA tensor cores
  ☆40Updated 11 months ago
• intel / npu-nn-cost-model
  Library for modelling performance costs of different Neural Network workloads on NPU devices
  ☆34Updated last week
• HabanaAI / DeepSpeed
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
  ☆13Updated last month
• SqueezeBits / QUICK
  QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
  ☆118Updated last year
• argonne-lcf / LLM-Inference-Bench
  LLM-Inference-Bench
  ☆45Updated 2 weeks ago
• efeslab / fiddler
  [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆213Updated 7 months ago
• mk1-project / quickreduce
  QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.
  ☆28Updated 3 months ago
• intel / llm-on-ray
  Pretrain, finetune and serve LLMs on Intel platforms with Ray
  ☆129Updated last month
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆252Updated 7 months ago
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆201Updated last year
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆238Updated 5 months ago
• Qualcomm-AI-research / FP8-quantization
  ☆149Updated 2 years ago
• microsoft / microxcaling
  PyTorch emulation library for Microscaling (MX)-compatible data formats
  ☆247Updated last week
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆277Updated 3 weeks ago
• HabanaAI / Habana_Custom_Kernel
  Provides the examples to write and build Habana custom kernels using the HabanaTools
  ☆21Updated 2 months ago
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆191Updated this week