Alternatives and similar repositories for Gaudi-tutorials:

Users that are interested in Gaudi-tutorials are comparing it to the libraries listed below

• HabanaAI / Model-References
  Reference models for Intel(R) Gaudi(R) AI Accelerator
  ☆159Updated this week
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆150Updated 9 months ago
• Qualcomm-AI-research / FP8-quantization
  ☆139Updated last year
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆201Updated last year
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆13Updated 2 months ago
• SqueezeBits / QUICK
  QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
  ☆116Updated 11 months ago
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆176Updated last month
• north-numerical-computing / tensor-cores-numerical-behavior
  Test suite for probing the numerical behavior of NVIDIA tensor cores
  ☆37Updated 7 months ago
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆89Updated 2 months ago
• HabanaAI / Habana_Custom_Kernel
  Provides the examples to write and build Habana custom kernels using the HabanaTools
  ☆20Updated 3 months ago
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆237Updated 4 months ago
• graphcore-research / llm-inference-research
  An experimentation platform for LLM inference optimisation
  ☆29Updated 5 months ago
• IntelLabs / FP8-Emulation-Toolkit
  PyTorch extension for emulating FP8 data formats on standard FP32 Xeon/GPU hardware.
  ☆106Updated 3 months ago
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆107Updated last week
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆62Updated 11 months ago
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆33Updated this week
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆173Updated this week
• ROCm / TransformerEngine
  ☆20Updated this week
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆56Updated this week
• Cornell-RelaxML / qtip
  ☆109Updated 2 months ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆61Updated 2 months ago
• jy-yuan / KIVI
  [ICML 2024] KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
  ☆276Updated last month
• intel / torch-xpu-ops
  ☆34Updated this week
• Aaronhuang-778 / SliM-LLM
  SliM-LLM: Salience-Driven Mixed-Precision Quantization for Large Language Models
  ☆27Updated 6 months ago
• mobiusml / gemlite
  Fast low-bit matmul kernels in Triton
  ☆250Updated last week
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆38Updated 2 months ago
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆102Updated 4 months ago
• triton-lang / kernels
  ☆71Updated 3 months ago
• ROCm / Megatron-LM
  Ongoing research training transformer models at scale
  ☆16Updated this week
• SNU-ARC / any-precision-llm
  [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs
  ☆96Updated 2 months ago