Alternatives and similar repositories for Gaudi-tutorials:

Users that are interested in Gaudi-tutorials are comparing it to the libraries listed below

• HabanaAI / Model-References
  Reference models for Intel(R) Gaudi(R) AI Accelerator
  ☆159Updated last week
• HabanaAI / Megatron-DeepSpeed
  Intel Gaudi's Megatron DeepSpeed Large Language Models for training
  ☆13Updated last month
• huggingface / tgi-gaudi
  Large Language Model Text Generation Inference on Habana Gaudi
  ☆31Updated this week
• HabanaAI / vllm-fork
  A high-throughput and memory-efficient inference and serving engine for LLMs
  ☆50Updated this week
• zinccat / Awesome-Triton-Kernels
  Collection of kernels written in Triton language
  ☆91Updated 3 months ago
• huggingface / optimum-habana
  Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
  ☆166Updated this week
• SqueezeBits / QUICK
  QUICK: Quantization-aware Interleaving and Conflict-free Kernel for efficient LLM inference
  ☆114Updated 10 months ago
• AlibabaResearch / flash-llm
  Flash-LLM: Enabling Cost-Effective and Highly-Efficient Large Generative Model Inference with Unstructured Sparsity
  ☆195Updated last year
• groq / mlagility
  Machine Learning Agility (MLAgility) benchmark and benchmarking tools
  ☆38Updated last month
• SNU-ARC / any-precision-llm
  [ICML 2024 Oral] Any-Precision LLM: Low-Cost Deployment of Multiple, Different-Sized LLMs
  ☆93Updated last month
• leimao / CUTLASS-Examples
  CUTLASS and CuTe Examples
  ☆37Updated 3 weeks ago
• Dao-AILab / fast-hadamard-transform
  Fast Hadamard transform in CUDA, with a PyTorch interface
  ☆135Updated 8 months ago
• intel / torch-ccl
  oneCCL Bindings for Pytorch*
  ☆87Updated 3 weeks ago
• facebookresearch / MODel_opt
  Memory Optimizations for Deep Learning (ICML 2023)
  ☆62Updated 10 months ago
• intel / intel-xpu-backend-for-triton
  OpenAI Triton backend for Intel® GPUs
  ☆157Updated this week
• gpu-mode / triton-index
  Cataloging released Triton kernels.
  ☆157Updated 3 weeks ago
• intel / intel-extension-for-deepspeed
  Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note…
  ☆58Updated last month
• hkproj / quantization-notes
  Notes on quantization in neural networks
  ☆66Updated last year
• HabanaAI / DeepSpeed
  DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
  ☆12Updated last month
• HabanaAI / Habana_Custom_Kernel
  Provides the examples to write and build Habana custom kernels using the HabanaTools
  ☆19Updated last month
• foundation-model-stack / foundation-model-stack
  🚀 Collection of components for development, training, tuning, and inference of foundation models leveraging PyTorch native components.
  ☆186Updated last week
• Qualcomm-AI-research / FP8-quantization
  ☆132Updated last year
• efeslab / fiddler
  [ICLR'25] Fast Inference of MoE Models with CPU-GPU Orchestration
  ☆180Updated 2 months ago
• kyegomez / FlashAttention20
  Get down and dirty with FlashAttention2.0 in pytorch, plug in and play no complex CUDA kernels
  ☆102Updated last year
• GATECH-EIC / ShiftAddLLM
  ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
  ☆101Updated 3 months ago
• HanGuo97 / flute
  Fast Matrix Multiplications for Lookup Table-Quantized LLMs
  ☆221Updated last week
• quic / cloud-ai-sdk
  Qualcomm Cloud AI SDK (Platform and Apps) enable high performance deep learning inference on Qualcomm Cloud AI platforms delivering high …
  ☆55Updated 3 months ago
• intel / torch-xpu-ops
  ☆34Updated this week
• pytorch-labs / applied-ai
  Applied AI experiments and examples for PyTorch
  ☆216Updated last week
• usyd-fsalab / fp6_llm
  An efficient GPU support for LLM inference with x-bit quantization (e.g. FP6,FP5).
  ☆232Updated 3 months ago