Large Language Model Text Generation Inference on Habana Gaudi
☆34Mar 20, 2025Updated last year
Alternatives and similar repositories for tgi-gaudi
Users that are interested in tgi-gaudi are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆212Jul 6, 2026Updated 3 weeks ago
- A high-throughput and memory-efficient inference and serving engine for LLMs☆90Jul 13, 2026Updated last week
- ☆23May 26, 2026Updated 2 months ago
- ☆16Jun 4, 2026Updated last month
- SGLang kernel library for Intel XPU☆27Updated this week
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- ☆182Updated this week
- GenAI components at micro-service level; GenAI service composer to create mega-service☆199Updated this week
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆609Updated this week
- Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open…☆736Updated this week
- Github action to connect to tailscale☆20Jun 8, 2026Updated last month
- Tutorials for running models on First-gen Gaudi and Gaudi2 for Training and Inference. The source files for the tutorials on https://dev…☆65Sep 18, 2025Updated 10 months ago
- AI Energy Score: Initiative to establish comparable energy efficiency ratings for AI models.☆40Dec 2, 2025Updated 7 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆95Updated this week
- Python interface to NUMA Linux library☆28Nov 5, 2019Updated 6 years ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Explainable AI Tooling (XAI). XAI is used to discover and explain a model's prediction in a way that is interpretable to the user. Releva…☆39Sep 22, 2025Updated 10 months ago
- ☆13Nov 29, 2024Updated last year
- Chunk Dedupe Estimation☆20Nov 5, 2024Updated last year
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆18Dec 19, 2024Updated last year
- ☆17Updated this week
- ☆100Updated this week
- A huge dataset for Document Visual Question Answering☆24Jul 29, 2024Updated last year
- Code for reproducing our paper: LMSOC: An Approach for Socially Sensitive Pretraining☆13Oct 22, 2021Updated 4 years ago
- Gets an auth token for a repo via a GitHub app installation☆16Updated this week
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- Helper Files for IDC☆45Oct 23, 2023Updated 2 years ago
- Full End-to-End examples showing how to use First-gen Gaudi and Gaudi2 in common use cases☆13Dec 2, 2024Updated last year
- Repo for the IDESSAI 2024 course on modeling audio with discrete tokens.☆13Sep 13, 2024Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆17Updated this week
- ☆27Jun 23, 2026Updated last month
- Modular RDMA Interface☆158Updated this week
- Nebula: Deep Neural Network Benchmarks in C++☆13Jan 2, 2025Updated last year
- An innovative library for efficient LLM inference via low-bit quantization☆352Aug 30, 2024Updated last year
- LeetCode plugin code debuging template.☆13Apr 11, 2025Updated last year
- Simple, predictable pricing with DigitalOcean hosting • AdAlways know what you'll pay with monthly caps and flat pricing. Enterprise-grade infrastructure trusted by 600k+ customers.
- A branch of marss with DRAMSim hooks☆19Aug 22, 2013Updated 12 years ago
- Sample Callback Server written in Node☆12Sep 22, 2018Updated 7 years ago
- ☆15May 26, 2026Updated 2 months ago
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆24Jul 30, 2024Updated last year
- A Prot paper related materials☆11Sep 5, 2022Updated 3 years ago
- The official Node SDK for Scale AI, the data platform for AI☆16Jan 10, 2024Updated 2 years ago
- 用C++å’ŒPython实现从头实现一个深度å¦ä¹ è®ç»ƒæ¡†æž¶â˜†12Nov 22, 2020Updated 5 years ago