Large Language Model Text Generation Inference on Habana Gaudi
☆34Mar 20, 2025Updated last year
Alternatives and similar repositories for tgi-gaudi
Users that are interested in tgi-gaudi are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆212Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆91Sep 22, 2026Updated 3 weeks ago
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆14Jan 8, 2026Updated 9 months ago
- ☆16Jun 4, 2026Updated 4 months ago
- Automatically derive Python dunder methods for your Rust code☆25Sep 24, 2026Updated 3 weeks ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- SGLang kernel library for Intel XPU☆36Updated this week
- GenAI components at micro-service level; GenAI service composer to create mega-service☆200Oct 9, 2026Updated last week
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆623Updated this week
- Nightly release store☆22Updated this week
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆38Aug 29, 2025Updated last year
- Generative AI Examples is a collection of GenAI examples such as ChatQnA, Copilot, which illustrate the pipeline capabilities of the Open…☆739Updated this week
- Github action to connect to tailscale☆24Aug 28, 2026Updated last month
- Mini-Engine Demonstration of Combining XeSS with VRS Tier 2.☆14Jan 26, 2026Updated 8 months ago
- Tutorials for running models on First-gen Gaudi and Gaudi2 for Training and Inference. The source files for the tutorials on https://dev…☆65Sep 18, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆97Oct 5, 2026Updated last week
- SynapseAI Core is a reference implementation of the SynapseAI API running on Habana Gaudi☆46Feb 3, 2025Updated last year
- oneAPI Deep Neural Network Library (oneDNN)☆22Updated this week
- Chunk Dedupe Estimation☆20Nov 5, 2024Updated last year
- MedConceptsQA: Open source medical concepts QA benchmark☆19Dec 30, 2024Updated last year
- ☆13Nov 29, 2024Updated last year
- ☆18Oct 2, 2026Updated 2 weeks ago
- ☆115Updated this week
- Gets an auth token for a repo via a GitHub app installation☆16Oct 10, 2026Updated last week
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- ☆22Sep 25, 2026Updated 3 weeks ago
- Helper Files for IDC☆45Oct 23, 2023Updated 2 years ago
- ☆13Feb 13, 2021Updated 5 years ago
- Full End-to-End examples showing how to use First-gen Gaudi and Gaudi2 in common use cases☆13Dec 2, 2024Updated last year
- Software kit for Qualcomm Cloud AI 100☆19Oct 10, 2026Updated last week
- ☆15Mar 3, 2025Updated last year
- © A Svelte component to format and display a copyright notice.☆20Jul 25, 2026Updated 2 months ago
- ☆27Updated this week
- Modular RDMA Interface☆187Updated this week
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- An innovative library for efficient LLM inference via low-bit quantization☆351Aug 30, 2024Updated 2 years ago
- Sample Callback Server written in Node☆12Sep 22, 2018Updated 8 years ago
- ☆15Sep 23, 2026Updated 3 weeks ago
- Hands-on projects with Llama 3, Ollama, Streamlit☆18Apr 27, 2024Updated 2 years ago
- ☆66Oct 2, 2026Updated 2 weeks ago
- A Prot paper related materials☆11Sep 5, 2022Updated 4 years ago
- Minimal implementation of a Byte Pair Encoding (BPE) tokenizer in Zig☆15Apr 7, 2025Updated last year