Large Language Model Text Generation Inference on Habana Gaudi
☆34Mar 20, 2025Updated last year
Alternatives and similar repositories for tgi-gaudi
Users that are interested in tgi-gaudi are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆207Mar 16, 2026Updated last week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆85Mar 18, 2026Updated last week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆14Jan 8, 2026Updated 2 months ago
- Automatically derive Python dunder methods for your Rust code☆25Jan 28, 2026Updated last month
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆38Aug 29, 2025Updated 6 months ago
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆23Jul 30, 2024Updated last year
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆90Mar 13, 2026Updated 2 weeks ago
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆553Mar 20, 2026Updated last week
- GenAI components at micro-service level; GenAI service composer to create mega-service☆195Updated this week
- The project delivers a comprehensive full-stack solution for the Intel® Enterprise AI Foundation on the OpenShift platform to provision I…☆21Jan 29, 2026Updated last month
- Github action to connect to tailscale☆19Mar 10, 2026Updated 2 weeks ago
- Reference models for Intel(R) Gaudi(R) AI Accelerator☆170Jan 8, 2026Updated 2 months ago
- Nightly release store☆23Mar 20, 2026Updated last week
- A framework for few-shot evaluation of language models.☆36Mar 18, 2025Updated last year
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Chunk Dedupe Estimation☆20Nov 5, 2024Updated last year
- Mini-Engine Demonstration of Combining XeSS with VRS Tier 2.☆14Jan 26, 2026Updated 2 months ago
- Tutorials for running models on First-gen Gaudi and Gaudi2 for Training and Inference. The source files for the tutorials on https://dev…☆64Sep 18, 2025Updated 6 months ago
- SynapseAI Core is a reference implementation of the SynapseAI API running on Habana Gaudi☆42Feb 3, 2025Updated last year
- ☆182Updated this week
- TPU inference for vLLM, with unified JAX and PyTorch support.☆266Updated this week
- Test-time-training on nearest neighbors for large language models☆49Apr 18, 2024Updated last year
- Software kit for Qualcomm Cloud AI 100☆20Dec 15, 2025Updated 3 months ago
- ☆20Oct 5, 2025Updated 5 months ago
- Wordpress hosting with auto-scaling on Cloudways • AdFully Managed hosting built for WordPress-powered businesses that need reliable, auto-scalable hosting. Cloudways SafeUpdates now available.
- InnerEye dataset creation tool for InnerEye-DeepLearning library. Transforms DICOM data into mask for training Deep Learning models.☆21Mar 21, 2024Updated 2 years ago
- Velocity And Luminance Adaptive Rasterization☆16Mar 31, 2023Updated 2 years ago
- Repo for the IDESSAI 2024 course on modeling audio with discrete tokens.☆13Sep 13, 2024Updated last year
- A huge dataset for Document Visual Question Answering☆21Jul 29, 2024Updated last year
- A high-throughput and memory-efficient inference and serving engine for LLMs☆16Mar 20, 2026Updated last week
- ☆24Feb 24, 2026Updated last month
- ☆20Aug 1, 2024Updated last year
- Full End-to-End examples showing how to use First-gen Gaudi and Gaudi2 in common use cases☆13Dec 2, 2024Updated last year
- Sample Callback Server written in Node☆12Sep 22, 2018Updated 7 years ago
- Proton VPN Special Offer - Get 70% off • AdSpecial partner offer. Trusted by over 100 million users worldwide. Tested, Approved and Recommended by Experts.
- Evaluate how vLLM and SGLang perform when running a small LLM model on a mid-range NVIDIA GPU☆20Mar 15, 2026Updated last week
- An innovative library for efficient LLM inference via low-bit quantization☆352Aug 30, 2024Updated last year
- ☆29Nov 18, 2025Updated 4 months ago
- ☆14Jun 25, 2025Updated 9 months ago
- Automatically check repositories health and quality and build reports that help us understand the current state of Sauce Labs repositorie…☆13Apr 10, 2023Updated 2 years ago
- ☆15Mar 3, 2025Updated last year
- Official PyTorch implementation of CD-MOE☆12Mar 18, 2026Updated last week