Large Language Model Text Generation Inference on Habana Gaudi
☆34Mar 20, 2025Updated last year
Alternatives and similar repositories for tgi-gaudi
Users that are interested in tgi-gaudi are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)☆213Updated this week
- A high-throughput and memory-efficient inference and serving engine for LLMs☆90Updated this week
- DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.☆14Jan 8, 2026Updated 7 months ago
- ☆23May 26, 2026Updated 3 months ago
- ☆16Jun 4, 2026Updated 3 months ago
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- SGLang kernel library for Intel XPU☆32Updated this week
- 🤗 Optimum Intel: Accelerate inference with Intel optimization tools☆617Updated this week
- QuickReduce is a performant all-reduce library designed for AMD ROCm that supports inline compression.☆38Aug 29, 2025Updated last year
- A framework for few-shot evaluation of language models.☆37Apr 3, 2026Updated 5 months ago
- Github action to connect to tailscale☆21Aug 28, 2026Updated last week
- Tutorials for running models on First-gen Gaudi and Gaudi2 for Training and Inference. The source files for the tutorials on https://dev…☆65Sep 18, 2025Updated 11 months ago
- Mini-Engine Demonstration of Combining XeSS with VRS Tier 2.☆14Jan 26, 2026Updated 7 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆97Updated this week
- ☆13Nov 29, 2024Updated last year
- Open source password manager - Proton Pass • AdSecurely store, share, and autofill your credentials with Proton Pass, the end-to-end encrypted password manager trusted by millions.
- Chunk Dedupe Estimation☆20Nov 5, 2024Updated last year
- MedConceptsQA: Open source medical concepts QA benchmark☆19Dec 30, 2024Updated last year
- Intel Gaudi's Megatron DeepSpeed Large Language Models for training☆18Dec 19, 2024Updated last year
- ☆18Updated this week
- ☆108Updated this week
- Gets an auth token for a repo via a GitHub app installation☆16Updated this week
- Helper Files for IDC☆45Oct 23, 2023Updated 2 years ago
- ☆13Feb 13, 2021Updated 5 years ago
- Repo for the IDESSAI 2024 course on modeling audio with discrete tokens.☆13Sep 13, 2024Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- ☆27Aug 26, 2026Updated last week
- Modular RDMA Interface☆174Updated this week
- An innovative library for efficient LLM inference via low-bit quantization☆352Aug 30, 2024Updated 2 years ago
- Sample Callback Server written in Node☆12Sep 22, 2018Updated 7 years ago
- ☆15May 26, 2026Updated 3 months ago
- Pixel Parsing. A reproduction of OCR-free end-to-end document understanding models with open data☆25Jul 30, 2024Updated 2 years ago
- ☆64Mar 6, 2026Updated 6 months ago
- Automatically check repositories health and quality and build reports that help us understand the current state of Sauce Labs repositorie…☆13Apr 10, 2023Updated 3 years ago
- ☆76Updated this week
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Pragmatic approach to parsing import profiles for CI's☆12Jul 1, 2024Updated 2 years ago
- Deploy KoGPT with Triton Inference Server☆14Nov 18, 2022Updated 3 years ago
- A repository of Dockerfiles, scripts, yaml files, Helm Charts, etc. used to build and scale the sample AI workflows with python, kubernet…☆12Feb 22, 2024Updated 2 years ago
- An in-process trace collector using the Rust tracing framework and the Perfetto C++ SDK☆16Mar 2, 2026Updated 6 months ago
- ☆15Jan 21, 2025Updated last year
- ☆10Aug 5, 2022Updated 4 years ago
- ☆14May 25, 2022Updated 4 years ago