IBM development fork of https://github.com/huggingface/text-generation-inference
☆67Oct 10, 2026Updated 3 weeks ago
Alternatives and similar repositories for text-generation-inference
Users that are interested in text-generation-inference are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆12Oct 7, 2025Updated last year
- Community maintained hardware plugin for vLLM on Spyre☆53Oct 1, 2026Updated last month
- ☆21Oct 24, 2026Updated last week
- ☆199Feb 9, 2024Updated 2 years ago
- The repo includes a set of Vertical Pod Autoscaler (VPA) recommenders pluggable with the default VPA on OpenShift.☆12Apr 14, 2023Updated 3 years ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated last year
- Boosting 4-bit inference kernels with 2:4 Sparsity☆101Sep 4, 2024Updated 2 years ago
- A Feishu/Lark AI agent bot☆16Feb 27, 2026Updated 8 months ago
- Example of applying CUDA graphs to LLaMA-v2☆11Aug 25, 2023Updated 3 years ago
- ODH Tools & Extensions Companion☆31Feb 8, 2026Updated 8 months ago
- PyTorch backend for IBM's Spyre AIU☆63Updated this week
- Operator for the OpenShift Lightspeed Service☆19Updated this week
- Writing FLUX in Triton☆42Sep 22, 2024Updated 2 years ago
- Kuadrant DNS Operator☆13Oct 8, 2026Updated 3 weeks ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- ☆13Feb 7, 2023Updated 3 years ago
- Documentation retrieval system to help LLMs navigate less-popular (yet often more powerful) Python libraries☆14May 13, 2024Updated 2 years ago
- ☆13Feb 22, 2024Updated 2 years ago
- ☆42Jul 1, 2025Updated last year
- Easily override the setting value by applying a decorator in tests. And automatically roll back.☆15Mar 22, 2024Updated 2 years ago
- Red Hat Certified optional operator for secondary schedulers☆22Oct 27, 2026Updated last week
- 🚀 Efficiently (pre)training foundation models with native PyTorch features, including FSDP for training and SDPA implementation of Flash…☆289Nov 24, 2025Updated 11 months ago
- Model as a Service☆46Updated this week
- Cloud Native Benchmarking of Foundation Models☆46Jul 31, 2025Updated last year
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Repository for the netperf component used by the Network-Aware framework for the Kubernetes platform based the Scheduler Framework☆10Dec 9, 2021Updated 4 years ago
- Redis container images based on Red Hat Software Collections and intended for OpenShift and general usage. Users can choose between Red H…☆29Oct 13, 2026Updated 2 weeks ago
- Augmented Dickey-Fuller implementation in Go☆12Mar 15, 2019Updated 7 years ago
- Ansible Risk Insight (ARI) is the tool to evaluate the quality and risk of the ansible content.☆34Jul 13, 2026Updated 3 months ago
- Watson Embedded AI runtime client libraries☆11Sep 17, 2025Updated last year
- ☆13Jan 7, 2025Updated last year
- Installs and maintains the kube-scheduler on a cluster.☆37Updated this week
- Automatic differentiation for Triton Kernels☆29Aug 12, 2025Updated last year
- 🚀 Collection of tuning recipes with HuggingFace SFTTrainer and PyTorch FSDP.☆59Oct 1, 2026Updated last month
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- Connecting Transformers on HuggingFace Hub with CTranslate2☆39Aug 27, 2024Updated 2 years ago
- Nabla Containers blog☆12May 26, 2021Updated 5 years ago
- Easy and Efficient Quantization for Transformers☆205Mar 25, 2026Updated 7 months ago
- Container Level Energy-efficient VPA Recommender☆28Mar 19, 2026Updated 7 months ago
- watsonx prompt lab☆16Sep 18, 2025Updated last year
- Estimate resources needed to train LLMs☆14Feb 10, 2026Updated 8 months ago
- Universal connector to LLMs for Node.js & Bun☆30Updated this week