Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
☆97Oct 5, 2026Updated last week
Alternatives and similar repositories for huggingface-inference-toolkit
Users that are interested in huggingface-inference-toolkit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆24Oct 6, 2026Updated last week
- ☆27Updated this week
- AI Energy Score: Initiative to establish comparable energy efficiency ratings for AI models.☆42Dec 2, 2025Updated 10 months ago
- YASEM - Yet Another Splade|Sparse Embedder - A simple and efficient library for SPLADE embeddings☆13May 22, 2025Updated last year
- Github action to connect to tailscale☆23Aug 28, 2026Updated last month
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- ANE accelerated embedding models!☆20Dec 11, 2024Updated last year
- ☆19Dec 16, 2025Updated 9 months ago
- 🦄 Serving Platform for Spatial AI and Robotics.☆23Jun 19, 2025Updated last year
- ☆10Oct 2, 2024Updated 2 years ago
- Chunk Dedupe Estimation☆20Nov 5, 2024Updated last year
- FlexiTokens☆23Dec 27, 2025Updated 9 months ago
- Large Language Model Text Generation Inference on Habana Gaudi☆34Mar 20, 2025Updated last year
- Nearly Inference Free Embeddings: make your RAG queries 500x faster☆89Apr 27, 2026Updated 5 months ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆25Jun 30, 2025Updated last year
- Managed Kubernetes at scale on DigitalOcean • AdDigitalOcean Kubernetes includes the control plane, bandwidth allowance, container registry, automatic updates, and more for free.
- A framework for few-shot evaluation of language models.☆37Apr 3, 2026Updated 6 months ago
- A course on building Large Language Models☆20Mar 24, 2025Updated last year
- ☆126Oct 6, 2026Updated last week
- Knowledgeable Embedding: Injecting dynamically updatable entity knowledge into embeddings to enhance RAG☆15Aug 31, 2025Updated last year
- Hugging Face on Microsoft Azure (documentation, examples and more)☆17Oct 6, 2026Updated last week
- Dataset Viber is your chill repo for data collection, annotation and vibe checks.☆47Sep 5, 2024Updated 2 years ago
- A Rust crate offering similar functionality to the Python transformers package using Candle.☆15Nov 19, 2024Updated last year
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆161Jul 14, 2025Updated last year
- Evals for agents☆15Dec 4, 2024Updated last year
- Bare Metal GPUs on DigitalOcean Gradient AI • AdPurpose-built for serious AI teams training foundational models, running large-scale inference, and pushing the boundaries of what's possible.
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,554Oct 6, 2026Updated last week
- The package used to build the documentation of our Hugging Face repos☆144Updated this week
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated last year
- Manage scalable open LLM inference endpoints in Slurm clusters☆296Jul 11, 2024Updated 2 years ago
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…☆213Aug 31, 2024Updated 2 years ago
- ☆16Jul 23, 2024Updated 2 years ago
- Let's build better datasets, together!☆276Sep 22, 2026Updated 3 weeks ago
- PySpark custom data source for Hugging Face Datasets☆27Sep 24, 2026Updated 2 weeks ago
- [NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding☆23Oct 10, 2024Updated 2 years ago
- Deploy on Railway without the complexity - Free Credits Offer • AdConnect your repo and Railway handles the rest with instant previews. Quickly provision container image services, databases, and storage volumes.
- Command Line Interface for Hugging Face Inference Endpoints☆65Apr 10, 2024Updated 2 years ago
- A library for working with prompt templates locally or on the Hugging Face Hub.☆56Mar 5, 2025Updated last year
- Speech to Speech conversation using the OpenAI RealTime API in Python 🐍☆25Nov 18, 2024Updated last year
- Convert datasets from Hugging Face to FiftyOne for Visualization☆11Mar 15, 2024Updated 2 years ago
- ☆17Oct 21, 2025Updated 11 months ago
- 🌏 Modular retrievers for zero-shot multilingual IR.☆30Mar 6, 2024Updated 2 years ago
- Official implementation of ECCV24 paper: POA☆24Aug 8, 2024Updated 2 years ago