Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
☆97Sep 1, 2026Updated this week
Alternatives and similar repositories for huggingface-inference-toolkit
Users that are interested in huggingface-inference-toolkit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆23May 26, 2026Updated 3 months ago
- ☆27Aug 26, 2026Updated last week
- 🚂 Fine-tune OpenAI models for text classification, question answering, and more☆17May 1, 2023Updated 3 years ago
- YASEM - Yet Another Splade|Sparse Embedder - A simple and efficient library for SPLADE embeddings☆13May 22, 2025Updated last year
- Github action to connect to tailscale☆21Updated this week
- Managed Database hosting by DigitalOcean • AdPostgreSQL, MySQL, MongoDB, Kafka, Valkey, and OpenSearch available. Automatically scale up storage and focus on building your apps.
- Hypercorn is an ASGI and WSGI Server based on Hyper libraries and inspired by Gunicorn.☆20Jan 12, 2026Updated 7 months ago
- ANE accelerated embedding models!☆20Dec 11, 2024Updated last year
- 🤝 Trade any tensors over the network☆31Sep 27, 2023Updated 2 years ago
- ☆10Oct 2, 2024Updated last year
- Chunk Dedupe Estimation☆20Nov 5, 2024Updated last year
- 🤗 Collection of examples on how to train, deploy and monitor HuggingFace models in Google Cloud Vertex AI☆23Feb 26, 2024Updated 2 years ago
- ☆102Sep 19, 2024Updated last year
- FlexiTokens☆23Dec 27, 2025Updated 8 months ago
- Large Language Model Text Generation Inference on Habana Gaudi☆34Mar 20, 2025Updated last year
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- Automatically derive Python dunder methods for your Rust code☆25May 26, 2026Updated 3 months ago
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆25Jun 30, 2025Updated last year
- A course on building Large Language Models☆20Mar 24, 2025Updated last year
- Knowledgeable Embedding: Injecting dynamically updatable entity knowledge into embeddings to enhance RAG☆15Aug 31, 2025Updated last year
- ☆29May 26, 2026Updated 3 months ago
- Build compute kernels and load them from the Hub.☆736Updated this week
- Hugging Face on Microsoft Azure (documentation, examples and more)☆16Aug 19, 2026Updated 2 weeks ago
- 8-bit floating point types for Rust☆64Feb 4, 2026Updated 6 months ago
- A blueprint for AI development, focusing on applied examples of RAG, information extraction, analysis and fine-tuning in the age of LLMs …☆67Feb 6, 2025Updated last year
- GPUs on demand by Runpod - Special Offer Available • AdRun AI, ML, and HPC workloads on powerful cloud GPUs—without limits or wasted spend. Deploy GPUs in under a minute and pay by the second.
- Dataset Viber is your chill repo for data collection, annotation and vibe checks.☆47Sep 5, 2024Updated last year
- A Rust crate offering similar functionality to the Python transformers package using Candle.☆15Nov 19, 2024Updated last year
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆162Jul 14, 2025Updated last year
- Evals for agents☆15Dec 4, 2024Updated last year
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,533Aug 11, 2026Updated 3 weeks ago
- The package used to build the documentation of our Hugging Face repos☆141Updated this week
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated 11 months ago
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…☆213Aug 31, 2024Updated 2 years ago
- ☆16Jul 23, 2024Updated 2 years ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- PySpark custom data source for Hugging Face Datasets☆27Jul 3, 2026Updated last month
- ☆15Dec 21, 2025Updated 8 months ago
- [NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding☆23Oct 10, 2024Updated last year
- Command Line Interface for Hugging Face Inference Endpoints☆65Apr 10, 2024Updated 2 years ago
- A library for working with prompt templates locally or on the Hugging Face Hub.☆56Mar 5, 2025Updated last year
- 🌏 Modular retrievers for zero-shot multilingual IR.☆30Mar 6, 2024Updated 2 years ago
- Official implementation of ECCV24 paper: POA☆24Aug 8, 2024Updated 2 years ago