Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
☆97Sep 17, 2026Updated this week
Alternatives and similar repositories for huggingface-inference-toolkit
Users that are interested in huggingface-inference-toolkit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆27Updated this week
- AI Energy Score: Initiative to establish comparable energy efficiency ratings for AI models.☆42Dec 2, 2025Updated 9 months ago
- 🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)☆17Mar 20, 2024Updated 2 years ago
- Hypercorn is an ASGI and WSGI Server based on Hyper libraries and inspired by Gunicorn.☆19Jan 12, 2026Updated 8 months ago
- ANE accelerated embedding models!☆20Dec 11, 2024Updated last year
- End-to-end encrypted email - Proton Mail • AdSpecial offer: 40% Off Yearly / 80% Off First Month. All Proton services are open source and independently audited for security.
- 🤝 Trade any tensors over the network☆31Sep 27, 2023Updated 2 years ago
- ☆10Oct 2, 2024Updated last year
- 🤗 Collection of examples on how to train, deploy and monitor HuggingFace models in Google Cloud Vertex AI☆23Feb 26, 2024Updated 2 years ago
- ☆102Sep 19, 2024Updated 2 years ago
- FlexiTokens☆23Dec 27, 2025Updated 8 months ago
- Nearly Inference Free Embeddings: make your RAG queries 500x faster☆86Apr 27, 2026Updated 4 months ago
- Automatically derive Python dunder methods for your Rust code☆25Updated this week
- Starbucks: Improved Training for 2D Matryoshka Embeddings☆25Jun 30, 2025Updated last year
- A framework for few-shot evaluation of language models.☆37Apr 3, 2026Updated 5 months ago
- Deploy to Railway using AI coding agents - Free Credits Offer • AdUse Claude Code, Codex, OpenCode, and more. Autonomous software development now has the infrastructure to match with Railway.
- A course on building Large Language Models☆20Mar 24, 2025Updated last year
- ☆125Updated this week
- Knowledgeable Embedding: Injecting dynamically updatable entity knowledge into embeddings to enhance RAG☆15Aug 31, 2025Updated last year
- ☆29Updated this week
- Hugging Face on Microsoft Azure (documentation, examples and more)☆17Updated this week
- Build compute kernels and load them from the Hub.☆749Updated this week
- Dataset Viber is your chill repo for data collection, annotation and vibe checks.☆47Sep 5, 2024Updated 2 years ago
- A Rust crate offering similar functionality to the Python transformers package using Candle.☆15Nov 19, 2024Updated last year
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆162Jul 14, 2025Updated last year
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- Evals for agents☆15Dec 4, 2024Updated last year
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,547Updated this week
- The package used to build the documentation of our Hugging Face repos☆144Updated this week
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated last year
- Manage scalable open LLM inference endpoints in Slurm clusters☆294Jul 11, 2024Updated 2 years ago
- Baguetter is a flexible, efficient, and hackable search engine library implemented in Python. It's designed for quickly benchmarking, imp…☆213Aug 31, 2024Updated 2 years ago
- ☆16Jul 23, 2024Updated 2 years ago
- PySpark custom data source for Hugging Face Datasets☆27Updated this week
- ☆15Dec 21, 2025Updated 9 months ago
- Serverless GPU API endpoints on Runpod - Get Bonus Credits • AdSkip the infrastructure headaches. Auto-scaling, pay-as-you-go, no-ops approach lets you focus on innovating your application.
- [NeurIPS 2024] | An Efficient Recipe for Long Context Extension via Middle-Focused Positional Encoding☆23Oct 10, 2024Updated last year
- Command Line Interface for Hugging Face Inference Endpoints☆65Apr 10, 2024Updated 2 years ago
- [NeurIPS 2024] 🕸 GlotCC Dataset and Pipline☆21Apr 6, 2025Updated last year
- A library for working with prompt templates locally or on the Hugging Face Hub.☆56Mar 5, 2025Updated last year
- ☆17Oct 21, 2025Updated 11 months ago
- Speech to Speech conversation using the OpenAI RealTime API in Python 🐍☆25Nov 18, 2024Updated last year
- Convert datasets from Hugging Face to FiftyOne for Visualization☆11Mar 15, 2024Updated 2 years ago