Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
☆98Oct 5, 2026Updated 3 weeks ago
Alternatives and similar repositories for huggingface-inference-toolkit
Users that are interested in huggingface-inference-toolkit are comparing it to the libraries listed below. We may earn a commission when you buy through links labeled 'Ad' on this page.
Sorting:
- ☆27Updated this week
- AI Energy Score: Initiative to establish comparable energy efficiency ratings for AI models.☆43Dec 2, 2025Updated 11 months ago
- 🚂 Fine-tune OpenAI models for text classification, question answering, and more☆17May 1, 2023Updated 3 years ago
- 🤗 HuggingFace Inference Toolkit for Google Cloud Vertex AI (similar to SageMaker's Inference Toolkit, but for Vertex AI and unofficial)☆17Mar 20, 2024Updated 2 years ago
- YASEM - Yet Another Splade|Sparse Embedder - A simple and efficient library for SPLADE embeddings☆13May 22, 2025Updated last year
- GPU virtual machines on DigitalOcean Gradient AI • AdGet to production fast with high-performance AMD and NVIDIA GPUs you can spin up in seconds. The definition of operational simplicity.
- Hypercorn is an ASGI and WSGI Server based on Hyper libraries and inspired by Gunicorn.☆21Jan 12, 2026Updated 9 months ago
- ☆126Oct 14, 2026Updated 2 weeks ago
- ANE accelerated embedding models!☆21Dec 11, 2024Updated last year
- Towards Diverse and Coherent Augmentation for Time-Series Forecasting☆13May 28, 2023Updated 3 years ago
- 🤝 Trade any tensors over the network☆31Sep 27, 2023Updated 3 years ago
- Large Language Model Text Generation Inference on Habana Gaudi☆34Mar 20, 2025Updated last year
- FlexiTokens☆23Dec 27, 2025Updated 10 months ago
- 🤗 Collection of examples on how to train, deploy and monitor HuggingFace models in Google Cloud Vertex AI☆23Feb 26, 2024Updated 2 years ago
- A second brain for your business or personal needs☆13Jan 21, 2026Updated 9 months ago
- 1-Click AI Models by DigitalOcean Gradient • AdDeploy popular AI models on DigitalOcean Gradient GPU virtual machines with just a single click. Zero configuration with optimized deployments.
- A framework for few-shot evaluation of language models.☆37Oct 14, 2026Updated 2 weeks ago
- Knowledgeable Embedding: Injecting dynamically updatable entity knowledge into embeddings to enhance RAG☆15Aug 31, 2025Updated last year
- A course on building Large Language Models☆21Mar 24, 2025Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆70Nov 17, 2025Updated 11 months ago
- ☆29Updated this week
- ☆103Sep 19, 2024Updated 2 years ago
- Automatically derive Python dunder methods for your Rust code☆25Sep 24, 2026Updated last month
- Custom fastapi server packaged as docker image for Huggingface inference endpoints deployment☆13Apr 17, 2024Updated 2 years ago
- ☆24Jul 10, 2026Updated 3 months ago
- Managed hosting for WordPress and PHP on Cloudways • AdManaged hosting for WordPress, Magento, Laravel, or PHP apps, on multiple cloud providers. Deploy in minutes on Cloudways by DigitalOcean.
- AI-powered survey evaluation tools☆11Aug 12, 2026Updated 2 months ago
- current theme☆10Nov 30, 2024Updated last year
- Dataset Viber is your chill repo for data collection, annotation and vibe checks.☆47Sep 5, 2024Updated 2 years ago
- ☆45Jul 1, 2026Updated 4 months ago
- The Batched API provides a flexible and efficient way to process multiple requests in a batch, with a primary focus on dynamic batching o…☆161Jul 14, 2025Updated last year
- The package used to build the documentation of our Hugging Face repos☆145Updated this week
- Build compute kernels and load them from the Hub.☆783Updated this week
- ☆12Apr 10, 2026Updated 6 months ago
- Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends☆2,575Updated this week
- Wordpress hosting with auto-scaling - Free Trial Offer • AdFully Managed hosting for WordPress and WooCommerce businesses that need reliable, auto-scalable performance. Cloudways SafeUpdates now available.
- Hugging Face on Microsoft Azure (documentation, examples and more)☆17Oct 14, 2026Updated 2 weeks ago
- Let's build better datasets, together!☆276Oct 24, 2026Updated last week
- PySpark custom data source for Hugging Face Datasets☆27Sep 24, 2026Updated last month
- ☆16Jul 23, 2024Updated 2 years ago
- A blueprint for AI development, focusing on applied examples of RAG, information extraction, analysis and fine-tuning in the age of LLMs …☆67Feb 6, 2025Updated last year
- [ACL 2025] An official pytorch implement of the paper: Condor: Enhance LLM Alignment with Knowledge-Driven Data Synthesis and Refinement☆41May 28, 2025Updated last year
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆32Sep 19, 2025Updated last year