A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
☆32Sep 19, 2025Updated 5 months ago
Alternatives and similar repositories for py-txi
Users that are interested in py-txi are comparing it to the libraries listed below
Sorting:
- The backend behind the LLM-Perf Leaderboard☆11May 5, 2024Updated last year
- ☆10Oct 2, 2024Updated last year
- ☆13Apr 25, 2025Updated 10 months ago
- 🚀 LLM inference optimization simulator, modeling compute-bound prefill and memory-bound decode phases.☆13Jul 12, 2025Updated 7 months ago
- ☆31Nov 14, 2024Updated last year
- ☆11Apr 25, 2021Updated 4 years ago
- 🚂 Fine-tune OpenAI models for text classification, question answering, and more☆17May 1, 2023Updated 2 years ago
- Implementation of the dilated self attention as described in "LongNet: Scaling Transformers to 1,000,000,000 Tokens"☆13Jul 23, 2023Updated 2 years ago
- Are foundation LMs multilingual knowledge bases? (EMNLP 2023)☆19Dec 8, 2023Updated 2 years ago
- Repositorio general para Bootcamps de Data Science en Coding Dojo☆11Nov 13, 2025Updated 3 months ago
- German Alpaca Dataset (Cleaned + Translated)☆26Apr 6, 2023Updated 2 years ago
- Chunk your text using gpt4o-mini more accurately☆44Aug 3, 2024Updated last year
- 🤗 Collection of examples on how to train, deploy and monitor HuggingFace models in Google Cloud Vertex AI☆22Feb 26, 2024Updated 2 years ago
- Repo for training MLMs, CLMs, or T5-type models on the OLM pretraining data, but it should work with any hugging face text dataset.☆96Feb 9, 2023Updated 3 years ago
- German dataset for DPR model training☆19Jul 21, 2024Updated last year
- ☆28Mar 24, 2025Updated 11 months ago
- Benchmark structured generation libraries☆31Oct 25, 2024Updated last year
- Nearly Inference Free Embeddings: make your RAG queries 500x faster☆70Feb 20, 2026Updated 2 weeks ago
- A Lightweight Library for AI Observability☆255Feb 20, 2025Updated last year
- Deploy a FastHTML app in just a few lines of simple python code on Modal's serverless infra.☆26Aug 19, 2024Updated last year
- python package of rocm-smi-lib☆24Dec 15, 2025Updated 2 months ago
- [ICLR 2025] 🚀 CodeMMLU Evaluator: A framework for evaluating LM models on CodeMMLU MCQs benchmark.☆29Apr 21, 2025Updated 10 months ago
- A framework for evaluating semantic search across custom datasets, metrics, and embedding backends.☆38May 26, 2025Updated 9 months ago
- IBM development fork of https://github.com/huggingface/text-generation-inference☆63Sep 18, 2025Updated 5 months ago
- Google TPU optimizations for transformers models☆134Jan 23, 2026Updated last month
- ☆29Apr 14, 2023Updated 2 years ago
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆184Sep 23, 2024Updated last year
- Article about deploying machine learning models using grpc, pytorch and asyncio☆30Nov 18, 2022Updated 3 years ago
- Manage scalable open LLM inference endpoints in Slurm clusters☆282Jul 11, 2024Updated last year
- Efficiently find the best-suited language model (LM) for your NLP task☆135Jul 26, 2025Updated 7 months ago
- Code and data for "StructLM: Towards Building Generalist Models for Structured Knowledge Grounding" (COLM 2024)☆76Oct 19, 2024Updated last year
- Command Line Interface for Hugging Face Inference Endpoints☆65Apr 10, 2024Updated last year
- Lite weight wrapper for the independent implementation of SPLADE++ models for search & retrieval pipelines. Models and Library created by…☆34Aug 24, 2024Updated last year
- SGLang is fast serving framework for large language models and vision language models.☆33Nov 24, 2025Updated 3 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆91Jan 9, 2026Updated 2 months ago
- The code for the paper ROUTERBENCH: A Benchmark for Multi-LLM Routing System☆154Jun 13, 2024Updated last year
- Alternate Implementation for Zero Shot Text Classification: Instead of reframing NLI/XNLI, this reframes the text backbone of CLIP models…☆37Apr 5, 2022Updated 3 years ago
- ☆10Sep 13, 2025Updated 5 months ago
- Extend existing LLMs way beyond the original training length with constant memory usage, without retraining☆736Apr 10, 2024Updated last year