Alternatives and similar repositories for stapi

Users that are interested in stapi are comparing it to the libraries listed below

• mesolitica / transformers-openai-api
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
  ☆24Updated 3 months ago
• nyunAI / PruneGPT
  ☆53Updated last year
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆45Updated 9 months ago
• kevaldekivadiya2415 / textembed
  TextEmbed is a REST API crafted for high-throughput and low-latency embedding inference. It accommodates a wide variety of embedding mode…
  ☆24Updated 9 months ago
• qdrant / bm42_eval
  Evaluation of bm42 sparse indexing algorithm
  ☆68Updated 11 months ago
• lightblue-tech / lb-reranker
  ☆23Updated 4 months ago
• backprop-ai / vllm-benchmark
  Benchmarking the serving capabilities of vLLM
  ☆46Updated 10 months ago
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆44Updated last week
• jquesnelle / transformers-openai-api
  An OpenAI Completions API compatible server for NLP transformers models
  ☆65Updated last year
• limcheekin / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆153Updated 11 months ago
• AnswerDotAI / ModernBERT-Instruct-mini-cookbook
  ☆47Updated 4 months ago
• agamm / semantic-split
  A Python library to chunk/group your texts based on semantic similarity.
  ☆96Updated 11 months ago
• Knowledgator / LiqFit
  Efficient few-shot learning with cross-encoders.
  ☆53Updated last year
• louisbrulenaudet / ragoon
  High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡
  ☆66Updated 7 months ago
• h2oai / enterprise-h2ogpte
  Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform
  ☆87Updated 3 weeks ago
• plaggy / rag-containers
  Ready-to-go containerized RAG service. Implemented with text-embedding-inference + Qdrant/LanceDB.
  ☆65Updated 6 months ago
• plaggy / fast-whisper-server
  ASR + diarization model server with speculative decoding
  ☆60Updated last year
• etalab-ia / albert-models
  Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.
  ☆42Updated 11 months ago
• IlyasMoutawwakil / py-txi
  A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.
  ☆33Updated last month
• joaodsmarques / LumberChunker
  This repository presents the original implementation of LumberChunker: Long-Form Narrative Document Segmentation by André V. Duarte, João…
  ☆69Updated 8 months ago
• bentoml / BentoVLLM
  Self-host LLMs with vLLM and BentoML
  ☆123Updated this week
• PrithivirajDamodaran / blitz-embed
  C++ inference wrappers for running blazing fast embedding services on your favourite serverless like AWS Lambda. By Prithivi Da, PRs welc…
  ☆22Updated last year
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆86Updated last month
• Dan-wanna-M / formatron
  Formatron empowers everyone to control the format of language models' output with minimal overhead.
  ☆206Updated 2 weeks ago
• huggingface / huggingface-inference-toolkit
  Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.
  ☆78Updated 2 weeks ago
• argilla-io / argilla-cookbook
  Simple examples using Argilla tools to build AI
  ☆53Updated 7 months ago
• jina-ai / llm-query-expansion
  Query Expension for Better Query Embedding using LLMs
  ☆52Updated 4 months ago
• flowaicom / flow-judge
  Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…
  ☆71Updated 7 months ago
• Knowledgator / unlimited_classifier
  Universal text classifier for generative models
  ☆24Updated 11 months ago
• AlexBodner / How_Much_VRAM
  ☆101Updated 9 months ago