Alternatives and similar repositories for stapi

Users that are interested in stapi are comparing it to the libraries listed below

• huseinzol05 / transformers-continuous-batching
  Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.
  ☆29Updated 10 months ago
• rag-wtf / open-text-embeddings
  Open Source Text Embedding Models with OpenAI Compatible API
  ☆167Updated last year
• Dan-wanna-M / formatron
  Formatron empowers everyone to control the format of language models' output with minimal overhead.
  ☆234Updated 8 months ago
• qdrant / bm42_eval
  Evaluation of bm42 sparse indexing algorithm
  ☆72Updated last year
• Knowledgator / LiqFit
  Efficient few-shot learning with cross-encoders.
  ☆62Updated last year
• agamm / semantic-split
  A Python library to chunk/group your texts based on semantic similarity.
  ☆103Updated last year
• nyunAI / PruneGPT
  ☆51Updated last year
• kevaldekivadiya2415 / textembed
  TextEmbed is a REST API crafted for high-throughput and low-latency embedding inference. It accommodates a wide variety of embedding mode…
  ☆28Updated last year
• leoguillaume / vllm-embedding
  Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.
  ☆44Updated last year
• chigkim / Ollama-MMLU-Pro
  ☆109Updated 5 months ago
• agokrani / distillKitPlus
  Easy to use, High Performant Knowledge Distillation for LLMs
  ☆97Updated 9 months ago
• stephenleo / llm-structured-output-benchmarks
  Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…
  ☆184Updated last year
• Knowledgator / unlimited_classifier
  Universal text classifier for generative models
  ☆24Updated last year
• promptslab / LLMtuner
  FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)
  ☆246Updated 2 years ago
• jukofyork / transplant-vocab
  Transplants vocabulary between language models, enabling the creation of draft models for speculative decoding WITHOUT retraining.
  ☆49Updated 3 months ago
• vespa-engine / pyvespa
  Python API for https://vespa.ai, the open big data serving engine
  ☆160Updated this week
• khaimt / qa_expert
  This repo is for handling Question Answering, especially for Multi-hop Question Answering
  ☆68Updated 2 years ago
• jina-ai / llm-query-expansion
  Query Expension for Better Query Embedding using LLMs
  ☆65Updated 11 months ago
• EveripediaNetwork / fastc
  Unattended Lightweight Text Classifiers with LLM Embeddings
  ☆186Updated last year
• vtuber-plan / langport
  Langport is a language model inference service
  ☆94Updated last year
• aurelio-labs / semantic-chunkers
  ☆248Updated 7 months ago
• xorbitsai / xllamacpp
  xllamacpp - a Python wrapper of llama.cpp
  ☆73Updated this week
• DS4SD / deepsearch-glm
  Create fast graph language models from converted PDF documents for knowledge extraction and Q&A.
  ☆58Updated last year
• plaggy / fast-whisper-server
  ASR + diarization model server with speculative decoding
  ☆64Updated last year
• LlmKira / fast-langdetect
  ⚡️ 80x faster Fasttext language detection out of the box | Split text by language
  ☆285Updated 4 months ago
• rayliuca / T-Ragx
  Enhancing Translation with RAG-Powered Large Language Models
  ☆89Updated last month
• michaelfeil / embed
  A stable, fast and easy-to-use inference library with a focus on a sync-to-async API
  ☆47Updated last year
• ibm-granite / granite-embedding-models
  ☆53Updated 3 months ago
• plaggy / rag-containers
  Ready-to-go containerized RAG service. Implemented with text-embedding-inference + Qdrant/LanceDB.
  ☆73Updated last year
• ComposioHQ / Composio-Function-Calling-Benchmark
  Function Calling Benchmark & Testing
  ☆92Updated last year