substratusai / stapiLinks
Sentence Transformers API: An OpenAI compatible embedding API server
☆68Updated last year
Alternatives and similar repositories for stapi
Users that are interested in stapi are comparing it to the libraries listed below
Sorting:
- Open Source Text Embedding Models with OpenAI Compatible API☆164Updated last year
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆29Updated 9 months ago
- Evaluation of bm42 sparse indexing algorithm☆72Updated last year
- A Python library to chunk/group your texts based on semantic similarity.☆101Updated last year
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆44Updated last year
- Formatron empowers everyone to control the format of language models' output with minimal overhead.☆231Updated 6 months ago
- Efficient few-shot learning with cross-encoders.☆60Updated last year
- Python API for https://vespa.ai, the open big data serving engine☆151Updated this week
- Easy to use, High Performant Knowledge Distillation for LLMs☆97Updated 7 months ago
- ☆241Updated 6 months ago
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆68Updated 3 weeks ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆45Updated last year
- C++ inference wrappers for running blazing fast embedding services on your favourite serverless like AWS Lambda. By Prithivi Da, PRs welc…☆23Updated last year
- FineTune LLMs in few lines of code (Text2Text, Text2Speech, Speech2Text)☆246Updated last year
- ☆51Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆78Updated last year
- Universal text classifier for generative models☆25Updated last year
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆179Updated last year
- TextEmbed is a REST API crafted for high-throughput and low-latency embedding inference. It accommodates a wide variety of embedding mode…☆27Updated last year
- xllamacpp - a Python wrapper of llama.cpp☆66Updated 2 weeks ago
- This repo is for handling Question Answering, especially for Multi-hop Question Answering☆67Updated last year
- Create fast graph language models from converted PDF documents for knowledge extraction and Q&A.☆57Updated 10 months ago
- A fast, lightweight and easy-to-use Python library for splitting text into semantically meaningful chunks.☆506Updated last month
- An enterprise-grade AI retriever designed to streamline AI integration into your applications, ensuring cutting-edge accuracy.☆292Updated 5 months ago
- Docker compose to run vLLM on Windows☆110Updated last year
- ASR + diarization model server with speculative decoding☆63Updated last year
- Ready-to-go containerized RAG service. Implemented with text-embedding-inference + Qdrant/LanceDB.☆73Updated 11 months ago
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆91Updated 3 months ago
- entropix style sampling + GUI☆27Updated last year
- ☆108Updated 3 months ago