substratusai / stapiLinks
Sentence Transformers API: An OpenAI compatible embedding API server
☆70Updated last year
Alternatives and similar repositories for stapi
Users that are interested in stapi are comparing it to the libraries listed below
Sorting:
- Lightweight continuous batching OpenAI compatibility using HuggingFace Transformers include T5 and Whisper.☆29Updated 10 months ago
- Open Source Text Embedding Models with OpenAI Compatible API☆167Updated last year
- Formatron empowers everyone to control the format of language models' output with minimal overhead.☆234Updated 8 months ago
- ☆248Updated 7 months ago
- Evaluation of bm42 sparse indexing algorithm☆72Updated last year
- A Python library to chunk/group your texts based on semantic similarity.☆103Updated last year
- ☆109Updated 5 months ago
- Efficient few-shot learning with cross-encoders.☆62Updated last year
- TextEmbed is a REST API crafted for high-throughput and low-latency embedding inference. It accommodates a wide variety of embedding mode…☆28Updated last year
- Code for evaluating with Flow-Judge-v0.1 - an open-source, lightweight (3.8B) language model optimized for LLM system evaluations. Crafte…☆84Updated last year
- Benchmark various LLM Structured Output frameworks: Instructor, Mirascope, Langchain, LlamaIndex, Fructose, Marvin, Outlines, etc on task…☆184Updated last year
- Create fast graph language models from converted PDF documents for knowledge extraction and Q&A.☆58Updated last year
- Easy to use, High Performant Knowledge Distillation for LLMs☆97Updated 9 months ago
- ☆51Updated last year
- unsloth-5090-multiple☆60Updated 8 months ago
- Deployment a light and full OpenAI API for production with vLLM to support /v1/embeddings with all embeddings models.☆44Updated last year
- High level library for batched embeddings generation, blazingly-fast web-based RAG and quantized indexes processing ⚡☆69Updated 2 months ago
- ⚡️ 80x faster Fasttext language detection out of the box | Split text by language☆285Updated 4 months ago
- A stable, fast and easy-to-use inference library with a focus on a sync-to-async API☆47Updated last year
- Unattended Lightweight Text Classifiers with LLM Embeddings☆186Updated last year
- Client Code Examples, Use Cases and Benchmarks for Enterprise h2oGPTe RAG-Based GenAI Platform☆90Updated 4 months ago
- A simple, easy-to-hack Vector Database☆183Updated 3 weeks ago
- ☆61Updated last year
- Experimental Code for StructuredRAG: JSON Response Formatting with Large Language Models☆115Updated 9 months ago
- Ready-to-go containerized RAG service. Implemented with text-embedding-inference + Qdrant/LanceDB.☆73Updated last year
- Universal text classifier for generative models☆24Updated last year
- This repo is for handling Question Answering, especially for Multi-hop Question Answering☆68Updated 2 years ago
- This repository presents the original implementation of LumberChunker: Long-Form Narrative Document Segmentation by André V. Duarte, João…☆89Updated last year
- xllamacpp - a Python wrapper of llama.cpp☆72Updated last week
- This code sets up a simple yet robust server using FastAPI for handling asynchronous requests for embedding generation and reranking task…☆72Updated last year