bentoml / sentence-embedding-bentoLinks
Sentence Embedding as a Service
☆15Updated 2 months ago
Alternatives and similar repositories for sentence-embedding-bento
Users that are interested in sentence-embedding-bento are comparing it to the libraries listed below
Sorting:
- Cortex-compatible model server for Python and TensorFlow☆17Updated 2 years ago
- Demo example of consumer goods categorization☆28Updated last year
- 🚂 Fine-tune OpenAI models for text classification, question answering, and more☆16Updated 2 years ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated last week
- Tools for formatting large language model prompts.☆13Updated last year
- MLFlow Deployment Plugin for Ray Serve☆46Updated 3 years ago
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 6 months ago
- GGML implementation of BERT model with Python bindings and quantization.☆56Updated last year
- Rust bindings for CTranslate2☆14Updated 2 years ago
- Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…☆33Updated 5 months ago
- ☆76Updated 8 months ago
- ☆56Updated 2 months ago
- ☆39Updated 2 years ago
- Multi-threaded matrix multiplication and cosine similarity calculations for dense and sparse matrices. Appropriate for calculating the K …☆83Updated 8 months ago
- setup the env for vllm users☆16Updated last year
- Deploy and Scale LLM-based applications☆26Updated 2 years ago
- Embedding models from Jina AI☆64Updated last year
- A collection of reproducible inference engine benchmarks☆32Updated 4 months ago
- [⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI☆48Updated 2 months ago
- Vector Database with support for late interaction and token level embeddings.☆55Updated 2 months ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆35Updated 2 years ago
- Simple dependency injection framework for Python☆21Updated last year
- experiments with inference on llama☆104Updated last year
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆87Updated 2 weeks ago
- The backend behind the LLM-Perf Leaderboard☆10Updated last year
- A file utility for accessing both local and remote files through a unified interface.☆44Updated 4 months ago
- Creating Generative AI Apps which work☆17Updated 5 months ago
- Lightning Fast: Faiss CPU + Onnx Quantized Multilingual Embedding Model☆23Updated last year
- Python tools☆12Updated last year