bentoml / sentence-embedding-bentoLinks
Sentence Embedding as a Service
☆15Updated last month
Alternatives and similar repositories for sentence-embedding-bento
Users that are interested in sentence-embedding-bento are comparing it to the libraries listed below
Sorting:
- Cortex-compatible model server for Python and TensorFlow☆17Updated 2 years ago
- MLFlow Deployment Plugin for Ray Serve☆46Updated 3 years ago
- Supervised instruction finetuning for LLM with HF trainer and Deepspeed☆35Updated 2 years ago
- Benchmark for machine learning model online serving (LLM, embedding, Stable-Diffusion, Whisper)☆28Updated 2 years ago
- Trace LLM calls (and others) and visualize them in WandB, as interactive SVG or using a streaming local webapp☆14Updated 5 months ago
- Demo example of consumer goods categorization☆28Updated last year
- ☆39Updated 2 years ago
- A Python wrapper around HuggingFace's TGI (text-generation-inference) and TEI (text-embedding-inference) servers.☆33Updated 2 months ago
- ☆56Updated last month
- This is the repo for the container that holds the models for the text2vec-transformers module☆51Updated 3 weeks ago
- setup the env for vllm users☆16Updated last year
- Lightning Fast: Faiss CPU + Onnx Quantized Multilingual Embedding Model☆23Updated 10 months ago
- Creating Generative AI Apps which work☆17Updated 3 months ago
- Open sourced backend for Martian's LLM Inference Provider Leaderboard☆19Updated 11 months ago
- Simple dependency injection framework for Python☆21Updated last year
- A collection of reproducible inference engine benchmarks☆32Updated 3 months ago
- **ARCHIVED** Filesystem interface to 🤗 Hub☆58Updated 2 years ago
- Embedding models from Jina AI☆62Updated last year
- A library for squeakily cleaning and filtering language datasets.☆47Updated 2 years ago
- Fast and versatile tokenizer for language models, compatible with SentencePiece, Tokenizers, Tiktoken and more. Supports BPE, Unigram and…☆28Updated 4 months ago
- Multi-threaded matrix multiplication and cosine similarity calculations for dense and sparse matrices. Appropriate for calculating the K …☆83Updated 7 months ago
- Hugging Face Inference Toolkit used to serve transformers, sentence-transformers, and diffusers models.☆83Updated 2 weeks ago
- Tools for formatting large language model prompts.☆13Updated last year
- ☆63Updated 4 months ago
- [⛔️ DEPRECATED] Friendli: the fastest serving engine for generative AI☆48Updated last month
- ☆75Updated 7 months ago
- A file utility for accessing both local and remote files through a unified interface.☆43Updated 2 months ago
- Deploy and Scale LLM-based applications☆26Updated 2 years ago
- a pipeline for using api calls to agnostically convert unstructured data into structured training data☆30Updated 10 months ago
- Adversarial Training and SFT for Bot Safety Models☆40Updated 2 years ago